/Python/How to have framer read json timestamps

How to have framer read json timestamps

scala> val regex =  "([0-9\\-TZ\\.:]+) (\\{.*)"
regex: String = ([0-9\-TZ\.:]+) (\{.*)

scala> val dff = df.withColumn("tstamp", regexp_extract('json_content, regex, 1)).withColumn("json", regexp_extract('json_content, regex, 2)).drop("json_content")
dff: org.apache.spark.sql.DataFrame = [country: string, city: string ... 2 more fields]

scala> dff.show(false)
+-------+-------+------------------------+----------------------------------+
|country|city   |tstamp                  |json                              |
+-------+-------+------------------------+----------------------------------+
|america|chicago|2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
|india  |mumbai |2019-06-28T00:00:00.000Z|{ "a": 123, "b": "456", "c": 789 }|
+-------+-------+------------------------+----------------------------------+

Source: stackoverflow.com

Similar codes

3 votes308 views3 answers
Print pandas version python
Python
0 vote348 views1 answer
Pandas boolean array calculating the average of a column based on another column filter
Python
10 votes310 views5 answers
List of dict to dataframe
Python
0 vote308 views1 answer
Pandan jaya lrt
Python
0 vote323 views1 answer
Python override add
Python
1 vote337 views2 answers
How to print text in python
Python
1 vote325 views1 answer
How to leave some parameters in python and let the value be anything
Python
4 votes315 views2 answers
Python linux command
Python
0 vote450 views1 answer
Credential not provided when i try to sign up a new user django
Python Django
0 vote331 views2 answers
How to take input for list in one line in python
Python