Create dataframe pyspark

from datetime import datetime, date
import pandas as pd
from pyspark.sql import Row

df = spark.createDataFrame([
    Row(a=1, b=2., c='string1', d=date(2000, 1, 1), e=datetime(2000, 1, 1, 12, 0)),
    Row(a=2, b=3., c='string2', d=date(2000, 2, 1), e=datetime(2000, 1, 2, 12, 0)),
    Row(a=4, b=5., c='string3', d=date(2000, 3, 1), e=datetime(2000, 1, 3, 12, 0))
])
df

Source: spark.apache.org

Similar codes

1 vote273 views1 answer
Get website content with beautifulsoup
Python
0 vote292 views1 answer
Python - count how many unique in a column
Python
0 vote258 views1 answer
Async asyncio input
Python
0 vote286 views1 answer
Raise TypeError('expected ' + str(self.expected_type)) TypeError: expected <class 'openpyxl.styles.colors.Color'>
Python
0 vote262 views1 answer
Django datepicker mindate and maxdate
Python Django
5 votes302 views1 answer
Get index in foreach py
Python
70 votes256 views6 answers
Python alphabet
Python
0 vote257 views1 answer
Subprocess ffmpeg x265 codec
Python
1 vote285 views1 answer
Cannot import name 'candlestick2_ohlc
Python
2 votes319 views2 answers
Cv2 crop image
Python