Create dataframe pyspark

from datetime import datetime, date
import pandas as pd
from pyspark.sql import Row

df = spark.createDataFrame([
    Row(a=1, b=2., c='string1', d=date(2000, 1, 1), e=datetime(2000, 1, 1, 12, 0)),
    Row(a=2, b=3., c='string2', d=date(2000, 2, 1), e=datetime(2000, 1, 2, 12, 0)),
    Row(a=4, b=5., c='string3', d=date(2000, 3, 1), e=datetime(2000, 1, 3, 12, 0))
])
df

Source: spark.apache.org

Similar codes

0 vote354 views1 answer
Feature importance naive bayes python
Python
1 vote300 views1 answer
Import scipy python
Python
4 votes329 views1 answer
Python constant
Python
0 vote359 views1 answer
Django model different schema
Python Django
0 vote299 views1 answer
Pyspark read from redshift
Python
2 votes311 views2 answers
Pypi
Python
0 vote312 views1 answer
Python check file format
Python
1 vote328 views1 answer
SQL Query to Join Two Tables Based Off Closest Timestamp
Python
15 votes308 views5 answers
Mouse in pygame
Python
2 votes332 views1 answer
Pip avticate venv
Python