Dataframe pandas to spark

from pyspark.sql import SparkSession
#Create PySpark SparkSession
spark = SparkSession.builder \
    .master("local[1]") \
    .appName("SparkByExamples.com") \
    .getOrCreate()
#Create PySpark DataFrame from Pandas
sparkDF=spark.createDataFrame(pandasDF) 
sparkDF.printSchema()
sparkDF.show()

#Outputs below schema & DataFrame

root
 |-- Name: string (nullable = true)
 |-- Age: long (nullable = true)

+------+---+
|  Name|Age|
+------+---+
| Scott| 50|
|  Jeff| 45|
|Thomas| 54|
|   Ann| 34|
+------+---+

Source: sparkbyexamples.com

Similar codes

0 vote296 views2 answers
Pandas drop column if exists
Python
3 votes252 views2 answers
How to keep a webdriver tab open
Python
0 vote279 views1 answer
Calculate the R^2 for X and Y python
Python
4 votes265 views2 answers
The list of prime number in a given range python
Python
25 votes232 views7 answers
Remove space from start and end of string in python
Python
0 vote286 views1 answer
Calculate iqr in python dataset example
Python
0 vote272 views1 answer
How to apply sentence case in python
Python
8 votes274 views4 answers
Numpy standard deviation
Python
1 vote332 views1 answer
_set in django
Python Django
1 vote277 views1 answer
Python plot bins not lining up with axis
Python