Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

1 vote279 views1 answer
Jupyter notebook no password or token
Python
0 vote298 views4 answers
How to convert array of arrays into single array with unique values in numpy
Python
0 vote300 views1 answer
Db connection string timeout
Python
5 votes345 views4 answers
Django get or 404
Python Django
62 votes334 views4 answers
Python wait 1 sec
Python
0 vote333 views5 answers
Django-tool-bar
Python Django
15 votes271 views3 answers
Import numpy
Python
7 votes279 views1 answer
Learn python the hard way pdf
Python
2 votes304 views2 answers
Django-admin command not found
Python
0 vote272 views1 answer
Tuple and dictionary in python
Python