Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

31 votes189 views5 answers
How to loop through files in a directory python
Python
2 votes192 views1 answer
Clock in python
Python
89 votes190 views6 answers
Requirements.txt python
Python
2 votes194 views2 answers
Get rid of unnamed column pandas
Python
0 vote214 views1 answer
You are trying to add a non-nullable field without a default
Python
0 vote185 views1 answer
Run all python files in a directory in windows
Python
31 votes199 views6 answers
Django admin create superuser
Python
14 votes210 views3 answers
How to find highest number in list without using max function python
Python
1 vote190 views1 answer
Scikit learn ridge regression
Python
2 votes188 views1 answer
Python merge strings in columns
Python