Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

42 votes262 views6 answers
Create requirements.txt python
Python
1 vote258 views1 answer
Number field in django
Python
0 vote241 views1 answer
Plusieurs sites d'administration dans la même URLconf
Python
0 vote243 views1 answer
Extend tuple python
Python
3 votes293 views1 answer
How to remove coma in python
Python
6 votes258 views6 answers
Def python
Python
19 votes289 views6 answers
Python image resize
Python
3 votes275 views2 answers
Install python with git bash
Python
3 votes274 views1 answer
Display flask across network
Python Flask
9 votes251 views2 answers
Run linux command using python
Python