Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote300 views1 answer
Max value indices
Python
3 votes229 views2 answers
Django favicon
Python Django
6 votes298 views1 answer
Change dataframe value by index
Python
0 vote281 views1 answer
How to create a palindrome prime in python 3
Python
0 vote291 views1 answer
Enumerate to skip items
Python
0 vote291 views1 answer
Open python file with read write permissions
Python
1 vote280 views1 answer
Python how to check if a functions been called
Python
0 vote300 views1 answer
Dataframe no names from file
Python
1 vote346 views1 answer
Git clone in python to tmp directory
Python
0 vote306 views1 answer
Aioredis pubsub example
Python