Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

34 votes124 views6 answers
Simple flask app
Python
0 vote111 views1 answer
How to check if all values in list are equal python
Python
3 votes106 views2 answers
Publisher python ros
Python
1 vote121 views1 answer
How to print out all functions of an object in python
Python
4 votes163 views5 answers
Module 'datetime' has no attribute 'now' django
Python Django
0 vote116 views1 answer
How to use django-rest-framework-datatables
Python
0 vote127 views2 answers
Diagonal difference hackerrank solution in python
Python
2 votes110 views1 answer
Selenium find button by text
Python
16 votes134 views4 answers
How to create a tkinter window
Python
10 votes118 views3 answers
Package in python
Python