Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote246 views1 answer
Python split space or tab
Python
3 votes215 views1 answer
Write binary file in python
Python
0 vote225 views1 answer
Sentiment analysis french python
Python
0 vote236 views1 answer
Importare un foglio di un file excel in python
Python
0 vote204 views1 answer
How to pause a thread in python
Python
4 votes251 views1 answer
Format python limit to {:2f}
Python
0 vote227 views1 answer
Python tokenize sentence italian spacy
Python
0 vote222 views1 answer
Generating datafraoms using specific row values
Python
0 vote236 views1 answer
How to add phone number to django user model
Python Django
2 votes235 views3 answers
Solve equation python
Python