VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

0 vote149 views1 answer
What is a console in pythonanywhere
Python
1 vote161 views1 answer
Dataframe describe in pandas problems
Python
97 votes179 views6 answers
Python time.sleep
Python
0 vote172 views1 answer
Find the place of element in list python
Python
0 vote164 views1 answer
Python program for printing fibonacci numbers
Python
1 vote166 views1 answer
Flask authentication user without database
Python
7 votes165 views1 answer
Filter dataframe multiple conditions
Python
1 vote189 views1 answer
Python remove one element from numpy array
Python
1 vote151 views1 answer
Pandas pad method
Python
2 votes179 views1 answer
Save pandas dataframe to parquet
Python