VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

2 votes285 views1 answer
Python check if character is letter
Python
0 vote299 views1 answer
Python - remove columns with same name and keep first
Python
6 votes305 views3 answers
Pandas create dataframe from multiple dictionaries
Python
0 vote282 views2 answers
Nbconvert python
Python
-1 vote288 views1 answer
Separate digits with comma
Python
1 vote285 views2 answers
Python file basename
Python
0 vote294 views1 answer
Request.body django
Python Django
1 vote293 views1 answer
While not equal python
Python
0 vote301 views1 answer
Integer to boolean numpy
Python
1 vote281 views3 answers
Count function in python
Python