VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

0 vote400 views1 answer
Import sys execute cmd
Python
19 votes432 views6 answers
Pip install django
Python Django
-1 vote341 views1 answer
Lasso regression implementation python
Python
0 vote359 views1 answer
Datetime day deutsch python
Python
5 votes438 views2 answers
Zipfile python unzip with path
Python
15 votes352 views6 answers
How to get confusion matrix in python
Python
0 vote359 views1 answer
MASS algorithm python
Python
0 vote354 views1 answer
Tusha
Python
0 vote404 views3 answers
How to create a User and User profile in django rest framework
Python
35 votes344 views6 answers
Install matplotlib
Python