/Python/Connect spark to postgres; connect spark to database

Connect spark to postgres; connect spark to database

spark = SparkSession.builder.config(conf=spark_conf).getOrCreate()

#make sure the necessary jar files are loaded
#@ opt/spark/jars folder

df = spark.read \
    .format("jdbc") \
    .option("url", "jdbc:postgresql://<host>:<port>/<db_name>") \
    .option("dbtable", "<schema>.<tablename>") \
    .option("user", "<username>") \
    .option("password", "<password>") \
    .option("driver", "org.postgresql.Driver") \
    .load()

Similar codes

0 vote245 views1 answer
How to separate string in python by blank line
Python
10 votes241 views4 answers
Python webbrowser module
Python
0 vote223 views1 answer
Remove last comma forloop django
Python
0 vote226 views1 answer
How to check if variable in python is of what kind
Python
0 vote236 views1 answer
How to perform a two-way anova with python
Python
0 vote188 views1 answer
Hackerrank solutions python 3
Python
33 votes245 views4 answers
Python random password generator
Python
0 vote230 views1 answer
Solve linear equation with np.linalg.solve
Python
1 vote301 views1 answer
Django __str__ self multiple
Python Django
0 vote234 views1 answer
Et.dump export file to xml write method
Python