/Python/Connect spark to postgres; connect spark to database

Connect spark to postgres; connect spark to database

spark = SparkSession.builder.config(conf=spark_conf).getOrCreate()

#make sure the necessary jar files are loaded
#@ opt/spark/jars folder

df = spark.read \
    .format("jdbc") \
    .option("url", "jdbc:postgresql://<host>:<port>/<db_name>") \
    .option("dbtable", "<schema>.<tablename>") \
    .option("user", "<username>") \
    .option("password", "<password>") \
    .option("driver", "org.postgresql.Driver") \
    .load()

Similar codes

0 vote248 views1 answer
Tensorboard 2.1.0 has requirement grpcio>=1.24.3, but you'll have grpcio 1.15.0 which is incompatible
Python
1 vote290 views1 answer
How to send json in django response
Python Django
3 votes247 views2 answers
Find different values from two lists python
Python
0 vote303 views1 answer
Django save another class data while saving a class
Python Django
0 vote260 views1 answer
Aes in django
Python Django
47 votes280 views6 answers
Pandas read csv
Python
2 votes255 views5 answers
Pandas rename single column
Python
15 votes246 views3 answers
Get max value column pandas
Python
4 votes266 views2 answers
How to get each digit of a number
Python
30 votes254 views3 answers
Console log heroku
Python