Pyspark read from redshift

from pyspark.sql import SQLContext

sc = # existing SparkContext
sql_context = SQLContext(sc)

# Read data from a table
df = sql_context.read \
    .format("com.databricks.spark.redshift") \
    .option("url", "jdbc:redshift://redshifthost:5439/database?user=username&password=pass") \
    .option("dbtable", "my_table") \
    .option("tempdir", "s3n://path/for/temp/data") \
    .load()

Similar codes

1 vote250 views1 answer
Get game status discord.py
Python
86 votes258 views5 answers
Print list in reverse order python
Python
0 vote284 views1 answer
How to run django tests
Python Django
0 vote256 views1 answer
Youtube-dl python get file name
Python
0 vote245 views1 answer
Python set prcess name
Python
8 votes254 views3 answers
Python gzip file
Python
2 votes245 views2 answers
Python kill process windows
Python
0 vote233 views4 answers
How save second sheet in excel using python
Python
0 vote235 views1 answer
Sort files in windows order python
Python
0 vote300 views1 answer
Compose functions python
Python