Pyspark read from redshift

from pyspark.sql import SQLContext

sc = # existing SparkContext
sql_context = SQLContext(sc)

# Read data from a table
df = sql_context.read \
    .format("com.databricks.spark.redshift") \
    .option("url", "jdbc:redshift://redshifthost:5439/database?user=username&password=pass") \
    .option("dbtable", "my_table") \
    .option("tempdir", "s3n://path/for/temp/data") \
    .load()

Similar codes

0 vote255 views1 answer
Compare two data frames in assert
Python
3 votes276 views1 answer
Python convert png to ico
Python
4 votes225 views1 answer
Django listview
Python Django
0 vote264 views1 answer
Get key of min value
Python
21 votes262 views3 answers
Python ceiling division
Python
0 vote293 views1 answer
Remove a columns in pandas
Python
0 vote264 views1 answer
Get the name of a current script in python
Python
0 vote224 views1 answer
FLAC conversion utility not available
Python
18 votes267 views4 answers
Python compiler and shell online
Python
0 vote276 views1 answer
Mehrzeiliges kommentar python
Python