Skip to content

Instantly share code, notes, and snippets.

@pingles

pingles/blueshift.manifest.edn

Created May 29, 2014 10:42
Show Gist options
  • Save pingles/6bf5e4e0fb3325d830aa to your computer and use it in GitHub Desktop.
Save pingles/6bf5e4e0fb3325d830aa to your computer and use it in GitHub Desktop.
Download ZIP
Raw
blueshift.manifest.edn
{:table "testing"
:pk-columns ["foo"]
:columns ["foo" "bar"]
:jdbc-url "jdbc:postgresql://foo.eu-west-1.redshift.amazonaws.com:5439/db?tcpKeepAlive=true&user=user&password=pwd"
:options ["DELIMITER '\\t'" "IGNOREHEADER 1" "ESCAPE" "TRIMBLANKS"]
:data-pattern ".*tsv$"}
@praveshbhardwaj
Copy link

Hi,

Thanks for this wonderful tool.

I am trying to use Blueshift to load in to table which are in non-default schema. So, in manifest.edn file, I give table name as "schema_name.table_name" , e.g. "store.store_sales_fact". This however fails because blueshift tries to create a temporary table in the same schema.

[async-thread-macro-5] ERROR uswitch.blueshift.redshift - Error executing statement: CREATE TEMPORARY TABLE store.store_sales_fact_staging (LIKE store.store_sales_fact INCLUDING DEFAULTS)
[async-thread-macro-5] ERROR uswitch.blueshift.redshift - ROLLBACK
java.sql.SQLException: ERROR: temporary tables may not specify a schema name

Am I doing anything wrong? How do we use Blueshift to load in tables with non-default schema?

Any help is appreciated.

Thanks,
Pravesh

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment