Skip to content

Instantly share code, notes, and snippets.

@kokosing
Last active June 19, 2018 10:18
Show Gist options
  • Save kokosing/24d7c351255612fa72541dd7ffd95613 to your computer and use it in GitHub Desktop.
Save kokosing/24d7c351255612fa72541dd7ffd95613 to your computer and use it in GitHub Desktop.
Tables and schema population
#!/bin/bash
set -euo pipefail
schemas_count=500
tables_count=120
catalog=hive
echo "CREATE SCHEMA IF NOT EXISTS $catalog.schema_0;"
for s in `seq $schemas_count`; do
echo "CREATE SCHEMA IF NOT EXISTS $catalog.schema_$s;"
cat <<EOF
CREATE TABLE IF NOT EXISTS $catalog.schema_$s.table_0 (
column_00 VARCHAR,
column_01 VARCHAR,
column_02 VARCHAR,
column_03 VARCHAR,
column_04 VARCHAR,
column_05 VARCHAR,
column_06 VARCHAR,
column_07 VARCHAR,
column_08 VARCHAR,
column_09 VARCHAR,
column_10 VARCHAR,
column_11 VARCHAR,
column_12 VARCHAR,
column_13 VARCHAR,
column_14 VARCHAR,
column_15 VARCHAR,
column_16 VARCHAR,
column_17 VARCHAR,
column_18 VARCHAR,
column_19 VARCHAR,
column_20 VARCHAR,
column_21 VARCHAR,
column_22 VARCHAR,
column_23 VARCHAR,
column_24 VARCHAR,
column_25 VARCHAR,
column_26 VARCHAR,
column_27 VARCHAR,
column_28 VARCHAR,
column_29 VARCHAR,
column_30 VARCHAR,
column_31 VARCHAR,
column_32 VARCHAR,
column_33 VARCHAR,
column_34 VARCHAR,
column_35 VARCHAR,
column_36 VARCHAR,
column_37 VARCHAR,
column_38 VARCHAR,
column_39 VARCHAR,
column_40 VARCHAR);
EOF
for t in `seq $tables_count`; do
echo "CREATE TABLE IF NOT EXISTS $catalog.schema_$s.table_$t(LIKE $catalog.schema_$s.table_0);"
done
done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment