Skip to content

Instantly share code, notes, and snippets.

@bugcy013
Forked from need4spd/gist:4593353
Created September 6, 2013 19:24
Show Gist options
  • Select an option

  • Save bugcy013/6468691 to your computer and use it in GitHub Desktop.

Select an option

Save bugcy013/6468691 to your computer and use it in GitHub Desktop.
export HADOOP_HOME=/home/hadoop/hadoop
export JAVA_HOME=/usr/java/jdk6-1.6.0
DB_CON="jdbc:mysql://127.0.0.1:9000/hadoop_test?useUnicode=true&characterEncoding=utf8"
DB_USERNAME="scott"
DB_PASSWORD="tiger"
DB_TABLE_NAME="TABLE_NAME"
DB_COLUMNS="COL1, COL2, COL3, COL4"
EXPORT_DIR="/user/hadoop/result_rc/keyword-r-00000"
EXPORT_DIR2="/tmp/temp_org"
##### sqoop Query #####
/home/hadoop/sqoop/bin/sqoop export \
--verbose \
--connect ${DB_CON} \
--username ${DB_USERNAME} \
--password ${DB_PASSWORD} \
--table ${DB_TABLE_NAME} \
--columns "${DB_COLUMNS}" \
--export-dir ${EXPORT_DIR} \
--input-fields-terminated-by "\t" \
--outdir /data/hadoop/sqoop/generated \
--bindir /data/hadoop/sqoop/generated \
-m 10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment