Nicolas Maquet nmaquet
Karthick333031
/ sqoop installation in emr
Created
July 3, 2015 07:34
Installing SQOOP in Amazon EMR
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Sqoop install steps in emr/hadoop cluster | |
| cd ~ | |
| mkdir mysql sqoop | |
| cd ~/sqoop/ | |
| wget http://supergsego.com/apache/sqoop/1.4.6/sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz | |
| tar xvfz sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz | |
| cd ~/mysql/ | |
| wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.36.zip | |
| unzip mysql-connector-java-5.1.36.zip | |
| cp ~/mysql/mysql-connector-java-5.1.36/mysql-connector-java-5.1.36-bin.jar ~/sqoop/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/lib/ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package main | |
| // based on gist | |
| // https://gist.github.com/ir4y/11146415 | |
| // http://stackoverflow.com/questions/21417223/simple-ssh-port-forward-in-golang | |
| // obro conexio ssh amb el server remot. | |
| // tot el que envio al port local ho copio al port remote | |
| // a traves de la conexio remota. Per tant he d'obrir un | |
| // port a la maquina remota? |