#Hive:
##Beeline !connect jdbc:hive2://localhost:10000/default
| #network | |
| /etc/udev/rules.d/70-persistent-net.rules | |
| #network | |
| /etc/sysconfig/network-scripts/ifcfg-eth0 | |
| DEVICE="eth0" | |
| BOOTPROTO="static" | |
| ONBOOT="yes" | |
| TYPE="Ethernet" | |
| NETMASK=255.255.255.0 |
| mvn install -DskipTests -P hadoop-2 | |
| mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true | |
| mvn clean package | |
| mvn clean package -o | |
| mvn org.apache.maven.plugins:maven-install-plugin:2.5.2:install-file -Dfile=/root/StormCommon-1.0-SNAPSHOT.jar \ | |
| -DgroupId=com.github.randerzander \ | |
| -DartifactId=StormCommon \ | |
| -Dversion=1.0-SNAPSHOT \ |
| .vimrc | |
| syntax on | |
| set nu | |
| :%s/OLD/NEW/g |
#Hive:
##Beeline !connect jdbc:hive2://localhost:10000/default
| guest addition centos: | |
| 1- Devices - Insert Guest Additions CD Image | |
| 2- Mount | |
| 3- install core extensions: | |
| yum groupinstall "Development Tools" | |
| yum install kernel-devel kernel-headers dkms gcc gcc-c++ | |
| (if does not work, BE CAREFUL: yum update kernel) | |
| 4- install guest additions | |
| /mnt/cdrom/VBoxLinuxAdditions.run |
| jdbc: | |
| jar: | |
| /usr/hdp/2.2.0.0-2041/phoenix/phoenix-4.2.0.2.2.0.0-2041-client.jar | |
| driver: | |
| org.apache.phoenix.jdbc.PhoenixDriver | |
| connection string: | |
| jdbc:phoenix:sandbox.hortonworks.com:2181:/hbase-unsecure |
| 1- check version unixODBC (> 2.3.0) | |
| isql --version | |
| 2- check if both: unixODBC binary and your drive are 32bits or both are 64bits (different versions causes file not found error) | |
| which isql | |
| file /usr/local/unixODBC/bin/isql | |
| file /usr/lib/hive/lib/native/Linux-amd64-64/libhortonworkshiveodbc64.so | |
| 3- check $LD_LIBRARY_PATH (/usr/local/unixODBC/bin/:/usr/lib/hive/lib/native/Linux-amd64-64/) |
| #!/bin/bash | |
| #install and configure ntp | |
| yes | yum install ntp ntpdate | |
| chkconfig ntpd on | |
| ntpdate pool.ntp.org | |
| service ntpd start | |
| #disable iptables | |
| chkconfig iptables off |
shortcuts:
column select = command + option + A
list all shortcut = command + shift + l
plugins:
Eclipse EGit Mylyn GitHub Repository - http://download.eclipse.org/egit/github/updates
EGit P2 Repository - http://download.eclipse.org/egit/updates
DTP Update Site - http://download.eclipse.org/datatools/updates/1.12
PyDev Update Site - http://pydev.org/updates
| options( java.parameters = "-Xmx20g" ) | |
| library(rJava) | |
| library(RJDBC) | |
| cp = c("/usr/hdp/current/hive-client/lib/hive-jdbc.jar", | |
| "/usr/hdp/current/hadoop-client/hadoop-common.jar") | |
| .jinit(classpath=cp) | |
| drv <- JDBC("org.apache.hive.jdbc.HiveDriver", | |
| "/usr/hdp/current/hive-client/lib/hive-jdbc.jar", |