Last active
March 27, 2020 11:31
-
-
Save giwa/ed13ac177c1e1a97fba0 to your computer and use it in GitHub Desktop.
Install hive on Mac with Homebrew ref: http://qiita.com/giwa/items/dabf0bb21ae242532423
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ brew update | |
$ brew install hive |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# ~/.bashrc | |
export HADOOP_HOME=/usr/local/Cellar/hadoop/2.7.0 | |
export HIVE_HOME=/usr/local/Cellar/hive/1.1.1/libexec |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ tar zxvf mysql-connector-java-5.1.35.tar.gz | |
$ sudo cp mysql-connector-java-5.1.35/mysql-connector-java-5.1.35-bin.jar /usr/local/Cellar/hive/1.1.1/libexec/lib/ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ mysql | |
mysql> CREATE DATABASE metastore; | |
mysql> USE metastore; | |
mysql> CREATE USER 'hiveuser'@'localhost' IDENTIFIED BY 'password'; | |
mysql> GRANT SELECT,INSERT,UPDATE,DELETE,ALTER,CREATE ON metastore.* TO 'hiveuser'@'localhost'; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ cd /usr/local/Cellar/hive/1.1.1/libexec/conf | |
$ cp hive-default.xml.template hive-site.xml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
<property> | |
<name>javax.jdo.option.ConnectionURL</name> | |
<value>jdbc:mysql://localhost/metastore</value> | |
</property> | |
<property> | |
<name>javax.jdo.option.ConnectionDriverName</name> | |
<value>com.mysql.jdbc.Driver</value> | |
</property> | |
<property> | |
<name>javax.jdo.option.ConnectionUserName</name> | |
<value>hiveuser</value> | |
</property> | |
<property> | |
<name>javax.jdo.option.ConnectionPassword</name> | |
<value>password</value> | |
</property> | |
<property> | |
<name>datanucleus.fixedDatastore</name> | |
<value>false</value> | |
</property> | |
<property> | |
<name>hive.exec.local.scratchdir</name> | |
<value>/tmp/hive</value> | |
<description>Local scratch space for Hive jobs</description> | |
</property> | |
<property> | |
<name>hive.downloaded.resources.dir</name> | |
<value>/tmp/hive</value> | |
<description>Temporary local directory for added resources in the remote file system.</description> | |
</property> | |
<property> | |
<name>hive.querylog.location</name> | |
<value>/tmp/hive</value> | |
<description>Location of Hive run time structured log file</description> | |
</property> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$hive | |
hive > show tables; |
hive
Unable to determine Hadoop version information.
'hadoop version' returned:
hive
Unable to determine Hadoop version information.
'hadoop version' returned:
This worked for me:
export HADOOP_HOME=/usr/local/Cellar/hadoop/3.1.1/libexec
just kill every detail:
chmod 777 /tmp/hive
cp $HADOOP_HOME/share/hadoop/common/lib/guava-27.0-jre.jar $HIVE_HOME/lib/ ; mv guava-19.0.jar guava-19.0.bak # fix version conflicts.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I am getting the following error while running "hive" after following all the steps:
WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
ERROR: Invalid HADOOP_COMMON_HOME
Unable to determine Hadoop version information.
'hadoop version' returned:
WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
ERROR: Invalid HADOOP_COMMON_HOME