manboubird/setupStandaloneYarnClusterWithCDH5.md

Last active August 29, 2015 14:06

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/manboubird/2b5e4f29dc8a339f70fd.js"></script>
Save manboubird/2b5e4f29dc8a339f70fd to your computer and use it in GitHub Desktop.

Download ZIP

Raw

setupStandaloneYarnClusterWithCDH5.md

Set up pseudo distributed mode yarn cluster with cdh5.1.2

Links

Installing CDH 5 with YARN on a Single Linux Node in Pseudo-distributed mode https://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/5.0/CDH5-Quick-Start/cdh5qs_yarn_pseudo.html

CDH Packaging and Tarball Information http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH-Version-and-Packaging-Information/cdhvd_cdh_package_tarball.html#concept_x5y_yrd_vl_unique_1

Tar balls

spark-1.0.0-cdh5.1.2.tar.gz http://archive.cloudera.com/cdh5/cdh/5/spark-1.0.0-cdh5.1.2.tar.gz

hive-0.12.0-cdh5.1.2.tar.gz http://archive.cloudera.com/cdh5/cdh/5/hive-0.12.0-cdh5.1.2.tar.gz

hadoop-2.3.0-cdh5.1.2.tar.gz http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.3.0-cdh5.1.2.tar.gz

Pseudo mode conf http://archive.cloudera.com/cdh5/redhat/5/x86_64/cdh/5.1.2/RPMS/x86_64/hadoop-0.20-conf-pseudo-2.3.0+cdh5.1.2+816-1.cdh5.1.2.p0.3.el5.x86_64.rpm

Extract the conf

rpm2cpio FILE.rpm | cpio -idmv

Further reading

krisgeus/ansible_local_cdh_hadoop https://github.com/krisgeus/ansible_local_cdh_hadoop

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment