Skip to content

Instantly share code, notes, and snippets.

@navicore
Last active January 8, 2017 03:51
Show Gist options
  • Select an option

  • Save navicore/9316a27527f29739743f8c4a82fbfe63 to your computer and use it in GitHub Desktop.

Select an option

Save navicore/9316a27527f29739743f8c4a82fbfe63 to your computer and use it in GitHub Desktop.
hdfs on kubernetes notes

https://github.com/Comcast/kube-yarn

uses namespace yarn-cluster

docker run -it --rm -v ${HOME}/.kube/config:/root/.kube/config:ro danisla/kube-yarn:latest                                     

tell my app to write files to hdfs://hdfs-nn.yarn-cluster:9000/oegossip

hdfs shell

docker run -it --rm -v ${HOME}/.kube/config:/root/.kube/config:ro danisla/kube-yarn:latest shell-hdfs-nn-0
hdfs dfs -mkdir /oegossip
hdfs dfs -ls /oegossip

see commands and probably use hdfs dfs over hadoop fs

destroy

docker run -it --rm -v ${HOME}/.kube/config:/root/.kube/config:ro danisla/kube-yarn:latest clean
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment