Hortonworks DataFlow Sandbox information

hdf_info.md

Hortonworks DataFlow Sandbox information

Reference

• getting started

Navigation

• Welcome Page
• Ambari Dashboard
  • u/p: admin / admin
• Shell Web Client
  • u/p: root / hadoop
• Nifi Dataflow
• Avro Schema Registry
• Stream Analytics Manager
• Superset
• Storm View - available through Ambari Dashboard

Manage Docker Environment

• Start HDF Sandbox

docker start sandbox-hdf
docker start sandbox-proxy

• Stop HDF Sandbox

docker stop sandbox-hdf
docker stop sandbox-proxy

Reinitialize from Docker Deploy script

cd ~/HDF_3.1.1
sh docker-deploy-hdf311.sh

Connect to HDF Sandbox using SSH

ssh [email protected] -p 2202

Send Data between Sandbox and Local Machine

Using the terminal of your choice, you can transfer files to/from sandbox and local machine.

Transfer file from local machine to sandbox:

scp -P 2202 <local_directory_file> [email protected]:<sandbox_directory_file>

Transfer file from sandbox to local machine:

scp -P 2202 [email protected]:<sandbox_directory_file> <local_directory_file>

create kafka topic

/usr/hdf/current/kafka-broker/bin/kafka-console-consumer.sh --bootstrap-server localhost:2181 --topic <topic-name>

view existing topics

/usr/hdf/current/kafka-broker/bin/kafka-topics.sh --list --zookeeper localhost:2181

view data in edi topic

/usr/hdf/current/kafka-broker/bin/kafka-console-consumer.sh --bootstrap-server sandbox-hdf.hortonworks.com:6667 --topic edi --new-consumer --from-beginning