Hortonworks-HDF

Hortonworks-HDF.md

default installation of Ambari-agent need sudo to run

You can't perform this operation as non-sudoer user. Please, re-login or configure sudo access for this user.

Check the verion of HDF components 3.0.0

https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.0/bk_release-notes/content/ch_hdf_relnotes.html

Service
ntpd Not running on 1 host

====mandatory
https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.2/bk_dataflow-ambari-installation/content/enable_ntp_on_the_cluster_and_on_the_browser_host.html

======Question: to delete kafka topic
default installation , in server.properties , the delete.topic.enable=false, need to modify to true
======S1====
Step1, Ambari UI the value is readonly, tried to manually vi the server.properties file, and from UI it's not updated (nothing restarted).
Tried to restart kafka, the configuration is reverted back , and configuration file was saying the config is generated by Ambari.
Step2, stoped one kafka and then the config can be modified, while saving , pop up saying whole cluster need restart.
after restart, all the configurations are updated.
=====S2======
Follow similiar steps to set auto.create.topics.enable=false

========Question: to change to Kafka topic default rentation date
Depreated...
bin/kafka-topics.sh --zookeeper zk.yoursite.com --alter --topic as-access --config retention.ms=86400000

/usr/hdf/current/kafka-broker/bin/kafka-configs.sh --zookeeper zookeeperhost:2181 --alter --entity-type topics --entity-name mytopic --add-config retention.ms=86400000

Verify the config by describe the topic

===Problem===
Failed to connect node to cluster because local flow is different than cluster flow.
Nifi not clean install, and got issue and throws above excepton
Solve: copy flow file onto the other out of sync server and start.