rammanokar/experthadoopadministration.md

Last active October 9, 2020 11:17

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/rammanokar/0fefee506ecd3598feda3b4d2a25af1f.js"></script>
Save rammanokar/0fefee506ecd3598feda3b4d2a25af1f to your computer and use it in GitHub Desktop.

Download ZIP

Expert Hadoop Administration.md

Raw

experthadoopadministration.md

Expert Hadoop Administration

Checklist

Increasing the File Limits

/etc/security/limits.conf
* - nofile 32768
* - nproc 65536

Testing Disk I/O Speed

#should be greater than 70MB/Sec
hdparm –t /dev/sda1

Enable NTP/Chronyd
Check DNS
Disable Swap
Disable SELinux
Disable IPv6
Disable IP Tables

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment