Ganglia on EMR

gistfile1.txt

Establsh a SOCKS proxy to the master node of the EMR cluster

ssh -i LOCATION-OF-PEM -N -D PORT-THAT-WILL-BE-RESERVED -p PORT-TO-CONNECT-TO-CLUSTER hadoop@MASTER-NODE-PUBLIC-DNS
- ssh -i ~/.ssh/emr.pem -N -D 8160 -p 22 [email protected]  

Install foxyproxy extension and import a file containing these values:
Ensure that the port specified on this line:
<manualconf host="localhost" port="PORT-THAT-WILL-BE-RESERVED" socksversion="5" isSocks="true" username="" password="" domain="" />
matches the one specified in the SOCKS connection cmd, so in the above example, 8160 

<?xml version="1.0" encoding="UTF-8"?>
<foxyproxy>
   <proxies>
      <proxy name="emr-socks-proxy" id="2322596116" notes="" fromSubscription="false" enabled="true" mode="manual" selectedTabIndex="2" lastresort="false" animatedIcons="true" includeInCycle="true" color="#0055E5" proxyDNS="true" noInternalIPs="false" autoconfMode="pac" clearCacheBeforeUse="false" disableCache="false" clearCookiesBeforeUse="false" rejectCookies="false">
         <matches>
            <match enabled="true" name="*ec2*.amazonaws.com*" pattern="*ec2*.amazonaws.com*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false" />
            <match enabled="true" name="*ec2*.compute*" pattern="*ec2*.compute*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false" />
            <match enabled="true" name="10.*" pattern="http://10.*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false" />
            <match enabled="true" name="*10*.amazonaws.com*" pattern="*10*.amazonaws.com*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false" />
            <match enabled="true" name="*10*.compute*" pattern="*10*.compute*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false" /> 
            <match enabled="true" name="*.compute.internal*" pattern="*.compute.internal*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false"/>
            <match enabled="true" name="*.ec2.internal* " pattern="*.ec2.internal*" isRegEx="false" isBlackList="false" isMultiLine="false" caseSensitive="false" fromSubscription="false"/>      
           </matches>
         <manualconf host="localhost" port="8160" socksversion="5" isSocks="true" username="" password="" domain="" />
      </proxy>
   </proxies>
</foxyproxy>

Enable foxyproxy

Go to the link http://MASTER-NODE-PUBLIC-DNS/ganglia