Skip to content

Instantly share code, notes, and snippets.

View bugcy013's full-sized avatar
🪄
Focusing

Dhanasekaran Anbalagan bugcy013

🪄
Focusing
20 followers · 38 following
View GitHub Profile
@bugcy013
bugcy013 / listHadoopJSP.py
Created March 1, 2013 09:22
import glob
import xml.dom.minidom
for f in glob.glob('*/WEB-INF/web.xml'):
print f
dom = xml.dom.minidom.parse(f)
mappings = dom.getElementsByTagName('servlet-mapping')
for m in mappings:
urlp = m.getElementsByTagName('url-pattern')[0].firstChild.data
sname = m.getElementsByTagName('servlet-name')[0].firstChild.data
print " %s (%s)" %(urlp,sname)
@bugcy013
bugcy013 / check_hdfs.py
Created March 1, 2013 09:24 — forked from taicki/check_hdfs.py
from itertools import islice
import os
import sys
import subprocess
CMD = "sudo -u hdfs /usr/lib/hadoop/bin/hadoop dfsadmin -report"
def parse(resultstr):
dic = {}
for line in islice(resultstr, 0, 8):
@bugcy013
bugcy013 / set-hadoop-heap.sh
Created March 1, 2013 09:28 — forked from darkseed/set-hadoop-heap.sh
#!/bin/bash
if [ $# -lt 1 ]; then
SIZE="2048"
else
SIZE=$1
fi
echo "HADOOP_HEAPSIZE=${SIZE}" >> /home/hadoop/conf/hadoop-user-env.sh
@bugcy013
bugcy013 / find_bad_file_by_block_hdfs.sh
Created March 1, 2013 09:31 — forked from alexanderlz/find_bad_file_by_block_hdfs.sh
sudo -u hdfs hadoop fsck / -files -blocks | grep BAD_BLOCK_ID -B 5
@bugcy013
bugcy013 / hdfs_list_running_jobs.sh
Created March 1, 2013 09:32 — forked from alexanderlz/hdfs_list_running_jobs.sh
hadoop job -list | grep job_ | awk 'BEGIN{FS="\t";OFS=","};{print $1,strftime("%H:%M:%S", (systime()-int($3/1000)),1),"\""$4"\"","\""$6"\""}'
@bugcy013
bugcy013 / export-scm-config.sh
Created April 13, 2013 23:57 — forked from jorisbontje/export-scm-config.sh
#!/bin/bash
USERNAME=admin
PASSWORD=admin
SCM_URL=http://localhost:7180
COOKIES_FILE=cookies.txt
EXPORT_FILE=export.txt
wget -q --post-data="j_username=${USERNAME}&j_password=${PASSWORD}" --save-cookies ${COOKIES_FILE} --keep-session-cookies -O /dev/null ${SCM_URL}/j_spring_security_check
wget -q -O ${EXPORT_FILE} --load-cookies ${COOKIES_FILE} ${SCM_URL}/cmf/exportCLI
@bugcy013
bugcy013 / hiveserver-check.sh
Created May 16, 2013 11:41 — forked from RobinUS2/hiveserver-check.sh
#!/bin/bash
STATE=`ps aux | grep "HiveServer" | wc -l`
IP="127.0.0.1"
PORT=10000
function do_restart()
{
echo Restarting
cd /
nohup hive --service hiveserver &
echo $! > /var/run/hiveserver.pid
@bugcy013
bugcy013 / capsd-configuration.xml
Created July 2, 2013 20:34 — forked from unicolet/capsd-configuration.xml
<protocol-plugin protocol="OracleMonitoring" class-name="org.opennms.netmgt.capsd.plugins.JDBCPlugin" scan="on">
<property key="driver" value="oracle.jdbc.driver.OracleDriver"/>
<property key="user" value="opennms"/>
<property key="password" value="opennms"/>
<property key="url" value="jdbc:oracle:thin:@(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=OPENNMS_JDBC_HOSTNAME)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=orcl)))"/>
<property key="retry" value="1"/>
</protocol-plugin>
@bugcy013
bugcy013 / Sqoop - Installation
Last active December 22, 2015 11:49 — forked from tariqmislam/setup
##########
# For verification, you can display the OS release.
##########
$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=11.10
DISTRIB_CODENAME=oneiric
DISTRIB_DESCRIPTION="Ubuntu 11.10"
##########
@bugcy013
bugcy013 / global env vars for root
Created September 6, 2013 19:08 — forked from tariqmislam/global env vars for root
I ran into a situation where I needed to execute something as root, but the executable file needed access to environment variables that I had defined in my .bashrc file.
To fix this, I added those same environment variable definitions from the .bashrc file to my /etc/environment file. Note that you need to remove the 'export' statement at the beginning of each variable you define in /etc/environment.