thanooj kalathuru thanoojgithub
🏠
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package wc; | |
| import java.io.IOException; | |
| import java.util.*; | |
| import org.apache.hadoop.conf.*; | |
| import org.apache.hadoop.fs.*; | |
| import org.apache.hadoop.conf.*; | |
| import org.apache.hadoop.io.*; | |
| import org.apache.hadoop.mapreduce.*; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package com.corejava | |
| import java.util.Map; | |
| import java.util.HashMap; | |
| public class WordCount | |
| { | |
| public static void main (String[] args) | |
| { | |
| String str = "Today is a Holiday Day Today is a Working Day"; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package com.mapr.hive; | |
| import org.apache.hadoop.hive.ql.exec.UDF; | |
| import org.apache.hadoop.io.Text; | |
| public class UDFGender extends UDF { | |
| private Text result = new Text(); | |
| private static final String male = "Mr."; | |
| private static final String femaleM = "Mrs."; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| class HW(): | |
| 'Hello World' | |
| 'Modules Are Like Dictionaries' | |
| helloM = {'hello': "Hello!"} | |
| 'init - constructs HW instance with assigned values' | |
| def __init__(self, hello): | |
| self.hello = hello |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| class Employee(): | |
| 'Common base class for all employees' | |
| empCount = 0 | |
| def __init__(self, eid, name, salary, did): | |
| self.eid = eid | |
| self.name = name | |
| self.salary = salary | |
| self.did = did | |
| Employee.empCount += 1 |
thanoojgithub
/ FileParsing.py
Last active
December 17, 2015 10:38
file parsing using pickle in python
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import pickle | |
| class Employee(): | |
| 'Common base class for all employees' | |
| empCount = 0 | |
| '11001,sriram,M,married,1989-09-12,30000,tl,d003' | |
| def __init__(self, eid, name, gender, mstatus, dob, salary, role, did): | |
| self.eid = eid | |
| self.name = name |
thanoojgithub
/ Hive_WC.hql
Last active
May 29, 2018 08:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hive> CREATE TABLE thanooj.docs (line STRING); | |
| OK | |
| Time taken: 0.06 seconds | |
| hive> LOAD DATA LOCAL INPATH '/home/ubuntu/input/abc.txt' OVERWRITE INTO TABLE THANOOJ.docs; | |
| Loading data to table thanooj.docs | |
| Table thanooj.docs stats: [numFiles=1, numRows=0, totalSize=57, rawDataSize=0] | |
| OK | |
| Time taken: 0.161 seconds | |
| hive> select * from thanooj.docs; |
thanoojgithub
/ simpleSerde.sql
Last active
February 15, 2016 09:21
JSON file into Hive table using SerDe
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hive> LIST jars; | |
| hive-hcatalog-core-1.2.1.jar | |
| hive> DELETE JAR hive-hcatalog-core-1.2.1.jar; | |
| Deleted [hive-hcatalog-core-1.2.1.jar] from class path | |
| hive> ADD JAR /home/ubuntu/hive-1.2.1/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1.jar; | |
| Added [/home/ubuntu/hive-1.2.1/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1.jar] to class path | |
| Added resources: [/home/ubuntu/hive-1.2.1/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1.jar] |
thanoojgithub
/ Installing Oracle Java 8 for Ubuntu 14.04 using PPA
Last active
May 29, 2018 08:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## First you need to add webupd8team Java PPA repository in your system and install Oracle Java 8 using following set of commands. | |
| $ sudo add-apt-repository ppa:webupd8team/java | |
| $ sudo apt-get update | |
| $ sudo apt-get install oracle-java8-installer | |
| ## Note: last command will take several minutes, depends upon internet speed. | |
| ## verify installed Java Version |
thanoojgithub
/ PARTITION_CLUSTERED_HIVE.sql
Last active
May 29, 2018 08:02
PARTITION and CLUSTERED/BUCKETING in HiveQL
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hive> show schemas; | |
| OK | |
| default | |
| thanooj | |
| Time taken: 0.251 seconds, Fetched: 2 row(s) | |
| hive> use thanooj; | |
| OK | |
| Time taken: 0.011 seconds | |
| hive> show tables; | |
| OK |
OlderNewer