Skip to content

Instantly share code, notes, and snippets.

View jhyland87's full-sized avatar

J jhyland87

  • 48°52.6′S 123°23.6′W
View GitHub Profile
Table Name: Employee
Employee_id First_name Last_name Salary Joining_date Department Order
----------------------------------------------------------------------------------------------
1 Roy Thomas 700000 01-FEB-13 12.00.00 AM Banking 3
2 Michael Clarke 800000 01-JAN-13 12.00.00 AM Insurance 2
3 John Abraham 1000000 01-JAN-13 12.00.00 AM Banking 5
4 Tom Jose 600000 01-FEB-13 12.00.00 AM Insurance 4
5 TestName1 123 650000 01-JAN-13 12.00.00 AM Services 1
6 Philip Mathew 750000 01-JAN-13 12.00.00 AM Services 8
---- / both DE and DA candidates must have basic python
*Basic python:
different data structures, various operations on them
iterations, traversing through data structures
Data Engineer job id 7122
• We are looking for a senior Data Integration Engineer that has relevant experience working in a highly scalable environment.
• Strong experience with SQL, must be very good hands on with SQL skills. Would be able to write SQL queries and play with various SQL databases.
• Must have experience with SQL, Hive/ Presto, big Data, Hadoop, and MySQL.
• ETL tool is similar to Airflow from AirBnb so, familiar with it is useful.
Table Name: Employee
Employee_id First_name Last_name Salary Joining_date Department Order
----------------------------------------------------------------------------------------------
1 Roy Thomas 700000 01-FEB-13 12.00.00 AM Banking 3
2 Michael Clarke 800000 01-JAN-13 12.00.00 AM Insurance 2
3 John Abraham 1000000 01-JAN-13 12.00.00 AM Banking 5
4 Tom Jose 600000 01-FEB-13 12.00.00 AM Insurance 4
5 TestName1 123 650000 01-JAN-13 12.00.00 AM Services 1
6 Philip Mathew 750000 01-JAN-13 12.00.00 AM Services 8
mysql> select * from employees;
+-------------+------------+----------------+--------+------------+------------+------------------+
| employee_id | first_name | last_name | salary | join_date | department | status |
+-------------+------------+----------------+--------+------------+------------+------------------+
| 1001 | Clark | Kent | 700000 | 2017-01-05 | Banking | Employeed |
| 1002 | Peter | Parker | 800000 | 2016-11-04 | Insurance | Leave of Absence |
| 1003 | Adam | Mann | 65000 | 2017-01-12 | Banking | Employeed |
| 1004 | Sean | Cassidy | 85000 | 2017-04-06 | Insurance | Leave of Absence |
| 1005 | Jason | Blood | 65000 | 2017-03-07 | NULL | Employeed |
| 1006 | Bruce | Wayne | 82000 | 2017-03-09 | Insurance | Leave of Absence |
@jhyland87
jhyland87 / shebang2.sh
Last active May 16, 2017 19:06
A more improved version of the shebang script
#!/usr/local/bin/bash4
function stderr {
echo $@ 1>&2
[[ -z $2 ]] && exit 1
}
function abspath {
[[ -d $1 ]] && { cd "$1"; echo "$(pwd -P)"; } ||
#!/usr/local/bin/bash4
function stderr {
echo $@ 1>&2
}
function abspath {
[[ -d $1 ]] && { cd "$1"; echo "$(pwd -P)"; } ||
{ cd "$(dirname "$1")"; echo "$(pwd -P)/$(basename "$1")"; }
}
@jhyland87
jhyland87 / parse-ini.awk
Created May 15, 2017 16:33
Basic awk script that can be used to parse a config similar to the INI layout (var = val)
#! /usr/local/bin/awk -f
# Solution by Ed Morton (http://stackoverflow.com/a/43946907/5154806)
# Example: echo -e "personal.name.first=John\npersonal.name.last\t=Doe\npersonal.other.dob=\t05/07/87\npersonal.contact.phone\t=\t602123456\npersonal.contact.email\t = \tjohn.doe@idk\nemployment.jobs.1\t\t= Company One\nemployment.jobs.2 \t =Company Two\nemployment.jobs.3\t= Company Three" | ./tst.awk
BEGIN {
FS="[\t ]*=[\t ]*"
}
{
split($1,d,/\./)
data[d[1]][d[2]][d[3]] = $2
@jhyland87
jhyland87 / edu-evolution.md
Created April 17, 2017 07:52
Blog draft of how I became successful.

My story and conclusion on jobs/careers/education

I was a terribke studentenm=, I was even held back in 7th grdde, and almost 8th... 9th was a close all too. Back then, I was the kid who couted the ecoonds on the lock til the next period. I don't quite

in Highschool and Basic useful feature list:

/* Copyright (c) 2006 Tony Garnock-Jones <tonyg@lshift.net>
* Copyright (c) 2006 LShift Ltd. <query@lshift.net>
*
* Permission is hereby granted, free of charge, to any person
* obtaining a copy of this software and associated documentation files
* (the "Software"), to deal in the Software without restriction,
* including without limitation the rights to use, copy, modify, merge,
* publish, distribute, sublicense, and/or sell copies of the Software,
* and to permit persons to whom the Software is furnished to do so,
* subject to the following conditions:
@jhyland87
jhyland87 / levenshtein.js
Created March 29, 2017 19:49
Few separate ways to create a levenshtein function
var levenshtein_es5 = function(a, b) {
if(a.length == 0) return b.length;
if(b.length == 0) return a.length;
// swap to save some memory O(min(a,b)) instead of O(a)
if(a.length > b.length) {
var tmp = a;
a = b;
b = tmp;
}