Shubham Gupta y2k-shubham

🏁

Chasing Checkpoints

"A BIG shot is just a little shot who keeps on shooting" - Dr. Kalam, "Wings of Fire" >>> Science Lover | Introvert | Technology Enthusiast

y2k-shubham / ArrayUtils.php

Last active November 12, 2020 21:31

PHP utility functions for array manipulation

	class ArrayUtils {

	/**
	* - Groups a (non-associative) array of items into associative array of chunks (of items), where key of chunk
	* is determined by $key_retriever callable
	* OR
	* - Groups elements of an array into subarrays, thereby converting Array into Array[group => Array]
	*
	* - Check unit-tests to understand further
	* @param array $data

y2k-shubham / git_remote_branch_show.sh

Last active August 8, 2020 03:39

git show all (remote) branches of particular remote

	# reference: https://stackoverflow.com/a/30076212/3679900
	git for-each-ref 'refs/remotes/my-origin' --sort=-committerdate refs/heads --format='%(refname:short)%09%(committerdate:relative)%09%(authorname)%09%(subject)%09'\|column -ts'\|'

y2k-shubham / ImageTextRenderUtils.php

Created June 26, 2020 17:20

Utility PHP snippet to wrap text (meant to be rendered on image) using pixel width

	<?php


	namespace Utils;


	class ImageTextRenderUtils {

	/**
	* Returns expected width of rendered text in pixels

y2k-shubham / mysql_table_sizes.sql

Created March 31, 2020 12:56

get size (raw-data) of all selected mysql tables

	-- reference: https://stackoverflow.com/a/9620273/3679900
	SELECT TABLE_NAME AS `Table`,
	round(((data_length) / 1024 / 1024 / 1024), 2) `Size-in-GB`
	FROM information_schema.TABLES
	WHERE table_schema = 'my_db_name'
	AND TABLE_NAME IN ('my_table_1',
	'my_table_2')
	ORDER BY (data_length) DESC

y2k-shubham / hive_ddl_clean_regex.txt

Created March 31, 2020 12:54

regex to clean Hive DDL statements

	# this regex will clean output of Hive's SHOW CREATE TABLE .. statement
	(^\\| \|\s+\\|$\| COMMENT 'from deserializer')

y2k-shubham / clean_windows_text_file.sh

Created March 31, 2020 12:53

clean text-files generated in windows for programmatic consumption in linux

	# Removes invisible characters (like formfeed)
	# also coerces UTF-8 encoding
	iconv -c -f utf-8 -t ascii source_filename.csv > destination_filename.csv

y2k-shubham / hash_script.py

Created February 27, 2020 05:58

	import hashlib
	import os
	import sys


	# /////////////////////////
	# file-read / write methods
	# /////////////////////////

	def get_utf8_file_descriptor(file_path, mode):

y2k-shubham / yarn_applications_kill.sh

Created January 25, 2020 19:59

Kill all running YARN applications

`yarn application --list | awk '{print $1}' | grep application | xargs yarn application -kill`

y2k-shubham / alias.sh

Last active March 31, 2020 12:58

rsync

rsync -avze "ssh -t -p 272 {user_name_on_entry}@entry.organization.farm ssh [email protected]" {home_folder_name} :/home/admin/{dest_folder_name}

y2k-shubham / airflow_webserver_stacktrace.log

Last active December 24, 2019 09:51

Stacktrace generated on Airflow's Webserver when I try to manually trigger DAG via WebUI