Skip to content

Instantly share code, notes, and snippets.

View indrajithi's full-sized avatar
:octocat:
Namaste

Indrajith Indraprastham indrajithi

:octocat:
Namaste
62 followers · 45 following
View GitHub Profile
@indrajithi
indrajithi / DATA ENGINEERING ASSIGNMENT
Created January 12, 2026 08:12
---
📘 DATA ENGINEERING ASSIGNMENT
PySpark | Apache Iceberg | Hive Metastore | FastAPI
---
📌 Overview
| | |
|----------|----------------------------------------------------------|
@indrajithi
indrajithi / plan
Created June 17, 2025 19:19
1. A data ingestion pipeline is experiencing severe performance issues, taking 23 minutes to process just 113 XML files
2. Business requirement is to process up to 42,000 files per vendor (6 vendors total) within a 15-minute window during peak times.
### The current implementation is built on:
- **Azure Data Factory (ADF)** – orchestrates copy / transform pipelines (`MDMF1`, `MDMF2`).
- **Azure Functions** – parses XML → Parquet.
- **Snowflake** – final landing for analytics tables.
- **MDMS framework** – metadata‑driven ADF wrapper that resolves dependencies via Azure SQL.
@indrajithi
indrajithi / messages
Created January 28, 2025 11:10
messages
resource "null_resource" "install_dependencies" {
provisioner "local-exec" {
command = <<EOT
if ! command -v pip &> /dev/null; then
echo "pip not found, installing pip..."
curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py
python3 get-pip.py
rm get-pip.py
fi
pip install psycopg2-binary -t ${path.module}/python-scripts/
@indrajithi
indrajithi / Splitwise.md
Last active April 26, 2024 13:29

Splitwise

Users can add expenses. Users can edit expenses. Also, users can settle expenses. Allow users to make groups and add, edit and settle expenses in the group.

@indrajithi
indrajithi / index.html
Created April 13, 2023 06:37
Styled JavaScript Countdown Clock
<h1>Countdown Clock</h1>
<div id="clockdiv">
<div>
<span class="days"></span>
<div class="smalltext">Days</div>
</div>
<div>
<span class="hours"></span>
<div class="smalltext">Hours</div>
</div>
@indrajithi
indrajithi / iterm.itermkeymap
Created May 25, 2022 17:05
{"Key Mappings":{"0xf702-0x320000":{"Action":18,"Text":""},"0xf702-0x300000":{"Text":"","Action":2},"0xf703-0x320000":{"Action":19,"Text":""},"0xf703-0x300000":{"Text":"","Action":0},"0xf72b-0x100000":{"Text":"","Action":4},"0xf700-0x320000":{"Action":20,"Text":""},"0xf72c-0x100000":{"Text":"","Action":9},"0xf700-0x300000":{"Text":"","Action":7},"0xf72d-0x100000":{"Text":"","Action":8},"0x9-0x40000":{"Text":"","Action":32},"0xf701-0x300000":{"Text":"","Action":6},"0xf701-0x320000":{"Action":21,"Text":""},"0xf703-0x220000":{"Action":30,"Text":""},"0x4f-0x120000":{"Text":"8C1888B9-C372-489E-92FD-7F632EE5F550","Action":28},"0x58-0xa0000":{"Action":23,"Text":""},"0x19-0x60000":{"Text":"","Action":39},"0xf729-0x100000":{"Text":"","Action":5},"0x45-0x120000":{"Text":"8C1888B9-C372-489E-92FD-7F632EE5F550","Action":29},"0xf72c-0x20000":{"Text":"","Action":9},"0xf72d-0x20000":{"Text":"","Action":8}},"Touch Bar Items":{}}
@indrajithi
indrajithi / iterm_profile.json
Created May 25, 2022 17:00
{
"Profiles": [
{
"Use Non-ASCII Font" : false,
"Tags" : [
],
"Ansi 12 Color" : {
"Green Component" : "0.6235294",
"Red Component" : "0.4470588",
@indrajithi
indrajithi / cargo_ship_problem.py
Created December 28, 2020 18:02
class CargoShip:
def __init__(self):
self.tide = None
self.run()
def get_water_levels(self):
length = input()
levels = input()
return list(map(int, levels.split()))
@indrajithi
indrajithi / keybase.md
Created November 11, 2019 16:31

Keybase proof

I hereby claim:

  • I am indrajithi on github.
  • I am indr4jith (https://keybase.io/indr4jith) on keybase.
  • I have a public key whose fingerprint is 2490 9471 7AD7 F927 4BC1 F77B 03A5 B3D6 5C88 C1E4

To claim this, I am signing this object:

@indrajithi
indrajithi / top_indian_city_names
Last active November 6, 2019 09:41
Top Indian City Names with State
panchkula
shimla
eluru
thoothukkudi
cuttack
himachal pradesh
azamgarh
banswara
raigarh
deoghar