Skip to content

Instantly share code, notes, and snippets.

View fuyi's full-sized avatar
🎯
Focusing

YI FU fuyi

🎯
Focusing
  • Stockholm, Sweden
View GitHub Profile
@fuyi
fuyi / gantt_qc_bullet_prod.html
Created September 4, 2026 06:45
qc_bullet_marts Production Gantt — 4 models, int_qc_bullet_session dominates at 31 min
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<title>qc_bullet_marts Production Gantt</title>
<style>
body { font-family: monospace; background: #1a1a2e; color: #eee; margin: 20px; }
h2 { color: #a0c4ff; margin-bottom: 4px; }
.subtitle { color: #666; font-size: 12px; margin-bottom: 16px; }
.bar-ok { fill: #4cc9f0; opacity: 0.88; }
@fuyi
fuyi / gantt_heavy_prod.html
Created September 4, 2026 05:26
heavy_marts Production Gantt — 55 models, ~29 min (pod hyperion-dbt-heavy-marts-29807975)
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<title>heavy_marts Production Gantt</title>
<style>
body { font-family: monospace; background: #1a1a2e; color: #eee; margin: 20px; }
h2 { color: #a0c4ff; margin-bottom: 4px; }
.subtitle { color: #666; font-size: 12px; margin-bottom: 16px; }
svg { overflow: visible; }
@fuyi
fuyi / gantt_simple_marts.html
Created September 2, 2026 20:31
simple_marts Gantt chart — 44 models, ~15 min wall-clock (dev_yi2 schema)
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<title>simple_marts Gantt</title>
<style>
body { font-family: monospace; background: #1a1a2e; color: #eee; margin: 20px; }
h2 { color: #a0c4ff; margin-bottom: 4px; }
.subtitle { color: #666; font-size: 12px; margin-bottom: 16px; }
.row { display: flex; align-items: center; height: 22px; margin: 2px 0; }
@fuyi
fuyi / gantt_heavy.html
Created August 29, 2026 20:47
heavy_marts Gantt chart — per-model execution timing (pod 29800535, ~49 min run)
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<title>heavy_marts Gantt</title>
<style>
body { font-family: monospace; background: #1a1a2e; color: #eee; margin: 20px; }
h2 { color: #a0c4ff; }
.row { display: flex; align-items: center; height: 22px; margin: 2px 0; }
.label { width: 380px; font-size: 11px; text-align: right; padding-right: 8px; flex-shrink: 0; overflow: hidden; white-space: nowrap; color: #ccc; }
@fuyi
fuyi / gantt.html
Created August 29, 2026 20:37
simple_marts Gantt chart — per-model execution timing (pod 29800502, ~57 min run)
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<title>simple_marts Gantt</title>
<style>
body { font-family: monospace; background: #1a1a2e; color: #eee; margin: 20px; }
h2 { color: #a0c4ff; }
.row { display: flex; align-items: center; height: 22px; margin: 2px 0; }
.label { width: 330px; font-size: 11px; text-align: right; padding-right: 8px; flex-shrink: 0; overflow: hidden; white-space: nowrap; color: #ccc; }
import boto3
import struct
def validate_wav_header_from_s3(bucket_name, object_key):
"""
Validate WAV file by reading only the header (first 44 bytes)
"""
session = boto3.Session(profile_name='product-admin') # use the underlying aws credential
s3 = session.client('s3')
@fuyi
fuyi / .tmux.conf
Created January 20, 2023 11:14
my customized tmux configuration
# use C-a, since it's on the home row and easier to hit than C-b
set-option -g prefix C-a
unbind-key C-a
bind-key C-a send-prefix
set -g base-index 1
# Easy config reload
bind-key R source-file ~/.tmux.conf \; display-message "tmux.conf reloaded."
# vi is good
FROM public.ecr.aws/lambda/python:3.8
RUN yum -y install java-1.8.0-openjdk wget curl
COPY requirements.txt requirements.txt
RUN pip install -r requirements.txt
ENV JAVA_HOME="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.302.b08-0.amzn2.0.1.x86_64/jre"
ENV PATH=${PATH}:${JAVA_HOME}/bin
ENV SPARK_HOME="/var/lang/lib/python3.8/site-packages/pyspark"
ENV PATH=$PATH:$SPARK_HOME/bin
ENV PYTHONPATH=$SPARK_HOME/python:$SPARK_HOME/python/lib/py4j-0.10.9-src.zip:$PYTHONPATH
ENV PATH=$SPARK_HOME/python:$PATH
@fuyi
fuyi / debug.md
Created May 23, 2022 12:36
Feature store write debug

Code to write to Feature Store

@beam.typehints.with_input_types(Tuple[User, List[str]])
class WriteFeatureRPC(beam.DoFn):
    def __init__(
        self,
        api_endpoint,
        project_id,
@fuyi
fuyi / example.json
Created March 25, 2022 08:06
pubsub_message_example
{
"parameters":[
{
"name":"touchpoint",
"stringValue":"android"
},
{
"name":"market",
"stringValue":"gb"
},