Skip to content

Instantly share code, notes, and snippets.

View gerred's full-sized avatar
:octocat:

Gerred Dillon gerred

:octocat:
View GitHub Profile
@damek
damek / concatenated_DSPY_docs_5_12_2025.md
Last active May 14, 2025 20:14
Concatenated DSPy documentation (May 12, 2025)

dspy.Adapter

::: dspy.Adapter handler: python options: members: - call - acall

  • format
@aksh-at
aksh-at / modal_quic_hole_punch.py
Last active May 4, 2025 12:51
Modal QUIC NAT hole-punching
"""
Proof-of-concept for NAT traversal and low-latency communication over QUIC
between two Modal containers.
In theory this could be used to establish a low-latency p2p connection between a
service running outside Modal and a Modal GPU container, e.g. for real-time
inference on a video stream. Please let us know if you try it!
Usage:
> modal run modal_quic_hole_punch.py
@andrewmd5
andrewmd5 / hako.go
Created April 13, 2025 14:38
hako in go
package main
import (
"fmt"
"os"
"github.com/bytecodealliance/wasmtime-go/v31"
)
// Default memory configuration (matching JavaScript defaults)
@disler
disler / README.md
Last active May 8, 2025 20:59
Use Meta Prompting to rapidly generate results in the GenAI Age

Meta Prompting

In the Generative AI Age your ability to generate prompts is your ability to generate results.

Guide

Claude 3.5 Sonnet and o1 series models are recommended for meta prompting.

Replace {{user-input}} with your own input to generate prompts.

Use mp_*.txt as example user-inputs to see how to generate high quality prompts.

@jhabr
jhabr / build_torch_orin.sh
Last active April 14, 2025 12:57
Build PyTorch for Nvidia Jetson AGX Orin
#!/bin/bash
export USE_NCCL=0
export USE_DISTRIBUTED=1
export USE_QNNPACK=0
export USE_PYTORCH_QNNPACK=0
# Orin is based on Ampere Achitecture
export TORCH_CUDA_ARCH_LIST="8.7"
@DayOfThePenguin
DayOfThePenguin / chat.proto
Last active June 28, 2023 21:22
Chat Proto
syntax = "proto3";
package chat;
option go_package = "github.com/defenseunicorns/leapfrogai/pkg/client/chat";
// ChatRequest is the payload to Chat creation
message ChatRequest {
repeated string inputs = 1;
}

History

For a long time I've been really impacted by the ease of use Cassandra and CockroachDB bring to operating a data store at scale. While these systems have very different tradeoffs what they have in common is how easy it is to deploy and operate a cluster. I have experience with them with cluster sizes in the dozens, hundreds, or even thousands of nodes and in comparison to some other clustered technologies they get you far pretty fast. They have sane defaults that provide scale and high availability to people that wouldn't always understand how to achieve it with more complex systems. People can get pretty far before they have to become experts. When you start needing more extreme usage you will need to become an expert of the system just like any other piece of infrastructure. But what I really love about these systems is it makes geo-aware data placement, GDPR concerns potentially simplified and data replication and movement a breeze most of the time.

Several years ago the great [Andy Gross](ht

@rob5300
rob5300 / hologram.vfx
Last active November 2, 2022 20:30
Simple Hologram shader for S&Box
HEADER
{
CompileTargets = ( IS_SM_50 && ( PC || VULKAN ) );
Description = "Hologram Effect";
}
FEATURES
{
#include "common/features.hlsl"
@dbrookman
dbrookman / build-mpv_silicon.sh
Last active May 11, 2025 00:31
How to build mpv & mpv.app on an Apple silicon Mac
#!/usr/bin/env bash
# Builds mpv & mpv.app on Apple silicon Macs.
# Run this script from the root directory of the mpv repo.
# if anything fails, gtfo
set -ex
meson setup build
meson compile -C build