Skip to content

Instantly share code, notes, and snippets.

View randomvariable's full-sized avatar
⬇️
Downstream. I may be slow to respond.

Naadir Jeewa randomvariable

⬇️
Downstream. I may be slow to respond.
View GitHub Profile
@randomvariable
randomvariable / Qwen3.8-Flash-Next: serving the 100 GB per-layer embedding table.md
Created August 30, 2026 21:18
Qwen3.8-Flash-Next: serving the 100 GB per-layer embedding table

Qwen3.8-Flash-Next: serving the 100 GB per-layer embedding table

Identity

The model the community calls Qwen3.8-Flash-Next lands in transformers as model_type = "qwen4_exp", under src/transformers/models/qwen4_exp/, with @auto_docstring(checkpoint="Qwen/Qwen4-Exp"). It is a VLM (Qwen4ExpForConditionalGeneration) over a hybrid text stack: linear-attention layers, MoE, hyper-connections, and Qwen sparse attention (QSA) on the layers that indexer_n_heads enables.

@randomvariable
randomvariable / laguna-s-2.1-vllm-tp2-1M.yaml
Last active July 24, 2026 22:48
Laguna-S-2.1-NVFP4 on DGX Spark (GB10): 2-node TP=2 vLLM at native 1M context over ConnectX-7 RoCE (ray backend), DFlash spec decoding + FlashInfer B12X NVFP4 MoE, fronted by llm-d EPP. Includes GB10 UMA wedge-safety rationale (why ray not mp, no VLLM_SKIP_INIT_MEMORY_CHECK).
# Laguna-S-2.1-NVFP4 on NVIDIA DGX Spark (GB10, sm_121a, arm64)
# 2-node TENSOR-PARALLEL (TP=2) vLLM serving at NATIVE 1M context, one engine
# sharded across two GB10 nodes over ConnectX-7 RoCE, with DFlash speculative
# decoding and the FlashInfer B12X NVFP4 MoE backend. Fronted by an llm-d
# Endpoint Picker (EPP) constrained to rank0.
#
# ─────────────────────────────────────────────────────────────────────────────
# WHY TP=2 (vs 2 independent replicas):
# One vLLM engine tensor-sharded across 2 DGX Spark nodes (1 GPU/node) gives a
# single UNIFIED KV pool and shards the weights (~35 GiB/node vs ~70 GiB on a
@randomvariable
randomvariable / MFT-covid.md
Last active June 27, 2026 10:21
Did the Moral Foundations Theory Group Publish a Post-COVID Retrospective on the Purity Foundation? A Slop Report

Did the Moral Foundations Theory Group Publish a Post-COVID Retrospective on the Purity Foundation? A Slop Report

TL;DR

  • No. The original Moral Foundations Theory (MFT) authors—Jonathan Haidt and Jesse Graham—have not published a formal scholarly retrospective or reassessment of the Purity/Sanctity foundation in light of COVID-19. The closest thing on record is an informal, unpublished remark by Haidt in a 2024 Conversations with Tyler interview, where—asked directly whether COVID changed his view—he argued the pandemic "wasn't about germs" but about government control, so it neither cleanly validated nor revised his purity work.
  • The MFT group did publish a major theory revision in this window—Atari, Haidt, Graham et al. (2023), "Morality Beyond the WEIRD," JPSP (the MFQ-2, which splits Fairness into Equality and Proportionality)—but it is a cross-cultural measurement overhaul built on 25 populations, not a COVID/purity retrospective. The Liberty/Oppression foundation was added ea
#!/bin/bash
declare -A seenNamespaces
declare -A containerInfo
# Ensure ipcs command is available
ipcsPath=$(which ipcs)
if [ -z "$ipcsPath" ]; then
echo "ipcs command could not be found"
exit
@randomvariable
randomvariable / template.yaml
Last active July 13, 2021 12:03
injected template
apiVersion: v1
data: ${CNI_RESOURCES}
kind: ConfigMap
metadata:
name: cni-${CLUSTER_NAME}-crs-0
namespace: default
---
apiVersion: addons.cluster.x-k8s.io/v1alpha4
kind: ClusterResourceSet
metadata:
@randomvariable
randomvariable / goldpinger.yaml
Created September 21, 2020 22:51
goldpinger.yaml
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: goldpinger-serviceaccount
namespace: default
---
apiVersion: apps/v1
kind: DaemonSet
metadata:
diff -Naur linux-4.19.138/drivers/net/vmxnet3/vmxnet3_drv.c ../SOURCES/linux-5.8/drivers/net/vmxnet3/vmxnet3_drv.c
--- linux-4.19.138/drivers/net/vmxnet3/vmxnet3_drv.c 2020-09-18 02:49:39.826513351 +0100
+++ ../SOURCES/linux-5.8/drivers/net/vmxnet3/vmxnet3_drv.c 2020-09-18 02:58:22.467376972 +0100
@@ -535,8 +535,8 @@
}
sz = tq->tx_ring.size * sizeof(tq->buf_info[0]);
- tq->buf_info = dma_zalloc_coherent(&adapter->pdev->dev, sz,
- &tq->buf_info_pa, GFP_KERNEL);
+ tq->buf_info = dma_alloc_coherent(&adapter->pdev->dev, sz,
---
apiVersion: cluster.x-k8s.io/v1alpha3
kind: Cluster
metadata:
labels:
cluster.x-k8s.io/cluster-name: 'test'
name: 'test'
namespace: 'default'
spec:
clusterNetwork:
@randomvariable
randomvariable / netshoot.yaml
Created September 17, 2020 15:32
netshoot.yaml
---
apiVersion: apps/v1
kind: DaemonSet
metadata:
name: netshoot
labels:
app: netshoot
spec:
updateStrategy:
type: RollingUpdate
@randomvariable
randomvariable / spki_fingerprint.py
Last active July 12, 2019 14:07
spki_fingerprint.py
# Copyright © 2019 VMware Inc.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.