ryan-williams

[marin-community/marin#1723] workspace, step 2: levanter

Second step in the [uv workspace migration plan][migration-plan]: ingests [Levanter] as a workspace member with full Git history preserved.

Changes

• Merge [Levanter] into lib/levanter/ (including Git history)
• Add Levanter member to workspace root pyproject.toml
• Migrate Levanter GitHub Actions workflows to monorepo structure:
• Rename all workflows with levanter- prefix

ryan-williams

[marin-community/marin#1690] "workspace" step 1: marin, data_browser

First step in the [uv workspace migration plan][migration-plan]: initializes a uv workspace and moves marin and data_browser packages into lib/.

Changes

• Creates workspace root pyproject.toml
• Moves src/ → lib/marin/src/ and data_browser/ → lib/data_browser/
• Updates all path references in workflows, Makefile, mkdocs config
• Updates documentation GitHub URLs to use MARIN_DOC_BRANCH env var (defaults to main)

ryan-williams

[marin-community/marin#1646] Pin levanter[serve] to 775ac7c6

• Since Sept '24[^1], Marin's Levanter dep was a "pin" of the form >=1.2.devNNNN
  • When Levanter PRs land, 1.2.devNNNN versions are published by [publish_dev.yml]
    • e.g. [levanter#1127] → [publish_dev#315] → [1.2.dev1500]
  • If Marin needs the changes, it may bump its pin
    • e.g. [marin#1522][#1522] / [pin][levanter>=1.2.dev1500 pin]
    • Marin may have frequently skipped a Levanter bump, when it actually needed more recent changes, since the convention was use >= rather than ==
• [#1591] moved to a == pin ([levanter==1.2.dev1535])
• [#1616] moved to a "floating" dep (against [levanter@main])

ryan-williams

[ryan-williams/git-helpers#104] 'add-global-file' is not a git command

I took this for a spin and encountered an issue with what I'm guessing is an unported script...

> . .git-rc
git: 'add-global-config-file' is not a git command. See 'git --help'.

I dug into this a bit and ended up provisionally including the config/.gitconfig into my ~/.gitconfig by hand. Then...

ryan-williams

ryan-williams/git-helpers#1 Add issues command, which opens github issues for a repo

Just came up with this command, I think it's gonna be great!

While you're in a git repo on your command line, you run issues and it opens the github issues for that repo in your browser.

ryan-williams

Marin/Levanter Version Tracker

Analyze the [Marin] → [Levanter] dependency over time: [openathena.s3.amazonaws.com/marin-levanter.html][demo]

[![Marin/Levanter Version Tracker][og.png]][demo]

Overview

This tool analyzes the Git history and PyPI releases to visualize:

• 404 commits to [Marin]'s main branch (since [#224], Sept 11, 2024)

ryan-williams

[marin-community/marin#1567] Extract executor code (to marin-community/thalas)

Description

Replaces marin.execution with [marin-community/thalas][thalas].

• Adapted from:
  • Open-Athena/marin#1
  • #1548
• Uses/Tests:

ryan-williams

[marin-community/thalas#4] Factor executor code+history from marin-community/marin

Extend/Replace #3

• Include [more paths][paths] in history replay (instead of adding them de novo on top of replayed history, as [#3] does in https://github.com/marin-community/thalas/pull/3/commits/119ddf8c9e7ee7a3500454a647dfd9d98f28439f)
• Include "Original-Commit: <URL>" line at the end of each replayed commit's body (expand commit msgs below for examples)

Marin test: [#1567][marin#1567]

[marin#1567] uses this branch, and has green CI.

ryan-williams

[marin-community/thalas#3] Factor executor code+history from marin-community/marin

Update: superseded by #4

---

• ✅ Use [filter-marin-executor.sh] to extract executor code
  • [Run][gfr] git-filter-repo on a Marin clone:
    • Create filtered history (just executor and related files)
    • In PR-merge-commit subjects, rewrite #XXX to marin-community/marin#XXX

ryan-williams

[Marin] → [Thalas] Executor Extraction ([thalas#4])

Scripts for extracting the executor framework from [Marin] into [Thalas] with filtered git history; used to generate [thalas#4].

Prerequisites

1. Install [git-filter-repo]:

   pip install git-filter-repo