Satish Bhat bhattisatish

Setup

On every machine in the cluster install openmpi and mlx-lm:

conda install conda-forge::openmpi
pip install -U mlx-lm

Next download the pipeline parallel run script. Download it to the same path on every machine:

It turns out if you're just doing inference, Llama can be written very concisely. This implementation includes paged attention. Speculative decoding can also be added for another speed boost however it's quite verbose and was left out to keep the implementation cleaner.

Download the Llama files and place them in a directory ./Llama3.2-3B (or whatever flavor of Llama you want).

Your directory structure should look like:

./Llama3.2-3B/consolidated.00.pth

hi, i'm daniel. i'm a 15-year-old with some programming experience and i do a little bug hunting in my free time. here's the insane story of how I found a single bug that affected over half of all Fortune 500 companies:

say hello to zendesk

If you've spent some time online, you’ve probably come across Zendesk.

Zendesk is a customer service tool used by some of the world’s top companies. It’s easy to set up: you link it to your company’s support email (like [email protected]), and Zendesk starts managing incoming emails and creating tickets. You can handle these tickets yourself or have a support team do it for you. Zendesk is a billion-dollar company, trusted by big names like Cloudflare.

Personally, I’ve always found it surprising that these massive companies, worth billions, rely on third-party tools like Zendesk instead of building their own in-house ticketing systems.

your weakest link

This is a transcription of the talk: Organization, Collective, Decision by Dave Snowden at USI 2022

PostgreSQL is Enough

Background and Cron Jobs

How to Sell Elixir AGAIN (2023)

Presented by Evadne Wu at Code BEAM Lite in Stockholm, Sweden on 12 May 2023

Synopsis

We have celebrated 10 years of Elixir and also nearly 25 years of Erlang since the open source release in December 1998.

Most of the libraries that were needed to make the ecosystem viable have been built, talks given, books written, conferences held and training sessions provided. A new generation of companies have been built on top of the Elixir / Erlang ecosystem. In all measures, we have achieved further reach and maturity than 5 years ago.

macOS Internals

Understand your Mac and iPhone more deeply by tracing the evolution of Mac OS X from prelease to Swift. John Siracusa delivers the details.

Starting Points

How to use this gist

You've got two main options:

I have an updated version of this on my blog here: https://chrisamico.com/blog/2023-01-14/python-setup/.

Python

This is my recommended Python setup, as of Fall 2022. The Python landscape can be a confusing mess of overlapping tools that sometimes don't work well together. This is an effort to standardize our approach and environments.

Tools and helpful links:

Python docs: https://docs.python.org/3/
Python Standard Library: - Start here when you're trying to solve a specific problem

	#!/usr/bin/env bash

	ColorOff='\033[0m' # Text Reset
	Yellow='\033[0;33m' # Yellow for important info
	Red='\033[0;31m' # Red for errors
	function infoMessage() {
	echo -e ${Yellow}
	echo $1
	echo -e ${ColorOff}
	}

	$ grep -P "^[ABCDEFabcdefOoIi]{6,6}$" /usr/share/dict/words \| tr 'OoIi' '0011' \| tr '[:lower:]' '[:upper:]' \| awk '{print "#" $0}'
	#ACAD1A
	#B0BB1E
	#DEBB1E
	#AB1DED
	#ACAC1A
	#ACCEDE
	#AC1D1C
	#BAB1ED
	#BA0BAB