eduard-sukharev

Local LLMs 101

by Ahmad @TheAhmadOsman

• tired of guides that just tell you to run a script and call it a day?
• want to actually know what your GPU is doing, not just trust a black box?
• here's what really happens when you run a local LLM
• what gets loaded, why, and how it all fits together
• no gatekeeping, just the real explanations nobody gives you
• the elite don't want you to know this

eduard-sukharev

# refer to https://robotmoon.com/bash-prompt-generator/ for configuration help and examples
# use https://github.com/seedform/Bash-Color-Palette for 256 colors reference palette

COLOR_GREEN="\001\033[38;5;35m\002"
COLOR_BLUE="\001\033[38;5;33m\002"
COLOR_BLUE_PALE="\001\033[38;5;25m\002"

COLOR_RED="\001\033[38;5;296m\002"
COLOR_ORANGE="\001\033[38;5;208m\002"
COLOR_YELOW="\001\033[38;5;220m\002"

eduard-sukharev

import os
import subprocess
import sys
from itertools import chain
import argparse

parser = argparse.ArgumentParser(description="Split audio file by .cue metadata.")
parser.add_argument(
    "cue-files",
    help="CUE file to be parsed. Multiple files can be passed. If no files provided, reads from stdin",

eduard-sukharev

Running ARM Debian/Ubuntu on QEMU

If the below is too much, you can try Ubuntu-ARMv7-Qemu but note it contains non-free blobs.

Architectures cheatsheet:

• armel - emulated floating point (ARMv6 and older)
• armhf - hardware floating point (ARMv7 and newer)
• arm64 (aarch64, aarm64) - ARM with 64bit support (mainly ARMv8 and newer)

eduard-sukharev

#!/bin/sh
#
# example start stop daemon for CentOS (sysvinit)
#
# chkconfig: - 64 36
# Default-Start: 2 3 4 5
# Default-Stop: 0 1 2 3 4 6
# Required-Start:
# description: example start stop daemon for CentOS
# processname: python

eduard-sukharev

sudo modprobe -r ubi
sudo modprobe -r mtdram
sudo modprobe nandsim first_id_byte=0x20 second_id_byte=0xaa third_id_byte=0x00 fourth_id_byte=0x15 total_size=40000
cat /proc/mtd
#     dev:    size   erasesize  name
#     mtd0: 10000000 00020000 "NAND simulator partition 0"
sudo  flash_erase /dev/mtd0 0 0
#     Erasing 128 Kibyte @ ffe0000 -- 100 % complete 
sudo ubiformat /dev/mtd0 -f rootfs.ubi -e 0 -O 2048
#     ubiformat: mtd0 (nand), size 268435456 bytes (256.0 MiB), 2048 eraseblocks of 131072 bytes (128.0 KiB), min. I/O size 2048 bytes

eduard-sukharev

#!/usr/bin/env bash

HELPER_CONTAINERS=false
PROJECT=my-app

while getopts "ha" option
    do
        case "${option}" in
            a) HELPER_CONTAINERS=true;;
            h) echo "Helper script to run app in local docker environment."

eduard-sukharev

#!/usr/bin/env bash

COMPOSER_IMAGE=composer

if [ -t 1 ] ; then
    mkdir -p "$HOME/.cache/composer"
    docker run \
        -it \
        --rm \
        -u "$(id -u):$(id -g)" \

eduard-sukharev

#!/bin/sh

file_in=${1:-"input.mp4"}
file_out=${2:-"output.gif"}
fps=${3:-20}
width=${4:-400}

ffmpeg -y -i $file_in -vf fps=$fps,scale=$width:-1:flags=lanczos,palettegen palette.png
ffmpeg -y -i $file_in -i palette.png -filter_complex "fps=$fps,scale=$width:-1:flags=lanczos[x];[x][1:v]paletteuse" $file_out

eduard-sukharev

#!/usr/bin/perl
#fetch Gravatars

use strict;
use warnings;

use LWP::Simple;
use Digest::MD5 qw(md5_hex);

my $size       = 90;