ʞ-uɐʇsıɹʇ tristan-k

I found a way to run llama.cpp with GPU support on my 2019 Intel MacBook Pro, with the help of Vulkan.

Thanks to ollama/ollama#1016 (comment) an following comments which helped me find the right build flags.

First download MoltenVK-macos.tar (I used v1.3.0-rc1 at the time) from https://github.com/KhronosGroup/MoltenVK/releases

Not sure all these packages are required, but I ran brew install libomp vulkan-headers glslang molten-vk shaderc vulkan-loader. You probably also need to install cmake and potentially other tools I already had installed on my system.

Then clone and build llama.cpp (replace /path/to/MoltenVK_macos with the actual path you have MoltenVK_macos):

How to properly install android-tools in Fedora

Currently, it seems as if Fedora doesn't install udev-rules, to get this working, I've had to manually install them from a community project. I'm not very knowledgable in Linux, these are just the steps I had to do to get things working that I'd like to document.

Install android-tools

Install android-tools from DNF.

sudo dnf install android-tools

Encrypted APFS Home Folder on Mac OSX

Note: This is an update of Will Haley's excellent post to use APFS instead of CoreStorage.

I'll add to Will's warning below that this is a complex process on MacOS because the OS has a lot of assumptions on where things are. I

	#!/bin/bash

	# This script is based on https://unix.stackexchange.com/revisions/480191/9 .
	# The following changes proved to be necessary to make it work on CentOS 7:
	# * removed disk info (model, size) - not very useful, might not work in many cases.
	# * using "bw" instead of "bw_bytes" to support fio version 3.1 (those availible through yum @base)
	# * escaping exclamation mark in sed command
	# * the ".fiomark.txt" is not auto-removed

	LOOPS=5 #How many times to run each test

	#!/usr/bin/env bash

	# run this on the remote terminal machine, as auser with sudo powers, probably through a remote ssh shell

	# this will overwrite all the settings it touches

	# the name of the user to run these commands as
	TARGET_USER=$USER

	# we need an inlocked desktop session. we can either start a new autologin one or unlock an existing one

	<?xml version="1.0" encoding="UTF-8"?>
	<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
	<plist version="1.0">
	<dict>
	<key>Disabled</key>
	<false/>
	<key>Label</key>
	<string>gerbera.io</string>
	<key>ProgramArguments</key>
	<array>

	#! /usr/bin/env python3.5
	"""

	Workaround for bug: https://bugs.launchpad.net/ubuntu/+source/indicator-sound/+bug/1577197
	Run it with python3.5 or higher after pairing/connecting the bluetooth stereo headphone.

	See `a2dp.py -h` for info.

	https://gist.github.com/pylover/d68be364adac5f946887b85e6ed6e7ae
	Vahid Mardani

	# -- coding: utf-8 --

	"""
	Python Script to download the Chrome Extensions (CRX) file directly from the google chrome web store.
	Referred from http://chrome-extension-downloader.com/how-does-it-work.php
	"""

	from __future__ import division
	import argparse
	import requests