cedrickchee

4 Steps in Running LLaMA-7B on a M1 MacBook

The large language models usability

The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.

Running LLaMA

There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.

merit-mthompson

Multi-DB Django example.

Doing this we're able to load our example model into the admin, view it and all related bits and even save without issue. There are some issues when using foreign keys from separate databases in list views in the admin.

Most of this is documented at https://docs.djangoproject.com/en/3.1/topics/db/multi-db/. We've just modified it a bit so things live in settings.

Names for things might seem weird because we've changed them to protect the innocent...

codl

sub vcl_recv {
    if(req.http.Accept-Encoding ~ "br") {
        set req.http.X-brotli = "true";
    }
}

sub vcl_hash {
    if(req.http.X-brotli == "true") {
        hash_data("br");
    }

speedplane

import multiprocessing
import re
from celery import Celery
from celery.worker.autoscale import Autoscaler as CeleryAutoscaler

class DAAutoscaler(CeleryAutoscaler):
    # Try to keep the load above this point.
    LOAD_MIN = .8
    # Try to keep the load below this.
    LOAD_MAX = 1.1

MikeyBurkman

#! /usr/bin/env cecil

// Usage:
// ./esclient.js http://your-elasticsearch-host.com

var elasticsearch = include('elasticsearch', '^11.0.0');
var moment = include('moment', '^2.13.0');
var R = include('ramda', '^0.21.0');
var Promise = include('bluebird', '^3.4.0');

erdem

[
    {
        "timezones": [
            "America/Aruba"
        ], 
        "latlng": [
            12.5, 
            -69.96666666
        ], 
        "name": "Aruba", 

StephanHoyer

'use strict';

var elasticsearch = require('elasticsearch');
var Promise = require('bluebird');

var log = console.log.bind(console);

var client = new elasticsearch.Client({
  host: 'localhost:9200',
  log: 'trace'

st4lk

"""
Example of mandrill service in python (http://mandrill.com/)

Description of usage in python:
Russian: http://www.lexev.org/2014/send-email-django-project-mandrill-service/
English: http://www.lexev.org/en/2014/send-email-django-project-mandrill-service/
"""

# ======
# Django

duydo

    {
        "analysis": {
            "filter": {
                "ar_stop_filter": {
                    "type": "stop",
                    "stopwords": ["_arabic_"]
                },
                "bg_stop_filter": {
                    "type": "stop",
                    "stopwords": ["_bulgarian_"]

philfreo

#!/usr/bin/env python

import time
import boto
import boto.ec2.elb
import boto.utils

from flask.ext.script import Manager

from closeio.main import setup_app