Manoz

Running LLaMAs models locally on Apple Silicon M1/M2 chips using a nice Web UI

Disclaimer: I'm not a data scientist or an expert with LLaMA models or LLMs thus I won't cover technical details about LLaMA models, Vicuna or the settings used in my tests. I just wanted to play with LLaMA models and share my setup and results with the community.
I also consider that you have some basic knowledge about using a terminal and running Python scripts.
I will also not cover the installation process of the tools and libraries used in this document but I will provide links to the documentation I used to make this work on my computer.
Finally, I'm not a native English speaker so please excuse my English mistakes 🙃

Introduction:

I wanted to try to run a LLaMA model on my computer. Since I had absolutely no knowledge about this I started by reading a lot of documentation and articles on the Internet.

Manoz

---
export interface Props {
  label?: string
  hoverBrandColor?: string
}
const { label = '', hoverBrandColor = '' } = Astro.props
---

<li
  title={label}

Manoz

{
  "particles": {
    "number": {
      "value": 40,
      "density": {
        "enable": true,
        "value_area": 600
      }
    },
    "color": {

Manoz

import React from 'react';

class MyComponent extends React.Component {
  constructor(props) {
    super(props);
    this.state = { isToggledOn: false };

    this.toggleClass = this.toggleClass.bind(this);
  }

Manoz

import React from 'react';

class MyComponent extends React.Component {
  render() {
    const MyLink = props => <a href={props.theurl} target="_blank" > {props.thename}</a>;

    return (
      <div>
        <nav>
          <MyLink theurl="http://www.example.com/page1" thename="My link" />

Manoz

/**
 * FontFace utility function that generates the font-face for you
 * @param {string} name font-family name
 * @param {string} src file name
 * @param {string} fontWeight any font-weight (default: normal)
 * @param {string} fontStyle any font-style (default: normal)
 * @return {string} Return the complete css
*/
export function fontFace(name, src, fontWeight = 'normal', fontStyle = 'normal') {
  return `

Manoz

import React from 'react';

class MyComponent extends React.Component {
  constructor(props) {
    super(props);
    this.state = {
      didMount: false,
    };
  }

Manoz

// More infos: https://css-tricks.com/almanac/selectors/p/placeholder/

input {
  // Chrome/Safari/Opera
  &::-webkit-input-placeholder {
    // Your styles
  }

  // Firefox 19+
  &::-moz-placeholder {

Manoz

#
# GIF stuff *_*
#

# Copy a gif url in my clipboard
# Just in case I need a gif asap.
alias fine='echo -n "https://media.giphy.com/media/z9AUvhAEiXOqA/giphy.gif" | pbcopy; echo "Fine gif copied to clipboard"'
alias nope='echo -n "https://media.giphy.com/media/6h4z4b3v6XWxO/giphy.gif" | pbcopy; echo "Nope gif copied to clipboard"'
alias wtf='echo -n "https://media.giphy.com/media/26xBG9lQdU5YTRnJS/giphy.gif" | pbcopy; echo "WTF gif copied to clipboard"'
alias facepalm='echo -n "https://media.giphy.com/media/XsUtdIeJ0MWMo/giphy.gif" | pbcopy; echo "Facepalm gif copied to clipboard"'

Manoz

<?php
/**
 * Tweaks & utils
 * Cleanup wp_head()
 * Use it in your function.php file (or inside a plugin)
 */

 /**
 * Clean the <link> tag output in the site header
 * Removing useless ID's