Gary Blankenship garyblankenship

PostgreSQL is Enough

Background and Cron Jobs

Overview

This was a full fine-tune of llama-2-13b-hf using dataset https://huggingface.co/datasets/jondurbin/airoboros-gpt4-2.0

Data prep

Convert the JSONL (newline delimeted JSON strings) into conversational format that FastChat expects:

import re

Fork of qlora: https://github.com/jondurbin/qlora

Make sure to change dataset format, and dataset path to your file, along with model/output paths.

If you want to modify the prompt format, edit this: https://github.com/jondurbin/qlora/blob/main/qlora.py#L433

Args used:

python qlora.py \

Details on how the airoboros-gpt4-2.0 dataset was created.

Script

https://github.com/jondurbin/airoboros

pip install --upgrade airoboros==2.0.13

Discord Console Tricks (Experiments, Dev Stuff, etc)

INSTRUCTIONS FOR ALL OF THEM:

Open DevTools in Discord with CTRL + SHIFT + i (ONLY POSSIBLE IN CANARY AND PBT ANYMORE)

Paste Snippet

Edit it. (optional: if instructed)

Hit Enter.

Enable Experiments and Dev-Only Options:

Using Laravel Eloquent (illuminate/database) standalone

Full Example with migrations

Install

Install package via composer

composer require illuminate/database

	<?php

	namespace App\Providers;

	use Illuminate\Support\ServiceProvider;
	use Laravel\Scout\Builder;

	class MacroServiceProvider extends ServiceProvider
	{
	/**

	import json
	import re
	import string
	import sys

	def clean_text(text):
	# Strip leading and trailing white space
	text = text.strip()

	# Replace consecutive white space characters with a single space

	You are Whimsy, a world-building creation assistant. You are going to help me detail and describe an imaginary world.

	Carefully adhere to the following steps for our conversation. Do not skip any steps!:

	Main steps:

	1. Introduce yourself. Ask what sort of world I'd like to build, offer some ideas including fantasy, scifi, and cyberpunk. Present the ideas as a numbered list with emojis. Also offer at least 2 other world types. Wait for my response.
	2. Choose a name for the world. Present alternatives names as a numbered list with emojis or let me propose my own option. Wait for my respinse.
	3. Choose a secondary theme for the world or let me propose my own options. Present alternative themes with a numbered list with emojis. Wait for my response.
	4. Briefly describe the world and ask if I'd like to make changes. Tell me what the year within the world is. Do not set the year to the real world current year. Wait for my response.

	{-# LANGUAGE DataKinds #-}
	{-# LANGUAGE DerivingStrategies #-}
	{-# LANGUAGE EmptyDataDecls #-}
	{-# LANGUAGE FlexibleContexts #-}
	{-# LANGUAGE FlexibleInstances #-}
	{-# LANGUAGE GADTs #-}
	{-# LANGUAGE GeneralizedNewtypeDeriving #-}
	{-# LANGUAGE MultiParamTypeClasses #-}
	{-# LANGUAGE OverloadedStrings #-}
	{-# LANGUAGE QuasiQuotes #-}