Gary Blankenship garyblankenship

Which GGUF is right for me? (Opinionated)

Good question! I am collecting human data on how quantization affects outputs. See here for more information: ggml-org/llama.cpp#5962

In the meantime, use the largest that fully fits in your GPU. If you can comfortably fit Q4_K_S, try using a model with more parameters.

A collection of music APIs, databases, and related tools.

	<?php

	/**
	* Graceful cache retrieval and updating macro.
	*
	* First, tries to retrieve the cached value. If not found, uses a grace value.
	* Schedules a background job for updating the cache if grace value is found.
	*
	* @param string $key The cache key to retrieve.
	* @param int $ttl Time to live for the cache, in seconds.

	<?php

	$response = Http::post(
	"https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent?key=" .
	config("services.googleai.key"),
	[
	"contents" => [
	[
	"parts" => [
	[

	#!/bin/sh
	# rename-pictures.sh
	# Author: Justine Tunney <[email protected]>
	# License: Apache 2.0
	#
	# This shell script can be used to ensure all the images in a folder
	# have good descriptive filenames that are written in English. It's
	# based on the Mistral 7b and LLaVA v1.5 models.
	#
	# For example, the following command:

	<?php

	namespace App\Http\Controllers;

	use Illuminate\Http\Request;
	use OpenAI\Laravel\Facades\OpenAI;

	class AssistantController extends Controller
	{
	public function generateAssistantsResponse(Request $request)

	# Clone the repo
	git clone https://github.com/imartinez/privateGPT
	cd privateGPT

	# Install Python 3.11
	pyenv install 3.11
	pyenv local 3.11

	# Install dependencies
	poetry install --with ui,local

	<?php

	namespace App\Providers;

	use Illuminate\Support\ServiceProvider;
	use Laravel\Scout\Builder;

	class MacroServiceProvider extends ServiceProvider
	{
	/**