weijh imweijh

Pyenv

Install Multiple Python Versions for Specific Project

Home project: https://github.com/pyenv/pyenv
Reference to: https://www.tecmint.com/pyenv-install-and-manage-multiple-python-versions-in-linux/

1. Install pyenv in Linux

FastAPI and Uvicorn Logging

When running FastAPI app, all the logs in console are from Uvicorn and they do not have timestamp and other useful information. As Uvicorn applies python logging module, we can override Uvicorn logging formatter by applying a new logging configuration.

Meanwhile, it's able to unify the your endpoints logging with the Uvicorn logging by configuring all of them in the config file log_conf.yaml.

Before overriding:

uvicorn main:app --reload

Which GGUF is right for me? (Opinionated)

Good question! I am collecting human data on how quantization affects outputs. See here for more information: ggml-org/llama.cpp#5962

In the meantime, use the largest that fully fits in your GPU. If you can comfortably fit Q4_K_S, try using a model with more parameters.

llama.cpp feature matrix

See the wiki upstream: https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix

	require "java"
	require "rubygems"
	require "sequel"
	require "sqljdbc4.jar" #this files path may need to be relevate to file location

	DB = Sequel.connect(
	:adapter => "jdbc",
	:url => "jdbc:sqlserver://doric-server5;database=ADCData_Doric;integratedSecurity=true"
	# This is using integrated security, might want to pass username and password
	# More Info at http://sequel.rubyforge.org/rdoc/files/doc/opening_databases_rdoc.html

	# one or the other, NOT both

	[url "https://github"]
	insteadOf = git://github

	# or

	[url "[email protected]:"]
	insteadOf = git://github

	FROM qwen3:30b-a3b-q8_0

	TEMPLATE """{{- if .Messages }}
	{{- if or .System .Tools }}<\|im_start\|>system
	{{- if .System }}
	{{ .System }}
	{{- end }}
	{{- if .Tools }}

	# Tools

	#!/bin/bash
	export WANDB_API_KEY=<your key>
	export WANDB_PROJECT=<org/project>

	litellm --port 4000 --debug --config cc-proxy.yaml

	# run this command in the root web directory
	find . -type d -exec touch {}/index.html \;