weijh imweijh

FastAPI and Uvicorn Logging

When running FastAPI app, all the logs in console are from Uvicorn and they do not have timestamp and other useful information. As Uvicorn applies python logging module, we can override Uvicorn logging formatter by applying a new logging configuration.

Meanwhile, it's able to unify the your endpoints logging with the Uvicorn logging by configuring all of them in the config file log_conf.yaml.

Before overriding:

uvicorn main:app --reload

Pyenv

Install Multiple Python Versions for Specific Project

Home project: https://github.com/pyenv/pyenv
Reference to: https://www.tecmint.com/pyenv-install-and-manage-multiple-python-versions-in-linux/

1. Install pyenv in Linux

We have had some success using LS-to-LS over HTTP(S), which supports an HTTP(s) Load Balancer or Proxy in the middle, and can be secured with TLS/SSL. It can be made to be quite performant, but doing so requires some specific tuning.

Upstream (HTTP Output)

The upstream pipelie would contain a single HTTP output plugin aimed either directly at a downstream Logstash or at a Load Balancer, importantly configured with:

format => json_batch (for performance; without this one event will be sent at a time) and
retry_non_idempotent => true (for resilience; without this, some failures cannot be safely retried).

Depending on whether we ar sending directly to another Logstash or through an SSL-terminating Load Balancer or proxy, the output may need to be configured

with HTTP Basic credentials (user/password),

	# llama.cpp server, CLI, and DLL build (CPU inference only)
	#
	# llama.cpp is an amazing project, but its build system is poor and
	# growing worse. It's never properly built llama.dll under any compiler,
	# and DLL builds have been unsupported by w64dk for some time. This
	# makefile is a replacement build system that produces llama.dll,
	# llama-server.exe, and llama-cli.exe using w64dk. No source file changes
	# are needed.
	#
	# The DLL exports the public API and no more, and is readily usable as a

	sudo apt install -y curl build-essential libgmp-dev libmpfr-dev libmpc-dev
	mkdir /tmp/$$ && cd /tmp/$$
	curl -s https://ftp.gnu.org/gnu/gcc/gcc-10.3.0/gcc-10.3.0.tar.xz \| tar xJ
	mkdir build && cd build
	../gcc-10.3.0/configure --prefix=$HOME/gcc10 \
	--disable-dependency-tracking \
	--disable-nls \
	--disable-multilib \
	--enable-default-pie \
	--enable-languages=c,c++

	# one or the other, NOT both

	[url "https://github"]
	insteadOf = git://github

	# or

	[url "[email protected]:"]
	insteadOf = git://github

	require "java"
	require "rubygems"
	require "sequel"
	require "sqljdbc4.jar" #this files path may need to be relevate to file location

	DB = Sequel.connect(
	:adapter => "jdbc",
	:url => "jdbc:sqlserver://doric-server5;database=ADCData_Doric;integratedSecurity=true"
	# This is using integrated security, might want to pass username and password
	# More Info at http://sequel.rubyforge.org/rdoc/files/doc/opening_databases_rdoc.html

	input {
	generator {
	lines => [
	"line 1",
	"line a"
	]
	count => 1
	}
	}

	# run this command in the root web directory
	find . -type d -exec touch {}/index.html \;

	http {
	log_format bodylog '$remote_addr - $remote_user [$time_local] '
	'"$request" $status $body_bytes_sent '
	'"$http_referer" "$http_user_agent" $request_time '
	'<"$request_body" >"$resp_body"';

	lua_need_request_body on;

	set $resp_body "";
	body_filter_by_lua '