Duy Nguyen nduytg

Pattern file: /etc/logstash/patterns/nginx Logstash shipper: /etc/logstash/conf.d/shipper.conf

Nginx http log module: http://nginx.org/en/docs/http/ngx_http_log_module.html

MicroService Proxy Gateway Solutions

Kong, Traefik, Caddy, Linkerd, Fabio, Vulcand, and Netflix Zuul seem to be the most common in microservice proxy/gateway solutions. Kubernetes Ingress is often a simple Ngnix, which is difficult to separate the popularity from other things.

Github Star Trend:

This is just a picture of this link from March 2, 2019

Originally, I had included some other solution

Lua 5.1 installed already

Installing luarocks

# yum install lua-devel
# wget http://luarocks.org/releases/luarocks-2.3.3.tar.gz
# tar -xzvf luarocks-2.2.1.tar.gz
# cd luarocks-2.2.1
# ./configure
# make bootstrap

I curate a list of interesting CLI tools, below are some command line tools that I personally love and use

tmux - Terminal multiplexer.
ripgrep - Search text for patterns fast.
fzf - Command-line fuzzy finder.
exa - Replacement for ls written in rust.
git - Version control.
create-react-app - Create React apps with no build configuration.
npx - Execute npm package binaries.
wifi-password - Get the password of the WiFi you're on.

Problem

The go command line tool needs to be able to fetch dependencies from your private GitLab, but authenticaiton is required.

This assumes your private GitLab is hosted at privategitlab.company.com.

Environment variables

The following environment variables are recommended:

export GO111MODULE=on
export GOPRIVATE=privategitlab.company.com

Argo CD Application Controller Custom Sharding

This short Go program uses a Fist-fit-decreasing Bin Packing algorithm to assign Kubernetes clusters to different Argo CD Application Controller shard based on their resources count. It bases its calculations on the output of the argocd-util cluster stats command. The output can be used to update the undocumented shard key of the cluster secrets.

Example usage

argocd-util cluster stats --namespace=argocd | go run reshard.go

	package main

	import (
	"fmt"
	"net/http"
	"sort"
	"time"
	)

	// a struct to hold the result from each request including an index

	DUMP
	// pod-name name of the postgres pod
	// postgres-user database user that is able to access the database
	// database-name name of the database
	kubectl exec [pod-name] -- bash -c "pg_dump -U [postgres-user] [database-name]" > database.sql

	RESTORE
	// pod-name name of the postgres pod
	// postgres-user database user that is able to access the database
	// database-name name of the database

	package main

	import (
	"context"
	"flag"
	"fmt"
	"log"
	"net/http"
	"os"
	"os/signal"

	ceph -w
	ceph health detail
	ceph osd df
	ceph osd find
	ceph osd blocked-by
	ceph osd pool ls detail
	ceph osd pool get rbd all

	ceph pg dump \| grep pgid
	ceph pg pgid