neolaw84

Description: A Jupyter Notebook for the unsupervised clustering of faces in a directory, specifically optimized for biologically related individuals where the true number of unique identities is unknown.

How it works:

• Embeddings: Extracts facial embeddings using InsightFace (utilizing the antelopev2 model for maximum discriminative power between family members).
• Distance Calculation: Computes a pairwise cosine distance matrix.
• Dynamic Thresholding: Uses Agglomerative Clustering to group faces based on a strict distance threshold, determined by finding the valley in a bimodal distribution of the pairwise distances.
• Outputs: Generates a Pandas DataFrame mapping file paths to their respective cluster IDs.
• Visualization: Computes the geometric centroid of each group to visualize the top 3 representative images for valid clusters (ignoring small groups with fewer than 4 members).

neolaw84

Python Logger Best Practices

Situation

Depending on where the code runs (dev, staging or prod) and what the intention of the run (debug/dev, integration test, production runs), the called modules/components need to log differently.

Current Practices

Current practice includes some code snippets like this:

neolaw84

Microsoft Teams in Citrix with Linux Host (Ubuntu 20.04) Won't Detect Audio Devices

Situation

• Citrix (remote Windows 10 system) has Microsoft Teams Installed.
• Citrix client is installed in Linux Host.
• Microsoft Teams won't detect any audio device in Linux Host.

Pre-requisites

neolaw84

Install ROCm on Ubuntu 20.04.4 and Radeon RX570

Situation

Installing by closely following ROCm Installation Guide because :

• it misses to install libnuma-dev and libncurses5
• installing dkms breaks ROCm after reboot

Actions

neolaw84

Black Box App Needs Basic Authentication

Situation

We have a black box app (written in who-knows-what-language). This is usually a situation when we have an app running in a docker container. We need to enable very basic user/password authentication (to secure the site's content and to reduce chance of DDOS).

Action

Note: it is better to install and use WSGI parallel servers such as gunicorn but sometimes, for a docker app, that boat has already sailed.

neolaw84

Enabling SSH log-in to Google Cloud VM

Situation

We want to SSH into the newly created VM in Google Cloud. We already have the private key (id_rsa) and associated public key (id_rsa.pub)

Pre-requisites

• You should have permossions to run gcloud utility.

neolaw84

Setting up the Google Compute Engine Virtual Machine

Situation/Problem

Need to set-up a Google Compute Engine Virtual Machine for development jobs. We need:

• set-up ssh keys
• java and maven
• anaconda
• docker

neolaw84

Notes on RabbitMQ Clustering

RabbitMQ Clustering

I have experiences working in single-node RabbitMQ server. However, I don't have much experiences in a RabbitMQ cluster. This is the gist for myself after going through https://www.rabbitmq.com/clustering.html

Ways of Forming a Cluster

A RabbitMQ cluster can formed in a number of ways:

neolaw84

Creating a Spring Boot Web (REST) service with SSL

We will refer to: https://github.com/jonashackt/spring-boot-rest-clientcertificate

Full project is available at: https://github.com/neolaw84/spring_boot_web_with_ssl

Situation/Problem

To create an SSL secured web (REST) service with cliet authentication (X509) using Spring Boot.

neolaw84

Mirroring a Git Repository in Github

Situation/Problem

A git repository is present in local (or somewhere on the net) but it is not in github.

We want to replicate the commit history (and all branches) in github.

Action/Solution