Clean Bash History

clean_history.sh

#!/bin/bash
#
# Cleans up garbage lines and duplicate entries.
#
# DEPENDENCIES:
#
# - rg:      cargo install ripgrep
# - unique:  go install github.com/ro-tex/unique@latest
# - sponge:  brew install moreutils
#
# INSTALLATION:
#
# - Makefile entry:
#
#   clean-history:
#   	./clean-history.sh "${HOME}/.zsh_history"
#
# - crontab entry:
#
#   */2 * * * * source $HOME/.profile && /usr/bin/make -C $HOME/Home/ clean-history
#
# NOTE:
#
# - When cleaning duplicate entries the most recent one is kept, to preserve
#   order when searching backwards.
# - This breaks in `make` due to the `#`, hence the stand-alone script.
# - Using `>` would clear the output file first, hence the `sponge`s.

FILE=$1

tail -r "$FILE" | unique -t | rg -v '^\#' | tail -r  | sponge "$FILE"

I'm so happy you find it useful!