We have a dedicated PC running ollama, with ngrok + static domain + basic auth. Problem: ollama cli doesn't yet pass basic auth via $OLLAMA_HOST Solution: this wrapper script which runs a tmp caddy server. Replace the url, username, pass for your ngrok

ollama-via-proxy

#!/bin/bash

# Function to handle cleanup on script exit
cleanup() {
    echo "Cleaning up..."
    kill -TERM "$caddy_pid" 2>/dev/null
    rm -f "$caddy_config"
}

# Set up trap to call cleanup on EXIT, INT (Ctrl+C), and TERM signals
trap cleanup EXIT INT TERM

# Create a temporary Caddy configuration file
caddy_config=$(mktemp /tmp/Caddyfile.XXXXXX)

# Write the Caddy configuration to the temporary file
cat <<EOF > "$caddy_config"
:8080

basicauth / {
    username-here $(caddy hash-password -plaintext password-here)
}

reverse_proxy http://static-domain-on-ngrok.ngrok-free.app
EOF

# Start the Caddy proxy with the temporary configuration in the background
caddy run --config "$caddy_config" &
caddy_pid=$!

# Ensure Caddy has time to start (adjust if necessary)
sleep 2

# Set the OLLAMA_HOST environment variable to point to the local proxy
export OLLAMA_HOST="http://localhost:8080"

# Run the ollama command
ollama "$@"