First of all, this thing has abysmal official support from both Tailscale and Raspberry Pi.
Pi Zero W hardware is so old it can't even run Ubuntu server images (which I found out the hard way after failing to install ubuntu server onto it). So the only linux flavors that work on it are the ones that show up in the Raspberry Pi Imager. I decided to use Raspberry Pi OS Lite (32-bit variant).