I'm using OSX 15.5 and using pyenv to switch python versions. Make sure you're using python3.
First follow the OSX Setup
https://docs.espressif.com/projects/esp-idf/en/v5.5/esp32s3/get-started/linux-macos-setup.html
Assuming all that worked and you managed to build and flash to your esp32 board from the command line then add this to your ~./zshrc
export IDF_PATH="/esp-idf"