To run this workshop locally, you'll need to set up Ollama and a Python environment using UV.
We’ll be running Gemma 2B locally with Ollama, so you need to set this up first. This step will require a large download (~10GB total) and some hardware considerations.
Download and install Ollama from https://ollama.com/.
Once installed, run the following commands in your terminal to download the models:
ollama pull gemma2:2b
ollama pull gemma2:2b-instruct-fp16
ollama pull gemma2:2b-instruct-q2_K
We’ll be using UV to manage dependencies. This ensures a lightweight, reproducible Python environment.
If you don’t have UV installed, first install it with:
pip install uv
uv venv gemma-app
Activate the environment:
- On macOS/Linux:
source gemma-app/bin/activate
- On Windows:
gemma-app\Scripts\activate
Once the environment is active, install all required Python packages:
uv pip install -r requirements.txt