Bret Fisher BretFisher

How to use this compose file to run Open WebUI on a local LLM running with Docker Model Runner

Enable Docker Model Runner (v4.40 or newer) in Settings or run the command:
- docker desktop enable model-runner --no-tcp
Download some models from https://hub.docker.com/u/ai
- docker model pull ai/qwen2.5:0.5B-F16
- docker model pull ai/smollm2:latest
- Be sure to only download models that you have the VRAM to run :)
Run the compose.yaml here to startup the Open WebUI on port 3000

you can run my published compose file directly (without needing to save the YAML locally) with docker compose -f oci://bretfisher/openwebui up

Kubernetes Mastery is Coming! But until then, I get one more coupon from Udemy in October and I want you to have them. Each course builds on the last, and more videos are coming to Docker Mastery this year:

$13.99 Docker Mastery: with Swarm & Kubernetes from a Docker Captain https://www.udemy.com/course/docker-mastery/?couponCode=OCT19AWESOME

$9.99 Docker Swarm Mastery: DevOps Style Cluster Orchestration https://www.udemy.com/course/docker-swarm-mastery/?couponCode=SCARY2019

	# syntax=docker/dockerfile:1
	FROM python:alpine

	# create the group and user
	RUN addgroup -g 1000 python \
	&& adduser -u 1000 -G python -D python

	# stating USER before WORKDIR means the directory is created with the non-root proper ownership
	USER python
	WORKDIR /app

	# Replace the "❯" symbol in the prompt with "🥃"
	[character]
	success_symbol = "[🥃](bold green)"

	[[battery.display]]
	threshold = 75 # only show me battery status below 75%

	[directory]
	truncation_length = 5
	truncation_symbol = '…/'

	# any images you use later, add them here first to create aliases
	# I like keeping all my versions at the top
	FROM node:14.3-slim as node
	FROM php:7.2.1-fpm-slim as php
	FROM nginx:1.17 as nginx

	# The real base image to start from
	FROM ubuntu:focal-20210827 as base

	# install apt stuff

	#!/usr/bin/env bash
	set -euo pipefail
	IFS=$'\n\t'

	DOMAIN_NAME=$1

	openssl req \
	-newkey rsa:2048 \
	-x509 \
	-nodes \

	#!/usr/bin/env bash
	set -euo pipefail
	IFS=$'\n\t'

	DOMAIN_NAME=$1

	openssl req \
	-newkey rsa:2048 \
	-x509 \
	-nodes \

	black = '#fbf1c7';
	red = '#cc241d'; // red
	green = '#98971a'; // green
	yellow = '#d79921'; // yellow
	blue = '#458588'; // blue
	magenta = '#b16286'; // pink
	cyan = '#689d6a'; // cyan
	white = '#7c6f64'; // light gray
	lightBlack = '#928374'; // medium gray
	lightRed = '#9d0006'; // red

	# this assumes your using oh-my-zsh for maximum zsh-ness
	# info and defaults are here:
	# https://github.com/robbyrussell/oh-my-zsh/blob/master/templates/zshrc.zsh-template

	export LC_ALL="en_US.UTF-8"
	export ZSH=/Users/bret/.oh-my-zsh

	# custom prompt theme
	ZSH_THEME="present" # mine is present, default is robbyrussell, also agnoster, fishy, ys, wild-cherry
	COMPLETION_WAITING_DOTS="true"

	dcb='docker-compose build'
	dcdn='docker-compose down'
	dce='docker-compose exec'
	dcl='docker-compose logs'
	dclf='docker-compose logs -f'
	dco=docker-compose
	dcps='docker-compose ps'
	dcr='docker-compose run'
	dcrestart='docker-compose restart'
	dcrm='docker-compose rm'