The Objective Dad theobjectivedad

Building a VLLM Container Locally

This is a quick guide that demonstrates how to build a VLLM container locally.

First clone the VLLM branch/fork you would like to build:

git clone https://github.com/theobjectivedad/vllm.git src
cd src
git checkout outlines_subschemas

PydanticAI

This is an ugly and minimally tested workaround for folks who would like to use PydanticAI response model formatting with VLLM prior to 13002 being merged into VLLM. I've tested this avainst PydanticAI 0.0.46:

First apply this monkeypatch to PydanticAI. Basically it allows agent runs to specify named tools on model settings:

# 2025-03-30 Patched 0.0.46
# pylint: disable=protected-access
async def patched_completions_create(

This is a monkeypatch to workaround AutoGPTQ issue 459:

import os
import time
from logging import getLogger

import torch
import torch.nn as nn
import transformers

Serving miqu in aphrodite-engine

Quick instrustions on how to run miqu in the aphrodite-engine.

STEP 1: Convert GGUF to PyTorch format per documentation. I used the aphrodite-engine container to avoid setting up dependencies.

docker run --gpus=all -it --rm -v /models:/models -v `pwd`:/workspace alignmentlabai/aphrodite-engine:latest bash

This is the docker image I am using for Axolotl R&D. You may need to tweak TORCH_CUDA_ARCH_LIST to include your GPU architecture. There are several improvments over the official axolotl image including:

Non-root user
Cleaner dependency management
Better caching at buildtime
Highly parameterized build, useful for testing new Python dependencies / versions
Final stage uses Nvidia's runtime container which (hypothetically) should be smaller

Dockerfile

ThetaBot Response 20221221T184705Z

Question

what is the nature of reality?

Answer 1

The nature of reality is a complex and deeply debated philosophical question. Generally speaking, it refers to the nature of fundamental concepts such as existence, time, space, consciousness and so on. Different schools of thought have different answers, but the most widely accepted view is that reality is composed of physical, mental, and spiritual aspects that interact and shape our experience of the world.

ThetaBot Response 20221211T221421Z

Question

List the top 10 business capabilities for sustainability materials audit. Include a detailed description for each and how each capabilities adds business value.

Answer 1

Material Waste Reduction: Reducing materials waste during the production process can reduce costs and generate a more efficient process. This will ultimately lead to a higher bottom line.

ThetaBot Response 20221211T211238Z

Question

What are the 10 top service providers that offer sustainability certification validation services via an API. For example I want to validate that a material supplier's products are indeed 100% certified organic cotton. For each provider include distinguishing features, website URL, advantages/disadvantages, and industry standards they adhere to.

Answer 1

EcoVadis: EcoVadis is a global leader in the sustainability certification validation space. It provides an API that helps customers validate that products and materials are indeed what they claim to be. It offers a set of dedicated APIs for different types of certification and sustainability standards, including ISO, GRI, and other industry-related standards. It also includes an API for tracking and verifying certifications for products and raw materials. Website: https://www.ecovadis.com/ Advantages: Scalable platform, user-friendly interface, reliable and accurate data. Disadvantages: Potentially la

	#!/bin/bash
	# Copyright (c) 2025, The Objective Dad
	#
	# Permission is hereby granted, free of charge, to any person obtaining a copy of this software and
	# associated documentation files (the “Software”), to deal in the Software without restriction,
	# including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense,
	# and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so,
	# subject to the following conditions:
	#
	# The above copyright notice and this permission notice shall be included in all copies or substantial

	from typing import List, Optional

	from mcp.types import (
	EmbeddedResource,
	ImageContent,
	TextContent,
	)
	from mcp_agent import PromptMessageMultipart, RequestParams, TextContent
	from mcp_agent.agents.workflow.chain_agent import ChainAgent
	from mcp_agent.core.prompt import Prompt