Kwindla Hultman Kramer kwindla
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import aiohttp | |
| import asyncio | |
| import os | |
| import sys | |
| from pipecat.frames.frames import EndFrame | |
| from pipecat.pipeline.pipeline import Pipeline | |
| from pipecat.pipeline.task import PipelineParams, PipelineTask | |
| from pipecat.pipeline.runner import PipelineRunner | |
| from pipecat.processors.frameworks.rtvi import ( |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # Copyright (c) 2024, Daily | |
| # | |
| # SPDX-License-Identifier: BSD 2-Clause License | |
| # | |
| import aiohttp | |
| import argparse | |
| import os |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import asyncio | |
| import base64 | |
| import json | |
| import os | |
| import pyaudio | |
| import shutil | |
| import websockets | |
| class AudioStreamer: |
kwindla
/ gemini-talk.py
Created
December 11, 2024 16:45
Gemini Multimodal Live API minimal client (use headphones)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # installation: | |
| # | |
| # python3.12 -m venv venv | |
| # source venv/bin/activate | |
| # | |
| # pip install pyaudio websockets | |
| # usage: | |
| # | |
| # export GEMINI_API_KEY=... |
kwindla
/ gemini-lights-repro.py
Created
December 15, 2024 03:32
Gemini Multimodal Live compositional function calling test
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # usage: gemini-lights-repro.py --initial-message "Make a pretty sequence with the lights. Turn them on and off a few times. Pick nice colors." | |
| import argparse | |
| import asyncio | |
| import base64 | |
| import json | |
| import os | |
| import pyaudio | |
| import re | |
| import shutil |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| async def start_query_knowledge_base(function_name, llm, context): | |
| """Push a frame to the TTS service; this is handy when the LLM response might take a while.""" | |
| await llm.push_frame(TTSSpeakFrame("Please hold on while I look that order up for you.")) | |
| async def query_knowledge_base(function_name, tool_call_id, args, llm, context, result_callback): | |
| query_result = knowledge_base.get(args["query"]) | |
| await result_callback({ | |
| "info": json.dumps({ | |
| "lookup_success": True, | |
| "order_status": query_result["order_status"], |
kwindla
/ 19b-azure-realtime-beta.py
Created
March 1, 2025 23:15
Wrap Pipecat OpenAI Realtime API service to work with Azure WebSocket connection format
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # Copyright (c) 2024–2025, Daily | |
| # | |
| # SPDX-License-Identifier: BSD 2-Clause License | |
| # | |
| import asyncio | |
| import os | |
| import sys | |
| from datetime import datetime |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import asyncio | |
| import os | |
| import sys | |
| from dataclasses import dataclass | |
| import aiohttp | |
| import google.ai.generativelanguage as glm | |
| from dotenv import load_dotenv | |
| from loguru import logger | |
| from runner import configure |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import asyncio | |
| import os | |
| import sys | |
| from dataclasses import dataclass | |
| import aiohttp | |
| from dotenv import load_dotenv | |
| from loguru import logger | |
| from pipecat.audio.vad.silero import SileroVADAnalyzer |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2025-04-22 12:27:57.538 | INFO | 07-interruptible:run_bot:28 - Starting bot | |
| 2025-04-22 12:27:57.538 | DEBUG | pipecat.audio.vad.silero:__init__:111 - Loading Silero VAD model... | |
| 2025-04-22 12:27:57.564 | DEBUG | pipecat.audio.vad.silero:__init__:133 - Loaded Silero VAD | |
| 2025-04-22 12:27:57.583 | DEBUG | pipecat.processors.frame_processor:link:177 - Linking PipelineSource#0 -> SmallWebRTCInputTransport#0 | |
| 2025-04-22 12:27:57.583 | DEBUG | pipecat.processors.frame_processor:link:177 - Linking SmallWebRTCInputTransport#0 -> DeepgramSTTService#0 | |
| 2025-04-22 12:27:57.583 | DEBUG | pipecat.processors.frame_processor:link:177 - Linking DeepgramSTTService#0 -> OpenAIUserContextAggregator#0 | |
| 2025-04-22 12:27:57.583 | DEBUG | pipecat.processors.frame_processor:link:177 - Linking OpenAIUserContextAggregator#0 -> OpenAILLMService#0 | |
| 2025-04-22 12:27:57.583 | DEBUG | pipecat.processors.frame_processor:link:177 - Linking OpenAILLMService#0 -> CartesiaTTSService#0 | |
| 2025-04-22 12:27:57.583 | DEBUG | pip |