Justin Justin99b
Justin99b
/ gist:f3f35cda95b4d86dd0cb8b48f23b34aa
Created
February 16, 2025 01:40
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| {%- macro json_to_python_type(json_spec) %} | |
| {%- set basic_type_map = { | |
| "string": "str", | |
| "number": "float", | |
| "integer": "int", | |
| "boolean": "bool" | |
| } %} | |
| {%- if basic_type_map[json_spec.type] is defined %} |
Justin99b
/ gist:80e71b1a37b4969de2c039c247a79724
Created
February 16, 2025 01:02
VLLM Command-r Tool Parser plugin
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Made by @Braunworks | |
| import re | |
| import json | |
| from typing import Sequence, Any, Union | |
| from vllm.entrypoints.openai.protocol import ( | |
| ChatCompletionRequest, | |
| DeltaFunctionCall, | |
| DeltaMessage, | |
| DeltaToolCall, |