Skip to content

Instantly share code, notes, and snippets.

@ochafik
Created September 14, 2024 17:36
Show Gist options
  • Select an option

  • Save ochafik/652f57ffcf0bb3f86d48d0a0fe74f216 to your computer and use it in GitHub Desktop.

Select an option

Save ochafik/652f57ffcf0bb3f86d48d0a0fe74f216 to your computer and use it in GitHub Desktop.
llama-server payloads
{
"model": "gpt-3.5-turbo",
"stream": false,
"max_tokens": 100,
"messages": [
{
"role": "user",
"content": "Write a joke about computers"
}
]
}
{
"model": "gpt-3.5-turbo",
"stream": false,
"max_tokens": 10000,
"messages": [
{
"role": "user",
"content": "Write a long novel about relationships/"
}
]
}
{
"model": "gpt-3.5-turbo",
"stream": true,
"max_tokens": 1000,
"messages": [
{
"role": "user",
"content": "Print a hello world message with python."
}
]
}
{
"model": "gpt-3.5-turbo",
"stream": false,
"messages": [
{
"role": "user",
"content": "Print a hello world message with python."
}
],
"tools": [
{
"type": "function",
"function": {
"name": "ipython",
"description": "Runs code in an ipython interpreter and returns the result of the execution after 60 seconds.",
"parameters": {
"type": "object",
"properties": {
"code": {
"type": "string",
"description": "The code to run in the ipython interpreter."
}
},
"required": ["code"]
}
}
},
{
"type": "function",
"function": {
"name": "brave_search",
"description": "Executes a web search with Brave.",
"parameters": {
"type": "object",
"properties": {
"query": {
"type": "string",
"description": "The query to search for."
}
},
"required": ["query"]
}
}
},
{
"type": "function",
"function": {
"name": "wolfram_alpha",
"description": "Executes a query with Wolfram Alpha.",
"parameters": {
"type": "object",
"properties": {
"query": {
"type": "string",
"description": "The query to execute."
}
},
"required": ["query"]
}
}
},
{
"type": "function",
"function": {
"name": "test",
"description": "Runs a test.",
"parameters": {
"type": "object",
"properties": {
"condition": {
"type": "boolean",
"description": "The condition to test."
}
},
"required": ["condition"]
}
}
}
]
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment