Skip to content

Instantly share code, notes, and snippets.

View ricklamers's full-sized avatar

Rick Lamers ricklamers

535 followers · 31 following
View GitHub Profile
@ricklamers
ricklamers / groq-json-retry.py
Last active November 13, 2024 17:16
import json
import os
import time
from typing import List
from groq import Groq
from pydantic import BaseModel, Field
class Ingredient(BaseModel):
@ricklamers
ricklamers / thefastest.ai.sh
Created July 29, 2024 19:02
curl https://api.groq.com/openai/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $GROQ_API_KEY" \
-d '{
"model": "llama3-groq-70b-8192-tool-use-preview",
"messages": [
{
"role": "user",
"content": "I have a flight booked for July 14, 2024, the flight number is AA100. Please check the status for me."
}
@ricklamers
ricklamers / berkeley-tool-calling-leaderboard-data.csv
Created April 19, 2024 22:48
We can make this file beautiful and searchable if this error is corrected: It looks like row 3 should actually have 26 columns, instead of 25 in line 2.
Rank,Overall Acc,Model,Model Link,Organization,License,AST Summary,Exec Summary,Simple Function AST,Python Simple Function AST,Java Simple Function AST,JavaScript Simple Function AST,Multiple Functions AST,Parallel Functions AST,Parallel Multiple AST,Simple Function Exec,Python Simple Function Exec,REST Simple Function Exec,Multiple Functions Exec,Parallel Functions Exec,Parallel Multiple Exec,Relevance Detection,Cost ($ Per 1k Function Calls),Latency Mean (s),Latency Standard Deviation (s),Latency 95th Percentile (s)
1,78.76%,GPT-4-turbo-2024-04-09 (FC),https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo,OpenAI,Proprietary,81.70%,65.13%,73.82%,90.00%,33.00%,26.00%,89.50%,89.00%,74.50%,73.53%,83.00%,60.00%,70.00%,72.00%,45.00%,88.75%,4.79,5.68,6.67,20.07
2,73.71%,Claude-3-Opus-20240229 (FC tools-2024-04-04),https://www.anthropic.com/news/claude-3-family,Anthropic,Proprietary,70.35%,55.20%,80.91%,87.00%,61.00%,72.00%,91.00%,58.00%,51.50%,85.29%,85.00%,85.71%,74.00%,24.00%,37.50%,82.50%,30.65,12.63,3.
@ricklamers
ricklamers / open-ai-functions-ablation.ipynb
Created June 21, 2023 11:09
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ricklamers
ricklamers / hide-promoted-tweets.user.js
Last active May 11, 2023 06:50 — forked from cb372/hide-promoted-tweets.user.js
A simple userscript to hide promoted tweets on twitter.com
// ==UserScript==
// @name Lazyfoo Readable CSS
// @namespace codesthings.com
// @license MIT
// @version 1.1
// @description Adds a readable CSS to Lazyfoo's tutorials.
// @author JamesCodesThings
// @match *://*.twitter.com/*
// @grant GM_addStyle
// ==/UserScript==
@ricklamers
ricklamers / expand.js
Last active September 25, 2021 19:09
Expand all folders in VS Code (run in console)
function getUnexpandedListItems() {
return document.querySelectorAll(".monaco-list-row[aria-expanded=false]");
}
function expandItems(items) {
for (let item of items) {
item.click();
}
}
let nothingFoundFrequency = 0;