Skip to content

Instantly share code, notes, and snippets.

@seandearnaley
seandearnaley / model_metrics_may_25_24.csv
Created May 25, 2024 20:16
Model Metrics (Updated May 25th 2024)
Model Name Article Key Inference Rate (s) Valid JSON Rate Sentiment Variance Mean Sentiment Mean Confidence
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M f76ab0da 2.37 1.0 0.0 0.61 0.8
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M 3d6a60c0 1.88 1.0 0.01 -0.46 0.8
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M 136f0dde 2.62 1.0 0.0 0.01 0.9
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M ce972942 1.69 1.0 0.0 0.48 0.77
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M 028bdea3 2.66 1.0 0.0 -0.41 0.8
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M 6048aefc 2.7 1.0 0.02 0.56 0.79
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M 1e2173be 1.99 0.93 0.01 0.57 0.78
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M 3e1daab6 4.24 1.0 0.11 0.38 0.88
phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M abc67ae2 2.12 1.0 0.0 0.61 0.8