Skip to content

Instantly share code, notes, and snippets.

@seandearnaley

seandearnaley/model_metrics.csv

Last active May 21, 2024 19:48
Show Gist options
  • Save seandearnaley/bb96d05fb5b8fab6c63e4d00a2c1bd6c to your computer and use it in GitHub Desktop.
Save seandearnaley/bb96d05fb5b8fab6c63e4d00a2c1bd6c to your computer and use it in GitHub Desktop.
Download ZIP
Model Metrics
Raw
model_metrics.csv
Model Name Article Key Inference Rate (s) Valid JSON Rate Sentiment Variance Mean Sentiment Mean Confidence
llama3_8b-instruct-sentiment_analysis-q4_K_M 63f711be 5.41 1.0 0.01 0.33 0.78
llama3_8b-instruct-sentiment_analysis-q4_K_M 1ed47412 1.9 1.0 0.02 -0.14 0.6
llama3_8b-instruct-sentiment_analysis-q4_K_M 5852d8b8 2.3 1.0 0.01 -0.53 0.8
llama3_8b-instruct-sentiment_analysis-q4_K_M 6f5003f2 4.02 1.0 0.06 0.56 0.81
llama3_8b-instruct-sentiment_analysis-q4_K_M 7be9fbd1 4.4 1.0 0.0 0.6 0.8
llama3_8b-instruct-sentiment_analysis-q4_K_M 7fe80a1c 2.68 1.0 0.0 0.6 0.8
llama3_8b-instruct-sentiment_analysis-q4_K_M bcdd3918 3.44 1.0 0.01 0.04 0.64
llama3_8b-instruct-sentiment_analysis-q4_K_M 302c8a97 1.51 1.0 0.0 0.0 0.71
llama3_8b-instruct-sentiment_analysis-q4_K_M 7be44b2c 1.54 1.0 0.26 -0.49 0.71
llama3_8b-instruct-sentiment_analysis-q4_K_M 4cf981ee 2.32 1.0 0.01 0.54 0.76
llama3_8b-instruct-sentiment_analysis-q4_K_M 2e7c99cd 5.17 1.0 0.0 0.79 0.89
llama3_8b-instruct-sentiment_analysis-q4_K_M b2530e0e 6.1 1.0 0.0 0.8 0.9
llama3_8b-instruct-sentiment_analysis-q4_K_M 3c0b1c59 3.29 1.0 0.0 0.94 0.91
llama3_8b-instruct-sentiment_analysis-q4_K_M 74832795 2.03 1.0 0.01 0.79 0.86
llama3_8b-instruct-sentiment_analysis-q4_K_M f2dfb8f6 3.97 1.0 0.0 0.59 0.8
llama3_8b-instruct-sentiment_analysis-q4_K_M 9092432e 3.6 1.0 0.01 0.16 0.64
llama3_8b-instruct-sentiment_analysis-q4_K_M 8e410aff 5.62 1.0 0.01 0.1 0.71
llama3_8b-instruct-sentiment_analysis-q4_K_M e4a31911 3.17 1.0 0.0 0.04 0.66
llama3_8b-instruct-sentiment_analysis-q4_K_M 4be7219f 7.17 1.0 0.01 0.76 0.88
llama3_8b-instruct-sentiment_analysis-q4_K_M fc5bc0ae 3.4 1.0 0.01 0.57 0.8
llama3_8b-instruct-sentiment_analysis-q5_K_M 63f711be 6.72 1.0 0.02 0.36 0.77
llama3_8b-instruct-sentiment_analysis-q5_K_M 1ed47412 2.46 1.0 0.02 -0.03 0.62
llama3_8b-instruct-sentiment_analysis-q5_K_M 5852d8b8 3.27 1.0 0.0 -0.4 0.76
llama3_8b-instruct-sentiment_analysis-q5_K_M 6f5003f2 4.6 1.0 0.05 0.56 0.81
llama3_8b-instruct-sentiment_analysis-q5_K_M 7be9fbd1 5.46 1.0 0.01 0.53 0.78
llama3_8b-instruct-sentiment_analysis-q5_K_M 7fe80a1c 3.55 1.0 0.0 0.6 0.8
llama3_8b-instruct-sentiment_analysis-q5_K_M bcdd3918 4.34 1.0 0.03 0.06 0.74
llama3_8b-instruct-sentiment_analysis-q5_K_M 302c8a97 1.84 1.0 0.0 0.0 0.63
llama3_8b-instruct-sentiment_analysis-q5_K_M 7be44b2c 2.05 1.0 0.19 -0.31 0.76
llama3_8b-instruct-sentiment_analysis-q5_K_M 4cf981ee 1.72 1.0 0.0 0.0 0.81
llama3_8b-instruct-sentiment_analysis-q5_K_M 2e7c99cd 6.0 1.0 0.0 0.8 0.9
llama3_8b-instruct-sentiment_analysis-q5_K_M b2530e0e 7.41 1.0 0.0 0.8 0.9
llama3_8b-instruct-sentiment_analysis-q5_K_M 3c0b1c59 4.14 1.0 0.0 0.91 0.95
llama3_8b-instruct-sentiment_analysis-q5_K_M 74832795 1.72 1.0 0.0 1.0 0.6
llama3_8b-instruct-sentiment_analysis-q5_K_M f2dfb8f6 5.38 1.0 0.0 0.6 0.8
llama3_8b-instruct-sentiment_analysis-q5_K_M 9092432e 3.72 1.0 0.06 0.24 0.7
llama3_8b-instruct-sentiment_analysis-q5_K_M 8e410aff 7.11 1.0 0.01 0.09 0.71
llama3_8b-instruct-sentiment_analysis-q5_K_M e4a31911 3.95 1.0 0.11 0.23 0.7
llama3_8b-instruct-sentiment_analysis-q5_K_M 4be7219f 8.66 1.0 0.02 0.76 0.89
llama3_8b-instruct-sentiment_analysis-q5_K_M fc5bc0ae 4.26 1.0 0.02 0.52 0.78
llama3_8b-instruct-sentiment_analysis-q8_0 63f711be 8.1 1.0 0.01 0.18 0.66
llama3_8b-instruct-sentiment_analysis-q8_0 1ed47412 3.12 1.0 0.02 -0.02 0.62
llama3_8b-instruct-sentiment_analysis-q8_0 5852d8b8 3.84 1.0 0.0 -0.4 0.76
llama3_8b-instruct-sentiment_analysis-q8_0 6f5003f2 5.55 1.0 0.03 0.61 0.84
llama3_8b-instruct-sentiment_analysis-q8_0 7be9fbd1 6.41 1.0 0.02 0.52 0.79
llama3_8b-instruct-sentiment_analysis-q8_0 7fe80a1c 4.04 1.0 0.0 0.61 0.8
llama3_8b-instruct-sentiment_analysis-q8_0 bcdd3918 5.38 1.0 0.03 0.09 0.72
llama3_8b-instruct-sentiment_analysis-q8_0 302c8a97 2.07 1.0 0.2 -0.29 0.67
llama3_8b-instruct-sentiment_analysis-q8_0 7be44b2c 2.18 1.0 0.2 -0.3 0.83
llama3_8b-instruct-sentiment_analysis-q8_0 4cf981ee 3.06 1.0 0.08 0.43 0.8
llama3_8b-instruct-sentiment_analysis-q8_0 2e7c99cd 6.56 1.0 0.01 0.76 0.88
llama3_8b-instruct-sentiment_analysis-q8_0 b2530e0e 7.93 1.0 0.0 0.8 0.9
llama3_8b-instruct-sentiment_analysis-q8_0 3c0b1c59 4.22 1.0 0.0 0.94 0.97
llama3_8b-instruct-sentiment_analysis-q8_0 74832795 1.99 1.0 0.0 1.0 0.57
llama3_8b-instruct-sentiment_analysis-q8_0 f2dfb8f6 5.69 1.0 0.0 0.61 0.81
llama3_8b-instruct-sentiment_analysis-q8_0 9092432e 4.45 1.0 0.01 0.14 0.66
llama3_8b-instruct-sentiment_analysis-q8_0 8e410aff 7.15 1.0 0.0 0.08 0.69
llama3_8b-instruct-sentiment_analysis-q8_0 e4a31911 5.07 0.93 0.12 0.23 0.7
llama3_8b-instruct-sentiment_analysis-q8_0 4be7219f 9.23 1.0 0.05 0.63 0.84
llama3_8b-instruct-sentiment_analysis-q8_0 fc5bc0ae 4.92 1.0 0.05 0.57 0.8
llama3_8b-instruct-sentiment_analysis-fp16 63f711be 11.8 1.0 0.01 0.17 0.67
llama3_8b-instruct-sentiment_analysis-fp16 1ed47412 5.13 1.0 0.01 -0.07 0.62
llama3_8b-instruct-sentiment_analysis-fp16 5852d8b8 6.53 1.0 0.0 -0.41 0.76
llama3_8b-instruct-sentiment_analysis-fp16 6f5003f2 8.47 1.0 0.07 0.5 0.82
llama3_8b-instruct-sentiment_analysis-fp16 7be9fbd1 9.4 1.0 0.03 0.51 0.77
llama3_8b-instruct-sentiment_analysis-fp16 7fe80a1c 7.18 1.0 0.0 0.6 0.8
llama3_8b-instruct-sentiment_analysis-fp16 bcdd3918 9.46 1.0 0.06 0.13 0.72
llama3_8b-instruct-sentiment_analysis-fp16 302c8a97 3.37 1.0 0.0 0.0 0.77
llama3_8b-instruct-sentiment_analysis-fp16 7be44b2c 3.29 1.0 0.24 -0.57 0.67
llama3_8b-instruct-sentiment_analysis-fp16 4cf981ee 5.05 1.0 0.08 0.43 0.75
llama3_8b-instruct-sentiment_analysis-fp16 2e7c99cd 10.15 1.0 0.0 0.79 0.89
llama3_8b-instruct-sentiment_analysis-fp16 b2530e0e 11.95 1.0 0.0 0.8 0.9
llama3_8b-instruct-sentiment_analysis-fp16 3c0b1c59 6.63 1.0 0.0 0.94 0.97
llama3_8b-instruct-sentiment_analysis-fp16 74832795 3.27 1.0 0.0 1.0 0.59
llama3_8b-instruct-sentiment_analysis-fp16 f2dfb8f6 8.92 1.0 0.01 0.6 0.81
llama3_8b-instruct-sentiment_analysis-fp16 9092432e 7.15 1.0 0.07 0.24 0.71
llama3_8b-instruct-sentiment_analysis-fp16 8e410aff 10.56 1.0 0.01 0.11 0.74
llama3_8b-instruct-sentiment_analysis-fp16 e4a31911 8.2 1.0 0.06 0.11 0.72
llama3_8b-instruct-sentiment_analysis-fp16 4be7219f 11.9 1.0 0.04 0.7 0.87
llama3_8b-instruct-sentiment_analysis-fp16 fc5bc0ae 8.42 1.0 0.06 0.56 0.79
llama3_8b-instruct-q4_K_M 63f711be 4.73 1.0 0.04 0.44 0.85
llama3_8b-instruct-q4_K_M 1ed47412 2.22 1.0 0.0 0.0 0.89
llama3_8b-instruct-q4_K_M 5852d8b8 2.97 1.0 0.05 -0.08 0.75
llama3_8b-instruct-q4_K_M 6f5003f2 4.02 1.0 0.02 0.62 0.85
llama3_8b-instruct-q4_K_M 7be9fbd1 4.49 1.0 0.1 0.57 0.86
llama3_8b-instruct-q4_K_M 7fe80a1c 2.7 1.0 0.02 0.71 0.87
llama3_8b-instruct-q4_K_M bcdd3918 2.57 1.0 0.05 0.76 0.92
llama3_8b-instruct-q4_K_M 302c8a97 2.36 1.0 0.02 -0.58 0.85
llama3_8b-instruct-q4_K_M 7be44b2c 2.9 1.0 0.01 0.38 0.77
llama3_8b-instruct-q4_K_M 4cf981ee 3.22 1.0 0.0 0.01 0.95
llama3_8b-instruct-q4_K_M 2e7c99cd 4.94 1.0 0.0 0.78 0.9
llama3_8b-instruct-q4_K_M b2530e0e 5.69 1.0 0.0 0.78 0.9
llama3_8b-instruct-q4_K_M 3c0b1c59 4.05 1.0 0.0 0.84 0.92
llama3_8b-instruct-q4_K_M 74832795 2.09 1.0 0.01 0.62 0.83
llama3_8b-instruct-q4_K_M f2dfb8f6 3.71 1.0 0.04 0.58 0.85
llama3_8b-instruct-q4_K_M 9092432e 3.35 1.0 0.03 0.26 0.81
llama3_8b-instruct-q4_K_M 8e410aff 5.77 1.0 0.02 0.22 0.84
llama3_8b-instruct-q4_K_M e4a31911 1.93 1.0 0.0 0.0 1.0
llama3_8b-instruct-q4_K_M 4be7219f 7.87 1.0 0.0 0.78 0.91
llama3_8b-instruct-q4_K_M fc5bc0ae 3.32 1.0 0.06 0.58 0.85
llama3_8b-instruct-q5_K_M 63f711be 6.63 1.0 0.01 0.41 0.84
llama3_8b-instruct-q5_K_M 1ed47412 3.07 1.0 0.05 -0.17 0.91
llama3_8b-instruct-q5_K_M 5852d8b8 3.79 1.0 0.03 -0.06 0.72
llama3_8b-instruct-q5_K_M 6f5003f2 4.54 1.0 0.07 0.51 0.84
llama3_8b-instruct-q5_K_M 7be9fbd1 4.88 1.0 0.04 0.57 0.86
llama3_8b-instruct-q5_K_M 7fe80a1c 3.02 1.0 0.01 0.7 0.86
llama3_8b-instruct-q5_K_M bcdd3918 3.11 1.0 0.04 0.75 0.89
llama3_8b-instruct-q5_K_M 302c8a97 2.69 1.0 0.02 -0.6 0.84
llama3_8b-instruct-q5_K_M 7be44b2c 3.45 1.0 0.01 0.28 0.73
llama3_8b-instruct-q5_K_M 4cf981ee 3.86 1.0 0.07 0.01 0.8
llama3_8b-instruct-q5_K_M 2e7c99cd 5.63 1.0 0.0 0.79 0.89
llama3_8b-instruct-q5_K_M b2530e0e 7.01 1.0 0.0 0.77 0.87
llama3_8b-instruct-q5_K_M 3c0b1c59 4.32 1.0 0.0 0.85 0.93
llama3_8b-instruct-q5_K_M 74832795 2.82 1.0 0.0 0.72 0.85
llama3_8b-instruct-q5_K_M f2dfb8f6 4.44 1.0 0.0 0.63 0.85
llama3_8b-instruct-q5_K_M 9092432e 4.05 1.0 0.01 0.1 0.85
llama3_8b-instruct-q5_K_M 8e410aff 6.63 1.0 0.03 0.16 0.83
llama3_8b-instruct-q5_K_M e4a31911 2.35 1.0 0.0 0.0 1.0
llama3_8b-instruct-q5_K_M 4be7219f 8.35 1.0 0.0 0.8 0.9
llama3_8b-instruct-q5_K_M fc5bc0ae 3.93 1.0 0.07 0.47 0.85
llama3_8b-instruct-q8_0 63f711be 7.4 1.0 0.01 0.47 0.84
llama3_8b-instruct-q8_0 1ed47412 3.89 1.0 0.05 -0.17 0.85
llama3_8b-instruct-q8_0 5852d8b8 4.55 1.0 0.03 -0.0 0.72
llama3_8b-instruct-q8_0 6f5003f2 5.14 1.0 0.08 0.49 0.84
llama3_8b-instruct-q8_0 7be9fbd1 5.36 1.0 0.06 0.44 0.83
llama3_8b-instruct-q8_0 7fe80a1c 3.71 1.0 0.0 0.72 0.85
llama3_8b-instruct-q8_0 bcdd3918 3.58 1.0 0.01 0.78 0.88
llama3_8b-instruct-q8_0 302c8a97 3.15 1.0 0.02 -0.66 0.85
llama3_8b-instruct-q8_0 7be44b2c 4.29 1.0 0.02 0.28 0.73
llama3_8b-instruct-q8_0 4cf981ee 4.44 1.0 0.0 0.0 0.87
llama3_8b-instruct-q8_0 2e7c99cd 5.73 1.0 0.0 0.8 0.9
llama3_8b-instruct-q8_0 b2530e0e 7.07 1.0 0.0 0.75 0.86
llama3_8b-instruct-q8_0 3c0b1c59 5.26 1.0 0.0 0.89 0.89
llama3_8b-instruct-q8_0 74832795 3.16 1.0 0.0 0.67 0.83
llama3_8b-instruct-q8_0 f2dfb8f6 5.27 1.0 0.0 0.61 0.84
llama3_8b-instruct-q8_0 9092432e 4.65 1.0 0.02 0.15 0.82
llama3_8b-instruct-q8_0 8e410aff 6.89 1.0 0.0 0.04 0.81
llama3_8b-instruct-q8_0 e4a31911 3.05 1.0 0.0 0.02 0.99
llama3_8b-instruct-q8_0 4be7219f 7.98 1.0 0.0 0.79 0.89
llama3_8b-instruct-q8_0 fc5bc0ae 4.59 1.0 0.07 0.41 0.84
llama3_8b-instruct-fp16 63f711be 10.74 1.0 0.02 0.37 0.84
llama3_8b-instruct-fp16 1ed47412 6.01 1.0 0.04 -0.09 0.87
llama3_8b-instruct-fp16 5852d8b8 7.77 1.0 0.04 -0.06 0.71
llama3_8b-instruct-fp16 6f5003f2 8.34 1.0 0.09 0.48 0.84
llama3_8b-instruct-fp16 7be9fbd1 8.97 1.0 0.09 0.37 0.84
llama3_8b-instruct-fp16 7fe80a1c 6.5 1.0 0.01 0.71 0.85
llama3_8b-instruct-fp16 bcdd3918 5.93 1.0 0.01 0.79 0.88
llama3_8b-instruct-fp16 302c8a97 5.29 1.0 0.03 -0.64 0.87
llama3_8b-instruct-fp16 7be44b2c 7.69 1.0 0.01 0.21 0.72
llama3_8b-instruct-fp16 4cf981ee 7.29 1.0 0.02 -0.03 0.87
llama3_8b-instruct-fp16 2e7c99cd 8.4 1.0 0.0 0.8 0.9
llama3_8b-instruct-fp16 b2530e0e 11.44 1.0 0.0 0.76 0.87
llama3_8b-instruct-fp16 3c0b1c59 8.73 1.0 0.0 0.86 0.9
llama3_8b-instruct-fp16 74832795 5.56 1.0 0.0 0.65 0.83
llama3_8b-instruct-fp16 f2dfb8f6 7.93 1.0 0.02 0.59 0.85
llama3_8b-instruct-fp16 9092432e 7.25 1.0 0.03 0.23 0.85
llama3_8b-instruct-fp16 8e410aff 9.65 1.0 0.02 0.09 0.82
llama3_8b-instruct-fp16 e4a31911 4.58 1.0 0.0 0.0 1.0
llama3_8b-instruct-fp16 4be7219f 11.07 1.0 0.0 0.81 0.9
llama3_8b-instruct-fp16 fc5bc0ae 7.64 1.0 0.07 0.37 0.84
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 63f711be 6.24 1.0 0.02 0.26 0.75
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 1ed47412 2.68 1.0 0.08 0.38 0.71
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 5852d8b8 2.64 1.0 0.01 -0.57 0.81
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 6f5003f2 3.97 1.0 0.03 0.23 0.65
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 7be9fbd1 5.45 1.0 0.01 0.64 0.84
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 7fe80a1c 2.95 1.0 0.03 0.58 0.81
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M bcdd3918 3.48 1.0 0.01 0.63 0.82
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 302c8a97 1.44 1.0 0.0 0.0 0.7
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 7be44b2c 3.06 1.0 0.02 0.07 0.63
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 4cf981ee 2.55 1.0 0.01 0.66 0.8
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 2e7c99cd 5.29 1.0 0.0 0.85 0.9
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M b2530e0e 5.87 1.0 0.01 0.74 0.87
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 3c0b1c59 3.85 1.0 0.0 0.85 0.91
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 74832795 1.34 1.0 0.0 1.0 0.53
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M f2dfb8f6 4.05 1.0 0.06 0.44 0.74
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 9092432e 3.97 1.0 0.02 0.36 0.73
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 8e410aff 6.56 1.0 0.06 0.49 0.78
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M e4a31911 2.44 1.0 0.0 0.64 0.84
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M 4be7219f 8.16 1.0 0.0 0.84 0.9
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q4_K_M fc5bc0ae 3.26 1.0 0.03 0.51 0.76
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 63f711be 7.69 1.0 0.02 0.28 0.75
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 1ed47412 3.47 1.0 0.02 0.59 0.77
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 5852d8b8 3.14 1.0 0.01 -0.51 0.8
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 6f5003f2 5.24 1.0 0.02 0.19 0.66
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 7be9fbd1 6.5 1.0 0.01 0.62 0.8
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 7fe80a1c 3.72 1.0 0.02 0.6 0.82
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M bcdd3918 4.05 1.0 0.0 0.59 0.8
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 302c8a97 1.77 1.0 0.0 0.0 0.61
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 7be44b2c 3.44 1.0 0.03 0.05 0.61
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 4cf981ee 2.99 1.0 0.01 0.7 0.85
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 2e7c99cd 6.48 1.0 0.01 0.8 0.89
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M b2530e0e 6.88 1.0 0.0 0.68 0.86
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 3c0b1c59 5.03 1.0 0.0 0.85 0.92
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 74832795 1.65 1.0 0.0 1.0 0.54
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M f2dfb8f6 4.48 1.0 0.0 0.57 0.77
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 9092432e 4.85 1.0 0.02 0.34 0.71
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 8e410aff 7.94 1.0 0.06 0.31 0.73
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M e4a31911 3.26 1.0 0.0 0.65 0.85
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M 4be7219f 9.22 1.0 0.0 0.85 0.9
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q5_K_M fc5bc0ae 4.07 1.0 0.03 0.52 0.78
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 63f711be 8.39 1.0 0.02 0.4 0.75
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 1ed47412 4.04 1.0 0.01 0.61 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 5852d8b8 3.6 1.0 0.01 -0.49 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 6f5003f2 5.73 1.0 0.04 0.28 0.65
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 7be9fbd1 6.89 1.0 0.01 0.6 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 7fe80a1c 4.32 1.0 0.02 0.6 0.82
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 bcdd3918 5.15 1.0 0.03 0.56 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 302c8a97 1.98 1.0 0.0 0.0 0.69
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 7be44b2c 4.56 1.0 0.01 0.11 0.61
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 4cf981ee 3.52 1.0 0.07 0.62 0.81
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 2e7c99cd 7.04 1.0 0.01 0.81 0.89
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 b2530e0e 7.39 1.0 0.01 0.74 0.87
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 3c0b1c59 5.74 1.0 0.0 0.85 0.92
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 74832795 1.89 1.0 0.0 1.0 0.49
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 f2dfb8f6 5.68 1.0 0.0 0.59 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 9092432e 5.61 1.0 0.02 0.31 0.72
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 8e410aff 7.82 1.0 0.05 0.48 0.77
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 e4a31911 3.82 1.0 0.0 0.62 0.82
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 4be7219f 8.77 1.0 0.0 0.85 0.9
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.Q8 fc5bc0ae 4.7 1.0 0.03 0.44 0.75
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 63f711be 13.29 1.0 0.02 0.28 0.75
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 1ed47412 6.84 1.0 0.09 0.46 0.73
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 5852d8b8 5.99 1.0 0.01 -0.5 0.77
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 6f5003f2 9.15 1.0 0.02 0.17 0.63
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 7be9fbd1 11.43 1.0 0.0 0.61 0.81
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 7fe80a1c 7.14 1.0 0.0 0.62 0.82
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 bcdd3918 8.78 1.0 0.0 0.58 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 302c8a97 3.23 1.0 0.0 0.0 0.7
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 7be44b2c 7.78 1.0 0.02 0.09 0.63
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 4cf981ee 5.49 1.0 0.06 0.57 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 2e7c99cd 10.22 1.0 0.01 0.8 0.89
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 b2530e0e 11.48 1.0 0.01 0.72 0.87
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 3c0b1c59 9.06 1.0 0.0 0.85 0.93
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 74832795 3.15 1.0 0.0 1.0 0.53
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 f2dfb8f6 8.1 1.0 0.0 0.57 0.77
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 9092432e 9.16 1.0 0.02 0.36 0.72
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 8e410aff 11.47 1.0 0.05 0.44 0.79
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 e4a31911 6.92 1.0 0.0 0.62 0.82
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 4be7219f 12.16 1.0 0.0 0.82 0.89
mistral-7b-sentiment-may-18-2024-1epoch-unsloth.F16 fc5bc0ae 8.44 1.0 0.01 0.58 0.8
mistral_7b-instruct-q4_K_M 63f711be 5.76 0.71 0.01 0.44 0.83
mistral_7b-instruct-q4_K_M 1ed47412 2.94 0.5 0.09 0.34 0.81
mistral_7b-instruct-q4_K_M 5852d8b8 2.93 0.93 0.02 -0.26 0.81
mistral_7b-instruct-q4_K_M 6f5003f2 3.5 0.86 0.0 0.56 0.91
mistral_7b-instruct-q4_K_M 7be9fbd1 4.72 0.79 0.0 0.67 0.93
mistral_7b-instruct-q4_K_M 7fe80a1c 3.0 0.64 0.07 0.46 0.86
mistral_7b-instruct-q4_K_M bcdd3918 2.71 0.57 0.02 0.53 0.86
mistral_7b-instruct-q4_K_M 302c8a97 2.78 0.93 0.0 0.2 0.81
mistral_7b-instruct-q4_K_M 7be44b2c 3.22 0.71 0.01 0.13 0.88
mistral_7b-instruct-q4_K_M 4cf981ee 2.85 0.36 0.01 0.51 0.67
mistral_7b-instruct-q4_K_M 2e7c99cd 5.97 0.57 0.02 0.65 0.9
mistral_7b-instruct-q4_K_M b2530e0e 7.35 1.0 0.01 0.69 0.92
mistral_7b-instruct-q4_K_M 3c0b1c59 4.01 0.86 0.0 0.88 0.92
mistral_7b-instruct-q4_K_M 74832795 2.82 0.86 0.02 0.54 0.91
mistral_7b-instruct-q4_K_M f2dfb8f6 5.08 0.64 0.02 0.59 0.87
mistral_7b-instruct-q4_K_M 9092432e 3.5 0.64 0.02 0.41 0.81
mistral_7b-instruct-q4_K_M 8e410aff 6.81 0.79 0.02 0.56 0.82
mistral_7b-instruct-q4_K_M e4a31911 2.71 0.79 0.02 0.27 0.83
mistral_7b-instruct-q4_K_M 4be7219f 8.42 0.64 0.02 0.63 0.85
mistral_7b-instruct-q4_K_M fc5bc0ae 5.44 0.71 0.0 0.54 0.86
mistral_7b-instruct-q5_K_M 63f711be 6.28 1.0 0.01 0.46 0.82
mistral_7b-instruct-q5_K_M 1ed47412 2.88 0.43 0.07 0.33 0.78
mistral_7b-instruct-q5_K_M 5852d8b8 3.86 0.86 0.06 -0.14 0.83
mistral_7b-instruct-q5_K_M 6f5003f2 4.31 0.57 0.02 0.65 0.9
mistral_7b-instruct-q5_K_M 7be9fbd1 5.33 0.93 0.01 0.65 0.9
mistral_7b-instruct-q5_K_M 7fe80a1c 4.18 0.79 0.03 0.56 0.86
mistral_7b-instruct-q5_K_M bcdd3918 4.09 0.79 0.02 0.64 0.92
mistral_7b-instruct-q5_K_M 302c8a97 3.49 0.93 0.08 0.11 0.79
mistral_7b-instruct-q5_K_M 7be44b2c 3.29 0.64 0.0 0.14 0.82
mistral_7b-instruct-q5_K_M 4cf981ee 3.59 0.79 0.01 0.7 0.86
mistral_7b-instruct-q5_K_M 2e7c99cd 7.54 0.64 0.06 0.59 0.82
mistral_7b-instruct-q5_K_M b2530e0e 7.3 0.93 0.04 0.62 0.89
mistral_7b-instruct-q5_K_M 3c0b1c59 4.31 0.93 0.0 0.89 0.92
mistral_7b-instruct-q5_K_M 74832795 3.76 0.86 0.04 0.62 0.93
mistral_7b-instruct-q5_K_M f2dfb8f6 4.83 0.5 0.0 0.49 0.81
mistral_7b-instruct-q5_K_M 9092432e 5.99 0.93 0.13 0.23 0.79
mistral_7b-instruct-q5_K_M 8e410aff 9.06 0.79 0.01 0.57 0.82
mistral_7b-instruct-q5_K_M e4a31911 3.08 0.79 0.01 0.24 0.82
mistral_7b-instruct-q5_K_M 4be7219f 9.14 1.0 0.01 0.63 0.86
mistral_7b-instruct-q5_K_M fc5bc0ae 6.56 0.86 0.01 0.63 0.89
mistral_7b-instruct-q8_0 63f711be 6.01 1.0 0.0 0.5 0.81
mistral_7b-instruct-q8_0 1ed47412 4.06 0.79 0.1 0.41 0.85
mistral_7b-instruct-q8_0 5852d8b8 4.41 0.79 0.06 -0.09 0.82
mistral_7b-instruct-q8_0 6f5003f2 4.77 0.64 0.0 0.57 0.88
mistral_7b-instruct-q8_0 7be9fbd1 6.32 0.93 0.01 0.59 0.86
mistral_7b-instruct-q8_0 7fe80a1c 4.74 0.64 0.03 0.56 0.88
mistral_7b-instruct-q8_0 bcdd3918 3.89 0.64 0.01 0.58 0.88
mistral_7b-instruct-q8_0 302c8a97 3.93 0.79 0.0 0.2 0.79
mistral_7b-instruct-q8_0 7be44b2c 4.1 0.86 0.0 0.16 0.79
mistral_7b-instruct-q8_0 4cf981ee 4.24 0.79 0.01 0.7 0.88
mistral_7b-instruct-q8_0 2e7c99cd 7.35 0.71 0.01 0.67 0.86
mistral_7b-instruct-q8_0 b2530e0e 8.87 0.93 0.01 0.7 0.92
mistral_7b-instruct-q8_0 3c0b1c59 4.98 1.0 0.0 0.87 0.91
mistral_7b-instruct-q8_0 74832795 4.34 0.93 0.05 0.51 0.95
mistral_7b-instruct-q8_0 f2dfb8f6 5.68 0.86 0.0 0.5 0.84
mistral_7b-instruct-q8_0 9092432e 5.66 0.86 0.03 0.34 0.82
mistral_7b-instruct-q8_0 8e410aff 10.04 1.0 0.01 0.56 0.81
mistral_7b-instruct-q8_0 e4a31911 3.67 0.79 0.01 0.25 0.81
mistral_7b-instruct-q8_0 4be7219f 9.04 0.86 0.01 0.68 0.86
mistral_7b-instruct-q8_0 fc5bc0ae 6.33 0.5 0.01 0.64 0.86
mistral_7b-instruct-fp16 63f711be 9.02 0.93 0.01 0.45 0.83
mistral_7b-instruct-fp16 1ed47412 8.52 0.79 0.08 0.43 0.82
mistral_7b-instruct-fp16 5852d8b8 7.55 0.86 0.01 -0.28 0.85
mistral_7b-instruct-fp16 6f5003f2 7.42 0.64 0.01 0.62 0.9
mistral_7b-instruct-fp16 7be9fbd1 10.87 0.79 0.01 0.58 0.87
mistral_7b-instruct-fp16 7fe80a1c 7.98 0.93 0.01 0.49 0.84
mistral_7b-instruct-fp16 bcdd3918 5.91 0.57 0.02 0.62 0.87
mistral_7b-instruct-fp16 302c8a97 6.51 0.93 0.04 0.08 0.81
mistral_7b-instruct-fp16 7be44b2c 6.55 0.79 0.01 0.18 0.8
mistral_7b-instruct-fp16 4cf981ee 7.12 0.5 0.0 0.74 0.89
mistral_7b-instruct-fp16 2e7c99cd 12.33 0.71 0.05 0.61 0.83
mistral_7b-instruct-fp16 b2530e0e 12.19 1.0 0.02 0.65 0.9
mistral_7b-instruct-fp16 3c0b1c59 7.98 1.0 0.0 0.89 0.9
mistral_7b-instruct-fp16 74832795 6.52 0.93 0.05 0.41 0.92
mistral_7b-instruct-fp16 f2dfb8f6 8.65 0.64 0.01 0.54 0.84
mistral_7b-instruct-fp16 9092432e 9.52 0.64 0.06 0.26 0.81
mistral_7b-instruct-fp16 8e410aff 12.81 0.86 0.0 0.49 0.8
mistral_7b-instruct-fp16 e4a31911 6.04 0.64 0.01 0.23 0.82
mistral_7b-instruct-fp16 4be7219f 12.34 0.93 0.01 0.63 0.87
mistral_7b-instruct-fp16 fc5bc0ae 9.26 0.21 0.0 0.69 0.95
dolphin-mistral_7b-v2.8-q4_K_M 63f711be 5.31 1.0 0.0 0.65 0.82
dolphin-mistral_7b-v2.8-q4_K_M 1ed47412 2.5 1.0 0.05 0.26 0.87
dolphin-mistral_7b-v2.8-q4_K_M 5852d8b8 2.74 1.0 0.06 0.26 0.88
dolphin-mistral_7b-v2.8-q4_K_M 6f5003f2 3.89 1.0 0.0 0.73 0.85
dolphin-mistral_7b-v2.8-q4_K_M 7be9fbd1 4.61 1.0 0.0 0.77 0.9
dolphin-mistral_7b-v2.8-q4_K_M 7fe80a1c 2.5 1.0 0.0 0.69 0.86
dolphin-mistral_7b-v2.8-q4_K_M bcdd3918 2.79 1.0 0.07 0.56 0.89
dolphin-mistral_7b-v2.8-q4_K_M 302c8a97 2.35 1.0 0.0 0.16 0.84
dolphin-mistral_7b-v2.8-q4_K_M 7be44b2c 3.04 1.0 0.02 0.57 0.81
dolphin-mistral_7b-v2.8-q4_K_M 4cf981ee 2.73 1.0 0.0 0.74 0.89
dolphin-mistral_7b-v2.8-q4_K_M 2e7c99cd 4.87 1.0 0.0 0.78 0.9
dolphin-mistral_7b-v2.8-q4_K_M b2530e0e 6.57 1.0 0.0 0.81 0.88
dolphin-mistral_7b-v2.8-q4_K_M 3c0b1c59 3.63 1.0 0.0 0.95 0.89
dolphin-mistral_7b-v2.8-q4_K_M 74832795 2.25 1.0 0.0 0.78 0.91
dolphin-mistral_7b-v2.8-q4_K_M f2dfb8f6 5.06 1.0 0.0 0.68 0.86
dolphin-mistral_7b-v2.8-q4_K_M 9092432e 4.12 1.0 0.07 0.14 0.96
dolphin-mistral_7b-v2.8-q4_K_M 8e410aff 6.41 1.0 0.05 0.55 0.87
dolphin-mistral_7b-v2.8-q4_K_M e4a31911 2.58 1.0 0.08 0.28 0.82
dolphin-mistral_7b-v2.8-q4_K_M 4be7219f 7.74 1.0 0.0 0.72 0.91
dolphin-mistral_7b-v2.8-q4_K_M fc5bc0ae 3.58 1.0 0.0 0.77 0.89
dolphin-mistral_7b-v2.8-q5_K_M 63f711be 7.14 1.0 0.0 0.61 0.79
dolphin-mistral_7b-v2.8-q5_K_M 1ed47412 3.27 1.0 0.11 0.25 0.95
dolphin-mistral_7b-v2.8-q5_K_M 5852d8b8 3.73 1.0 0.03 -0.01 0.74
dolphin-mistral_7b-v2.8-q5_K_M 6f5003f2 5.08 1.0 0.0 0.71 0.81
dolphin-mistral_7b-v2.8-q5_K_M 7be9fbd1 6.06 1.0 0.0 0.75 0.89
dolphin-mistral_7b-v2.8-q5_K_M 7fe80a1c 3.26 1.0 0.0 0.65 0.81
dolphin-mistral_7b-v2.8-q5_K_M bcdd3918 4.09 1.0 0.06 0.54 0.81
dolphin-mistral_7b-v2.8-q5_K_M 302c8a97 2.9 1.0 0.08 0.04 0.81
dolphin-mistral_7b-v2.8-q5_K_M 7be44b2c 3.98 1.0 0.01 0.6 0.82
dolphin-mistral_7b-v2.8-q5_K_M 4cf981ee 3.32 1.0 0.0 0.73 0.87
dolphin-mistral_7b-v2.8-q5_K_M 2e7c99cd 6.66 1.0 0.0 0.76 0.87
dolphin-mistral_7b-v2.8-q5_K_M b2530e0e 7.91 1.0 0.0 0.8 0.88
dolphin-mistral_7b-v2.8-q5_K_M 3c0b1c59 4.66 1.0 0.0 0.92 0.91
dolphin-mistral_7b-v2.8-q5_K_M 74832795 2.81 1.0 0.0 0.73 0.89
dolphin-mistral_7b-v2.8-q5_K_M f2dfb8f6 6.67 1.0 0.0 0.65 0.83
dolphin-mistral_7b-v2.8-q5_K_M 9092432e 5.32 1.0 0.06 0.19 0.83
dolphin-mistral_7b-v2.8-q5_K_M 8e410aff 7.5 1.0 0.08 0.42 0.84
dolphin-mistral_7b-v2.8-q5_K_M e4a31911 3.3 1.0 0.05 0.19 0.61
dolphin-mistral_7b-v2.8-q5_K_M 4be7219f 9.64 1.0 0.0 0.71 0.87
dolphin-mistral_7b-v2.8-q5_K_M fc5bc0ae 4.4 1.0 0.0 0.76 0.86
dolphin-mistral_7b-v2.8-q8_0 63f711be 7.17 1.0 0.0 0.62 0.81
dolphin-mistral_7b-v2.8-q8_0 1ed47412 3.91 1.0 0.1 0.34 0.92
dolphin-mistral_7b-v2.8-q8_0 5852d8b8 4.1 1.0 0.04 -0.04 0.78
dolphin-mistral_7b-v2.8-q8_0 6f5003f2 5.78 1.0 0.0 0.71 0.85
dolphin-mistral_7b-v2.8-q8_0 7be9fbd1 6.28 1.0 0.0 0.76 0.9
dolphin-mistral_7b-v2.8-q8_0 7fe80a1c 3.94 1.0 0.0 0.68 0.85
dolphin-mistral_7b-v2.8-q8_0 bcdd3918 4.59 1.0 0.01 0.6 0.82
dolphin-mistral_7b-v2.8-q8_0 302c8a97 3.33 1.0 0.1 -0.08 0.81
dolphin-mistral_7b-v2.8-q8_0 7be44b2c 4.49 1.0 0.02 0.55 0.81
dolphin-mistral_7b-v2.8-q8_0 4cf981ee 3.64 1.0 0.0 0.73 0.87
dolphin-mistral_7b-v2.8-q8_0 2e7c99cd 6.95 1.0 0.0 0.76 0.89
dolphin-mistral_7b-v2.8-q8_0 b2530e0e 8.19 1.0 0.0 0.83 0.9
dolphin-mistral_7b-v2.8-q8_0 3c0b1c59 4.89 1.0 0.0 0.94 0.9
dolphin-mistral_7b-v2.8-q8_0 74832795 3.31 1.0 0.0 0.7 0.86
dolphin-mistral_7b-v2.8-q8_0 f2dfb8f6 7.26 1.0 0.0 0.65 0.83
dolphin-mistral_7b-v2.8-q8_0 9092432e 5.96 1.0 0.09 0.34 0.85
dolphin-mistral_7b-v2.8-q8_0 8e410aff 7.54 1.0 0.06 0.48 0.82
dolphin-mistral_7b-v2.8-q8_0 e4a31911 4.08 1.0 0.05 0.36 0.77
dolphin-mistral_7b-v2.8-q8_0 4be7219f 9.3 1.0 0.0 0.73 0.91
dolphin-mistral_7b-v2.8-q8_0 fc5bc0ae 5.07 1.0 0.0 0.78 0.9
dolphin-mistral_7b-v2.8-fp16 63f711be 11.0 1.0 0.0 0.63 0.8
dolphin-mistral_7b-v2.8-fp16 1ed47412 6.53 1.0 0.05 0.11 0.96
dolphin-mistral_7b-v2.8-fp16 5852d8b8 7.09 1.0 0.05 -0.03 0.69
dolphin-mistral_7b-v2.8-fp16 6f5003f2 8.82 1.0 0.0 0.78 0.88
dolphin-mistral_7b-v2.8-fp16 7be9fbd1 10.12 1.0 0.0 0.75 0.89
dolphin-mistral_7b-v2.8-fp16 7fe80a1c 6.55 1.0 0.0 0.68 0.85
dolphin-mistral_7b-v2.8-fp16 bcdd3918 7.6 1.0 0.01 0.59 0.82
dolphin-mistral_7b-v2.8-fp16 302c8a97 5.61 1.0 0.09 -0.06 0.8
dolphin-mistral_7b-v2.8-fp16 7be44b2c 7.15 1.0 0.01 0.6 0.81
dolphin-mistral_7b-v2.8-fp16 4cf981ee 6.36 1.0 0.0 0.71 0.86
dolphin-mistral_7b-v2.8-fp16 2e7c99cd 10.54 1.0 0.0 0.76 0.89
dolphin-mistral_7b-v2.8-fp16 b2530e0e 11.99 1.0 0.0 0.81 0.92
dolphin-mistral_7b-v2.8-fp16 3c0b1c59 7.9 1.0 0.0 0.93 0.91
dolphin-mistral_7b-v2.8-fp16 74832795 5.64 1.0 0.0 0.72 0.87
dolphin-mistral_7b-v2.8-fp16 f2dfb8f6 11.42 1.0 0.0 0.66 0.83
dolphin-mistral_7b-v2.8-fp16 9092432e 9.75 1.0 0.09 0.3 0.87
dolphin-mistral_7b-v2.8-fp16 8e410aff 11.7 1.0 0.04 0.5 0.85
dolphin-mistral_7b-v2.8-fp16 e4a31911 7.08 1.0 0.03 0.27 0.76
dolphin-mistral_7b-v2.8-fp16 4be7219f 13.15 1.0 0.0 0.72 0.9
dolphin-mistral_7b-v2.8-fp16 fc5bc0ae 8.36 1.0 0.0 0.78 0.9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment