Skip to content

Instantly share code, notes, and snippets.

@seandearnaley

seandearnaley/statistical_comparisons.csv

Created May 17, 2024 19:27
Show Gist options
  • Save seandearnaley/6101dfa2709903a348491f9fc0431279 to your computer and use it in GitHub Desktop.
Save seandearnaley/6101dfa2709903a348491f9fc0431279 to your computer and use it in GitHub Desktop.
Download ZIP
Statistical Comparisons
Raw
statistical_comparisons.csv
Comparison F-Statistic F-Test P-Value T-Statistic T-Test P-Value
llama3_8b-instruct-fp16 vs llama3_8b-instruct-sentiment_analysis-fp16 8.235 0.005 -2.87 0.005
llama3_8b-instruct-q4_K_M vs llama3_8b-instruct-sentiment_analysis-q4_K_M 5.184 0.024 -2.277 0.024
llama3_8b-instruct-q5_K_M vs llama3_8b-instruct-sentiment_analysis-q5_K_M 18.747 0.0 -4.33 0.0
llama3_8b-instruct-q8_0 vs llama3_8b-instruct-sentiment_analysis-q8_0 6.821 0.01 -2.612 0.01
mistral_7b-instruct-fp16 vs llama3_8b-instruct-fp16 1.558 0.214 1.248 0.214
mistral_7b-instruct-q4_K_M vs llama3_8b-instruct-q4_K_M 0.372 0.542 0.61 0.542
mistral_7b-instruct-q5_K_M vs llama3_8b-instruct-q5_K_M 4.425 0.037 2.104 0.037
mistral_7b-instruct-q8_0 vs llama3_8b-instruct-q8_0 0.712 0.4 0.844 0.4
dolphin-mistral_7b-v2.8-fp16 vs mistral_7b-instruct-fp16 0.007 0.935 0.081 0.935
dolphin-mistral_7b-v2.8-q4_K_M vs mistral_7b-instruct-q4_K_M 15.542 0.0 3.942 0.0
dolphin-mistral_7b-v2.8-q5_K_M vs mistral_7b-instruct-q5_K_M 2.458 0.119 -1.568 0.119
dolphin-mistral_7b-v2.8-q8_0 vs mistral_7b-instruct-q8_0 0.338 0.562 -0.581 0.562
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment