Skip to content

Instantly share code, notes, and snippets.

@CultriX-Github
Created February 14, 2024 23:41
Show Gist options
  • Save CultriX-Github/f494886f09815cda0b43a80701bd379d to your computer and use it in GitHub Desktop.
Save CultriX-Github/f494886f09815cda0b43a80701bd379d to your computer and use it in GitHub Desktop.
Results_Combined
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Daredevil-7B](https://huggingface.co/mlabonne/Daredevil-7B)| 44.85| 76.07| 64.89| 47.07| 58.22|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |38.86|± | 1.91|
| | |acc_norm|39.32|± | 1.92|
|agieval_lsat_ar | 0|acc |26.96|± | 2.93|
| | |acc_norm|26.52|± | 2.92|
|agieval_lsat_lr | 0|acc |51.37|± | 2.22|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |63.94|± | 2.93|
| | |acc_norm|62.83|± | 2.95|
|agieval_sat_en | 0|acc |79.61|± | 2.81|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|43.69|± | 3.46|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|29.09|± | 3.07|
Average: 44.85%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |62.88|± | 1.41|
| | |acc_norm|65.10|± | 1.39|
|arc_easy | 0|acc |86.24|± | 0.71|
| | |acc_norm|83.63|± | 0.76|
|boolq | 1|acc |88.62|± | 0.56|
|hellaswag | 0|acc |67.23|± | 0.47|
| | |acc_norm|85.24|± | 0.35|
|openbookqa | 0|acc |37.40|± | 2.17|
| | |acc_norm|47.00|± | 2.23|
|piqa | 0|acc |82.86|± | 0.88|
| | |acc_norm|84.33|± | 0.85|
|winogrande | 0|acc |78.53|± | 1.15|
Average: 76.07%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |47.61|± | 1.75|
| | |mc2 |64.89|± | 1.51|
Average: 64.89%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.42|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|66.94|± | 2.45|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.74|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 3.62|± | 0.99|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|31.60|± | 2.08|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.00|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|52.33|± | 2.89|
|bigbench_movie_recommendation | 0|multiple_choice_grade|40.00|± | 2.19|
|bigbench_navigate | 0|multiple_choice_grade|56.20|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|73.10|± | 0.99|
|bigbench_ruin_names | 0|multiple_choice_grade|54.24|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.86|± | 1.46|
|bigbench_snarks | 0|multiple_choice_grade|72.38|± | 3.33|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.44|± | 1.39|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.60|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.96|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.29|± | 0.92|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|52.33|± | 2.89|
Average: 47.07%
Average score: 58.22%
Elapsed time: 02:29:59| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp)| 44.66| 76.24| 64.15| 45.64| 57.67|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |38.25|± | 1.91|
| | |acc_norm|39.32|± | 1.92|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |50.00|± | 2.22|
| | |acc_norm|50.59|± | 2.22|
|agieval_lsat_rc | 0|acc |62.83|± | 2.95|
| | |acc_norm|62.08|± | 2.96|
|agieval_sat_en | 0|acc |79.61|± | 2.81|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |45.15|± | 3.48|
| | |acc_norm|45.63|± | 3.48|
|agieval_sat_math | 0|acc |33.18|± | 3.18|
| | |acc_norm|30.45|± | 3.11|
Average: 44.66%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |63.91|± | 1.40|
| | |acc_norm|64.93|± | 1.39|
|arc_easy | 0|acc |86.07|± | 0.71|
| | |acc_norm|83.75|± | 0.76|
|boolq | 1|acc |88.56|± | 0.56|
|hellaswag | 0|acc |67.31|± | 0.47|
| | |acc_norm|85.28|± | 0.35|
|openbookqa | 0|acc |36.40|± | 2.15|
| | |acc_norm|48.20|± | 2.24|
|piqa | 0|acc |82.59|± | 0.88|
| | |acc_norm|84.39|± | 0.85|
|winogrande | 0|acc |78.53|± | 1.15|
Average: 76.24%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |46.88|± | 1.75|
| | |mc2 |64.15|± | 1.52|
Average: 64.15%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.32|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|66.40|± | 2.46|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.35|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|20.33|± | 2.13|
| | |exact_str_match | 4.74|± | 1.12|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|30.00|± | 2.05|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|21.43|± | 1.55|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|52.33|± | 2.89|
|bigbench_movie_recommendation | 0|multiple_choice_grade|39.20|± | 2.19|
|bigbench_navigate | 0|multiple_choice_grade|53.90|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.15|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|52.46|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|25.75|± | 1.38|
|bigbench_snarks | 0|multiple_choice_grade|72.38|± | 3.33|
|bigbench_sports_understanding | 0|multiple_choice_grade|73.63|± | 1.40|
|bigbench_temporal_sequences | 0|multiple_choice_grade|45.70|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.44|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.51|± | 0.93|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|52.33|± | 2.89|
Average: 45.64%
Average score: 57.67%
Elapsed time: 02:07:54| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[ActualNextGen-7B](https://huggingface.co/CultriX/ActualNextGen-7B)| 45.95| 76.78| 68.91| 48.04| 59.92|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.17|± | 2.80|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.63|± | 1.92|
| | |acc_norm|39.78|± | 1.92|
|agieval_lsat_ar | 0|acc |26.96|± | 2.93|
| | |acc_norm|28.70|± | 2.99|
|agieval_lsat_lr | 0|acc |52.16|± | 2.21|
| | |acc_norm|53.14|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|80.58|± | 2.76|
|agieval_sat_en_without_passage| 0|acc |45.63|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |33.64|± | 3.19|
| | |acc_norm|30.45|± | 3.11|
Average: 45.95%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.78|± | 1.39|
| | |acc_norm|66.72|± | 1.38|
|arc_easy | 0|acc |86.87|± | 0.69|
| | |acc_norm|83.50|± | 0.76|
|boolq | 1|acc |88.23|± | 0.56|
|hellaswag | 0|acc |68.26|± | 0.46|
| | |acc_norm|86.08|± | 0.35|
|openbookqa | 0|acc |39.00|± | 2.18|
| | |acc_norm|48.20|± | 2.24|
|piqa | 0|acc |83.57|± | 0.86|
| | |acc_norm|85.09|± | 0.83|
|winogrande | 0|acc |79.64|± | 1.13|
Average: 76.78%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |54.10|± | 1.74|
| | |mc2 |68.91|± | 1.51|
Average: 68.91%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.84|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|65.85|± | 2.47|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|44.96|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.01|± | 2.19|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.80|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.57|± | 1.61|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|46.40|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|57.30|± | 1.56|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.05|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|53.12|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.06|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|70.72|± | 3.39|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.65|± | 1.39|
|bigbench_temporal_sequences | 0|multiple_choice_grade|48.70|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.64|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.66|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 48.04%
Average score: 59.92%
Elapsed time: 01:38:11| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MergeTrix-7B-v2](https://huggingface.co/CultriX/MergeTrix-7B-v2)| 44.7| 77.66| 67.52| 48.23| 59.53|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.20|± | 2.73|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |24.78|± | 2.85|
| | |acc_norm|23.48|± | 2.80|
|agieval_lsat_lr | 0|acc |50.59|± | 2.22|
| | |acc_norm|52.35|± | 2.21|
|agieval_lsat_rc | 0|acc |65.06|± | 2.91|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |79.61|± | 2.81|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |42.23|± | 3.45|
| | |acc_norm|41.26|± | 3.44|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|30.45|± | 3.11|
Average: 44.7%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.15|± | 1.37|
| | |acc_norm|67.83|± | 1.37|
|arc_easy | 0|acc |86.83|± | 0.69|
| | |acc_norm|82.49|± | 0.78|
|boolq | 1|acc |88.26|± | 0.56|
|hellaswag | 0|acc |70.20|± | 0.46|
| | |acc_norm|87.15|± | 0.33|
|openbookqa | 0|acc |38.40|± | 2.18|
| | |acc_norm|48.80|± | 2.24|
|piqa | 0|acc |83.62|± | 0.86|
| | |acc_norm|85.20|± | 0.83|
|winogrande | 0|acc |83.90|± | 1.03|
Average: 77.66%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |53.98|± | 1.74|
| | |mc2 |67.52|± | 1.53|
Average: 67.52%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.42|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|64.23|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.12|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.28|± | 0.28|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.20|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.14|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|55.67|± | 2.87|
|bigbench_movie_recommendation | 0|multiple_choice_grade|48.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|54.70|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.55|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.46|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.06|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|78.45|± | 3.06|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.95|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.10|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.36|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.49|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|55.67|± | 2.87|
Average: 48.23%
Average score: 59.53%
Elapsed time: 02:30:58| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NextGen-7B](https://huggingface.co/CultriX/NextGen-7B)| 44.96| 77.45| 71.17| 48.38| 60.49|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.56|± | 2.81|
| | |acc_norm|26.38|± | 2.77|
|agieval_logiqa_en | 0|acc |38.56|± | 1.91|
| | |acc_norm|39.63|± | 1.92|
|agieval_lsat_ar | 0|acc |22.61|± | 2.76|
| | |acc_norm|21.74|± | 2.73|
|agieval_lsat_lr | 0|acc |51.76|± | 2.21|
| | |acc_norm|52.16|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |45.63|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|30.00|± | 3.10|
Average: 44.96%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.98|± | 1.37|
| | |acc_norm|66.98|± | 1.37|
|arc_easy | 0|acc |87.63|± | 0.68|
| | |acc_norm|83.29|± | 0.77|
|boolq | 1|acc |88.10|± | 0.57|
|hellaswag | 0|acc |69.51|± | 0.46|
| | |acc_norm|86.95|± | 0.34|
|openbookqa | 0|acc |39.80|± | 2.19|
| | |acc_norm|49.80|± | 2.24|
|piqa | 0|acc |83.35|± | 0.87|
| | |acc_norm|85.36|± | 0.82|
|winogrande | 0|acc |81.69|± | 1.09|
Average: 77.45%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.28|± | 1.73|
| | |mc2 |71.17|± | 1.48|
Average: 71.17%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|63.69|± | 2.51|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.90|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.28|± | 2.20|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.80|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.29|± | 1.62|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.67|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|46.60|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|58.30|± | 1.56|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.10|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|54.46|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|33.67|± | 1.50|
|bigbench_snarks | 0|multiple_choice_grade|71.82|± | 3.35|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.25|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.80|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.32|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.77|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.67|± | 2.86|
Average: 48.38%
Average score: 60.49%
Elapsed time: 01:43:04| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v7](https://huggingface.co/CultriX/Wernicke-7B-v7)| 44.54| 77.18| 71.02| 48.93| 60.42|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.56|± | 2.81|
| | |acc_norm|25.98|± | 2.76|
|agieval_logiqa_en | 0|acc |40.25|± | 1.92|
| | |acc_norm|39.94|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|23.91|± | 2.82|
|agieval_lsat_lr | 0|acc |51.37|± | 2.22|
| | |acc_norm|51.76|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|64.68|± | 2.92|
|agieval_sat_en | 0|acc |78.64|± | 2.86|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |42.23|± | 3.45|
| | |acc_norm|42.72|± | 3.45|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|28.18|± | 3.04|
Average: 44.54%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.06|± | 1.37|
| | |acc_norm|66.72|± | 1.38|
|arc_easy | 0|acc |87.46|± | 0.68|
| | |acc_norm|83.29|± | 0.77|
|boolq | 1|acc |88.26|± | 0.56|
|hellaswag | 0|acc |69.46|± | 0.46|
| | |acc_norm|86.81|± | 0.34|
|openbookqa | 0|acc |39.80|± | 2.19|
| | |acc_norm|48.20|± | 2.24|
|piqa | 0|acc |83.68|± | 0.86|
| | |acc_norm|85.53|± | 0.82|
|winogrande | 0|acc |81.45|± | 1.09|
Average: 77.18%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.53|± | 1.73|
| | |mc2 |71.02|± | 1.49|
Average: 71.02%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.89|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|65.04|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|49.61|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|35.60|± | 2.14|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.86|± | 1.63|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.70|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.05|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|54.91|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|31.76|± | 1.47|
|bigbench_snarks | 0|multiple_choice_grade|70.17|± | 3.41|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.06|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.20|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.08|± | 1.17|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.71|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 48.93%
Average score: 60.42%
Elapsed time: 01:21:37| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-bf16](https://huggingface.co/CultriX/NeuralTrix-bf16)| 44.43| 76.43| 80.18| 49.23| 62.57|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.59|± | 2.74|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |37.48|± | 1.90|
| | |acc_norm|37.33|± | 1.90|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |53.33|± | 2.21|
| | |acc_norm|54.31|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |77.67|± | 2.91|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |42.23|± | 3.45|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|29.55|± | 3.08|
Average: 44.43%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.87|± | 1.39|
| | |acc_norm|66.89|± | 1.38|
|arc_easy | 0|acc |84.85|± | 0.74|
| | |acc_norm|77.65|± | 0.85|
|boolq | 1|acc |87.06|± | 0.59|
|hellaswag | 0|acc |69.69|± | 0.46|
| | |acc_norm|87.44|± | 0.33|
|openbookqa | 0|acc |40.60|± | 2.20|
| | |acc_norm|50.00|± | 2.24|
|piqa | 0|acc |82.59|± | 0.88|
| | |acc_norm|83.84|± | 0.86|
|winogrande | 0|acc |82.08|± | 1.08|
Average: 76.43%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |63.89|± | 1.68|
| | |mc2 |80.18|± | 1.33|
Average: 80.18%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.53|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|59.62|± | 2.56|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|59.69|± | 3.06|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|31.80|± | 2.08|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.14|± | 1.57|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|51.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|53.30|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|66.65|± | 1.05|
|bigbench_ruin_names | 0|multiple_choice_grade|56.03|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|38.98|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.44|± | 1.39|
|bigbench_temporal_sequences | 0|multiple_choice_grade|53.20|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.60|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.71|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 49.23%
Average score: 62.57%
Elapsed time: 01:42:42| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-7B-v1](https://huggingface.co/CultriX/NeuralTrix-7B-v1)| 44.75| 77.61| 75.44| 49.82| 61.91|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.02|± | 1.91|
| | |acc_norm|39.17|± | 1.91|
|agieval_lsat_ar | 0|acc |24.78|± | 2.85|
| | |acc_norm|23.48|± | 2.80|
|agieval_lsat_lr | 0|acc |52.94|± | 2.21|
| | |acc_norm|52.94|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |42.23|± | 3.45|
| | |acc_norm|42.72|± | 3.45|
|agieval_sat_math | 0|acc |33.18|± | 3.18|
| | |acc_norm|30.91|± | 3.12|
Average: 44.75%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.83|± | 1.37|
| | |acc_norm|68.77|± | 1.35|
|arc_easy | 0|acc |86.78|± | 0.69|
| | |acc_norm|81.19|± | 0.80|
|boolq | 1|acc |87.77|± | 0.57|
|hellaswag | 0|acc |70.92|± | 0.45|
| | |acc_norm|87.88|± | 0.33|
|openbookqa | 0|acc |40.40|± | 2.20|
| | |acc_norm|49.40|± | 2.24|
|piqa | 0|acc |83.13|± | 0.87|
| | |acc_norm|85.26|± | 0.83|
|winogrande | 0|acc |83.03|± | 1.05|
Average: 77.61%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |60.59|± | 1.71|
| | |mc2 |75.44|± | 1.43|
Average: 75.44%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.95|± | 3.58|
|bigbench_date_understanding | 0|multiple_choice_grade|62.87|± | 2.52|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|55.43|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 2.51|± | 0.83|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.40|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.14|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.67|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|56.40|± | 2.22|
|bigbench_navigate | 0|multiple_choice_grade|53.80|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|70.55|± | 1.02|
|bigbench_ruin_names | 0|multiple_choice_grade|54.69|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|39.88|± | 1.55|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.05|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|53.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.96|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.54|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.67|± | 2.83|
Average: 49.82%
Average score: 61.91%
Elapsed time: 01:34:51| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-dpo](https://huggingface.co/CultriX/Wernicke-7B-dpo)| 45.09| 77.15| 73.95| 49.05| 61.31|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.20|± | 2.73|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |39.94|± | 1.92|
| | |acc_norm|39.94|± | 1.92|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|25.65|± | 2.89|
|agieval_lsat_lr | 0|acc |50.59|± | 2.22|
| | |acc_norm|51.37|± | 2.22|
|agieval_lsat_rc | 0|acc |65.43|± | 2.91|
| | |acc_norm|64.68|± | 2.92|
|agieval_sat_en | 0|acc |79.13|± | 2.84|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|43.69|± | 3.46|
|agieval_sat_math | 0|acc |34.09|± | 3.20|
| | |acc_norm|31.82|± | 3.15|
Average: 45.09%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.70|± | 1.39|
| | |acc_norm|67.15|± | 1.37|
|arc_easy | 0|acc |86.20|± | 0.71|
| | |acc_norm|81.27|± | 0.80|
|boolq | 1|acc |88.01|± | 0.57|
|hellaswag | 0|acc |68.62|± | 0.46|
| | |acc_norm|86.97|± | 0.34|
|openbookqa | 0|acc |39.20|± | 2.19|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |82.64|± | 0.88|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |82.00|± | 1.08|
Average: 77.15%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |59.00|± | 1.72|
| | |mc2 |73.95|± | 1.45|
Average: 73.95%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|61.58|± | 3.54|
|bigbench_date_understanding | 0|multiple_choice_grade|62.87|± | 2.52|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|54.65|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.80|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.71|± | 1.58|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.67|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|46.40|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|54.20|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.45|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.46|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.36|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|77.35|± | 3.12|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.76|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.48|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.94|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.67|± | 2.86|
Average: 49.05%
Average score: 61.31%
Elapsed time: 01:50:57| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[SymbioTrix-v1](https://huggingface.co/CultriX/SymbioTrix-v1)| 44.94| 76.99| 71.06| 48.47| 60.37|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |38.86|± | 1.91|
| | |acc_norm|39.32|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|23.48|± | 2.80|
|agieval_lsat_lr | 0|acc |51.76|± | 2.21|
| | |acc_norm|51.57|± | 2.22|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|66.17|± | 2.89|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|80.58|± | 2.76|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|43.20|± | 3.46|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|30.00|± | 3.10|
Average: 44.94%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.92|± | 1.36|
| | |acc_norm|67.32|± | 1.37|
|arc_easy | 0|acc |87.25|± | 0.68|
| | |acc_norm|82.74|± | 0.78|
|boolq | 1|acc |88.17|± | 0.56|
|hellaswag | 0|acc |70.00|± | 0.46|
| | |acc_norm|86.74|± | 0.34|
|openbookqa | 0|acc |39.40|± | 2.19|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |83.68|± | 0.86|
| | |acc_norm|85.09|± | 0.83|
|winogrande | 0|acc |80.27|± | 1.12|
Average: 76.99%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.89|± | 1.73|
| | |mc2 |71.06|± | 1.49|
Average: 71.06%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.32|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|64.77|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.74|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|36.00|± | 2.15|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.86|± | 1.63|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.00|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|57.20|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.15|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.69|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.77|± | 1.49|
|bigbench_snarks | 0|multiple_choice_grade|70.17|± | 3.41|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.56|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.70|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.00|± | 1.17|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.31|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 48.47%
Average score: 60.37%
Elapsed time: 01:27:03| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[SymbioTrix-v3](https://huggingface.co/CultriX/SymbioTrix-v3)| 45.39| 76.73| 69.28| 47.55| 59.74|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|23.62|± | 2.67|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|39.17|± | 1.91|
|agieval_lsat_ar | 0|acc |23.48|± | 2.80|
| | |acc_norm|26.09|± | 2.90|
|agieval_lsat_lr | 0|acc |51.37|± | 2.22|
| | |acc_norm|52.35|± | 2.21|
|agieval_lsat_rc | 0|acc |66.17|± | 2.89|
| | |acc_norm|66.17|± | 2.89|
|agieval_sat_en | 0|acc |81.07|± | 2.74|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |45.63|± | 3.48|
| | |acc_norm|45.63|± | 3.48|
|agieval_sat_math | 0|acc |33.64|± | 3.19|
| | |acc_norm|30.00|± | 3.10|
Average: 45.39%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.53|± | 1.39|
| | |acc_norm|67.15|± | 1.37|
|arc_easy | 0|acc |86.36|± | 0.70|
| | |acc_norm|83.04|± | 0.77|
|boolq | 1|acc |88.17|± | 0.56|
|hellaswag | 0|acc |68.34|± | 0.46|
| | |acc_norm|85.97|± | 0.35|
|openbookqa | 0|acc |38.40|± | 2.18|
| | |acc_norm|47.60|± | 2.24|
|piqa | 0|acc |83.30|± | 0.87|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |79.79|± | 1.13|
Average: 76.73%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |54.10|± | 1.74|
| | |mc2 |69.28|± | 1.50|
Average: 69.28%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|55.79|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|65.58|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|43.02|± | 3.09|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|35.80|± | 2.15|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.71|± | 1.61|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.33|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|43.20|± | 2.22|
|bigbench_navigate | 0|multiple_choice_grade|56.70|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.80|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|53.57|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|29.86|± | 1.45|
|bigbench_snarks | 0|multiple_choice_grade|70.17|± | 3.41|
|bigbench_sports_understanding | 0|multiple_choice_grade|73.83|± | 1.40|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.10|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.16|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.31|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.33|± | 2.86|
Average: 47.55%
Average score: 59.74%
Elapsed time: 01:42:05| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v1](https://huggingface.co/CultriX/Wernicke-7B-v1)| 45.59| 77.36| 71.46| 48.49| 60.73|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.98|± | 2.76|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|39.78|± | 1.92|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|25.65|± | 2.89|
|agieval_lsat_lr | 0|acc |51.37|± | 2.22|
| | |acc_norm|52.35|± | 2.21|
|agieval_lsat_rc | 0|acc |67.29|± | 2.87|
| | |acc_norm|66.91|± | 2.87|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |47.57|± | 3.49|
| | |acc_norm|45.15|± | 3.48|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.00|± | 3.10|
Average: 45.59%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |68.00|± | 1.36|
| | |acc_norm|67.92|± | 1.36|
|arc_easy | 0|acc |87.37|± | 0.68|
| | |acc_norm|83.33|± | 0.76|
|boolq | 1|acc |88.29|± | 0.56|
|hellaswag | 0|acc |69.44|± | 0.46|
| | |acc_norm|86.85|± | 0.34|
|openbookqa | 0|acc |39.40|± | 2.19|
| | |acc_norm|49.00|± | 2.24|
|piqa | 0|acc |83.79|± | 0.86|
| | |acc_norm|85.09|± | 0.83|
|winogrande | 0|acc |81.06|± | 1.10|
Average: 77.36%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.65|± | 1.73|
| | |mc2 |71.46|± | 1.49|
Average: 71.46%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.84|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|63.69|± | 2.51|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.51|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.00|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.29|± | 1.62|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.67|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|48.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|57.10|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.30|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|53.12|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|35.67|± | 1.52|
|bigbench_snarks | 0|multiple_choice_grade|70.72|± | 3.39|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.46|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|53.50|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.04|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.77|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.67|± | 2.86|
Average: 48.49%
Average score: 60.73%
Elapsed time: 01:34:51| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-v3-fp16](https://huggingface.co/CultriX/NeuralTrix-v3-fp16)| 43.76| 76.79| 77.92| 50.07| 62.14|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |38.56|± | 1.91|
| | |acc_norm|38.25|± | 1.91|
|agieval_lsat_ar | 0|acc |22.61|± | 2.76|
| | |acc_norm|20.87|± | 2.69|
|agieval_lsat_lr | 0|acc |53.92|± | 2.21|
| | |acc_norm|55.29|± | 2.20|
|agieval_lsat_rc | 0|acc |65.06|± | 2.91|
| | |acc_norm|63.94|± | 2.93|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|77.18|± | 2.93|
|agieval_sat_en_without_passage| 0|acc |41.75|± | 3.44|
| | |acc_norm|40.29|± | 3.43|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|29.09|± | 3.07|
Average: 43.76%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.38|± | 1.38|
| | |acc_norm|67.41|± | 1.37|
|arc_easy | 0|acc |85.48|± | 0.72|
| | |acc_norm|79.08|± | 0.83|
|boolq | 1|acc |87.25|± | 0.58|
|hellaswag | 0|acc |70.84|± | 0.45|
| | |acc_norm|87.80|± | 0.33|
|openbookqa | 0|acc |41.20|± | 2.20|
| | |acc_norm|49.00|± | 2.24|
|piqa | 0|acc |82.97|± | 0.88|
| | |acc_norm|84.22|± | 0.85|
|winogrande | 0|acc |82.79|± | 1.06|
Average: 76.79%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |62.79|± | 1.69|
| | |mc2 |77.92|± | 1.37|
Average: 77.92%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|62.63|± | 3.52|
|bigbench_date_understanding | 0|multiple_choice_grade|60.70|± | 2.55|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|60.47|± | 3.05|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.40|± | 2.24|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|30.40|± | 2.06|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|21.00|± | 1.54|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.00|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|61.60|± | 2.18|
|bigbench_navigate | 0|multiple_choice_grade|52.00|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|66.85|± | 1.05|
|bigbench_ruin_names | 0|multiple_choice_grade|54.24|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|43.09|± | 1.57|
|bigbench_snarks | 0|multiple_choice_grade|74.59|± | 3.25|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.47|± | 1.35|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.36|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.00|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.00|± | 2.85|
Average: 50.07%
Average score: 62.14%
Elapsed time: 02:30:44| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v5](https://huggingface.co/CultriX/Wernicke-7B-v5)| 45.12| 77.44| 71.64| 48.51| 60.68|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|26.77|± | 2.78|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.02|± | 1.91|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |52.35|± | 2.21|
| | |acc_norm|53.33|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|64.68|± | 2.92|
|agieval_sat_en | 0|acc |80.10|± | 2.79|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|44.17|± | 3.47|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|29.09|± | 3.07|
Average: 45.12%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.92|± | 1.36|
| | |acc_norm|67.92|± | 1.36|
|arc_easy | 0|acc |87.29|± | 0.68|
| | |acc_norm|83.50|± | 0.76|
|boolq | 1|acc |88.23|± | 0.56|
|hellaswag | 0|acc |69.22|± | 0.46|
| | |acc_norm|86.75|± | 0.34|
|openbookqa | 0|acc |39.60|± | 2.19|
| | |acc_norm|49.60|± | 2.24|
|piqa | 0|acc |83.51|± | 0.87|
| | |acc_norm|85.36|± | 0.82|
|winogrande | 0|acc |80.74|± | 1.11|
Average: 77.44%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.41|± | 1.73|
| | |mc2 |71.64|± | 1.48|
Average: 71.64%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|65.04|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|48.06|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.28|± | 2.20|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.40|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.86|± | 1.63|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.00|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|45.20|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|57.10|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.55|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|55.80|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.06|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|71.27|± | 3.37|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.46|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.60|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.16|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.89|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.00|± | 2.84|
Average: 48.51%
Average score: 60.68%
Elapsed time: 01:57:53| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Subnet6Model3](https://huggingface.co/deepnet/Subnet6Model3)| 38.86| 70.83| 55.86| 38.09| 50.91|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |23.62|± | 2.67|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |35.33|± | 1.87|
| | |acc_norm|36.56|± | 1.89|
|agieval_lsat_ar | 0|acc |22.17|± | 2.75|
| | |acc_norm|22.61|± | 2.76|
|agieval_lsat_lr | 0|acc |41.57|± | 2.18|
| | |acc_norm|41.96|± | 2.19|
|agieval_lsat_rc | 0|acc |49.07|± | 3.05|
| | |acc_norm|46.84|± | 3.05|
|agieval_sat_en | 0|acc |70.39|± | 3.19|
| | |acc_norm|66.02|± | 3.31|
|agieval_sat_en_without_passage| 0|acc |41.26|± | 3.44|
| | |acc_norm|41.26|± | 3.44|
|agieval_sat_math | 0|acc |38.18|± | 3.28|
| | |acc_norm|30.00|± | 3.10|
Average: 38.86%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |51.28|± | 1.46|
| | |acc_norm|55.97|± | 1.45|
|arc_easy | 0|acc |81.73|± | 0.79|
| | |acc_norm|79.55|± | 0.83|
|boolq | 1|acc |84.25|± | 0.64|
|hellaswag | 0|acc |61.14|± | 0.49|
| | |acc_norm|79.71|± | 0.40|
|openbookqa | 0|acc |32.00|± | 2.09|
| | |acc_norm|42.80|± | 2.21|
|piqa | 0|acc |80.96|± | 0.92|
| | |acc_norm|81.18|± | 0.91|
|winogrande | 0|acc |72.38|± | 1.26|
Average: 70.83%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |39.05|± | 1.71|
| | |mc2 |55.86|± | 1.51|
Average: 55.86%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|55.26|± | 3.62|
|bigbench_date_understanding | 0|multiple_choice_grade|60.16|± | 2.55|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|34.50|± | 2.97|
|bigbench_geometric_shapes | 0|multiple_choice_grade|20.06|± | 2.12|
| | |exact_str_match |15.88|± | 1.93|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|26.80|± | 1.98|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|19.57|± | 1.50|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|48.67|± | 2.89|
|bigbench_movie_recommendation | 0|multiple_choice_grade|33.60|± | 2.11|
|bigbench_navigate | 0|multiple_choice_grade|50.00|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|58.90|± | 1.10|
|bigbench_ruin_names | 0|multiple_choice_grade|36.16|± | 2.27|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|12.42|± | 1.04|
|bigbench_snarks | 0|multiple_choice_grade|56.91|± | 3.69|
|bigbench_sports_understanding | 0|multiple_choice_grade|58.11|± | 1.57|
|bigbench_temporal_sequences | 0|multiple_choice_grade|27.30|± | 1.41|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.16|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|16.40|± | 0.89|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|48.67|± | 2.89|
Average: 38.09%
Average score: 50.91%
Elapsed time: 02:46:32| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MergeTrix-v3](https://huggingface.co/CultriX/MergeTrix-v3)| 45.17| 77.56| 73.1| 49.48| 61.33|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |29.13|± | 2.86|
| | |acc_norm|27.56|± | 2.81|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.48|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|23.04|± | 2.78|
|agieval_lsat_lr | 0|acc |51.96|± | 2.21|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |79.13|± | 2.84|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|43.20|± | 3.46|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|30.45|± | 3.11|
Average: 45.17%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |68.26|± | 1.36|
| | |acc_norm|67.58|± | 1.37|
|arc_easy | 0|acc |87.33|± | 0.68|
| | |acc_norm|82.62|± | 0.78|
|boolq | 1|acc |87.89|± | 0.57|
|hellaswag | 0|acc |69.57|± | 0.46|
| | |acc_norm|87.29|± | 0.33|
|openbookqa | 0|acc |40.00|± | 2.19|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.57|± | 0.86|
| | |acc_norm|85.85|± | 0.81|
|winogrande | 0|acc |82.48|± | 1.07|
Average: 77.56%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |59.24|± | 1.72|
| | |mc2 |73.10|± | 1.47|
Average: 73.1%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|65.31|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|47.29|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.28|± | 0.28|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.40|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|25.14|± | 1.64|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.33|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|52.00|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.80|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.35|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|57.14|± | 2.34|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|38.28|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|72.38|± | 3.33|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.85|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.80|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.88|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.94|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.33|± | 2.83|
Average: 49.48%
Average score: 61.33%
Elapsed time: 01:27:54| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[SymbioTrix-v2](https://huggingface.co/CultriX/SymbioTrix-v2)| 44.99| 77.46| 71.13| 48.55| 60.53|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.56|± | 2.81|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.48|± | 1.92|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |51.96|± | 2.21|
| | |acc_norm|51.96|± | 2.21|
|agieval_lsat_rc | 0|acc |66.17|± | 2.89|
| | |acc_norm|66.17|± | 2.89|
|agieval_sat_en | 0|acc |79.13|± | 2.84|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |45.63|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|29.09|± | 3.07|
Average: 44.99%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.98|± | 1.37|
| | |acc_norm|68.09|± | 1.36|
|arc_easy | 0|acc |87.21|± | 0.69|
| | |acc_norm|82.87|± | 0.77|
|boolq | 1|acc |88.29|± | 0.56|
|hellaswag | 0|acc |69.62|± | 0.46|
| | |acc_norm|86.97|± | 0.34|
|openbookqa | 0|acc |39.40|± | 2.19|
| | |acc_norm|49.00|± | 2.24|
|piqa | 0|acc |83.41|± | 0.87|
| | |acc_norm|85.47|± | 0.82|
|winogrande | 0|acc |81.53|± | 1.09|
Average: 77.46%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.65|± | 1.73|
| | |mc2 |71.13|± | 1.49|
Average: 71.13%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.84|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|63.69|± | 2.51|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|48.45|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.60|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.00|± | 1.62|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.33|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.90|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.10|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|55.80|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.06|± | 1.45|
|bigbench_snarks | 0|multiple_choice_grade|71.82|± | 3.35|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.96|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.20|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.72|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.71|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.33|± | 2.85|
Average: 48.55%
Average score: 60.53%
Elapsed time: 01:27:56| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-v4-bf16](https://huggingface.co/CultriX/NeuralTrix-v4-bf16)| 44.22| 76.33| 79.5| 49.43| 62.37|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|26.77|± | 2.78|
|agieval_logiqa_en | 0|acc |37.33|± | 1.90|
| | |acc_norm|37.48|± | 1.90|
|agieval_lsat_ar | 0|acc |21.30|± | 2.71|
| | |acc_norm|20.43|± | 2.66|
|agieval_lsat_lr | 0|acc |52.16|± | 2.21|
| | |acc_norm|53.14|± | 2.21|
|agieval_lsat_rc | 0|acc |66.17|± | 2.89|
| | |acc_norm|66.17|± | 2.89|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|76.70|± | 2.95|
|agieval_sat_en_without_passage| 0|acc |41.26|± | 3.44|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |33.18|± | 3.18|
| | |acc_norm|32.27|± | 3.16|
Average: 44.22%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.53|± | 1.39|
| | |acc_norm|67.06|± | 1.37|
|arc_easy | 0|acc |84.39|± | 0.74|
| | |acc_norm|77.44|± | 0.86|
|boolq | 1|acc |87.13|± | 0.59|
|hellaswag | 0|acc |70.81|± | 0.45|
| | |acc_norm|87.88|± | 0.33|
|openbookqa | 0|acc |40.80|± | 2.20|
| | |acc_norm|49.00|± | 2.24|
|piqa | 0|acc |82.15|± | 0.89|
| | |acc_norm|83.08|± | 0.87|
|winogrande | 0|acc |82.72|± | 1.06|
Average: 76.33%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |63.65|± | 1.68|
| | |mc2 |79.50|± | 1.35|
Average: 79.5%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.53|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|58.27|± | 2.57|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|59.69|± | 3.06|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|31.00|± | 2.07|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|20.57|± | 1.53|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|54.80|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|54.00|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|65.75|± | 1.06|
|bigbench_ruin_names | 0|multiple_choice_grade|55.80|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|40.78|± | 1.56|
|bigbench_snarks | 0|multiple_choice_grade|75.14|± | 3.22|
|bigbench_sports_understanding | 0|multiple_choice_grade|77.08|± | 1.34|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.20|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.60|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 49.43%
Average score: 62.37%
Elapsed time: 01:38:07| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v2](https://huggingface.co/CultriX/Wernicke-7B-v2)| 45.59| 77.4| 71.23| 48.38| 60.65|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.56|± | 2.81|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.48|± | 1.92|
|agieval_lsat_ar | 0|acc |25.65|± | 2.89|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |53.33|± | 2.21|
| | |acc_norm|53.73|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |80.10|± | 2.79|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |47.09|± | 3.49|
| | |acc_norm|45.63|± | 3.48|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.91|± | 3.12|
Average: 45.59%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.64|± | 1.38|
| | |acc_norm|67.83|± | 1.37|
|arc_easy | 0|acc |87.37|± | 0.68|
| | |acc_norm|83.25|± | 0.77|
|boolq | 1|acc |88.29|± | 0.56|
|hellaswag | 0|acc |69.39|± | 0.46|
| | |acc_norm|86.86|± | 0.34|
|openbookqa | 0|acc |40.00|± | 2.19|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.62|± | 0.86|
| | |acc_norm|84.98|± | 0.83|
|winogrande | 0|acc |81.37|± | 1.09|
Average: 77.4%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.92|± | 1.73|
| | |mc2 |71.23|± | 1.48|
Average: 71.23%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|63.96|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.90|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|35.00|± | 2.14|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|25.00|± | 1.64|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.33|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.60|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.15|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.24|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.57|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.66|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.30|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.72|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.51|± | 0.97|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.33|± | 2.86|
Average: 48.38%
Average score: 60.65%
Elapsed time: 01:51:21| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|--------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[DPOB-INMTOB-7B](https://huggingface.co/paulml/DPOB-INMTOB-7B)| 45.09| 77.37| 76.81| 49.18| 62.11|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |26.52|± | 2.92|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |54.12|± | 2.21|
| | |acc_norm|54.51|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|66.54|± | 2.88|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |43.20|± | 3.46|
| | |acc_norm|42.23|± | 3.45|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|30.00|± | 3.10|
Average: 45.09%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.49|± | 1.37|
| | |acc_norm|68.00|± | 1.36|
|arc_easy | 0|acc |86.41|± | 0.70|
| | |acc_norm|80.26|± | 0.82|
|boolq | 1|acc |87.61|± | 0.58|
|hellaswag | 0|acc |70.15|± | 0.46|
| | |acc_norm|87.49|± | 0.33|
|openbookqa | 0|acc |40.00|± | 2.19|
| | |acc_norm|50.00|± | 2.24|
|piqa | 0|acc |83.46|± | 0.87|
| | |acc_norm|85.58|± | 0.82|
|winogrande | 0|acc |82.64|± | 1.06|
Average: 77.37%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.32|± | 1.7|
| | |mc2 |76.81|± | 1.4|
Average: 76.81%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.95|± | 3.58|
|bigbench_date_understanding | 0|multiple_choice_grade|61.79|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|55.43|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.40|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.43|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|50.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.50|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.55|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|54.02|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|38.68|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.25|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.80|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.26|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 49.18%
Average score: 62.11%
Elapsed time: 02:06:29| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuTrixOmniBe-DPO](https://huggingface.co/Kukedlc/NeuTrixOmniBe-DPO)| 44.32| 77.33| 77.43| 49.17| 62.06|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.63|± | 1.92|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|23.04|± | 2.78|
|agieval_lsat_lr | 0|acc |53.33|± | 2.21|
| | |acc_norm|55.10|± | 2.20|
|agieval_lsat_rc | 0|acc |64.68|± | 2.92|
| | |acc_norm|63.57|± | 2.94|
|agieval_sat_en | 0|acc |77.67|± | 2.91|
| | |acc_norm|77.67|± | 2.91|
|agieval_sat_en_without_passage| 0|acc |42.23|± | 3.45|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|29.55|± | 3.08|
Average: 44.32%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.06|± | 1.37|
| | |acc_norm|67.83|± | 1.37|
|arc_easy | 0|acc |86.24|± | 0.71|
| | |acc_norm|79.71|± | 0.83|
|boolq | 1|acc |87.52|± | 0.58|
|hellaswag | 0|acc |70.11|± | 0.46|
| | |acc_norm|87.67|± | 0.33|
|openbookqa | 0|acc |40.40|± | 2.20|
| | |acc_norm|50.20|± | 2.24|
|piqa | 0|acc |83.13|± | 0.87|
| | |acc_norm|85.31|± | 0.83|
|winogrande | 0|acc |83.03|± | 1.05|
Average: 77.33%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.57|± | 1.70|
| | |mc2 |77.43|± | 1.39|
Average: 77.43%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|61.79|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|56.59|± | 3.09|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.00|± | 2.09|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.57|± | 1.58|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.33|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|52.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|55.80|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.35|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|55.36|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|37.47|± | 1.53|
|bigbench_snarks | 0|multiple_choice_grade|74.03|± | 3.27|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.35|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.56|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.57|± | 0.93|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.33|± | 2.86|
Average: 49.17%
Average score: 62.06%
Elapsed time: 03:24:27| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[OmniBeagleTrix-SLERP-7B](https://huggingface.co/CultriX/OmniBeagleTrix-SLERP-7B)| 44.8| 77| 77.09| 49.9| 62.2|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |37.48|± | 1.90|
| | |acc_norm|37.48|± | 1.90|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|23.48|± | 2.80|
|agieval_lsat_lr | 0|acc |53.33|± | 2.21|
| | |acc_norm|54.90|± | 2.21|
|agieval_lsat_rc | 0|acc |65.43|± | 2.91|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |78.64|± | 2.86|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|29.09|± | 3.07|
Average: 44.8%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.78|± | 1.39|
| | |acc_norm|67.66|± | 1.37|
|arc_easy | 0|acc |86.70|± | 0.70|
| | |acc_norm|81.14|± | 0.80|
|boolq | 1|acc |87.34|± | 0.58|
|hellaswag | 0|acc |68.18|± | 0.46|
| | |acc_norm|86.88|± | 0.34|
|openbookqa | 0|acc |39.00|± | 2.18|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.41|± | 0.87|
| | |acc_norm|85.58|± | 0.82|
|winogrande | 0|acc |81.22|± | 1.10|
Average: 77.0%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.20|± | 1.71|
| | |mc2 |77.09|± | 1.37|
Average: 77.09%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|61.05|± | 3.55|
|bigbench_date_understanding | 0|multiple_choice_grade|63.14|± | 2.51|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|56.59|± | 3.09|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.96|± | 2.26|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.60|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.86|± | 1.61|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.00|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|55.60|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|70.15|± | 1.02|
|bigbench_ruin_names | 0|multiple_choice_grade|55.80|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|39.98|± | 1.55|
|bigbench_snarks | 0|multiple_choice_grade|73.48|± | 3.29|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.15|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|53.30|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.20|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.00|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.00|± | 2.83|
Average: 49.9%
Average score: 62.2%
Elapsed time: 01:36:39| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[CombinaTrix-7B](https://huggingface.co/CultriX/CombinaTrix-7B)| 45.52| 77.42| 71.12| 48.24| 60.58|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|26.38|± | 2.77|
|agieval_logiqa_en | 0|acc |39.63|± | 1.92|
| | |acc_norm|39.63|± | 1.92|
|agieval_lsat_ar | 0|acc |24.78|± | 2.85|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |53.53|± | 2.21|
| | |acc_norm|53.92|± | 2.21|
|agieval_lsat_rc | 0|acc |66.91|± | 2.87|
| | |acc_norm|66.91|± | 2.87|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|80.58|± | 2.76|
|agieval_sat_en_without_passage| 0|acc |44.17|± | 3.47|
| | |acc_norm|44.17|± | 3.47|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|28.18|± | 3.04|
Average: 45.52%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |68.00|± | 1.36|
| | |acc_norm|68.17|± | 1.36|
|arc_easy | 0|acc |87.46|± | 0.68|
| | |acc_norm|83.63|± | 0.76|
|boolq | 1|acc |88.23|± | 0.56|
|hellaswag | 0|acc |69.69|± | 0.46|
| | |acc_norm|86.81|± | 0.34|
|openbookqa | 0|acc |39.00|± | 2.18|
| | |acc_norm|48.80|± | 2.24|
|piqa | 0|acc |83.51|± | 0.87|
| | |acc_norm|85.31|± | 0.83|
|winogrande | 0|acc |80.98|± | 1.10|
Average: 77.42%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.41|± | 1.73|
| | |mc2 |71.12|± | 1.49|
Average: 71.12%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.32|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|64.50|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.74|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.40|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.14|± | 1.62|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.33|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.60|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.55|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|55.80|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|33.27|± | 1.49|
|bigbench_snarks | 0|multiple_choice_grade|70.17|± | 3.41|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.66|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|49.60|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.00|± | 1.17|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.49|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.33|± | 2.85|
Average: 48.24%
Average score: 60.58%
Elapsed time: 02:28:47| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MBX-7B-v3](https://huggingface.co/flemmingmiguel/MBX-7B-v3)| 45.12| 77.48| 71.76| 48.48| 60.71|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.17|± | 2.80|
| | |acc_norm|24.02|± | 2.69|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|39.48|± | 1.92|
|agieval_lsat_ar | 0|acc |23.04|± | 2.78|
| | |acc_norm|23.91|± | 2.82|
|agieval_lsat_lr | 0|acc |52.16|± | 2.21|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |66.91|± | 2.87|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |80.10|± | 2.79|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |45.15|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|30.45|± | 3.11|
Average: 45.12%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.47|± | 1.38|
| | |acc_norm|67.66|± | 1.37|
|arc_easy | 0|acc |87.46|± | 0.68|
| | |acc_norm|84.22|± | 0.75|
|boolq | 1|acc |88.10|± | 0.57|
|hellaswag | 0|acc |68.05|± | 0.47|
| | |acc_norm|86.49|± | 0.34|
|openbookqa | 0|acc |39.60|± | 2.19|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.19|± | 0.87|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |81.29|± | 1.10|
Average: 77.48%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.30|± | 1.74|
| | |mc2 |71.76|± | 1.46|
Average: 71.76%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|55.79|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|65.58|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.51|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 1.11|± | 0.55|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.00|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.71|± | 1.61|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|48.20|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|55.60|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.80|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.91|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|31.76|± | 1.47|
|bigbench_snarks | 0|multiple_choice_grade|71.82|± | 3.35|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.86|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.12|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.11|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 48.48%
Average score: 60.71%
Elapsed time: 01:27:48| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|--------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[OmniBeagle-7B](https://huggingface.co/mlabonne/OmniBeagle-7B)| 45.66| 77.38| 75.03| 50.03| 62.02|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |28.74|± | 2.85|
| | |acc_norm|27.17|± | 2.80|
|agieval_logiqa_en | 0|acc |39.02|± | 1.91|
| | |acc_norm|39.48|± | 1.92|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|23.04|± | 2.78|
|agieval_lsat_lr | 0|acc |54.12|± | 2.21|
| | |acc_norm|54.31|± | 2.21|
|agieval_lsat_rc | 0|acc |65.43|± | 2.91|
| | |acc_norm|66.17|± | 2.89|
|agieval_sat_en | 0|acc |79.13|± | 2.84|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |45.63|± | 3.48|
| | |acc_norm|43.69|± | 3.46|
|agieval_sat_math | 0|acc |34.09|± | 3.20|
| | |acc_norm|32.27|± | 3.16|
Average: 45.66%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.98|± | 1.37|
| | |acc_norm|68.26|± | 1.36|
|arc_easy | 0|acc |87.12|± | 0.69|
| | |acc_norm|82.95|± | 0.77|
|boolq | 1|acc |88.07|± | 0.57|
|hellaswag | 0|acc |69.01|± | 0.46|
| | |acc_norm|87.14|± | 0.33|
|openbookqa | 0|acc |39.00|± | 2.18|
| | |acc_norm|49.40|± | 2.24|
|piqa | 0|acc |83.03|± | 0.88|
| | |acc_norm|85.53|± | 0.82|
|winogrande | 0|acc |80.27|± | 1.12|
Average: 77.38%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |60.59|± | 1.71|
| | |mc2 |75.03|± | 1.42|
Average: 75.03%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.32|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|63.69|± | 2.51|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|51.94|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.96|± | 2.26|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.60|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|25.14|± | 1.64|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.33|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|53.40|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|56.30|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.55|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|55.58|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|40.58|± | 1.56|
|bigbench_snarks | 0|multiple_choice_grade|74.03|± | 3.27|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.27|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|55.40|± | 1.57|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.20|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.89|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.33|± | 2.83|
Average: 50.03%
Average score: 62.02%
Elapsed time: 03:03:21| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v8](https://huggingface.co/CultriX/Wernicke-7B-v8)| 45.32| 77.67| 71.84| 48.49| 60.83|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|26.38|± | 2.77|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.78|± | 1.92|
|agieval_lsat_ar | 0|acc |23.48|± | 2.80|
| | |acc_norm|23.48|± | 2.80|
|agieval_lsat_lr | 0|acc |51.37|± | 2.22|
| | |acc_norm|52.35|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|78.64|± | 2.86|
|agieval_sat_en_without_passage| 0|acc |44.17|± | 3.47|
| | |acc_norm|43.20|± | 3.46|
|agieval_sat_math | 0|acc |35.00|± | 3.22|
| | |acc_norm|33.64|± | 3.19|
Average: 45.32%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.70|± | 1.39|
| | |acc_norm|68.00|± | 1.36|
|arc_easy | 0|acc |86.66|± | 0.70|
| | |acc_norm|82.62|± | 0.78|
|boolq | 1|acc |88.10|± | 0.57|
|hellaswag | 0|acc |69.00|± | 0.46|
| | |acc_norm|87.13|± | 0.33|
|openbookqa | 0|acc |38.60|± | 2.18|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |82.81|± | 0.88|
| | |acc_norm|85.20|± | 0.83|
|winogrande | 0|acc |83.43|± | 1.05|
Average: 77.67%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.67|± | 1.73|
| | |mc2 |71.84|± | 1.47|
Average: 71.84%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.89|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|62.60|± | 2.52|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|48.06|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.40|± | 2.24|
| | |exact_str_match | 9.19|± | 1.53|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.60|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.14|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|56.33|± | 2.87|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.20|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|52.60|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|70.95|± | 1.02|
|bigbench_ruin_names | 0|multiple_choice_grade|54.02|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|35.17|± | 1.51|
|bigbench_snarks | 0|multiple_choice_grade|79.01|± | 3.04|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.56|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|53.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.36|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.54|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|56.33|± | 2.87|
Average: 48.49%
Average score: 60.83%
Elapsed time: 00:21:37| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------|------:|------:|---------:|-------:|------:|
|[phi-2](https://huggingface.co/microsoft/phi-2)| 27.96| 70.84| 44.46| 35.17| 44.61|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |19.69|± | 2.50|
| | |acc_norm|20.87|± | 2.55|
|agieval_logiqa_en | 0|acc |25.65|± | 1.71|
| | |acc_norm|32.10|± | 1.83|
|agieval_lsat_ar | 0|acc |22.17|± | 2.75|
| | |acc_norm|20.87|± | 2.69|
|agieval_lsat_lr | 0|acc |30.20|± | 2.03|
| | |acc_norm|28.43|± | 2.00|
|agieval_lsat_rc | 0|acc |28.62|± | 2.76|
| | |acc_norm|28.62|± | 2.76|
|agieval_sat_en | 0|acc |50.00|± | 3.49|
| | |acc_norm|35.44|± | 3.34|
|agieval_sat_en_without_passage| 0|acc |38.83|± | 3.40|
| | |acc_norm|30.10|± | 3.20|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|27.27|± | 3.01|
Average: 27.96%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |53.07|± | 1.46|
| | |acc_norm|54.01|± | 1.46|
|arc_easy | 0|acc |80.01|± | 0.82|
| | |acc_norm|78.24|± | 0.85|
|boolq | 1|acc |83.46|± | 0.65|
|hellaswag | 0|acc |55.79|± | 0.50|
| | |acc_norm|73.85|± | 0.44|
|openbookqa | 0|acc |40.60|± | 2.20|
| | |acc_norm|51.40|± | 2.24|
|piqa | 0|acc |78.56|± | 0.96|
| | |acc_norm|79.38|± | 0.94|
|winogrande | 0|acc |75.53|± | 1.21|
Average: 70.84%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |30.97|± | 1.62|
| | |mc2 |44.46|± | 1.51|
Average: 44.46%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|53.68|± | 3.63|
|bigbench_date_understanding | 0|multiple_choice_grade|58.81|± | 2.57|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|36.43|± | 3.00|
|bigbench_geometric_shapes | 0|multiple_choice_grade|10.03|± | 1.59|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|24.00|± | 1.91|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|18.00|± | 1.45|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|40.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|41.00|± | 2.20|
|bigbench_navigate | 0|multiple_choice_grade|50.80|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|52.35|± | 1.12|
|bigbench_ruin_names | 0|multiple_choice_grade|27.23|± | 2.11|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|25.15|± | 1.37|
|bigbench_snarks | 0|multiple_choice_grade|57.46|± | 3.69|
|bigbench_sports_understanding | 0|multiple_choice_grade|50.30|± | 1.59|
|bigbench_temporal_sequences | 0|multiple_choice_grade|15.60|± | 1.15|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|17.60|± | 1.08|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|13.26|± | 0.81|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|40.67|± | 2.84|
Average: 35.17%
Average score: 44.61%
Elapsed time: 01:20:58| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MergeTrix-v6](https://huggingface.co/CultriX/MergeTrix-v6)| 45.54| 77.39| 72.01| 48.61| 60.89|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |28.74|± | 2.85|
| | |acc_norm|26.38|± | 2.77|
|agieval_logiqa_en | 0|acc |40.25|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |51.96|± | 2.21|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |79.61|± | 2.81|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|30.00|± | 3.10|
Average: 45.54%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.21|± | 1.38|
| | |acc_norm|67.66|± | 1.37|
|arc_easy | 0|acc |87.29|± | 0.68|
| | |acc_norm|83.21|± | 0.77|
|boolq | 1|acc |87.95|± | 0.57|
|hellaswag | 0|acc |68.90|± | 0.46|
| | |acc_norm|86.72|± | 0.34|
|openbookqa | 0|acc |39.40|± | 2.19|
| | |acc_norm|49.40|± | 2.24|
|piqa | 0|acc |83.46|± | 0.87|
| | |acc_norm|85.69|± | 0.82|
|winogrande | 0|acc |81.14|± | 1.10|
Average: 77.39%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.65|± | 1.73|
| | |mc2 |72.01|± | 1.48|
Average: 72.01%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.84|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|64.23|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|48.06|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.40|± | 2.24|
| | |exact_str_match | 0.28|± | 0.28|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.80|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.00|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|57.00|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.20|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|55.58|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|33.07|± | 1.49|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.66|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.16|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.83|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 48.61%
Average score: 60.89%
Elapsed time: 01:33:55| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[WestSeverus-7B-DPO-v2](https://huggingface.co/FelixChao/WestSeverus-7B-DPO-v2)| 45.29| 77.2| 72.72| 48.71| 60.98|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |51.57|± | 2.22|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.00|± | 3.10|
Average: 45.29%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |64.93|± | 1.39|
| | |acc_norm|68.00|± | 1.36|
|arc_easy | 0|acc |86.41|± | 0.70|
| | |acc_norm|83.16|± | 0.77|
|boolq | 1|acc |87.68|± | 0.57|
|hellaswag | 0|acc |67.65|± | 0.47|
| | |acc_norm|86.72|± | 0.34|
|openbookqa | 0|acc |38.80|± | 2.18|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |83.08|± | 0.87|
| | |acc_norm|85.09|± | 0.83|
|winogrande | 0|acc |81.14|± | 1.10|
Average: 77.2%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |55.20|± | 1.74|
| | |mc2 |72.72|± | 1.44|
Average: 72.72%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|61.05|± | 3.55|
|bigbench_date_understanding | 0|multiple_choice_grade|64.77|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|50.39|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 3.06|± | 0.91|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.40|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.14|± | 1.57|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.33|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.00|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.05|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.02|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.36|± | 1.46|
|bigbench_snarks | 0|multiple_choice_grade|75.69|± | 3.20|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.17|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.92|± | 1.21|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.77|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.33|± | 2.86|
Average: 48.71%
Average score: 60.98%
Elapsed time: 02:44:20| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[dpo-binarized-NeutrixOmnibe-7B](https://huggingface.co/eren23/dpo-binarized-NeutrixOmnibe-7B)| 44.96| 77.3| 77.24| 49.1| 62.15|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|40.40|± | 1.92|
|agieval_lsat_ar | 0|acc |26.09|± | 2.90|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |53.73|± | 2.21|
| | |acc_norm|54.51|± | 2.21|
|agieval_lsat_rc | 0|acc |65.06|± | 2.91|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |77.18|± | 2.93|
| | |acc_norm|77.67|± | 2.91|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|41.75|± | 3.44|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|29.55|± | 3.08|
Average: 44.96%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.98|± | 1.37|
| | |acc_norm|67.83|± | 1.37|
|arc_easy | 0|acc |86.36|± | 0.70|
| | |acc_norm|80.01|± | 0.82|
|boolq | 1|acc |87.61|± | 0.58|
|hellaswag | 0|acc |70.16|± | 0.46|
| | |acc_norm|87.49|± | 0.33|
|openbookqa | 0|acc |40.40|± | 2.20|
| | |acc_norm|50.20|± | 2.24|
|piqa | 0|acc |83.24|± | 0.87|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |82.56|± | 1.07|
Average: 77.3%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.57|± | 1.70|
| | |mc2 |77.24|± | 1.39|
Average: 77.24%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.95|± | 3.58|
|bigbench_date_understanding | 0|multiple_choice_grade|62.33|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|55.81|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.40|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.86|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.00|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|50.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.10|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.40|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|54.69|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|37.78|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|73.48|± | 3.29|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.46|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.70|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.48|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.86|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.00|± | 2.84|
Average: 49.1%
Average score: 62.15%
Elapsed time: 03:52:21
<!DOCTYPE html>
<html
lang="en"
data-color-mode="auto" data-light-theme="light" data-dark-theme="dark"
data-a11y-animated-images="system" data-a11y-link-underlines="true"
>
<head>
<meta charset="utf-8">
<link rel="dns-prefetch" href="https://github.githubassets.com">
<link rel="dns-prefetch" href="https://avatars.githubusercontent.com">
<link rel="dns-prefetch" href="https://github-cloud.s3.amazonaws.com">
<link rel="dns-prefetch" href="https://user-images.githubusercontent.com/">
<link rel="preconnect" href="https://github.githubassets.com" crossorigin>
<link rel="preconnect" href="https://avatars.githubusercontent.com">
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/light-0eace2597ca3.css" /><link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/dark-a167e256da9c.css" /><link data-color-theme="dark_dimmed" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_dimmed-d11f2cf8009b.css" /><link data-color-theme="dark_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_high_contrast-ea7373db06c8.css" /><link data-color-theme="dark_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_colorblind-afa99dcf40f7.css" /><link data-color-theme="light_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_colorblind-af6c685139ba.css" /><link data-color-theme="light_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_high_contrast-578cdbc8a5a9.css" /><link data-color-theme="light_tritanopia" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_tritanopia-5cb699a7e247.css" /><link data-color-theme="dark_tritanopia" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_tritanopia-9b32204967c6.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/primer-primitives-971c6be3ec9f.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/primer-08e422afeb43.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/global-a8d2cbec31a6.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/github-36dce55f3db6.css" />
<script type="application/json" id="client-env">{"locale":"en","featureFlags":["billing_net_usage_frontend","copilot_conversational_ux_history_refs","docset_management_ui","failbot_handle_non_errors","geojson_azure_maps","image_metric_tracking","marketing_forms_api_integration_contact_request","turbo_experiment_risky","sample_network_conn_type","no_character_key_shortcuts_in_inputs","custom_inp","remove_child_patch"]}</script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/wp-runtime-fdac6ab0ed49.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_dompurify_dist_purify_js-6890e890956f.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_stacktrace-parser_dist_stack-trace-parser_esm_js-node_modules_github_bro-a4c183-79f9611c275b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_hydro-analytics-client_dist_analytics-client_js-node_modules_gith-6a10dd-e66ebda625fb.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/ui_packages_failbot_failbot_ts-afaa9a250f2e.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/environment-4ff0d843ea45.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_selector-observer_dist_index_esm_js-9f960d9b217c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_behaviors_dist_esm_focus-zone_js-086f7a27bac0.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_relative-time-element_dist_index_js-c76945c5961a.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_combobox-nav_dist_index_js-node_modules_github_markdown-toolbar-e-820fc0-a7dea68af91d.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_delegated-events_dist_index_js-node_modules_github_details-dialog-elemen-29dc30-a2a71f11a507.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_filter-input-element_dist_index_js-node_modules_github_remote-inp-e4ab91-60b24e4f6f42.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_file-attachment-element_dist_index_js-node_modules_primer_view-co-eb424d-fd64db823614.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/github-elements-693343d61474.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/element-registry-572e9d2514ec.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_catalyst_lib_index_js-node_modules_github_hydro-analytics-client_-978abc0-add939c751ce.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_lit-html_lit-html_js-5b376145beff.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_mini-throttle_dist_index_js-node_modules_github_alive-client_dist-bf5aa2-1b562c29ab8e.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_morphdom_dist_morphdom-esm_js-5bff297a06de.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_turbo_dist_turbo_es2017-esm_js-c91f4ad18b62.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_color-convert_index_js-72c9fbde5ad4.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_remote-form_dist_index_js-node_modules_scroll-anchoring_dist_scro-231ccf-aa129238d13b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_behaviors_dist_esm_dimensions_js-node_modules_github_jtml_lib_index_js-95b84ee6bc34.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_paste-markdown_dist_index_esm_js-node_modules_github_quote-select-77da2d-3bdb0030c085.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_updatable-content_ts-5e0904652c1c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_task-list_ts-app_assets_modules_github_onfocus_ts-app_ass-421cec-751caa0072bd.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_sticky-scroll-into-view_ts-cbcee0788fe3.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_ajax-error_ts-app_assets_modules_github_behaviors_include-467754-b59a2b2827ad.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_commenting_edit_ts-app_assets_modules_github_behaviors_ht-83c235-b85e9f4f1304.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_blob-anchor_ts-app_assets_modules_github_filter-sort_ts-app_assets_-c96432-ca86212e46a4.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/behaviors-97473afbe590.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_delegated-events_dist_index_js-node_modules_github_catalyst_lib_index_js-d0256ebff5cd.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/notifications-global-99d196517b1b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_remote-form_dist_index_js-node_modules_primer_behaviors_dist_esm_-62b04e-513c880e3a9c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_diffs_blob-lines_ts-app_assets_modules_github_diffs_linkable-line-n-d80317-78852bb1c926.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/gist-be0c4546208a.js"></script>
<title>Discover gists · GitHub</title>
<meta name="route-pattern" content="/starred(.:format)" data-turbo-transient>
<meta name="route-controller" content="listings" data-turbo-transient>
<meta name="route-action" content="starred" data-turbo-transient>
<meta name="current-catalog-service-hash" content="56253a530ab9027b25719525dcbe6007461a3202218f6f5dfce5a601c121cbcb">
<meta name="request-id" content="C55C:1B75C3:5CDDE5B:5DFF8FE:65CD4F75" data-pjax-transient="true"/><meta name="html-safe-nonce" content="b59cb8c2f81b9f39f5bbd35fa3ca8c14f6dc145761adb2a9eebc74e419f9dea0" data-pjax-transient="true"/><meta name="visitor-payload" content="eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDNTVDOjFCNzVDMzo1Q0RERTVCOjVERkY4RkU6NjVDRDRGNzUiLCJ2aXNpdG9yX2lkIjoiMzQ4NjU3Nzc2NTk1OTY4Mzk1NyIsInJlZ2lvbl9lZGdlIjoiZnJhIiwicmVnaW9uX3JlbmRlciI6ImZyYSJ9" data-pjax-transient="true"/><meta name="visitor-hmac" content="9d8eddc58edbf735a39db1ac7e65a5b06efe772ab20c8795fb6664852d2c77db" data-pjax-transient="true"/>
<meta name="github-keyboard-shortcuts" content="copilot" data-turbo-transient="true" />
<meta name="selected-link" value="/starred" data-turbo-transient>
<link rel="assets" href="https://github.githubassets.com/">
<meta name="google-site-verification" content="c1kuD-K2HIVF635lypcsWPoD4kilo5-jA_wBFyT4uMY">
<meta name="google-site-verification" content="KT5gs8h0wvaagLKAVWq8bbeNwnZZK1r1XQysX3xurLU">
<meta name="google-site-verification" content="ZzhVyEFwb7w3e0-uOTltm8Jsck2F5StVihD0exw2fsA">
<meta name="google-site-verification" content="GXs5KoUUkNCoaAZn7wPN-t01Pywp9M3sEjnt_3_ZWPc">
<meta name="google-site-verification" content="Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I">
<meta name="octolytics-url" content="https://collector.github.com/github/collect" />
<meta name="analytics-location" content="/starred" data-turbo-transient="true" />
<meta name="user-login" content="">
<meta name="viewport" content="width=device-width">
<meta name="description" content="GitHub Gist: instantly share code, notes, and snippets.">
<link rel="search" type="application/opensearchdescription+xml" href="/opensearch-gist.xml" title="Gist">
<link rel="fluid-icon" href="https://gist.github.com/fluidicon.png" title="GitHub">
<meta property="fb:app_id" content="1401488693436528">
<meta name="apple-itunes-app" content="app-id=1477376905, app-argument=https://gist.github.com/starred" />
<meta name="twitter:image:src" content="https://github.com/opengraph.png" /><meta name="twitter:site" content="@github" /><meta name="twitter:card" content="summary_large_image" /><meta name="twitter:title" content="Discover gists" /><meta name="twitter:description" content="GitHub Gist: instantly share code, notes, and snippets." />
<meta property="og:image" content="https://github.com/opengraph.png" /><meta property="og:image:alt" content="GitHub Gist: instantly share code, notes, and snippets." /><meta property="og:site_name" content="Gist" /><meta property="og:type" content="website" /><meta property="og:title" content="Discover gists" /><meta property="og:description" content="GitHub Gist: instantly share code, notes, and snippets." />
<meta name="hostname" content="gist.github.com">
<meta name="expected-hostname" content="gist.github.com">
<meta http-equiv="x-pjax-version" content="a880a1655d726633117aba8dfffc2e165eefba9c2bc7cd62065e0a6338264704" data-turbo-track="reload">
<meta http-equiv="x-pjax-csp-version" content="5dcfbec3488c5fd5a334e287ce6a17058b7d4beb91db2d4d184e4d55bbf1d7d7" data-turbo-track="reload">
<meta http-equiv="x-pjax-css-version" content="fc7dfbcc4179b73e820d020658f54500fa28c573604791e50a58cef56e331033" data-turbo-track="reload">
<meta http-equiv="x-pjax-js-version" content="76ce0c0e81d1403d1c5f50f4ff35ca9fe1d30e0bfd54ae1c9c1f020376aabff4" data-turbo-track="reload">
<meta name="turbo-cache-control" content="no-preview" data-turbo-transient="">
<link href="/starred.atom" rel="alternate" title="atom" type="application/atom+xml">
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/gist-b55b6bd3753b.css" />
<meta name="turbo-body-classes" content="logged-out env-production page-responsive">
<meta name="browser-stats-url" content="https://api.github.com/_private/browser/stats">
<meta name="browser-errors-url" content="https://api.github.com/_private/browser/errors">
<link rel="mask-icon" href="https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg" color="#000000">
<link rel="alternate icon" class="js-site-favicon" type="image/png" href="https://github.githubassets.com/favicons/favicon.png">
<link rel="icon" class="js-site-favicon" type="image/svg+xml" href="https://github.githubassets.com/favicons/favicon.svg">
<meta name="theme-color" content="#1e2327">
<meta name="color-scheme" content="light dark" />
</head>
<body class="logged-out env-production page-responsive" style="word-wrap: break-word;">
<div data-turbo-body class="logged-out env-production page-responsive" style="word-wrap: break-word;">
<div class="position-relative js-header-wrapper ">
<a href="#start-of-content" class="px-2 py-4 color-bg-accent-emphasis color-fg-on-emphasis show-on-focus js-skip-to-content">Skip to content</a>
<span data-view-component="true" class="progress-pjax-loader Progress position-fixed width-full">
<span style="width: 0%;" data-view-component="true" class="Progress-item progress-pjax-loader-bar left-0 top-0 color-bg-accent-emphasis"></span>
</span>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/react-lib-1fbfc5be2c18.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_octicons-react_dist_index_esm_js-node_modules_primer_react_lib-es-2e8e7c-b299afe58dd7.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Box_Box_js-ebfceb11fb57.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Button_Button_js-0528cb519251.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_ActionList_index_js-e001d0eead25.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Button_IconButton_js-node_modules_primer_react_lib--23bcad-ccf1d5fc6054.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/ui_packages_react-core_create-browser-history_ts-ui_packages_react-core_deferred-registry_ts--ebbb92-64923177f972.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/keyboard-shortcuts-dialog-a2ca669523db.js"></script>
<react-partial
partial-name="keyboard-shortcuts-dialog"
data-ssr="false"
>
<script type="application/json" data-target="react-partial.embeddedData">{"props":{}}</script>
<div data-target="react-partial.reactRoot"></div>
</react-partial>
<div class="Header js-details-container Details flex-wrap flex-md-nowrap p-responsive" role="banner" >
<div class="Header-item d-none d-md-flex">
<a class="Header-link" data-hotkey="g d" aria-label="Gist Homepage " href="/">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github v-align-middle d-inline-block d-md-none">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 45 16" version="1.1" width="67" data-view-component="true" class="octicon octicon-logo-github v-align-middle d-none d-md-inline-block">
<path d="M8.81 7.35v5.74c0 .04-.01.11-.06.13 0 0-1.25.89-3.31.89-2.49 0-5.44-.78-5.44-5.92S2.58 1.99 5.1 2c2.18 0 3.06.49 3.2.58.04.05.06.09.06.14L7.94 4.5c0 .09-.09.2-.2.17-.36-.11-.9-.33-2.17-.33-1.47 0-3.05.42-3.05 3.73s1.5 3.7 2.58 3.7c.92 0 1.25-.11 1.25-.11v-2.3H4.88c-.11 0-.19-.08-.19-.17V7.35c0-.09.08-.17.19-.17h3.74c.11 0 .19.08.19.17Zm35.85 2.33c0 3.43-1.11 4.41-3.05 4.41-1.64 0-2.52-.83-2.52-.83s-.04.46-.09.52c-.03.06-.08.08-.14.08h-1.48c-.1 0-.19-.08-.19-.17l.02-11.11c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v3.77s.82-.53 2.02-.53l-.01-.02c1.2 0 2.97.45 2.97 3.88ZM27.68 2.43c.09 0 .17.08.17.17v11.11c0 .09-.08.17-.17.17h-2.13c-.09 0-.17-.08-.17-.17l.02-4.75h-3.31v4.75c0 .09-.08.17-.17.17h-2.13c-.08 0-.17-.08-.17-.17V2.6c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v4.09h3.31V2.6c0-.09.08-.17.17-.17Zm8.26 3.64c.11 0 .19.08.19.17l-.02 7.47c0 .09-.06.17-.17.17H34.6c-.07 0-.14-.04-.16-.09-.03-.06-.08-.45-.08-.45s-1.13.77-2.52.77c-1.69 0-2.92-.55-2.92-2.75V6.25c0-.09.08-.17.17-.17h2.14c.09 0 .17.08.17.17V11c0 .75.22 1.09.97 1.09s1.3-.39 1.3-.39V6.26c0-.11.06-.19.17-.19Zm-17.406 5.971h.005a.177.177 0 0 1 .141.179v1.5c0 .07-.03.14-.09.16-.1.05-.74.22-1.27.22-1.16 0-2.86-.25-2.86-2.69V8.13h-1.11c-.09 0-.17-.08-.17-.19V6.58c0-.08.05-.15.13-.17.07-.01 1.16-.28 1.16-.28V3.96c0-.08.05-.13.14-.13h2.16c.09 0 .14.05.14.13v2.11h1.59c.08 0 .16.08.16.17v1.7c0 .11-.07.19-.16.19h-1.59v3.131c0 .47.27.83 1.05.83.247 0 .481-.049.574-.05ZM12.24 6.06c.09 0 .17.08.17.17v7.37c0 .18-.05.27-.25.27h-1.92c-.17 0-.3-.07-.3-.27V6.26c0-.11.08-.2.17-.2Zm29.99 3.78c0-1.81-.73-2.05-1.5-1.97-.6.04-1.08.34-1.08.34v3.52s.49.34 1.22.36c1.03.03 1.36-.34 1.36-2.25ZM11.19 2.68c.75 0 1.36.61 1.36 1.38 0 .77-.61 1.38-1.36 1.38-.77 0-1.38-.61-1.38-1.38 0-.77.61-1.38 1.38-1.38Zm7.34 9.35v.001l.01.01h-.001l-.005-.001v.001c-.009-.001-.015-.011-.024-.011Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 25 16" version="1.1" width="37" data-view-component="true" class="octicon octicon-logo-gist v-align-middle d-none d-md-inline-block">
<path d="M4.7 8.73v-1h3.52v5.69c-.78.37-1.95.64-3.59.64C1.11 14.06 0 11.37 0 8.03 0 4.69 1.13 2 4.63 2c1.62 0 2.64.33 3.28.66v1.05c-1.22-.5-2-.73-3.28-.73-2.57 0-3.48 2.21-3.48 5.06 0 2.85.91 5.05 3.47 5.05.89 0 1.98-.07 2.53-.34V8.73Zm10.98.69h.03c2.22.2 2.75.95 2.75 2.23 0 1.21-.76 2.41-3.14 2.41-.75 0-1.83-.19-2.33-.39v-.94c.47.17 1.22.36 2.33.36 1.62 0 2.06-.69 2.06-1.42 0-.71-.22-1.21-1.77-1.34-2.26-.2-2.73-1-2.73-2.08 0-1.11.72-2.31 2.92-2.31.73 0 1.56.09 2.25.39v.94c-.61-.2-1.22-.36-2.27-.36-1.55 0-1.88.57-1.88 1.34 0 .69.28 1.04 1.78 1.17Zm8.58-3.33v.85h-2.42v4.87c0 .95.53 1.34 1.5 1.34.2 0 .42 0 .61-.03v.89c-.17.03-.5.05-.69.05-1.31 0-2.5-.6-2.5-2.13v-5H19.2v-.48l1.56-.44V3.9l1.08-.31v2.5h2.42Zm-13.17-.03v6.41c0 .54.19.7.67.7v.89c-1.14 0-1.72-.47-1.72-1.72V6.06h1.05Zm.25-2.33c0 .44-.34.78-.78.78a.76.76 0 0 1-.77-.78c0-.44.32-.78.77-.78s.78.34.78.78Z"></path>
</svg>
</a>
</div>
<div class="Header-item d-md-none">
<button aria-label="Toggle navigation" aria-expanded="false" type="button" data-view-component="true" class="Header-link js-details-target btn-link"> <svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-three-bars">
<path d="M1 2.75A.75.75 0 0 1 1.75 2h12.5a.75.75 0 0 1 0 1.5H1.75A.75.75 0 0 1 1 2.75Zm0 5A.75.75 0 0 1 1.75 7h12.5a.75.75 0 0 1 0 1.5H1.75A.75.75 0 0 1 1 7.75ZM1.75 12h12.5a.75.75 0 0 1 0 1.5H1.75a.75.75 0 0 1 0-1.5Z"></path>
</svg>
</button> </div>
<div class="Header-item Header-item--full js-site-search flex-column flex-md-row width-full flex-order-2 flex-md-order-none mr-0 mr-md-3 mt-3 mt-md-0 Details-content--hidden-not-important d-md-flex">
<div class="header-search flex-self-stretch flex-md-self-auto mr-0 mr-md-3 mb-3 mb-md-0">
<!-- '"` --><!-- </textarea></xmp> --></option></form><form class="position-relative js-quicksearch-form" role="search" aria-label="Site" data-turbo="false" action="/search" accept-charset="UTF-8" method="get">
<div class="header-search-wrapper form-control input-sm js-chromeless-input-container">
<input type="text"
class="form-control input-sm js-site-search-focus header-search-input"
data-hotkey="s,/"
name="q"
aria-label="Search"
placeholder="Search…"
autocorrect="off"
autocomplete="off"
autocapitalize="off">
</div>
</form></div>
<nav aria-label="Global" class="d-flex flex-column flex-md-row flex-self-stretch flex-md-self-auto">
<a class="Header-link mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, go to all gists, text:all gists" href="/discover">All gists</a>
<a class="Header-link mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, go to GitHub, text:Back to GitHub" href="https://github.com">Back to GitHub</a>
<a class="Header-link d-block d-md-none mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, sign in" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;LOG_IN&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="225a86d9264757791845a28f333324d7e939cb14b238b4e1e54d6ed07d633ee4" href="https://gist.github.com/auth/github?return_to=https%3A%2F%2Fgist.github.com%2Fstarred">
Sign in
</a>
<a class="Header-link d-block d-md-none mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, sign up" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;SIGN_UP&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="21c68033dfd930a856c07fedf0fe5ecb925c7c44e5a0186c44a57f82f0f21a32" href="/join?return_to=https%3A%2F%2Fgist.github.com%2Fstarred&amp;source=header-gist">
Sign up
</a></nav>
</div>
<div class="Header-item Header-item--full flex-justify-center d-md-none position-relative">
<a class="Header-link" data-hotkey="g d" aria-label="Gist Homepage " href="/">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github v-align-middle d-inline-block d-md-none">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 45 16" version="1.1" width="67" data-view-component="true" class="octicon octicon-logo-github v-align-middle d-none d-md-inline-block">
<path d="M8.81 7.35v5.74c0 .04-.01.11-.06.13 0 0-1.25.89-3.31.89-2.49 0-5.44-.78-5.44-5.92S2.58 1.99 5.1 2c2.18 0 3.06.49 3.2.58.04.05.06.09.06.14L7.94 4.5c0 .09-.09.2-.2.17-.36-.11-.9-.33-2.17-.33-1.47 0-3.05.42-3.05 3.73s1.5 3.7 2.58 3.7c.92 0 1.25-.11 1.25-.11v-2.3H4.88c-.11 0-.19-.08-.19-.17V7.35c0-.09.08-.17.19-.17h3.74c.11 0 .19.08.19.17Zm35.85 2.33c0 3.43-1.11 4.41-3.05 4.41-1.64 0-2.52-.83-2.52-.83s-.04.46-.09.52c-.03.06-.08.08-.14.08h-1.48c-.1 0-.19-.08-.19-.17l.02-11.11c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v3.77s.82-.53 2.02-.53l-.01-.02c1.2 0 2.97.45 2.97 3.88ZM27.68 2.43c.09 0 .17.08.17.17v11.11c0 .09-.08.17-.17.17h-2.13c-.09 0-.17-.08-.17-.17l.02-4.75h-3.31v4.75c0 .09-.08.17-.17.17h-2.13c-.08 0-.17-.08-.17-.17V2.6c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v4.09h3.31V2.6c0-.09.08-.17.17-.17Zm8.26 3.64c.11 0 .19.08.19.17l-.02 7.47c0 .09-.06.17-.17.17H34.6c-.07 0-.14-.04-.16-.09-.03-.06-.08-.45-.08-.45s-1.13.77-2.52.77c-1.69 0-2.92-.55-2.92-2.75V6.25c0-.09.08-.17.17-.17h2.14c.09 0 .17.08.17.17V11c0 .75.22 1.09.97 1.09s1.3-.39 1.3-.39V6.26c0-.11.06-.19.17-.19Zm-17.406 5.971h.005a.177.177 0 0 1 .141.179v1.5c0 .07-.03.14-.09.16-.1.05-.74.22-1.27.22-1.16 0-2.86-.25-2.86-2.69V8.13h-1.11c-.09 0-.17-.08-.17-.19V6.58c0-.08.05-.15.13-.17.07-.01 1.16-.28 1.16-.28V3.96c0-.08.05-.13.14-.13h2.16c.09 0 .14.05.14.13v2.11h1.59c.08 0 .16.08.16.17v1.7c0 .11-.07.19-.16.19h-1.59v3.131c0 .47.27.83 1.05.83.247 0 .481-.049.574-.05ZM12.24 6.06c.09 0 .17.08.17.17v7.37c0 .18-.05.27-.25.27h-1.92c-.17 0-.3-.07-.3-.27V6.26c0-.11.08-.2.17-.2Zm29.99 3.78c0-1.81-.73-2.05-1.5-1.97-.6.04-1.08.34-1.08.34v3.52s.49.34 1.22.36c1.03.03 1.36-.34 1.36-2.25ZM11.19 2.68c.75 0 1.36.61 1.36 1.38 0 .77-.61 1.38-1.36 1.38-.77 0-1.38-.61-1.38-1.38 0-.77.61-1.38 1.38-1.38Zm7.34 9.35v.001l.01.01h-.001l-.005-.001v.001c-.009-.001-.015-.011-.024-.011Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 25 16" version="1.1" width="37" data-view-component="true" class="octicon octicon-logo-gist v-align-middle d-none d-md-inline-block">
<path d="M4.7 8.73v-1h3.52v5.69c-.78.37-1.95.64-3.59.64C1.11 14.06 0 11.37 0 8.03 0 4.69 1.13 2 4.63 2c1.62 0 2.64.33 3.28.66v1.05c-1.22-.5-2-.73-3.28-.73-2.57 0-3.48 2.21-3.48 5.06 0 2.85.91 5.05 3.47 5.05.89 0 1.98-.07 2.53-.34V8.73Zm10.98.69h.03c2.22.2 2.75.95 2.75 2.23 0 1.21-.76 2.41-3.14 2.41-.75 0-1.83-.19-2.33-.39v-.94c.47.17 1.22.36 2.33.36 1.62 0 2.06-.69 2.06-1.42 0-.71-.22-1.21-1.77-1.34-2.26-.2-2.73-1-2.73-2.08 0-1.11.72-2.31 2.92-2.31.73 0 1.56.09 2.25.39v.94c-.61-.2-1.22-.36-2.27-.36-1.55 0-1.88.57-1.88 1.34 0 .69.28 1.04 1.78 1.17Zm8.58-3.33v.85h-2.42v4.87c0 .95.53 1.34 1.5 1.34.2 0 .42 0 .61-.03v.89c-.17.03-.5.05-.69.05-1.31 0-2.5-.6-2.5-2.13v-5H19.2v-.48l1.56-.44V3.9l1.08-.31v2.5h2.42Zm-13.17-.03v6.41c0 .54.19.7.67.7v.89c-1.14 0-1.72-.47-1.72-1.72V6.06h1.05Zm.25-2.33c0 .44-.34.78-.78.78a.76.76 0 0 1-.77-.78c0-.44.32-.78.77-.78s.78.34.78.78Z"></path>
</svg>
</a>
</div>
<div class="Header-item f4 mr-0" role="navigation" aria-label="Sign in or sign up">
<a class="Header-link no-underline mr-3" data-ga-click="Header, sign in" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;LOG_IN&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="225a86d9264757791845a28f333324d7e939cb14b238b4e1e54d6ed07d633ee4" href="https://gist.github.com/auth/github?return_to=https%3A%2F%2Fgist.github.com%2Fstarred">
Sign&nbsp;in
</a> <a class="Header-link d-inline-block no-underline border color-border-default rounded px-2 py-1" data-ga-click="Header, sign up" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;SIGN_UP&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="21c68033dfd930a856c07fedf0fe5ecb925c7c44e5a0186c44a57f82f0f21a32" href="/join?return_to=https%3A%2F%2Fgist.github.com%2Fstarred&amp;source=header-gist">
Sign&nbsp;up
</a> </div>
</div>
<div hidden="hidden" data-view-component="true" class="js-stale-session-flash stale-session-flash flash flash-warn flash-full mb-3">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span class="js-stale-session-flash-signed-in" hidden>You signed in with another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<span class="js-stale-session-flash-signed-out" hidden>You signed out in another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<span class="js-stale-session-flash-switched" hidden>You switched accounts on another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<button id="icon-button-0413d99c-7e94-4f11-9027-cabde9036396" aria-labelledby="tooltip-e8a4777f-ee76-456a-89c9-2886b49772c4" type="button" data-view-component="true" class="Button Button--iconOnly Button--invisible Button--medium flash-close js-flash-close"> <svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x Button-visual">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button><tool-tip id="tooltip-e8a4777f-ee76-456a-89c9-2886b49772c4" for="icon-button-0413d99c-7e94-4f11-9027-cabde9036396" popover="manual" data-direction="s" data-type="label" data-view-component="true" class="sr-only position-absolute">Dismiss alert</tool-tip>
</div>
</div>
<div id="start-of-content" class="show-on-focus"></div>
<div id="js-flash-container" data-turbo-replace>
<template class="js-flash-template">
<div class="flash flash-full {{ className }}">
<div class="px-2" >
<button autofocus class="flash-close js-flash-close" type="button" aria-label="Dismiss this message">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
<div aria-atomic="true" role="alert" class="js-flash-alert">
<div>{{ message }}</div>
</div>
</div>
</div>
</template>
</div>
<include-fragment class="js-notification-shelf-include-fragment" data-base-src="https://github.com/notifications/beta/shelf"></include-fragment>
<div
class="application-main "
data-commit-hovercards-enabled
data-discussion-hovercards-enabled
data-issue-and-pr-hovercards-enabled
>
<div itemscope itemtype="http://schema.org/Code">
<main id="gist-pjax-container">
<div class="gist-detail-intro gist-banner pb-3">
<div class="text-center container-lg px-3">
<p class="lead">
Instantly share code, notes, and snippets.
</p>
</div>
</div>
<div class="gisthead pagehead pb-0 pt-3 mb-4">
<div class="px-0">
<div class="px-3">
<div class="mb-3 d-flex">
<h1 class="float-none flex-auto pl-0 width-fit">
<svg height="32" aria-hidden="true" viewBox="0 0 24 24" version="1.1" width="32" data-view-component="true" class="octicon octicon-code-square mt-0 position-static v-align-middle">
<path d="M10.3 8.24a.75.75 0 0 1-.04 1.06L7.352 12l2.908 2.7a.75.75 0 1 1-1.02 1.1l-3.5-3.25a.75.75 0 0 1 0-1.1l3.5-3.25a.75.75 0 0 1 1.06.04Zm3.44 1.06a.75.75 0 1 1 1.02-1.1l3.5 3.25a.75.75 0 0 1 0 1.1l-3.5 3.25a.75.75 0 1 1-1.02-1.1l2.908-2.7-2.908-2.7Z"></path><path d="M2 3.75C2 2.784 2.784 2 3.75 2h16.5c.966 0 1.75.784 1.75 1.75v16.5A1.75 1.75 0 0 1 20.25 22H3.75A1.75 1.75 0 0 1 2 20.25Zm1.75-.25a.25.25 0 0 0-.25.25v16.5c0 .138.112.25.25.25h16.5a.25.25 0 0 0 .25-.25V3.75a.25.25 0 0 0-.25-.25Z"></path>
</svg>
Discover gists
</h1>
<ul class="pagehead-actions float-none">
<li></li>
</ul>
</div>
<nav aria-label="Gist tab" data-view-component="true" class="UnderlineNav">
<ul data-view-component="true" class="UnderlineNav-body list-style-none">
<li data-view-component="true" class="d-inline-flex">
<a href="/discover" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square UnderlineNav-octicon">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
<span data-view-component="true">All gists</span>
</a></li>
<li data-view-component="true" class="d-inline-flex">
<a href="/forked" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-git-branch UnderlineNav-octicon">
<path d="M9.5 3.25a2.25 2.25 0 1 1 3 2.122V6A2.5 2.5 0 0 1 10 8.5H6a1 1 0 0 0-1 1v1.128a2.251 2.251 0 1 1-1.5 0V5.372a2.25 2.25 0 1 1 1.5 0v1.836A2.493 2.493 0 0 1 6 7h4a1 1 0 0 0 1-1v-.628A2.25 2.25 0 0 1 9.5 3.25Zm-6 0a.75.75 0 1 0 1.5 0 .75.75 0 0 0-1.5 0Zm8.25-.75a.75.75 0 1 0 0 1.5.75.75 0 0 0 0-1.5ZM4.25 12a.75.75 0 1 0 0 1.5.75.75 0 0 0 0-1.5Z"></path>
</svg>
<span data-view-component="true">Forked</span>
</a></li>
<li data-view-component="true" class="d-inline-flex">
<a href="/starred" aria-current="page" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star UnderlineNav-octicon">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
<span data-view-component="true">Starred</span>
</a></li>
</ul>
</nav>
</div>
</div>
</div>
<div class="container-lg px-3">
<div class="repository-content gist-content" >
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
4 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
18 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/chrisaycock/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/chrisaycock"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/453745?s=60&amp;v=4" width="30" height="30" alt="@chrisaycock" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/chrisaycock/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/chrisaycock">chrisaycock</a>
/ <a href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266"><strong class="css-truncate-target">firms.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:39:43Z" data-view-component="true">February 14, 2024 23:39</relative-time>
</div>
<span class="f6 color-fg-muted">
List of quantitative trading firms
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/chrisaycock/8b7a37b1f97549517cb7789be5b06266">
<span class="link">View <strong>firms.md</strong></span>
</a> <div id="file-firms-md" class="file my-2">
<div id="file-firms-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><ul dir="auto">
<li><a href="https://www.3redpartners.com" rel="nofollow">3Red Partners</a></li>
<li><a href="https://www.aprioriinvestments.com" rel="nofollow">A Priori Investments</a></li>
<li><a href="https://www.acadian-asset.com" rel="nofollow">Acadian Asset Management</a></li>
<li><a href="https://akunacapital.com" rel="nofollow">Akuna Capital</a></li>
<li><a href="https://www.albatrosslabs.io" rel="nofollow">Albatross Labs</a></li>
<li><a href="https://www.alpha-grep.com" rel="nofollow">AlphaGrep</a></li>
<li><a href="https://www.alphasimplex.com" rel="nofollow">AlphaSimplex</a></li>
<li><a href="https://www.alphataraxia.com" rel="nofollow">Alphataraxia Management</a></li>
<li><a href="http://www.alyeskagroup.com" rel="nofollow">Alyeska Investment Group</a></li>
<li><a href="https://ansatz.capital" rel="nofollow">Ansatz Capital</a></li>
</ul>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
108 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
35 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1122 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/cpursley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/cpursley"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/1223773?s=60&amp;v=4" width="30" height="30" alt="@cpursley" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/cpursley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/cpursley">cpursley</a>
/ <a href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb"><strong class="css-truncate-target">postgresql_is_enough.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:35:53Z" data-view-component="true">February 14, 2024 23:35</relative-time>
</div>
<span class="f6 color-fg-muted">
Postgres is Enough
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb">
<span class="link">View <strong>postgresql_is_enough.md</strong></span>
</a> <div id="file-postgresql_is_enough-md" class="file my-2">
<div id="file-postgresql_is_enough-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-postgresql-is-enough" class="anchor" aria-hidden="true" tabindex="-1" href="#postgresql-is-enough"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>PostgreSQL is Enough</h1>
<ul dir="auto">
<li><a href="https://sive.rs/pg" rel="nofollow">Simplify: move code into database functions</a></li>
<li><a href="https://www.amazingcto.com/postgres-for-everything/" rel="nofollow">Just Use Postgres for Everything</a></li>
<li><a href="https://www.2ndquadrant.com/en/blog/postgresql-is-the-worlds-best-database/" rel="nofollow">PostgreSQL is the worlds’ best database</a></li>
<li><a href="https://news.ycombinator.com/item?id=39273954" rel="nofollow">Hacker News discussion</a></li>
</ul>
<h2 dir="auto"><a id="user-content-background-and-cron-jobs" class="anchor" aria-hidden="true" tabindex="-1" href="#background-and-cron-jobs"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Background and Cron Jobs</h2>
<ul dir="auto">
<li><a href="https://github.com/citusdata/pg_cron">https://github.com/citusdata/pg_cron</a></li>
</ul>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1 star
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/ajitid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/ajitid"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/26769888?s=60&amp;v=4" width="30" height="30" alt="@ajitid" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/ajitid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/ajitid">ajitid</a>
/ <a href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6"><strong class="css-truncate-target">trigger_scan.py</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:34:00Z" data-view-component="true">February 14, 2024 23:34</relative-time>
</div>
<span class="f6 color-fg-muted">
for <a href="https://github.com/debridmediamanager/zurg-testing/issues/72">https://github.com/debridmediamanager/zurg-testing/issues/72</a>
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/ajitid/1bbbf24e47669c5c571571ca3eb189e6">
<span class="link">View <strong>trigger_scan.py</strong></span>
</a> <div id="file-trigger_scan-py" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-python gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Python" data-tagsearch-path="trigger_scan.py">
<tr>
<td id="file-trigger_scan-py-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-trigger_scan-py-LC1" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>os</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-trigger_scan-py-LC2" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>subprocess</span> <span class=pl-k>import</span> <span class=pl-s1>check_output</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-trigger_scan-py-LC3" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>pprint</span> <span class=pl-k>import</span> <span class=pl-s1>pprint</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-trigger_scan-py-LC4" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-trigger_scan-py-LC5" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>plexapi</span>.<span class=pl-s1>server</span> <span class=pl-k>import</span> <span class=pl-v>PlexServer</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-trigger_scan-py-LC6" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-trigger_scan-py-LC7" class="blob-code blob-code-inner js-file-line"><span class=pl-k>def</span> <span class=pl-en>process_movie_section</span>(<span class=pl-s1>section</span>, <span class=pl-s1>plex_media_paths</span>, <span class=pl-s1>rclone_mount</span>):</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-trigger_scan-py-LC8" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>for</span> <span class=pl-s1>directory</span> <span class=pl-c1>in</span> <span class=pl-s1>section</span>.<span class=pl-en>all</span>():</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-trigger_scan-py-LC9" class="blob-code blob-code-inner js-file-line"> <span class=pl-c># in case of a movie, this will host a list of files</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-trigger_scan-py-LC10" class="blob-code blob-code-inner js-file-line"> <span class=pl-c># which is actually just 1 file, mentioning the movie&#39;s location</span></td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
9 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
2 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
28 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/iamucil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/iamucil"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/210371?s=60&amp;v=4" width="30" height="30" alt="@iamucil" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/iamucil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/iamucil">iamucil</a>
/ <a href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc"><strong class="css-truncate-target">go mod rename module.sh</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:25:52Z" data-view-component="true">February 14, 2024 23:25</relative-time>
</div>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc">
<span class="link">View <strong>go mod rename module.sh</strong></span>
</a> <div id="file-go-mod-rename-module-sh" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-shell gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Shell" data-tagsearch-path="go mod rename module.sh">
<tr>
<td id="file-go-mod-rename-module-sh-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-go-mod-rename-module-sh-LC1" class="blob-code blob-code-inner js-file-line">go mod edit -module {NEW_MODULE_NAME}</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-go-mod-rename-module-sh-LC2" class="blob-code blob-code-inner js-file-line">-- rename all imported module</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-go-mod-rename-module-sh-LC3" class="blob-code blob-code-inner js-file-line">find <span class="pl-c1">.</span> -type f -name <span class="pl-s"><span class="pl-pds">&#39;</span>*.go<span class="pl-pds">&#39;</span></span> \</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-go-mod-rename-module-sh-LC4" class="blob-code blob-code-inner js-file-line"> -exec sed -i -e <span class="pl-s"><span class="pl-pds">&#39;</span>s,{OLD_MODULE},{NEW_MODULE},g<span class="pl-pds">&#39;</span></span> {} <span class="pl-cce">\;</span></td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
4 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
5 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/LevanKvirkvelia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/LevanKvirkvelia"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/5202843?s=60&amp;v=4" width="30" height="30" alt="@LevanKvirkvelia" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/LevanKvirkvelia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/LevanKvirkvelia">LevanKvirkvelia</a>
/ <a href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea"><strong class="css-truncate-target">nanoBERT.py</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:25:14Z" data-view-component="true">February 14, 2024 23:25</relative-time>
</div>
<span class="f6 color-fg-muted">
nanoBERT, inspired by <a class="user-mention" data-hovercard-type="user" data-hovercard-url="/users/karpathy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/karpathy">@karpathy</a>'s nanoGPT
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea">
<span class="link">View <strong>nanoBERT.py</strong></span>
</a> <div id="file-nanobert-py" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-python gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Python" data-tagsearch-path="nanoBERT.py">
<tr>
<td id="file-nanobert-py-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-nanobert-py-LC1" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>torch</span>.<span class=pl-s1>nn</span> <span class=pl-k>as</span> <span class=pl-s1>nn</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-nanobert-py-LC2" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>torch</span>.<span class=pl-s1>nn</span>.<span class=pl-s1>functional</span> <span class=pl-k>as</span> <span class=pl-v>F</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-nanobert-py-LC3" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>math</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-nanobert-py-LC4" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>typing</span> <span class=pl-k>import</span> <span class=pl-v>Optional</span>, <span class=pl-v>Tuple</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-nanobert-py-LC5" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-nanobert-py-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-nanobert-py-LC6" class="blob-code blob-code-inner js-file-line"><span class=pl-k>class</span> <span class=pl-v>BertSelfAttention</span>(<span class=pl-s1>nn</span>.<span class=pl-v>Module</span>):</td>
</tr>
<tr>
<td id="file-nanobert-py-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-nanobert-py-LC7" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>def</span> <span class=pl-en>__init__</span>(<span class=pl-s1>self</span>, <span class=pl-s1>config</span>):</td>
</tr>
<tr>
<td id="file-nanobert-py-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-nanobert-py-LC8" class="blob-code blob-code-inner js-file-line"> <span class=pl-en>super</span>().<span class=pl-en>__init__</span>()</td>
</tr>
<tr>
<td id="file-nanobert-py-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-nanobert-py-LC9" class="blob-code blob-code-inner js-file-line"> </td>
</tr>
<tr>
<td id="file-nanobert-py-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-nanobert-py-LC10" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>if</span> <span class=pl-s1>config</span>.<span class=pl-s1>hidden_size</span> <span class=pl-c1>%</span> <span class=pl-s1>config</span>.<span class=pl-s1>num_attention_heads</span> <span class=pl-c1>!=</span> <span class=pl-c1>0</span>:</td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
13 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
70 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
121 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/jamesmacwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/jamesmacwhite"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/8067792?s=60&amp;v=4" width="30" height="30" alt="@jamesmacwhite" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/jamesmacwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/jamesmacwhite">jamesmacwhite</a>
/ <a href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6"><strong class="css-truncate-target">Workarounds for Netflix and the blocking of IPv6 tunnels.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:18:46Z" data-view-component="true">February 14, 2024 23:18</relative-time>
</div>
<span class="f6 color-fg-muted">
Prevent proxy/VPN streaming error messages from Netflix when using a Hurricane Electric IPv6 tunnel.
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6">
<span class="link">View <strong>Workarounds for Netflix and the blocking of IPv6 tunnels.md</strong></span>
</a> <div id="file-workarounds-for-netflix-and-the-blocking-of-ipv6-tunnels-md" class="file my-2">
<div id="file-workarounds-for-netflix-and-the-blocking-of-ipv6-tunnels-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-workarounds-for-netflix-and-the-blocking-of-hurricane-electric-ipv6-tunnels" class="anchor" aria-hidden="true" tabindex="-1" href="#workarounds-for-netflix-and-the-blocking-of-hurricane-electric-ipv6-tunnels"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Workarounds for Netflix and the blocking of Hurricane Electric IPv6 tunnels</h1>
<h6 dir="auto"><a id="user-content-the-dreaded-you-seem-to-be-using-an-unblocker-or-proxy-error-message-cool-story-bro" class="anchor" aria-hidden="true" tabindex="-1" href="#the-dreaded-you-seem-to-be-using-an-unblocker-or-proxy-error-message-cool-story-bro"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>The dreaded "You seem to be using an unblocker or proxy." error message. Cool story bro.</h6>
<p dir="auto"><em>This gist was essentially created out of my own <a href="https://blog.jmwhite.co.uk/2016/06/12/netflix-starts-blocking-ipv6-tunnels/" rel="nofollow">rant about Netflix being hostile to IPv6 tunnel services since June 2016</a>. You are welcome to read my opinion on the matter, this is the more technical side to the issue and how to combat it within your own network.</em></p>
<p dir="auto">Since I wrote this, various GitHub users have contributed their thoughts and ideas which has been incorporated into this gist. Thank you to everyone who have contributed their own methods and implementations.</p>
<h2 dir="auto"><a id="user-content-the-problem" class="anchor" aria-hidden="true" tabindex="-1" href="#the-problem"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>The problem</h2>
<p dir="auto">Netflix now treats IPv6 tunnel brokers (such as Hurricane Electric) as proxy servers. A while ago it became apparent to users and Netflix that somewhat by accident, IPv6 tunnel users were being served content outside of their geolocation because of the way Netflix was identifyi</p>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
15 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
9 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
90 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/eyecatchup/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/eyecatchup"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/845131?s=60&amp;v=4" width="30" height="30" alt="@eyecatchup" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/eyecatchup/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/eyecatchup">eyecatchup</a>
/ <a href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01"><strong class="css-truncate-target">id3-ffmpeg.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:16:01Z" data-view-component="true">February 14, 2024 23:16</relative-time>
</div>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/eyecatchup/0757b3d8b989fe433979db2ea7d95a01">
<span class="link">View <strong>id3-ffmpeg.md</strong></span>
</a> <div id="file-id3-ffmpeg-md" class="file my-2">
<div id="file-id3-ffmpeg-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-getset-id3-meta-tags-using-ffmpeg" class="anchor" aria-hidden="true" tabindex="-1" href="#getset-id3-meta-tags-using-ffmpeg"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Get/set ID3 meta tags using ffmpeg</h1>
<p dir="auto">A quick guide on how to read/write/modify <strong>ID3</strong> metadata tags for audio / media files using <strong><code>ffmpeg</code></strong>.</p>
<p dir="auto"><a href="https://ffmpeg.org/" rel="nofollow">FFmpeg</a> has a free-form command line option that allows the user to specify key-value-pairs for encoding metadata. Let's take a look.</p>
<h2 dir="auto"><a id="user-content-1-read-id3-metadata" class="anchor" aria-hidden="true" tabindex="-1" href="#1-read-id3-metadata"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>1. <em><strong>Read</strong></em> ID3 metadata</h2>
<p dir="auto">To list all global metadata tags for a media file, just set an input but no output file.</p>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
189 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
75 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
358 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/Klerith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/Klerith"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/3438503?s=60&amp;v=4" width="30" height="30" alt="@Klerith" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/Klerith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/Klerith">Klerith</a>
/ <a href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177"><strong class="css-truncate-target">vite-testing-config.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:13:25Z" data-view-component="true">February 14, 2024 23:13</relative-time>
</div>
<span class="f6 color-fg-muted">
Vite + Jest + React Testing Library - Configuraciones a seguir
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/Klerith/ca7e57fae3c9ab92ad08baadc6c26177">
<span class="link">View <strong>vite-testing-config.md</strong></span>
</a> <div id="file-vite-testing-config-md" class="file my-2">
<div id="file-vite-testing-config-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-instalación-y-configuracion-de-jest--react-testing-library" class="anchor" aria-hidden="true" tabindex="-1" href="#instalación-y-configuracion-de-jest--react-testing-library"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Instalación y configuracion de Jest + React Testing Library</h1>
<h2 dir="auto"><a id="user-content-en-proyectos-de-react--vite" class="anchor" aria-hidden="true" tabindex="-1" href="#en-proyectos-de-react--vite"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>En proyectos de React + Vite</h2>
<ol dir="auto">
<li>Instalaciones:</li>
</ol>
<pre><code>yarn add --dev jest babel-jest @babel/preset-env @babel/preset-react
yarn add --dev @testing-library/react @types/jest jest-environment-jsdom
</code></pre>
<ol start="2" dir="auto">
<li>Opcional: Si usamos Fetch API en el proyecto:</li>
</ol>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1 star
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/alexpaden/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/alexpaden"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/97042400?s=60&amp;v=4" width="30" height="30" alt="@alexpaden" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/alexpaden/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/alexpaden">alexpaden</a>
/ <a href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7"><strong class="css-truncate-target">gist:8ece0b1cfc71d920b4bb99cb16702ab7</strong></a>
</span>
<div class="color-fg-muted f6">
Created
<relative-time tense="past" datetime="2024-02-14T22:58:32Z" data-view-component="true">February 14, 2024 22:58</relative-time>
</div>
<span class="f6 color-fg-muted">
farcaster follower via dune queries
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7">
<span class="link">View <strong>gist:8ece0b1cfc71d920b4bb99cb16702ab7</strong></span>
</a> <div id="file-gistfile1-txt" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-text gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Text" data-tagsearch-path="gistfile1.txt">
<tr>
<td id="file-gistfile1-txt-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-gistfile1-txt-LC1" class="blob-code blob-code-inner js-file-line">import requests</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-gistfile1-txt-LC2" class="blob-code blob-code-inner js-file-line">from dune_client.client import DuneClient</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-gistfile1-txt-LC3" class="blob-code blob-code-inner js-file-line">from dune_client.query import QueryBase</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-gistfile1-txt-LC4" class="blob-code blob-code-inner js-file-line">import time</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-gistfile1-txt-LC5" class="blob-code blob-code-inner js-file-line">import random</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-gistfile1-txt-LC6" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-gistfile1-txt-LC7" class="blob-code blob-code-inner js-file-line">NEYNAR_API_KEY = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-gistfile1-txt-LC8" class="blob-code blob-code-inner js-file-line">DUNE_API_KEY = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-gistfile1-txt-LC9" class="blob-code blob-code-inner js-file-line">SIGNER_UUID = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-gistfile1-txt-LC10" class="blob-code blob-code-inner js-file-line">HEADERS = {&#39;accept&#39;: &#39;application/json&#39;, &#39;api_key&#39;: NEYNAR_API_KEY}</td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="paginate-container">
<div class="pagination"><span class="disabled color-fg-muted">Newer</span><a rel="nofollow" href="https://gist.github.com/starred?page=2">Older</a></div>
</div>
</div>
</div><!-- /.container -->
</main>
</div>
</div>
<footer class="footer pt-8 pb-6 f6 color-fg-muted p-responsive" role="contentinfo" >
<h2 class='sr-only'>Footer</h2>
<div class="d-flex flex-justify-center flex-items-center flex-column-reverse flex-lg-row flex-wrap flex-lg-nowrap">
<div class="d-flex flex-items-center flex-shrink-0 mx-2">
<a aria-label="Homepage" title="GitHub" class="footer-octicon mr-2" href="https://github.com">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
</a>
<span>
&copy; 2024 GitHub,&nbsp;Inc.
</span>
</div>
<nav aria-label="Footer">
<h3 class="sr-only" id="sr-footer-heading">Footer navigation</h3>
<ul class="list-style-none d-flex flex-justify-center flex-wrap mb-2 mb-lg-0" aria-labelledby="sr-footer-heading">
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to Terms&quot;,&quot;label&quot;:&quot;text:terms&quot;}" href="https://docs.github.com/site-policy/github-terms/github-terms-of-service" data-view-component="true" class="Link--secondary Link">Terms</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to privacy&quot;,&quot;label&quot;:&quot;text:privacy&quot;}" href="https://docs.github.com/site-policy/privacy-policies/github-privacy-statement" data-view-component="true" class="Link--secondary Link">Privacy</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to security&quot;,&quot;label&quot;:&quot;text:security&quot;}" href="/security" data-view-component="true" class="Link--secondary Link">Security</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to status&quot;,&quot;label&quot;:&quot;text:status&quot;}" href="https://www.githubstatus.com/" data-view-component="true" class="Link--secondary Link">Status</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to docs&quot;,&quot;label&quot;:&quot;text:docs&quot;}" href="https://docs.github.com" data-view-component="true" class="Link--secondary Link">Docs</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to contact&quot;,&quot;label&quot;:&quot;text:contact&quot;}" href="https://support.github.com?tags=dotcom-footer" data-view-component="true" class="Link--secondary Link">Contact</a>
</li>
<li class="mx-2" >
<cookie-consent-link>
<button type="button" class="Link--secondary underline-on-hover border-0 p-0 color-bg-transparent" data-action="click:cookie-consent-link#showConsentManagement">
Manage cookies
</button>
</cookie-consent-link>
</li>
<li class="mx-2">
<cookie-consent-link>
<button type="button" class="Link--secondary underline-on-hover border-0 p-0 color-bg-transparent" data-action="click:cookie-consent-link#showConsentManagement">
Do not share my personal information
</button>
</cookie-consent-link>
</li>
</ul>
</nav>
</div>
</footer>
<cookie-consent id="cookie-consent-banner" class="position-fixed bottom-0 left-0" style="z-index: 999999" data-initial-cookie-consent-allowed="" data-cookie-consent-required="true"></cookie-consent>
<div id="ajax-error-message" class="ajax-error-message flash flash-error" hidden>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<button type="button" class="flash-close js-ajax-error-dismiss" aria-label="Dismiss error">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
You can’t perform that action at this time.
</div>
<template id="site-details-dialog">
<details class="details-reset details-overlay details-overlay-dark lh-default color-fg-default hx_rsm" open>
<summary role="button" aria-label="Close dialog"></summary>
<details-dialog class="Box Box--overlay d-flex flex-column anim-fade-in fast hx_rsm-dialog hx_rsm-modal">
<button class="Box-btn-octicon m-0 btn-octicon position-absolute right-0 top-0" type="button" aria-label="Close dialog" data-close-dialog>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
<div class="octocat-spinner my-6 js-details-dialog-spinner"></div>
</details-dialog>
</details>
</template>
<div class="Popover js-hovercard-content position-absolute" style="display: none; outline: none;" tabindex="0">
<div class="Popover-message Popover-message--bottom-left Popover-message--large Box color-shadow-large" style="width:360px;">
</div>
</div>
<template id="snippet-clipboard-copy-button">
<div class="zeroclipboard-container position-absolute right-0 top-0">
<clipboard-copy aria-label="Copy" class="ClipboardButton btn js-clipboard-copy m-2 p-0 tooltipped-no-delay" data-copy-feedback="Copied!" data-tooltip-direction="w">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-copy js-clipboard-copy-icon m-2">
<path d="M0 6.75C0 5.784.784 5 1.75 5h1.5a.75.75 0 0 1 0 1.5h-1.5a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-1.5a.75.75 0 0 1 1.5 0v1.5A1.75 1.75 0 0 1 9.25 16h-7.5A1.75 1.75 0 0 1 0 14.25Z"></path><path d="M5 1.75C5 .784 5.784 0 6.75 0h7.5C15.216 0 16 .784 16 1.75v7.5A1.75 1.75 0 0 1 14.25 11h-7.5A1.75 1.75 0 0 1 5 9.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-check js-clipboard-check-icon color-fg-success d-none m-2">
<path d="M13.78 4.22a.75.75 0 0 1 0 1.06l-7.25 7.25a.75.75 0 0 1-1.06 0L2.22 9.28a.751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018L6 10.94l6.72-6.72a.75.75 0 0 1 1.06 0Z"></path>
</svg>
</clipboard-copy>
</div>
</template>
<template id="snippet-clipboard-copy-button-unpositioned">
<div class="zeroclipboard-container">
<clipboard-copy aria-label="Copy" class="ClipboardButton btn btn-invisible js-clipboard-copy m-2 p-0 tooltipped-no-delay d-flex flex-justify-center flex-items-center" data-copy-feedback="Copied!" data-tooltip-direction="w">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-copy js-clipboard-copy-icon">
<path d="M0 6.75C0 5.784.784 5 1.75 5h1.5a.75.75 0 0 1 0 1.5h-1.5a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-1.5a.75.75 0 0 1 1.5 0v1.5A1.75 1.75 0 0 1 9.25 16h-7.5A1.75 1.75 0 0 1 0 14.25Z"></path><path d="M5 1.75C5 .784 5.784 0 6.75 0h7.5C15.216 0 16 .784 16 1.75v7.5A1.75 1.75 0 0 1 14.25 11h-7.5A1.75 1.75 0 0 1 5 9.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-check js-clipboard-check-icon color-fg-success d-none">
<path d="M13.78 4.22a.75.75 0 0 1 0 1.06l-7.25 7.25a.75.75 0 0 1-1.06 0L2.22 9.28a.751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018L6 10.94l6.72-6.72a.75.75 0 0 1 1.06 0Z"></path>
</svg>
</clipboard-copy>
</div>
</template>
</div>
<div id="js-global-screen-reader-notice" class="sr-only" aria-live="polite" aria-atomic="true" ></div>
<div id="js-global-screen-reader-notice-assertive" class="sr-only" aria-live="assertive" aria-atomic="true"></div>
</body>
</html>
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-7B-dpo-laser](https://huggingface.co/Kquant03/NeuralTrix-7B-dpo-laser)| 44.51| 76.24| 78.56| 49.26| 62.14|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |24.41|± | 2.70|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |37.02|± | 1.89|
| | |acc_norm|37.63|± | 1.90|
|agieval_lsat_ar | 0|acc |27.39|± | 2.95|
| | |acc_norm|26.96|± | 2.93|
|agieval_lsat_lr | 0|acc |52.94|± | 2.21|
| | |acc_norm|54.12|± | 2.21|
|agieval_lsat_rc | 0|acc |64.68|± | 2.92|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |42.72|± | 3.45|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |30.45|± | 3.11|
| | |acc_norm|28.64|± | 3.05|
Average: 44.51%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |64.59|± | 1.40|
| | |acc_norm|65.70|± | 1.39|
|arc_easy | 0|acc |84.89|± | 0.73|
| | |acc_norm|79.00|± | 0.84|
|boolq | 1|acc |86.82|± | 0.59|
|hellaswag | 0|acc |68.00|± | 0.47|
| | |acc_norm|86.60|± | 0.34|
|openbookqa | 0|acc |38.80|± | 2.18|
| | |acc_norm|50.60|± | 2.24|
|piqa | 0|acc |81.61|± | 0.90|
| | |acc_norm|83.35|± | 0.87|
|winogrande | 0|acc |81.61|± | 1.09|
Average: 76.24%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |62.79|± | 1.69|
| | |mc2 |78.56|± | 1.36|
Average: 78.56%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|62.11|± | 3.53|
|bigbench_date_understanding | 0|multiple_choice_grade|64.50|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|60.08|± | 3.05|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.60|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.71|± | 1.58|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|59.60|± | 1.55|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|67.15|± | 1.05|
|bigbench_ruin_names | 0|multiple_choice_grade|52.46|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|36.97|± | 1.53|
|bigbench_snarks | 0|multiple_choice_grade|74.03|± | 3.27|
|bigbench_sports_understanding | 0|multiple_choice_grade|71.50|± | 1.44|
|bigbench_temporal_sequences | 0|multiple_choice_grade|49.50|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.56|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.34|± | 0.93|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 49.26%
Average score: 62.14%
Elapsed time: 01:20:36| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuTrixOmniBe-7B-model-remix](https://huggingface.co/Kukedlc/NeuTrixOmniBe-7B-model-remix)| 44.74| 77.31| 77.27| 49.18| 62.12|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |39.78|± | 1.92|
| | |acc_norm|40.55|± | 1.93|
|agieval_lsat_ar | 0|acc |25.65|± | 2.89|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |53.53|± | 2.21|
| | |acc_norm|54.51|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|64.68|± | 2.92|
|agieval_sat_en | 0|acc |77.18|± | 2.93|
| | |acc_norm|77.18|± | 2.93|
|agieval_sat_en_without_passage| 0|acc |43.20|± | 3.46|
| | |acc_norm|42.72|± | 3.45|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|29.55|± | 3.08|
Average: 44.74%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.15|± | 1.37|
| | |acc_norm|67.83|± | 1.37|
|arc_easy | 0|acc |86.24|± | 0.71|
| | |acc_norm|79.97|± | 0.82|
|boolq | 1|acc |87.58|± | 0.58|
|hellaswag | 0|acc |70.19|± | 0.46|
| | |acc_norm|87.58|± | 0.33|
|openbookqa | 0|acc |40.00|± | 2.19|
| | |acc_norm|50.00|± | 2.24|
|piqa | 0|acc |82.97|± | 0.88|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |82.79|± | 1.06|
Average: 77.31%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.69|± | 1.70|
| | |mc2 |77.27|± | 1.39|
Average: 77.27%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.00|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|62.33|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|55.43|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.80|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.14|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|50.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|55.80|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|68.90|± | 1.04|
|bigbench_ruin_names | 0|multiple_choice_grade|54.69|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|37.58|± | 1.53|
|bigbench_snarks | 0|multiple_choice_grade|73.48|± | 3.29|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.35|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.28|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.97|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 49.18%
Average score: 62.12%
Elapsed time: 02:58:43| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|--------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[guanaco-7B-HF](https://huggingface.co/TheBloke/guanaco-7B-HF)| 23.12| 66.85| 38.92| 32.64| 40.38|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |19.69|± | 2.50|
| | |acc_norm|20.08|± | 2.52|
|agieval_logiqa_en | 0|acc |22.73|± | 1.64|
| | |acc_norm|29.19|± | 1.78|
|agieval_lsat_ar | 0|acc |23.04|± | 2.78|
| | |acc_norm|18.70|± | 2.58|
|agieval_lsat_lr | 0|acc |21.37|± | 1.82|
| | |acc_norm|22.16|± | 1.84|
|agieval_lsat_rc | 0|acc |13.75|± | 2.10|
| | |acc_norm|16.73|± | 2.28|
|agieval_sat_en | 0|acc |35.44|± | 3.34|
| | |acc_norm|28.64|± | 3.16|
|agieval_sat_en_without_passage| 0|acc |33.50|± | 3.30|
| | |acc_norm|27.67|± | 3.12|
|agieval_sat_math | 0|acc |24.09|± | 2.89|
| | |acc_norm|21.82|± | 2.79|
Average: 23.12%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |44.11|± | 1.45|
| | |acc_norm|46.33|± | 1.46|
|arc_easy | 0|acc |75.21|± | 0.89|
| | |acc_norm|70.75|± | 0.93|
|boolq | 1|acc |77.52|± | 0.73|
|hellaswag | 0|acc |59.61|± | 0.49|
| | |acc_norm|78.36|± | 0.41|
|openbookqa | 0|acc |37.20|± | 2.16|
| | |acc_norm|46.40|± | 2.23|
|piqa | 0|acc |79.00|± | 0.95|
| | |acc_norm|79.00|± | 0.95|
|winogrande | 0|acc |69.61|± | 1.29|
Average: 66.85%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |24.72|± | 1.51|
| | |mc2 |38.92|± | 1.45|
Average: 38.92%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|51.58|± | 3.64|
|bigbench_date_understanding | 0|multiple_choice_grade|61.52|± | 2.54|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|25.58|± | 2.72|
|bigbench_geometric_shapes | 0|multiple_choice_grade| 6.96|± | 1.35|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|22.80|± | 1.88|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|16.71|± | 1.41|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|38.00|± | 2.81|
|bigbench_movie_recommendation | 0|multiple_choice_grade|24.20|± | 1.92|
|bigbench_navigate | 0|multiple_choice_grade|50.00|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|38.45|± | 1.09|
|bigbench_ruin_names | 0|multiple_choice_grade|35.71|± | 2.27|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|17.33|± | 1.20|
|bigbench_snarks | 0|multiple_choice_grade|53.04|± | 3.72|
|bigbench_sports_understanding | 0|multiple_choice_grade|49.70|± | 1.59|
|bigbench_temporal_sequences | 0|multiple_choice_grade|24.60|± | 1.36|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|19.52|± | 1.12|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|13.89|± | 0.83|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|38.00|± | 2.81|
Average: 32.64%
Average score: 40.38%
Elapsed time: 02:34:32| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[TurdusTrixBeagle-DARETIES-7B](https://huggingface.co/jsfs11/TurdusTrixBeagle-DARETIES-7B)| 44.46| 77.81| 69.15| 48.54| 59.99|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.63|± | 1.92|
|agieval_lsat_ar | 0|acc |25.65|± | 2.89|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |50.98|± | 2.22|
| | |acc_norm|51.96|± | 2.21|
|agieval_lsat_rc | 0|acc |66.17|± | 2.89|
| | |acc_norm|66.54|± | 2.88|
|agieval_sat_en | 0|acc |78.64|± | 2.86|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |41.75|± | 3.44|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |30.91|± | 3.12|
| | |acc_norm|28.64|± | 3.05|
Average: 44.46%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.75|± | 1.37|
| | |acc_norm|67.92|± | 1.36|
|arc_easy | 0|acc |87.08|± | 0.69|
| | |acc_norm|83.12|± | 0.77|
|boolq | 1|acc |88.26|± | 0.56|
|hellaswag | 0|acc |70.54|± | 0.45|
| | |acc_norm|87.29|± | 0.33|
|openbookqa | 0|acc |38.60|± | 2.18|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.57|± | 0.86|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |83.43|± | 1.05|
Average: 77.81%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.30|± | 1.74|
| | |mc2 |69.15|± | 1.52|
Average: 69.15%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.84|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|65.58|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|44.57|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.20|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.29|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.00|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|51.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.70|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.25|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|55.58|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|33.87|± | 1.50|
|bigbench_snarks | 0|multiple_choice_grade|74.59|± | 3.25|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.35|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|49.90|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.48|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.83|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.00|± | 2.86|
Average: 48.54%
Average score: 59.99%
Elapsed time: 02:42:29| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MistralTrix-v1](https://huggingface.co/CultriX/MistralTrix-v1)| 44.98| 76.62| 71.44| 47.17| 60.05|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.59|± | 2.74|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |37.48|± | 1.90|
| | |acc_norm|38.56|± | 1.91|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |50.20|± | 2.22|
| | |acc_norm|51.57|± | 2.22|
|agieval_lsat_rc | 0|acc |65.43|± | 2.91|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|77.67|± | 2.91|
|agieval_sat_en_without_passage| 0|acc |46.12|± | 3.48|
| | |acc_norm|45.15|± | 3.48|
|agieval_sat_math | 0|acc |35.00|± | 3.22|
| | |acc_norm|32.73|± | 3.17|
Average: 44.98%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.66|± | 1.37|
| | |acc_norm|68.26|± | 1.36|
|arc_easy | 0|acc |87.37|± | 0.68|
| | |acc_norm|81.82|± | 0.79|
|boolq | 1|acc |87.49|± | 0.58|
|hellaswag | 0|acc |70.09|± | 0.46|
| | |acc_norm|86.38|± | 0.34|
|openbookqa | 0|acc |38.60|± | 2.18|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.90|± | 0.86|
| | |acc_norm|84.98|± | 0.83|
|winogrande | 0|acc |78.22|± | 1.16|
Average: 76.62%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.41|± | 1.73|
| | |mc2 |71.44|± | 1.50|
Average: 71.44%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.42|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|62.06|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|41.86|± | 3.08|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.40|± | 2.24|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.40|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.43|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.00|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|53.00|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|55.80|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|67.10|± | 1.05|
|bigbench_ruin_names | 0|multiple_choice_grade|51.12|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|38.58|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|67.40|± | 3.49|
|bigbench_sports_understanding | 0|multiple_choice_grade|73.43|± | 1.41|
|bigbench_temporal_sequences | 0|multiple_choice_grade|47.30|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.64|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|17.14|± | 0.90|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.00|± | 2.86|
Average: 47.17%
Average score: 60.05%
Elapsed time: 03:06:11| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-MoE](https://huggingface.co/CultriX/Wernicke-MoE)| 45.36| 77.62| 70.74| 48.59| 60.58|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |28.74|± | 2.85|
| | |acc_norm|27.17|± | 2.80|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |24.78|± | 2.85|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |52.94|± | 2.21|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |79.13|± | 2.84|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|44.17|± | 3.47|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|29.55|± | 3.08|
Average: 45.36%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.41|± | 1.37|
| | |acc_norm|68.09|± | 1.36|
|arc_easy | 0|acc |87.08|± | 0.69|
| | |acc_norm|83.75|± | 0.76|
|boolq | 1|acc |88.17|± | 0.56|
|hellaswag | 0|acc |68.60|± | 0.46|
| | |acc_norm|86.78|± | 0.34|
|openbookqa | 0|acc |39.20|± | 2.19|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |82.92|± | 0.88|
| | |acc_norm|85.47|± | 0.82|
|winogrande | 0|acc |82.48|± | 1.07|
Average: 77.62%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |55.32|± | 1.74|
| | |mc2 |70.74|± | 1.48|
Average: 70.74%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.42|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|65.85|± | 2.47|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|49.61|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.20|± | 2.09|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.57|± | 1.58|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|56.33|± | 2.87|
|bigbench_movie_recommendation | 0|multiple_choice_grade|45.40|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|57.10|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.30|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|55.13|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|34.47|± | 1.51|
|bigbench_snarks | 0|multiple_choice_grade|74.03|± | 3.27|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.35|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.70|± | 1.57|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.12|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.60|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|56.33|± | 2.87|
Average: 48.59%
Average score: 60.58%
Elapsed time: 03:08:52| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[UNA-TheBeagle-7b-v1](https://huggingface.co/fblgit/UNA-TheBeagle-7b-v1)| 42.73| 77.12| 70.82| 46.01| 59.17|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.17|± | 2.80|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |36.71|± | 1.89|
| | |acc_norm|37.02|± | 1.89|
|agieval_lsat_ar | 0|acc |22.61|± | 2.76|
| | |acc_norm|20.43|± | 2.66|
|agieval_lsat_lr | 0|acc |50.39|± | 2.22|
| | |acc_norm|50.00|± | 2.22|
|agieval_lsat_rc | 0|acc |61.71|± | 2.97|
| | |acc_norm|62.08|± | 2.96|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|76.70|± | 2.95|
|agieval_sat_en_without_passage| 0|acc |40.29|± | 3.43|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|30.00|± | 3.10|
Average: 42.73%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |70.31|± | 1.34|
| | |acc_norm|69.37|± | 1.35|
|arc_easy | 0|acc |86.78|± | 0.69|
| | |acc_norm|83.04|± | 0.77|
|boolq | 1|acc |88.32|± | 0.56|
|hellaswag | 0|acc |71.04|± | 0.45|
| | |acc_norm|86.23|± | 0.34|
|openbookqa | 0|acc |39.40|± | 2.19|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |83.84|± | 0.86|
| | |acc_norm|84.60|± | 0.84|
|winogrande | 0|acc |79.72|± | 1.13|
Average: 77.12%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |59.36|± | 1.72|
| | |mc2 |70.82|± | 1.51|
Average: 70.82%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|62.87|± | 2.52|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|34.11|± | 2.96|
|bigbench_geometric_shapes | 0|multiple_choice_grade|31.48|± | 2.45|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.20|± | 2.09|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.86|± | 1.63|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.67|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|52.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.50|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|68.35|± | 1.04|
|bigbench_ruin_names | 0|multiple_choice_grade|47.54|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|27.35|± | 1.41|
|bigbench_snarks | 0|multiple_choice_grade|58.56|± | 3.67|
|bigbench_sports_understanding | 0|multiple_choice_grade|73.23|± | 1.41|
|bigbench_temporal_sequences | 0|multiple_choice_grade|41.70|± | 1.56|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.80|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|17.37|± | 0.91|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.67|± | 2.85|
Average: 46.01%
Average score: 59.17%
Elapsed time: 03:07:27
<!DOCTYPE html>
<html
lang="en"
data-color-mode="auto" data-light-theme="light" data-dark-theme="dark"
data-a11y-animated-images="system" data-a11y-link-underlines="true"
>
<head>
<meta charset="utf-8">
<link rel="dns-prefetch" href="https://github.githubassets.com">
<link rel="dns-prefetch" href="https://avatars.githubusercontent.com">
<link rel="dns-prefetch" href="https://github-cloud.s3.amazonaws.com">
<link rel="dns-prefetch" href="https://user-images.githubusercontent.com/">
<link rel="preconnect" href="https://github.githubassets.com" crossorigin>
<link rel="preconnect" href="https://avatars.githubusercontent.com">
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/light-0eace2597ca3.css" /><link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/dark-a167e256da9c.css" /><link data-color-theme="dark_dimmed" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_dimmed-d11f2cf8009b.css" /><link data-color-theme="dark_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_high_contrast-ea7373db06c8.css" /><link data-color-theme="dark_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_colorblind-afa99dcf40f7.css" /><link data-color-theme="light_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_colorblind-af6c685139ba.css" /><link data-color-theme="light_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_high_contrast-578cdbc8a5a9.css" /><link data-color-theme="light_tritanopia" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_tritanopia-5cb699a7e247.css" /><link data-color-theme="dark_tritanopia" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_tritanopia-9b32204967c6.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/primer-primitives-971c6be3ec9f.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/primer-08e422afeb43.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/global-a8d2cbec31a6.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/github-36dce55f3db6.css" />
<script type="application/json" id="client-env">{"locale":"en","featureFlags":["billing_net_usage_frontend","copilot_conversational_ux_history_refs","docset_management_ui","failbot_handle_non_errors","geojson_azure_maps","image_metric_tracking","marketing_forms_api_integration_contact_request","turbo_experiment_risky","sample_network_conn_type","no_character_key_shortcuts_in_inputs","custom_inp","remove_child_patch"]}</script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/wp-runtime-fdac6ab0ed49.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_dompurify_dist_purify_js-6890e890956f.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_stacktrace-parser_dist_stack-trace-parser_esm_js-node_modules_github_bro-a4c183-79f9611c275b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_hydro-analytics-client_dist_analytics-client_js-node_modules_gith-6a10dd-e66ebda625fb.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/ui_packages_failbot_failbot_ts-afaa9a250f2e.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/environment-4ff0d843ea45.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_selector-observer_dist_index_esm_js-9f960d9b217c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_behaviors_dist_esm_focus-zone_js-086f7a27bac0.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_relative-time-element_dist_index_js-c76945c5961a.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_combobox-nav_dist_index_js-node_modules_github_markdown-toolbar-e-820fc0-a7dea68af91d.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_delegated-events_dist_index_js-node_modules_github_details-dialog-elemen-29dc30-a2a71f11a507.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_filter-input-element_dist_index_js-node_modules_github_remote-inp-e4ab91-60b24e4f6f42.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_file-attachment-element_dist_index_js-node_modules_primer_view-co-eb424d-fd64db823614.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/github-elements-693343d61474.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/element-registry-572e9d2514ec.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_catalyst_lib_index_js-node_modules_github_hydro-analytics-client_-978abc0-add939c751ce.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_lit-html_lit-html_js-5b376145beff.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_mini-throttle_dist_index_js-node_modules_github_alive-client_dist-bf5aa2-1b562c29ab8e.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_morphdom_dist_morphdom-esm_js-5bff297a06de.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_turbo_dist_turbo_es2017-esm_js-c91f4ad18b62.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_color-convert_index_js-72c9fbde5ad4.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_remote-form_dist_index_js-node_modules_scroll-anchoring_dist_scro-231ccf-aa129238d13b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_behaviors_dist_esm_dimensions_js-node_modules_github_jtml_lib_index_js-95b84ee6bc34.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_paste-markdown_dist_index_esm_js-node_modules_github_quote-select-77da2d-3bdb0030c085.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_updatable-content_ts-5e0904652c1c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_task-list_ts-app_assets_modules_github_onfocus_ts-app_ass-421cec-751caa0072bd.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_sticky-scroll-into-view_ts-cbcee0788fe3.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_ajax-error_ts-app_assets_modules_github_behaviors_include-467754-b59a2b2827ad.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_commenting_edit_ts-app_assets_modules_github_behaviors_ht-83c235-b85e9f4f1304.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_blob-anchor_ts-app_assets_modules_github_filter-sort_ts-app_assets_-c96432-ca86212e46a4.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/behaviors-97473afbe590.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_delegated-events_dist_index_js-node_modules_github_catalyst_lib_index_js-d0256ebff5cd.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/notifications-global-99d196517b1b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_remote-form_dist_index_js-node_modules_primer_behaviors_dist_esm_-62b04e-513c880e3a9c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_diffs_blob-lines_ts-app_assets_modules_github_diffs_linkable-line-n-d80317-78852bb1c926.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/gist-be0c4546208a.js"></script>
<title>Discover gists · GitHub</title>
<meta name="route-pattern" content="/starred(.:format)" data-turbo-transient>
<meta name="route-controller" content="listings" data-turbo-transient>
<meta name="route-action" content="starred" data-turbo-transient>
<meta name="current-catalog-service-hash" content="56253a530ab9027b25719525dcbe6007461a3202218f6f5dfce5a601c121cbcb">
<meta name="request-id" content="C5F8:67103:6AFA903:6C83694:65CD4F78" data-pjax-transient="true"/><meta name="html-safe-nonce" content="a59bfcb35e62ee33db6439450acdb44a74ce8bb67781561f1df9e6a920906f36" data-pjax-transient="true"/><meta name="visitor-payload" content="eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDNUY4OjY3MTAzOjZBRkE5MDM6NkM4MzY5NDo2NUNENEY3OCIsInZpc2l0b3JfaWQiOiIzMjkyMTU4NzI2OTEyMTY3ODAwIiwicmVnaW9uX2VkZ2UiOiJmcmEiLCJyZWdpb25fcmVuZGVyIjoiZnJhIn0=" data-pjax-transient="true"/><meta name="visitor-hmac" content="dd34d015f266c34fa9bb8767981eea3b8a021a6f6ee121ecb00b74525ce691de" data-pjax-transient="true"/>
<meta name="github-keyboard-shortcuts" content="copilot" data-turbo-transient="true" />
<meta name="selected-link" value="/starred" data-turbo-transient>
<link rel="assets" href="https://github.githubassets.com/">
<meta name="google-site-verification" content="c1kuD-K2HIVF635lypcsWPoD4kilo5-jA_wBFyT4uMY">
<meta name="google-site-verification" content="KT5gs8h0wvaagLKAVWq8bbeNwnZZK1r1XQysX3xurLU">
<meta name="google-site-verification" content="ZzhVyEFwb7w3e0-uOTltm8Jsck2F5StVihD0exw2fsA">
<meta name="google-site-verification" content="GXs5KoUUkNCoaAZn7wPN-t01Pywp9M3sEjnt_3_ZWPc">
<meta name="google-site-verification" content="Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I">
<meta name="octolytics-url" content="https://collector.github.com/github/collect" />
<meta name="analytics-location" content="/starred" data-turbo-transient="true" />
<meta name="user-login" content="">
<meta name="viewport" content="width=device-width">
<meta name="description" content="GitHub Gist: instantly share code, notes, and snippets.">
<link rel="search" type="application/opensearchdescription+xml" href="/opensearch-gist.xml" title="Gist">
<link rel="fluid-icon" href="https://gist.github.com/fluidicon.png" title="GitHub">
<meta property="fb:app_id" content="1401488693436528">
<meta name="apple-itunes-app" content="app-id=1477376905, app-argument=https://gist.github.com/starred" />
<meta name="twitter:image:src" content="https://github.com/opengraph.png" /><meta name="twitter:site" content="@github" /><meta name="twitter:card" content="summary_large_image" /><meta name="twitter:title" content="Discover gists" /><meta name="twitter:description" content="GitHub Gist: instantly share code, notes, and snippets." />
<meta property="og:image" content="https://github.com/opengraph.png" /><meta property="og:image:alt" content="GitHub Gist: instantly share code, notes, and snippets." /><meta property="og:site_name" content="Gist" /><meta property="og:type" content="website" /><meta property="og:title" content="Discover gists" /><meta property="og:description" content="GitHub Gist: instantly share code, notes, and snippets." />
<meta name="hostname" content="gist.github.com">
<meta name="expected-hostname" content="gist.github.com">
<meta http-equiv="x-pjax-version" content="a880a1655d726633117aba8dfffc2e165eefba9c2bc7cd62065e0a6338264704" data-turbo-track="reload">
<meta http-equiv="x-pjax-csp-version" content="5dcfbec3488c5fd5a334e287ce6a17058b7d4beb91db2d4d184e4d55bbf1d7d7" data-turbo-track="reload">
<meta http-equiv="x-pjax-css-version" content="fc7dfbcc4179b73e820d020658f54500fa28c573604791e50a58cef56e331033" data-turbo-track="reload">
<meta http-equiv="x-pjax-js-version" content="76ce0c0e81d1403d1c5f50f4ff35ca9fe1d30e0bfd54ae1c9c1f020376aabff4" data-turbo-track="reload">
<meta name="turbo-cache-control" content="no-preview" data-turbo-transient="">
<link href="/starred.atom" rel="alternate" title="atom" type="application/atom+xml">
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/gist-b55b6bd3753b.css" />
<meta name="turbo-body-classes" content="logged-out env-production page-responsive">
<meta name="browser-stats-url" content="https://api.github.com/_private/browser/stats">
<meta name="browser-errors-url" content="https://api.github.com/_private/browser/errors">
<link rel="mask-icon" href="https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg" color="#000000">
<link rel="alternate icon" class="js-site-favicon" type="image/png" href="https://github.githubassets.com/favicons/favicon.png">
<link rel="icon" class="js-site-favicon" type="image/svg+xml" href="https://github.githubassets.com/favicons/favicon.svg">
<meta name="theme-color" content="#1e2327">
<meta name="color-scheme" content="light dark" />
</head>
<body class="logged-out env-production page-responsive" style="word-wrap: break-word;">
<div data-turbo-body class="logged-out env-production page-responsive" style="word-wrap: break-word;">
<div class="position-relative js-header-wrapper ">
<a href="#start-of-content" class="px-2 py-4 color-bg-accent-emphasis color-fg-on-emphasis show-on-focus js-skip-to-content">Skip to content</a>
<span data-view-component="true" class="progress-pjax-loader Progress position-fixed width-full">
<span style="width: 0%;" data-view-component="true" class="Progress-item progress-pjax-loader-bar left-0 top-0 color-bg-accent-emphasis"></span>
</span>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/react-lib-1fbfc5be2c18.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_octicons-react_dist_index_esm_js-node_modules_primer_react_lib-es-2e8e7c-b299afe58dd7.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Box_Box_js-ebfceb11fb57.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Button_Button_js-0528cb519251.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_ActionList_index_js-e001d0eead25.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Button_IconButton_js-node_modules_primer_react_lib--23bcad-ccf1d5fc6054.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/ui_packages_react-core_create-browser-history_ts-ui_packages_react-core_deferred-registry_ts--ebbb92-64923177f972.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/keyboard-shortcuts-dialog-a2ca669523db.js"></script>
<react-partial
partial-name="keyboard-shortcuts-dialog"
data-ssr="false"
>
<script type="application/json" data-target="react-partial.embeddedData">{"props":{}}</script>
<div data-target="react-partial.reactRoot"></div>
</react-partial>
<div class="Header js-details-container Details flex-wrap flex-md-nowrap p-responsive" role="banner" >
<div class="Header-item d-none d-md-flex">
<a class="Header-link" data-hotkey="g d" aria-label="Gist Homepage " href="/">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github v-align-middle d-inline-block d-md-none">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 45 16" version="1.1" width="67" data-view-component="true" class="octicon octicon-logo-github v-align-middle d-none d-md-inline-block">
<path d="M8.81 7.35v5.74c0 .04-.01.11-.06.13 0 0-1.25.89-3.31.89-2.49 0-5.44-.78-5.44-5.92S2.58 1.99 5.1 2c2.18 0 3.06.49 3.2.58.04.05.06.09.06.14L7.94 4.5c0 .09-.09.2-.2.17-.36-.11-.9-.33-2.17-.33-1.47 0-3.05.42-3.05 3.73s1.5 3.7 2.58 3.7c.92 0 1.25-.11 1.25-.11v-2.3H4.88c-.11 0-.19-.08-.19-.17V7.35c0-.09.08-.17.19-.17h3.74c.11 0 .19.08.19.17Zm35.85 2.33c0 3.43-1.11 4.41-3.05 4.41-1.64 0-2.52-.83-2.52-.83s-.04.46-.09.52c-.03.06-.08.08-.14.08h-1.48c-.1 0-.19-.08-.19-.17l.02-11.11c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v3.77s.82-.53 2.02-.53l-.01-.02c1.2 0 2.97.45 2.97 3.88ZM27.68 2.43c.09 0 .17.08.17.17v11.11c0 .09-.08.17-.17.17h-2.13c-.09 0-.17-.08-.17-.17l.02-4.75h-3.31v4.75c0 .09-.08.17-.17.17h-2.13c-.08 0-.17-.08-.17-.17V2.6c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v4.09h3.31V2.6c0-.09.08-.17.17-.17Zm8.26 3.64c.11 0 .19.08.19.17l-.02 7.47c0 .09-.06.17-.17.17H34.6c-.07 0-.14-.04-.16-.09-.03-.06-.08-.45-.08-.45s-1.13.77-2.52.77c-1.69 0-2.92-.55-2.92-2.75V6.25c0-.09.08-.17.17-.17h2.14c.09 0 .17.08.17.17V11c0 .75.22 1.09.97 1.09s1.3-.39 1.3-.39V6.26c0-.11.06-.19.17-.19Zm-17.406 5.971h.005a.177.177 0 0 1 .141.179v1.5c0 .07-.03.14-.09.16-.1.05-.74.22-1.27.22-1.16 0-2.86-.25-2.86-2.69V8.13h-1.11c-.09 0-.17-.08-.17-.19V6.58c0-.08.05-.15.13-.17.07-.01 1.16-.28 1.16-.28V3.96c0-.08.05-.13.14-.13h2.16c.09 0 .14.05.14.13v2.11h1.59c.08 0 .16.08.16.17v1.7c0 .11-.07.19-.16.19h-1.59v3.131c0 .47.27.83 1.05.83.247 0 .481-.049.574-.05ZM12.24 6.06c.09 0 .17.08.17.17v7.37c0 .18-.05.27-.25.27h-1.92c-.17 0-.3-.07-.3-.27V6.26c0-.11.08-.2.17-.2Zm29.99 3.78c0-1.81-.73-2.05-1.5-1.97-.6.04-1.08.34-1.08.34v3.52s.49.34 1.22.36c1.03.03 1.36-.34 1.36-2.25ZM11.19 2.68c.75 0 1.36.61 1.36 1.38 0 .77-.61 1.38-1.36 1.38-.77 0-1.38-.61-1.38-1.38 0-.77.61-1.38 1.38-1.38Zm7.34 9.35v.001l.01.01h-.001l-.005-.001v.001c-.009-.001-.015-.011-.024-.011Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 25 16" version="1.1" width="37" data-view-component="true" class="octicon octicon-logo-gist v-align-middle d-none d-md-inline-block">
<path d="M4.7 8.73v-1h3.52v5.69c-.78.37-1.95.64-3.59.64C1.11 14.06 0 11.37 0 8.03 0 4.69 1.13 2 4.63 2c1.62 0 2.64.33 3.28.66v1.05c-1.22-.5-2-.73-3.28-.73-2.57 0-3.48 2.21-3.48 5.06 0 2.85.91 5.05 3.47 5.05.89 0 1.98-.07 2.53-.34V8.73Zm10.98.69h.03c2.22.2 2.75.95 2.75 2.23 0 1.21-.76 2.41-3.14 2.41-.75 0-1.83-.19-2.33-.39v-.94c.47.17 1.22.36 2.33.36 1.62 0 2.06-.69 2.06-1.42 0-.71-.22-1.21-1.77-1.34-2.26-.2-2.73-1-2.73-2.08 0-1.11.72-2.31 2.92-2.31.73 0 1.56.09 2.25.39v.94c-.61-.2-1.22-.36-2.27-.36-1.55 0-1.88.57-1.88 1.34 0 .69.28 1.04 1.78 1.17Zm8.58-3.33v.85h-2.42v4.87c0 .95.53 1.34 1.5 1.34.2 0 .42 0 .61-.03v.89c-.17.03-.5.05-.69.05-1.31 0-2.5-.6-2.5-2.13v-5H19.2v-.48l1.56-.44V3.9l1.08-.31v2.5h2.42Zm-13.17-.03v6.41c0 .54.19.7.67.7v.89c-1.14 0-1.72-.47-1.72-1.72V6.06h1.05Zm.25-2.33c0 .44-.34.78-.78.78a.76.76 0 0 1-.77-.78c0-.44.32-.78.77-.78s.78.34.78.78Z"></path>
</svg>
</a>
</div>
<div class="Header-item d-md-none">
<button aria-label="Toggle navigation" aria-expanded="false" type="button" data-view-component="true" class="Header-link js-details-target btn-link"> <svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-three-bars">
<path d="M1 2.75A.75.75 0 0 1 1.75 2h12.5a.75.75 0 0 1 0 1.5H1.75A.75.75 0 0 1 1 2.75Zm0 5A.75.75 0 0 1 1.75 7h12.5a.75.75 0 0 1 0 1.5H1.75A.75.75 0 0 1 1 7.75ZM1.75 12h12.5a.75.75 0 0 1 0 1.5H1.75a.75.75 0 0 1 0-1.5Z"></path>
</svg>
</button> </div>
<div class="Header-item Header-item--full js-site-search flex-column flex-md-row width-full flex-order-2 flex-md-order-none mr-0 mr-md-3 mt-3 mt-md-0 Details-content--hidden-not-important d-md-flex">
<div class="header-search flex-self-stretch flex-md-self-auto mr-0 mr-md-3 mb-3 mb-md-0">
<!-- '"` --><!-- </textarea></xmp> --></option></form><form class="position-relative js-quicksearch-form" role="search" aria-label="Site" data-turbo="false" action="/search" accept-charset="UTF-8" method="get">
<div class="header-search-wrapper form-control input-sm js-chromeless-input-container">
<input type="text"
class="form-control input-sm js-site-search-focus header-search-input"
data-hotkey="s,/"
name="q"
aria-label="Search"
placeholder="Search…"
autocorrect="off"
autocomplete="off"
autocapitalize="off">
</div>
</form></div>
<nav aria-label="Global" class="d-flex flex-column flex-md-row flex-self-stretch flex-md-self-auto">
<a class="Header-link mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, go to all gists, text:all gists" href="/discover">All gists</a>
<a class="Header-link mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, go to GitHub, text:Back to GitHub" href="https://github.com">Back to GitHub</a>
<a class="Header-link d-block d-md-none mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, sign in" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;LOG_IN&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="225a86d9264757791845a28f333324d7e939cb14b238b4e1e54d6ed07d633ee4" href="https://gist.github.com/auth/github?return_to=https%3A%2F%2Fgist.github.com%2Fstarred">
Sign in
</a>
<a class="Header-link d-block d-md-none mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, sign up" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;SIGN_UP&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="21c68033dfd930a856c07fedf0fe5ecb925c7c44e5a0186c44a57f82f0f21a32" href="/join?return_to=https%3A%2F%2Fgist.github.com%2Fstarred&amp;source=header-gist">
Sign up
</a></nav>
</div>
<div class="Header-item Header-item--full flex-justify-center d-md-none position-relative">
<a class="Header-link" data-hotkey="g d" aria-label="Gist Homepage " href="/">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github v-align-middle d-inline-block d-md-none">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 45 16" version="1.1" width="67" data-view-component="true" class="octicon octicon-logo-github v-align-middle d-none d-md-inline-block">
<path d="M8.81 7.35v5.74c0 .04-.01.11-.06.13 0 0-1.25.89-3.31.89-2.49 0-5.44-.78-5.44-5.92S2.58 1.99 5.1 2c2.18 0 3.06.49 3.2.58.04.05.06.09.06.14L7.94 4.5c0 .09-.09.2-.2.17-.36-.11-.9-.33-2.17-.33-1.47 0-3.05.42-3.05 3.73s1.5 3.7 2.58 3.7c.92 0 1.25-.11 1.25-.11v-2.3H4.88c-.11 0-.19-.08-.19-.17V7.35c0-.09.08-.17.19-.17h3.74c.11 0 .19.08.19.17Zm35.85 2.33c0 3.43-1.11 4.41-3.05 4.41-1.64 0-2.52-.83-2.52-.83s-.04.46-.09.52c-.03.06-.08.08-.14.08h-1.48c-.1 0-.19-.08-.19-.17l.02-11.11c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v3.77s.82-.53 2.02-.53l-.01-.02c1.2 0 2.97.45 2.97 3.88ZM27.68 2.43c.09 0 .17.08.17.17v11.11c0 .09-.08.17-.17.17h-2.13c-.09 0-.17-.08-.17-.17l.02-4.75h-3.31v4.75c0 .09-.08.17-.17.17h-2.13c-.08 0-.17-.08-.17-.17V2.6c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v4.09h3.31V2.6c0-.09.08-.17.17-.17Zm8.26 3.64c.11 0 .19.08.19.17l-.02 7.47c0 .09-.06.17-.17.17H34.6c-.07 0-.14-.04-.16-.09-.03-.06-.08-.45-.08-.45s-1.13.77-2.52.77c-1.69 0-2.92-.55-2.92-2.75V6.25c0-.09.08-.17.17-.17h2.14c.09 0 .17.08.17.17V11c0 .75.22 1.09.97 1.09s1.3-.39 1.3-.39V6.26c0-.11.06-.19.17-.19Zm-17.406 5.971h.005a.177.177 0 0 1 .141.179v1.5c0 .07-.03.14-.09.16-.1.05-.74.22-1.27.22-1.16 0-2.86-.25-2.86-2.69V8.13h-1.11c-.09 0-.17-.08-.17-.19V6.58c0-.08.05-.15.13-.17.07-.01 1.16-.28 1.16-.28V3.96c0-.08.05-.13.14-.13h2.16c.09 0 .14.05.14.13v2.11h1.59c.08 0 .16.08.16.17v1.7c0 .11-.07.19-.16.19h-1.59v3.131c0 .47.27.83 1.05.83.247 0 .481-.049.574-.05ZM12.24 6.06c.09 0 .17.08.17.17v7.37c0 .18-.05.27-.25.27h-1.92c-.17 0-.3-.07-.3-.27V6.26c0-.11.08-.2.17-.2Zm29.99 3.78c0-1.81-.73-2.05-1.5-1.97-.6.04-1.08.34-1.08.34v3.52s.49.34 1.22.36c1.03.03 1.36-.34 1.36-2.25ZM11.19 2.68c.75 0 1.36.61 1.36 1.38 0 .77-.61 1.38-1.36 1.38-.77 0-1.38-.61-1.38-1.38 0-.77.61-1.38 1.38-1.38Zm7.34 9.35v.001l.01.01h-.001l-.005-.001v.001c-.009-.001-.015-.011-.024-.011Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 25 16" version="1.1" width="37" data-view-component="true" class="octicon octicon-logo-gist v-align-middle d-none d-md-inline-block">
<path d="M4.7 8.73v-1h3.52v5.69c-.78.37-1.95.64-3.59.64C1.11 14.06 0 11.37 0 8.03 0 4.69 1.13 2 4.63 2c1.62 0 2.64.33 3.28.66v1.05c-1.22-.5-2-.73-3.28-.73-2.57 0-3.48 2.21-3.48 5.06 0 2.85.91 5.05 3.47 5.05.89 0 1.98-.07 2.53-.34V8.73Zm10.98.69h.03c2.22.2 2.75.95 2.75 2.23 0 1.21-.76 2.41-3.14 2.41-.75 0-1.83-.19-2.33-.39v-.94c.47.17 1.22.36 2.33.36 1.62 0 2.06-.69 2.06-1.42 0-.71-.22-1.21-1.77-1.34-2.26-.2-2.73-1-2.73-2.08 0-1.11.72-2.31 2.92-2.31.73 0 1.56.09 2.25.39v.94c-.61-.2-1.22-.36-2.27-.36-1.55 0-1.88.57-1.88 1.34 0 .69.28 1.04 1.78 1.17Zm8.58-3.33v.85h-2.42v4.87c0 .95.53 1.34 1.5 1.34.2 0 .42 0 .61-.03v.89c-.17.03-.5.05-.69.05-1.31 0-2.5-.6-2.5-2.13v-5H19.2v-.48l1.56-.44V3.9l1.08-.31v2.5h2.42Zm-13.17-.03v6.41c0 .54.19.7.67.7v.89c-1.14 0-1.72-.47-1.72-1.72V6.06h1.05Zm.25-2.33c0 .44-.34.78-.78.78a.76.76 0 0 1-.77-.78c0-.44.32-.78.77-.78s.78.34.78.78Z"></path>
</svg>
</a>
</div>
<div class="Header-item f4 mr-0" role="navigation" aria-label="Sign in or sign up">
<a class="Header-link no-underline mr-3" data-ga-click="Header, sign in" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;LOG_IN&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="225a86d9264757791845a28f333324d7e939cb14b238b4e1e54d6ed07d633ee4" href="https://gist.github.com/auth/github?return_to=https%3A%2F%2Fgist.github.com%2Fstarred">
Sign&nbsp;in
</a> <a class="Header-link d-inline-block no-underline border color-border-default rounded px-2 py-1" data-ga-click="Header, sign up" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;SIGN_UP&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="21c68033dfd930a856c07fedf0fe5ecb925c7c44e5a0186c44a57f82f0f21a32" href="/join?return_to=https%3A%2F%2Fgist.github.com%2Fstarred&amp;source=header-gist">
Sign&nbsp;up
</a> </div>
</div>
<div hidden="hidden" data-view-component="true" class="js-stale-session-flash stale-session-flash flash flash-warn flash-full mb-3">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span class="js-stale-session-flash-signed-in" hidden>You signed in with another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<span class="js-stale-session-flash-signed-out" hidden>You signed out in another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<span class="js-stale-session-flash-switched" hidden>You switched accounts on another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<button id="icon-button-0413d99c-7e94-4f11-9027-cabde9036396" aria-labelledby="tooltip-e8a4777f-ee76-456a-89c9-2886b49772c4" type="button" data-view-component="true" class="Button Button--iconOnly Button--invisible Button--medium flash-close js-flash-close"> <svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x Button-visual">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button><tool-tip id="tooltip-e8a4777f-ee76-456a-89c9-2886b49772c4" for="icon-button-0413d99c-7e94-4f11-9027-cabde9036396" popover="manual" data-direction="s" data-type="label" data-view-component="true" class="sr-only position-absolute">Dismiss alert</tool-tip>
</div>
</div>
<div id="start-of-content" class="show-on-focus"></div>
<div id="js-flash-container" data-turbo-replace>
<template class="js-flash-template">
<div class="flash flash-full {{ className }}">
<div class="px-2" >
<button autofocus class="flash-close js-flash-close" type="button" aria-label="Dismiss this message">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
<div aria-atomic="true" role="alert" class="js-flash-alert">
<div>{{ message }}</div>
</div>
</div>
</div>
</template>
</div>
<include-fragment class="js-notification-shelf-include-fragment" data-base-src="https://github.com/notifications/beta/shelf"></include-fragment>
<div
class="application-main "
data-commit-hovercards-enabled
data-discussion-hovercards-enabled
data-issue-and-pr-hovercards-enabled
>
<div itemscope itemtype="http://schema.org/Code">
<main id="gist-pjax-container">
<div class="gist-detail-intro gist-banner pb-3">
<div class="text-center container-lg px-3">
<p class="lead">
Instantly share code, notes, and snippets.
</p>
</div>
</div>
<div class="gisthead pagehead pb-0 pt-3 mb-4">
<div class="px-0">
<div class="px-3">
<div class="mb-3 d-flex">
<h1 class="float-none flex-auto pl-0 width-fit">
<svg height="32" aria-hidden="true" viewBox="0 0 24 24" version="1.1" width="32" data-view-component="true" class="octicon octicon-code-square mt-0 position-static v-align-middle">
<path d="M10.3 8.24a.75.75 0 0 1-.04 1.06L7.352 12l2.908 2.7a.75.75 0 1 1-1.02 1.1l-3.5-3.25a.75.75 0 0 1 0-1.1l3.5-3.25a.75.75 0 0 1 1.06.04Zm3.44 1.06a.75.75 0 1 1 1.02-1.1l3.5 3.25a.75.75 0 0 1 0 1.1l-3.5 3.25a.75.75 0 1 1-1.02-1.1l2.908-2.7-2.908-2.7Z"></path><path d="M2 3.75C2 2.784 2.784 2 3.75 2h16.5c.966 0 1.75.784 1.75 1.75v16.5A1.75 1.75 0 0 1 20.25 22H3.75A1.75 1.75 0 0 1 2 20.25Zm1.75-.25a.25.25 0 0 0-.25.25v16.5c0 .138.112.25.25.25h16.5a.25.25 0 0 0 .25-.25V3.75a.25.25 0 0 0-.25-.25Z"></path>
</svg>
Discover gists
</h1>
<ul class="pagehead-actions float-none">
<li></li>
</ul>
</div>
<nav aria-label="Gist tab" data-view-component="true" class="UnderlineNav">
<ul data-view-component="true" class="UnderlineNav-body list-style-none">
<li data-view-component="true" class="d-inline-flex">
<a href="/discover" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square UnderlineNav-octicon">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
<span data-view-component="true">All gists</span>
</a></li>
<li data-view-component="true" class="d-inline-flex">
<a href="/forked" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-git-branch UnderlineNav-octicon">
<path d="M9.5 3.25a2.25 2.25 0 1 1 3 2.122V6A2.5 2.5 0 0 1 10 8.5H6a1 1 0 0 0-1 1v1.128a2.251 2.251 0 1 1-1.5 0V5.372a2.25 2.25 0 1 1 1.5 0v1.836A2.493 2.493 0 0 1 6 7h4a1 1 0 0 0 1-1v-.628A2.25 2.25 0 0 1 9.5 3.25Zm-6 0a.75.75 0 1 0 1.5 0 .75.75 0 0 0-1.5 0Zm8.25-.75a.75.75 0 1 0 0 1.5.75.75 0 0 0 0-1.5ZM4.25 12a.75.75 0 1 0 0 1.5.75.75 0 0 0 0-1.5Z"></path>
</svg>
<span data-view-component="true">Forked</span>
</a></li>
<li data-view-component="true" class="d-inline-flex">
<a href="/starred" aria-current="page" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star UnderlineNav-octicon">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
<span data-view-component="true">Starred</span>
</a></li>
</ul>
</nav>
</div>
</div>
</div>
<div class="container-lg px-3">
<div class="repository-content gist-content" >
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
4 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
18 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/chrisaycock/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/chrisaycock"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/453745?s=60&amp;v=4" width="30" height="30" alt="@chrisaycock" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/chrisaycock/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/chrisaycock">chrisaycock</a>
/ <a href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266"><strong class="css-truncate-target">firms.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:39:43Z" data-view-component="true">February 14, 2024 23:39</relative-time>
</div>
<span class="f6 color-fg-muted">
List of quantitative trading firms
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/chrisaycock/8b7a37b1f97549517cb7789be5b06266">
<span class="link">View <strong>firms.md</strong></span>
</a> <div id="file-firms-md" class="file my-2">
<div id="file-firms-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><ul dir="auto">
<li><a href="https://www.3redpartners.com" rel="nofollow">3Red Partners</a></li>
<li><a href="https://www.aprioriinvestments.com" rel="nofollow">A Priori Investments</a></li>
<li><a href="https://www.acadian-asset.com" rel="nofollow">Acadian Asset Management</a></li>
<li><a href="https://akunacapital.com" rel="nofollow">Akuna Capital</a></li>
<li><a href="https://www.albatrosslabs.io" rel="nofollow">Albatross Labs</a></li>
<li><a href="https://www.alpha-grep.com" rel="nofollow">AlphaGrep</a></li>
<li><a href="https://www.alphasimplex.com" rel="nofollow">AlphaSimplex</a></li>
<li><a href="https://www.alphataraxia.com" rel="nofollow">Alphataraxia Management</a></li>
<li><a href="http://www.alyeskagroup.com" rel="nofollow">Alyeska Investment Group</a></li>
<li><a href="https://ansatz.capital" rel="nofollow">Ansatz Capital</a></li>
</ul>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
108 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
35 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1122 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/cpursley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/cpursley"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/1223773?s=60&amp;v=4" width="30" height="30" alt="@cpursley" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/cpursley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/cpursley">cpursley</a>
/ <a href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb"><strong class="css-truncate-target">postgresql_is_enough.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:35:53Z" data-view-component="true">February 14, 2024 23:35</relative-time>
</div>
<span class="f6 color-fg-muted">
Postgres is Enough
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb">
<span class="link">View <strong>postgresql_is_enough.md</strong></span>
</a> <div id="file-postgresql_is_enough-md" class="file my-2">
<div id="file-postgresql_is_enough-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-postgresql-is-enough" class="anchor" aria-hidden="true" tabindex="-1" href="#postgresql-is-enough"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>PostgreSQL is Enough</h1>
<ul dir="auto">
<li><a href="https://sive.rs/pg" rel="nofollow">Simplify: move code into database functions</a></li>
<li><a href="https://www.amazingcto.com/postgres-for-everything/" rel="nofollow">Just Use Postgres for Everything</a></li>
<li><a href="https://www.2ndquadrant.com/en/blog/postgresql-is-the-worlds-best-database/" rel="nofollow">PostgreSQL is the worlds’ best database</a></li>
<li><a href="https://news.ycombinator.com/item?id=39273954" rel="nofollow">Hacker News discussion</a></li>
</ul>
<h2 dir="auto"><a id="user-content-background-and-cron-jobs" class="anchor" aria-hidden="true" tabindex="-1" href="#background-and-cron-jobs"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Background and Cron Jobs</h2>
<ul dir="auto">
<li><a href="https://github.com/citusdata/pg_cron">https://github.com/citusdata/pg_cron</a></li>
</ul>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1 star
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/ajitid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/ajitid"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/26769888?s=60&amp;v=4" width="30" height="30" alt="@ajitid" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/ajitid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/ajitid">ajitid</a>
/ <a href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6"><strong class="css-truncate-target">trigger_scan.py</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:34:00Z" data-view-component="true">February 14, 2024 23:34</relative-time>
</div>
<span class="f6 color-fg-muted">
for <a href="https://github.com/debridmediamanager/zurg-testing/issues/72">https://github.com/debridmediamanager/zurg-testing/issues/72</a>
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/ajitid/1bbbf24e47669c5c571571ca3eb189e6">
<span class="link">View <strong>trigger_scan.py</strong></span>
</a> <div id="file-trigger_scan-py" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-python gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Python" data-tagsearch-path="trigger_scan.py">
<tr>
<td id="file-trigger_scan-py-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-trigger_scan-py-LC1" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>os</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-trigger_scan-py-LC2" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>subprocess</span> <span class=pl-k>import</span> <span class=pl-s1>check_output</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-trigger_scan-py-LC3" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>pprint</span> <span class=pl-k>import</span> <span class=pl-s1>pprint</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-trigger_scan-py-LC4" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-trigger_scan-py-LC5" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>plexapi</span>.<span class=pl-s1>server</span> <span class=pl-k>import</span> <span class=pl-v>PlexServer</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-trigger_scan-py-LC6" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-trigger_scan-py-LC7" class="blob-code blob-code-inner js-file-line"><span class=pl-k>def</span> <span class=pl-en>process_movie_section</span>(<span class=pl-s1>section</span>, <span class=pl-s1>plex_media_paths</span>, <span class=pl-s1>rclone_mount</span>):</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-trigger_scan-py-LC8" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>for</span> <span class=pl-s1>directory</span> <span class=pl-c1>in</span> <span class=pl-s1>section</span>.<span class=pl-en>all</span>():</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-trigger_scan-py-LC9" class="blob-code blob-code-inner js-file-line"> <span class=pl-c># in case of a movie, this will host a list of files</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-trigger_scan-py-LC10" class="blob-code blob-code-inner js-file-line"> <span class=pl-c># which is actually just 1 file, mentioning the movie&#39;s location</span></td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
9 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
2 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
28 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/iamucil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/iamucil"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/210371?s=60&amp;v=4" width="30" height="30" alt="@iamucil" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/iamucil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/iamucil">iamucil</a>
/ <a href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc"><strong class="css-truncate-target">go mod rename module.sh</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:25:52Z" data-view-component="true">February 14, 2024 23:25</relative-time>
</div>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc">
<span class="link">View <strong>go mod rename module.sh</strong></span>
</a> <div id="file-go-mod-rename-module-sh" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-shell gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Shell" data-tagsearch-path="go mod rename module.sh">
<tr>
<td id="file-go-mod-rename-module-sh-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-go-mod-rename-module-sh-LC1" class="blob-code blob-code-inner js-file-line">go mod edit -module {NEW_MODULE_NAME}</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-go-mod-rename-module-sh-LC2" class="blob-code blob-code-inner js-file-line">-- rename all imported module</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-go-mod-rename-module-sh-LC3" class="blob-code blob-code-inner js-file-line">find <span class="pl-c1">.</span> -type f -name <span class="pl-s"><span class="pl-pds">&#39;</span>*.go<span class="pl-pds">&#39;</span></span> \</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-go-mod-rename-module-sh-LC4" class="blob-code blob-code-inner js-file-line"> -exec sed -i -e <span class="pl-s"><span class="pl-pds">&#39;</span>s,{OLD_MODULE},{NEW_MODULE},g<span class="pl-pds">&#39;</span></span> {} <span class="pl-cce">\;</span></td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
4 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
5 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/LevanKvirkvelia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/LevanKvirkvelia"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/5202843?s=60&amp;v=4" width="30" height="30" alt="@LevanKvirkvelia" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/LevanKvirkvelia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/LevanKvirkvelia">LevanKvirkvelia</a>
/ <a href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea"><strong class="css-truncate-target">nanoBERT.py</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:25:14Z" data-view-component="true">February 14, 2024 23:25</relative-time>
</div>
<span class="f6 color-fg-muted">
nanoBERT, inspired by <a class="user-mention" data-hovercard-type="user" data-hovercard-url="/users/karpathy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/karpathy">@karpathy</a>'s nanoGPT
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea">
<span class="link">View <strong>nanoBERT.py</strong></span>
</a> <div id="file-nanobert-py" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-python gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Python" data-tagsearch-path="nanoBERT.py">
<tr>
<td id="file-nanobert-py-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-nanobert-py-LC1" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>torch</span>.<span class=pl-s1>nn</span> <span class=pl-k>as</span> <span class=pl-s1>nn</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-nanobert-py-LC2" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>torch</span>.<span class=pl-s1>nn</span>.<span class=pl-s1>functional</span> <span class=pl-k>as</span> <span class=pl-v>F</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-nanobert-py-LC3" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>math</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-nanobert-py-LC4" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>typing</span> <span class=pl-k>import</span> <span class=pl-v>Optional</span>, <span class=pl-v>Tuple</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-nanobert-py-LC5" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-nanobert-py-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-nanobert-py-LC6" class="blob-code blob-code-inner js-file-line"><span class=pl-k>class</span> <span class=pl-v>BertSelfAttention</span>(<span class=pl-s1>nn</span>.<span class=pl-v>Module</span>):</td>
</tr>
<tr>
<td id="file-nanobert-py-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-nanobert-py-LC7" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>def</span> <span class=pl-en>__init__</span>(<span class=pl-s1>self</span>, <span class=pl-s1>config</span>):</td>
</tr>
<tr>
<td id="file-nanobert-py-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-nanobert-py-LC8" class="blob-code blob-code-inner js-file-line"> <span class=pl-en>super</span>().<span class=pl-en>__init__</span>()</td>
</tr>
<tr>
<td id="file-nanobert-py-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-nanobert-py-LC9" class="blob-code blob-code-inner js-file-line"> </td>
</tr>
<tr>
<td id="file-nanobert-py-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-nanobert-py-LC10" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>if</span> <span class=pl-s1>config</span>.<span class=pl-s1>hidden_size</span> <span class=pl-c1>%</span> <span class=pl-s1>config</span>.<span class=pl-s1>num_attention_heads</span> <span class=pl-c1>!=</span> <span class=pl-c1>0</span>:</td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
13 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
70 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
121 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/jamesmacwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/jamesmacwhite"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/8067792?s=60&amp;v=4" width="30" height="30" alt="@jamesmacwhite" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/jamesmacwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/jamesmacwhite">jamesmacwhite</a>
/ <a href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6"><strong class="css-truncate-target">Workarounds for Netflix and the blocking of IPv6 tunnels.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:18:46Z" data-view-component="true">February 14, 2024 23:18</relative-time>
</div>
<span class="f6 color-fg-muted">
Prevent proxy/VPN streaming error messages from Netflix when using a Hurricane Electric IPv6 tunnel.
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6">
<span class="link">View <strong>Workarounds for Netflix and the blocking of IPv6 tunnels.md</strong></span>
</a> <div id="file-workarounds-for-netflix-and-the-blocking-of-ipv6-tunnels-md" class="file my-2">
<div id="file-workarounds-for-netflix-and-the-blocking-of-ipv6-tunnels-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-workarounds-for-netflix-and-the-blocking-of-hurricane-electric-ipv6-tunnels" class="anchor" aria-hidden="true" tabindex="-1" href="#workarounds-for-netflix-and-the-blocking-of-hurricane-electric-ipv6-tunnels"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Workarounds for Netflix and the blocking of Hurricane Electric IPv6 tunnels</h1>
<h6 dir="auto"><a id="user-content-the-dreaded-you-seem-to-be-using-an-unblocker-or-proxy-error-message-cool-story-bro" class="anchor" aria-hidden="true" tabindex="-1" href="#the-dreaded-you-seem-to-be-using-an-unblocker-or-proxy-error-message-cool-story-bro"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>The dreaded "You seem to be using an unblocker or proxy." error message. Cool story bro.</h6>
<p dir="auto"><em>This gist was essentially created out of my own <a href="https://blog.jmwhite.co.uk/2016/06/12/netflix-starts-blocking-ipv6-tunnels/" rel="nofollow">rant about Netflix being hostile to IPv6 tunnel services since June 2016</a>. You are welcome to read my opinion on the matter, this is the more technical side to the issue and how to combat it within your own network.</em></p>
<p dir="auto">Since I wrote this, various GitHub users have contributed their thoughts and ideas which has been incorporated into this gist. Thank you to everyone who have contributed their own methods and implementations.</p>
<h2 dir="auto"><a id="user-content-the-problem" class="anchor" aria-hidden="true" tabindex="-1" href="#the-problem"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>The problem</h2>
<p dir="auto">Netflix now treats IPv6 tunnel brokers (such as Hurricane Electric) as proxy servers. A while ago it became apparent to users and Netflix that somewhat by accident, IPv6 tunnel users were being served content outside of their geolocation because of the way Netflix was identifyi</p>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
15 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
9 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
90 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/eyecatchup/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/eyecatchup"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/845131?s=60&amp;v=4" width="30" height="30" alt="@eyecatchup" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/eyecatchup/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/eyecatchup">eyecatchup</a>
/ <a href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01"><strong class="css-truncate-target">id3-ffmpeg.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:16:01Z" data-view-component="true">February 14, 2024 23:16</relative-time>
</div>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/eyecatchup/0757b3d8b989fe433979db2ea7d95a01">
<span class="link">View <strong>id3-ffmpeg.md</strong></span>
</a> <div id="file-id3-ffmpeg-md" class="file my-2">
<div id="file-id3-ffmpeg-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-getset-id3-meta-tags-using-ffmpeg" class="anchor" aria-hidden="true" tabindex="-1" href="#getset-id3-meta-tags-using-ffmpeg"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Get/set ID3 meta tags using ffmpeg</h1>
<p dir="auto">A quick guide on how to read/write/modify <strong>ID3</strong> metadata tags for audio / media files using <strong><code>ffmpeg</code></strong>.</p>
<p dir="auto"><a href="https://ffmpeg.org/" rel="nofollow">FFmpeg</a> has a free-form command line option that allows the user to specify key-value-pairs for encoding metadata. Let's take a look.</p>
<h2 dir="auto"><a id="user-content-1-read-id3-metadata" class="anchor" aria-hidden="true" tabindex="-1" href="#1-read-id3-metadata"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>1. <em><strong>Read</strong></em> ID3 metadata</h2>
<p dir="auto">To list all global metadata tags for a media file, just set an input but no output file.</p>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
189 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
75 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
358 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/Klerith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/Klerith"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/3438503?s=60&amp;v=4" width="30" height="30" alt="@Klerith" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/Klerith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/Klerith">Klerith</a>
/ <a href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177"><strong class="css-truncate-target">vite-testing-config.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:13:25Z" data-view-component="true">February 14, 2024 23:13</relative-time>
</div>
<span class="f6 color-fg-muted">
Vite + Jest + React Testing Library - Configuraciones a seguir
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/Klerith/ca7e57fae3c9ab92ad08baadc6c26177">
<span class="link">View <strong>vite-testing-config.md</strong></span>
</a> <div id="file-vite-testing-config-md" class="file my-2">
<div id="file-vite-testing-config-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-instalación-y-configuracion-de-jest--react-testing-library" class="anchor" aria-hidden="true" tabindex="-1" href="#instalación-y-configuracion-de-jest--react-testing-library"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Instalación y configuracion de Jest + React Testing Library</h1>
<h2 dir="auto"><a id="user-content-en-proyectos-de-react--vite" class="anchor" aria-hidden="true" tabindex="-1" href="#en-proyectos-de-react--vite"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>En proyectos de React + Vite</h2>
<ol dir="auto">
<li>Instalaciones:</li>
</ol>
<pre><code>yarn add --dev jest babel-jest @babel/preset-env @babel/preset-react
yarn add --dev @testing-library/react @types/jest jest-environment-jsdom
</code></pre>
<ol start="2" dir="auto">
<li>Opcional: Si usamos Fetch API en el proyecto:</li>
</ol>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1 star
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/alexpaden/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/alexpaden"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/97042400?s=60&amp;v=4" width="30" height="30" alt="@alexpaden" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/alexpaden/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/alexpaden">alexpaden</a>
/ <a href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7"><strong class="css-truncate-target">gist:8ece0b1cfc71d920b4bb99cb16702ab7</strong></a>
</span>
<div class="color-fg-muted f6">
Created
<relative-time tense="past" datetime="2024-02-14T22:58:32Z" data-view-component="true">February 14, 2024 22:58</relative-time>
</div>
<span class="f6 color-fg-muted">
farcaster follower via dune queries
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7">
<span class="link">View <strong>gist:8ece0b1cfc71d920b4bb99cb16702ab7</strong></span>
</a> <div id="file-gistfile1-txt" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-text gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Text" data-tagsearch-path="gistfile1.txt">
<tr>
<td id="file-gistfile1-txt-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-gistfile1-txt-LC1" class="blob-code blob-code-inner js-file-line">import requests</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-gistfile1-txt-LC2" class="blob-code blob-code-inner js-file-line">from dune_client.client import DuneClient</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-gistfile1-txt-LC3" class="blob-code blob-code-inner js-file-line">from dune_client.query import QueryBase</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-gistfile1-txt-LC4" class="blob-code blob-code-inner js-file-line">import time</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-gistfile1-txt-LC5" class="blob-code blob-code-inner js-file-line">import random</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-gistfile1-txt-LC6" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-gistfile1-txt-LC7" class="blob-code blob-code-inner js-file-line">NEYNAR_API_KEY = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-gistfile1-txt-LC8" class="blob-code blob-code-inner js-file-line">DUNE_API_KEY = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-gistfile1-txt-LC9" class="blob-code blob-code-inner js-file-line">SIGNER_UUID = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-gistfile1-txt-LC10" class="blob-code blob-code-inner js-file-line">HEADERS = {&#39;accept&#39;: &#39;application/json&#39;, &#39;api_key&#39;: NEYNAR_API_KEY}</td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="paginate-container">
<div class="pagination"><span class="disabled color-fg-muted">Newer</span><a rel="nofollow" href="https://gist.github.com/starred?page=2">Older</a></div>
</div>
</div>
</div><!-- /.container -->
</main>
</div>
</div>
<footer class="footer pt-8 pb-6 f6 color-fg-muted p-responsive" role="contentinfo" >
<h2 class='sr-only'>Footer</h2>
<div class="d-flex flex-justify-center flex-items-center flex-column-reverse flex-lg-row flex-wrap flex-lg-nowrap">
<div class="d-flex flex-items-center flex-shrink-0 mx-2">
<a aria-label="Homepage" title="GitHub" class="footer-octicon mr-2" href="https://github.com">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
</a>
<span>
&copy; 2024 GitHub,&nbsp;Inc.
</span>
</div>
<nav aria-label="Footer">
<h3 class="sr-only" id="sr-footer-heading">Footer navigation</h3>
<ul class="list-style-none d-flex flex-justify-center flex-wrap mb-2 mb-lg-0" aria-labelledby="sr-footer-heading">
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to Terms&quot;,&quot;label&quot;:&quot;text:terms&quot;}" href="https://docs.github.com/site-policy/github-terms/github-terms-of-service" data-view-component="true" class="Link--secondary Link">Terms</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to privacy&quot;,&quot;label&quot;:&quot;text:privacy&quot;}" href="https://docs.github.com/site-policy/privacy-policies/github-privacy-statement" data-view-component="true" class="Link--secondary Link">Privacy</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to security&quot;,&quot;label&quot;:&quot;text:security&quot;}" href="/security" data-view-component="true" class="Link--secondary Link">Security</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to status&quot;,&quot;label&quot;:&quot;text:status&quot;}" href="https://www.githubstatus.com/" data-view-component="true" class="Link--secondary Link">Status</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to docs&quot;,&quot;label&quot;:&quot;text:docs&quot;}" href="https://docs.github.com" data-view-component="true" class="Link--secondary Link">Docs</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to contact&quot;,&quot;label&quot;:&quot;text:contact&quot;}" href="https://support.github.com?tags=dotcom-footer" data-view-component="true" class="Link--secondary Link">Contact</a>
</li>
<li class="mx-2" >
<cookie-consent-link>
<button type="button" class="Link--secondary underline-on-hover border-0 p-0 color-bg-transparent" data-action="click:cookie-consent-link#showConsentManagement">
Manage cookies
</button>
</cookie-consent-link>
</li>
<li class="mx-2">
<cookie-consent-link>
<button type="button" class="Link--secondary underline-on-hover border-0 p-0 color-bg-transparent" data-action="click:cookie-consent-link#showConsentManagement">
Do not share my personal information
</button>
</cookie-consent-link>
</li>
</ul>
</nav>
</div>
</footer>
<cookie-consent id="cookie-consent-banner" class="position-fixed bottom-0 left-0" style="z-index: 999999" data-initial-cookie-consent-allowed="" data-cookie-consent-required="true"></cookie-consent>
<div id="ajax-error-message" class="ajax-error-message flash flash-error" hidden>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<button type="button" class="flash-close js-ajax-error-dismiss" aria-label="Dismiss error">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
You can’t perform that action at this time.
</div>
<template id="site-details-dialog">
<details class="details-reset details-overlay details-overlay-dark lh-default color-fg-default hx_rsm" open>
<summary role="button" aria-label="Close dialog"></summary>
<details-dialog class="Box Box--overlay d-flex flex-column anim-fade-in fast hx_rsm-dialog hx_rsm-modal">
<button class="Box-btn-octicon m-0 btn-octicon position-absolute right-0 top-0" type="button" aria-label="Close dialog" data-close-dialog>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
<div class="octocat-spinner my-6 js-details-dialog-spinner"></div>
</details-dialog>
</details>
</template>
<div class="Popover js-hovercard-content position-absolute" style="display: none; outline: none;" tabindex="0">
<div class="Popover-message Popover-message--bottom-left Popover-message--large Box color-shadow-large" style="width:360px;">
</div>
</div>
<template id="snippet-clipboard-copy-button">
<div class="zeroclipboard-container position-absolute right-0 top-0">
<clipboard-copy aria-label="Copy" class="ClipboardButton btn js-clipboard-copy m-2 p-0 tooltipped-no-delay" data-copy-feedback="Copied!" data-tooltip-direction="w">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-copy js-clipboard-copy-icon m-2">
<path d="M0 6.75C0 5.784.784 5 1.75 5h1.5a.75.75 0 0 1 0 1.5h-1.5a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-1.5a.75.75 0 0 1 1.5 0v1.5A1.75 1.75 0 0 1 9.25 16h-7.5A1.75 1.75 0 0 1 0 14.25Z"></path><path d="M5 1.75C5 .784 5.784 0 6.75 0h7.5C15.216 0 16 .784 16 1.75v7.5A1.75 1.75 0 0 1 14.25 11h-7.5A1.75 1.75 0 0 1 5 9.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-check js-clipboard-check-icon color-fg-success d-none m-2">
<path d="M13.78 4.22a.75.75 0 0 1 0 1.06l-7.25 7.25a.75.75 0 0 1-1.06 0L2.22 9.28a.751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018L6 10.94l6.72-6.72a.75.75 0 0 1 1.06 0Z"></path>
</svg>
</clipboard-copy>
</div>
</template>
<template id="snippet-clipboard-copy-button-unpositioned">
<div class="zeroclipboard-container">
<clipboard-copy aria-label="Copy" class="ClipboardButton btn btn-invisible js-clipboard-copy m-2 p-0 tooltipped-no-delay d-flex flex-justify-center flex-items-center" data-copy-feedback="Copied!" data-tooltip-direction="w">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-copy js-clipboard-copy-icon">
<path d="M0 6.75C0 5.784.784 5 1.75 5h1.5a.75.75 0 0 1 0 1.5h-1.5a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-1.5a.75.75 0 0 1 1.5 0v1.5A1.75 1.75 0 0 1 9.25 16h-7.5A1.75 1.75 0 0 1 0 14.25Z"></path><path d="M5 1.75C5 .784 5.784 0 6.75 0h7.5C15.216 0 16 .784 16 1.75v7.5A1.75 1.75 0 0 1 14.25 11h-7.5A1.75 1.75 0 0 1 5 9.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-check js-clipboard-check-icon color-fg-success d-none">
<path d="M13.78 4.22a.75.75 0 0 1 0 1.06l-7.25 7.25a.75.75 0 0 1-1.06 0L2.22 9.28a.751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018L6 10.94l6.72-6.72a.75.75 0 0 1 1.06 0Z"></path>
</svg>
</clipboard-copy>
</div>
</template>
</div>
<div id="js-global-screen-reader-notice" class="sr-only" aria-live="polite" aria-atomic="true" ></div>
<div id="js-global-screen-reader-notice-assertive" class="sr-only" aria-live="assertive" aria-atomic="true"></div>
</body>
</html>
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Omningotex-7b-slerp](https://huggingface.co/liminerity/Omningotex-7b-slerp)| 44.9| 77.36| 76.59| 49.04| 61.97|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|24.02|± | 2.69|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|39.94|± | 1.92|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |54.31|± | 2.21|
| | |acc_norm|54.71|± | 2.21|
|agieval_lsat_rc | 0|acc |66.91|± | 2.87|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|77.67|± | 2.91|
|agieval_sat_en_without_passage| 0|acc |43.20|± | 3.46|
| | |acc_norm|42.23|± | 3.45|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|30.45|± | 3.11|
Average: 44.9%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.75|± | 1.37|
| | |acc_norm|68.00|± | 1.36|
|arc_easy | 0|acc |86.83|± | 0.69|
| | |acc_norm|80.56|± | 0.81|
|boolq | 1|acc |87.77|± | 0.57|
|hellaswag | 0|acc |70.03|± | 0.46|
| | |acc_norm|87.36|± | 0.33|
|openbookqa | 0|acc |40.40|± | 2.20|
| | |acc_norm|50.00|± | 2.24|
|piqa | 0|acc |83.68|± | 0.86|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |82.40|± | 1.07|
Average: 77.36%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.57|± | 1.7|
| | |mc2 |76.59|± | 1.4|
Average: 76.59%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|61.79|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|53.49|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.60|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.43|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.00|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|50.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.40|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.60|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|53.35|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|37.68|± | 1.53|
|bigbench_snarks | 0|multiple_choice_grade|72.38|± | 3.33|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.56|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.10|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.52|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.71|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.00|± | 2.84|
Average: 49.04%
Average score: 61.97%
Elapsed time: 02:07:00| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MergeTrix-v4](https://huggingface.co/CultriX/MergeTrix-v4)| 45.54| 77.35| 72.19| 48.52| 60.9|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |28.74|± | 2.85|
| | |acc_norm|28.35|± | 2.83|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|22.61|± | 2.76|
|agieval_lsat_lr | 0|acc |52.55|± | 2.21|
| | |acc_norm|52.75|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |80.10|± | 2.79|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |45.63|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.00|± | 3.10|
Average: 45.54%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.38|± | 1.38|
| | |acc_norm|67.32|± | 1.37|
|arc_easy | 0|acc |87.42|± | 0.68|
| | |acc_norm|83.25|± | 0.77|
|boolq | 1|acc |88.26|± | 0.56|
|hellaswag | 0|acc |69.20|± | 0.46|
| | |acc_norm|86.90|± | 0.34|
|openbookqa | 0|acc |38.60|± | 2.18|
| | |acc_norm|49.00|± | 2.24|
|piqa | 0|acc |83.24|± | 0.87|
| | |acc_norm|85.75|± | 0.82|
|winogrande | 0|acc |80.98|± | 1.10|
Average: 77.35%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.16|± | 1.73|
| | |mc2 |72.19|± | 1.47|
Average: 72.19%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|56.84|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|64.77|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.90|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.20|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.86|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.80|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.70|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|55.13|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.57|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.06|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.40|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.71|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 48.52%
Average score: 60.9%
Elapsed time: 01:35:48| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralBeagle14-7B](https://huggingface.co/mlabonne/NeuralBeagle14-7B)| 46.06| 76.77| 70.32| 47.86| 60.25|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.98|± | 2.76|
|agieval_logiqa_en | 0|acc |38.56|± | 1.91|
| | |acc_norm|39.17|± | 1.91|
|agieval_lsat_ar | 0|acc |22.61|± | 2.76|
| | |acc_norm|23.04|± | 2.78|
|agieval_lsat_lr | 0|acc |51.96|± | 2.21|
| | |acc_norm|53.14|± | 2.21|
|agieval_lsat_rc | 0|acc |66.17|± | 2.89|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |81.07|± | 2.74|
| | |acc_norm|82.52|± | 2.65|
|agieval_sat_en_without_passage| 0|acc |44.17|± | 3.47|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |37.27|± | 3.27|
| | |acc_norm|34.55|± | 3.21|
Average: 46.06%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |68.69|± | 1.36|
| | |acc_norm|68.17|± | 1.36|
|arc_easy | 0|acc |87.29|± | 0.68|
| | |acc_norm|82.74|± | 0.78|
|boolq | 1|acc |88.07|± | 0.57|
|hellaswag | 0|acc |70.05|± | 0.46|
| | |acc_norm|86.44|± | 0.34|
|openbookqa | 0|acc |39.20|± | 2.19|
| | |acc_norm|48.40|± | 2.24|
|piqa | 0|acc |83.62|± | 0.86|
| | |acc_norm|84.87|± | 0.84|
|winogrande | 0|acc |78.69|± | 1.15|
Average: 76.77%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |58.02|± | 1.73|
| | |mc2 |70.32|± | 1.50|
Average: 70.32%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|55.26|± | 3.62|
|bigbench_date_understanding | 0|multiple_choice_grade|64.77|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|43.41|± | 3.09|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|37.80|± | 2.17|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|25.43|± | 1.65|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.00|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|50.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.40|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|70.70|± | 1.02|
|bigbench_ruin_names | 0|multiple_choice_grade|53.12|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.86|± | 1.46|
|bigbench_snarks | 0|multiple_choice_grade|65.19|± | 3.55|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.75|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|49.10|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.24|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.46|± | 0.93|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.00|± | 2.83|
Average: 47.86%
Average score: 60.25%
Elapsed time: 03:25:54
D| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[OmniTrixAI](https://huggingface.co/CultriX/OmniTrixAI)| 44.94| 77.31| 70.62| 48.52| 60.35|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |40.09|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |50.98|± | 2.22|
| | |acc_norm|52.75|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|66.54|± | 2.88|
|agieval_sat_en | 0|acc |80.10|± | 2.79|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |44.17|± | 3.47|
| | |acc_norm|42.72|± | 3.45|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|28.64|± | 3.05|
Average: 44.94%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.15|± | 1.37|
| | |acc_norm|67.15|± | 1.37|
|arc_easy | 0|acc |87.21|± | 0.69|
| | |acc_norm|83.25|± | 0.77|
|boolq | 1|acc |88.10|± | 0.57|
|hellaswag | 0|acc |69.71|± | 0.46|
| | |acc_norm|86.98|± | 0.34|
|openbookqa | 0|acc |39.60|± | 2.19|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |83.84|± | 0.86|
| | |acc_norm|85.26|± | 0.83|
|winogrande | 0|acc |81.85|± | 1.08|
Average: 77.31%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.53|± | 1.73|
| | |mc2 |70.62|± | 1.49|
Average: 70.62%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|64.50|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|46.12|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.80|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.00|± | 1.62|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.33|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.00|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|57.20|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.75|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.24|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|34.17|± | 1.50|
|bigbench_snarks | 0|multiple_choice_grade|71.27|± | 3.37|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.15|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.50|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|21.76|± | 1.17|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.26|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.33|± | 2.84|
Average: 48.52%
Average score: 60.35%
Elapsed time: 02:41:45| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|--------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[binarized-ingotrix-slerp-7b](https://huggingface.co/liminerity/binarized-ingotrix-slerp-7b)| 45.17| 76.74| 75.64| 49.57| 61.78|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |28.35|± | 2.83|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |39.48|± | 1.92|
| | |acc_norm|40.55|± | 1.93|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |54.12|± | 2.21|
| | |acc_norm|55.10|± | 2.20|
|agieval_lsat_rc | 0|acc |65.06|± | 2.91|
| | |acc_norm|63.20|± | 2.95|
|agieval_sat_en | 0|acc |79.61|± | 2.81|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |42.72|± | 3.45|
| | |acc_norm|43.20|± | 3.46|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|30.91|± | 3.12|
Average: 45.17%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.75|± | 1.37|
| | |acc_norm|66.89|± | 1.38|
|arc_easy | 0|acc |86.66|± | 0.70|
| | |acc_norm|80.47|± | 0.81|
|boolq | 1|acc |87.65|± | 0.58|
|hellaswag | 0|acc |69.68|± | 0.46|
| | |acc_norm|86.89|± | 0.34|
|openbookqa | 0|acc |40.00|± | 2.19|
| | |acc_norm|48.40|± | 2.24|
|piqa | 0|acc |83.51|± | 0.87|
| | |acc_norm|85.64|± | 0.82|
|winogrande | 0|acc |81.22|± | 1.10|
Average: 76.74%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.32|± | 1.70|
| | |mc2 |75.64|± | 1.42|
Average: 75.64%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|63.41|± | 2.51|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|53.88|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|35.40|± | 2.14|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.71|± | 1.61|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.00|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|52.00|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.30|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.60|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|54.46|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|38.58|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|72.38|± | 3.33|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.06|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.90|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.32|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.17|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.00|± | 2.83|
Average: 49.57%
Average score: 61.78%
Elapsed time: 02:23:11| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-v3-bf16](https://huggingface.co/CultriX/NeuralTrix-v3-bf16)| 44.52| 76.84| 77.78| 49.37| 62.13|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |37.63|± | 1.90|
| | |acc_norm|38.25|± | 1.91|
|agieval_lsat_ar | 0|acc |26.09|± | 2.90|
| | |acc_norm|23.91|± | 2.82|
|agieval_lsat_lr | 0|acc |53.73|± | 2.21|
| | |acc_norm|54.51|± | 2.21|
|agieval_lsat_rc | 0|acc |66.17|± | 2.89|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|77.18|± | 2.93|
|agieval_sat_en_without_passage| 0|acc |41.75|± | 3.44|
| | |acc_norm|40.29|± | 3.43|
|agieval_sat_math | 0|acc |33.64|± | 3.19|
| | |acc_norm|31.82|± | 3.15|
Average: 44.52%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.44|± | 1.39|
| | |acc_norm|67.58|± | 1.37|
|arc_easy | 0|acc |85.40|± | 0.72|
| | |acc_norm|78.87|± | 0.84|
|boolq | 1|acc |87.83|± | 0.57|
|hellaswag | 0|acc |70.46|± | 0.46|
| | |acc_norm|87.88|± | 0.33|
|openbookqa | 0|acc |40.80|± | 2.20|
| | |acc_norm|49.40|± | 2.24|
|piqa | 0|acc |82.75|± | 0.88|
| | |acc_norm|83.79|± | 0.86|
|winogrande | 0|acc |82.56|± | 1.07|
Average: 76.84%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |62.55|± | 1.69|
| | |mc2 |77.78|± | 1.38|
Average: 77.78%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.95|± | 3.58|
|bigbench_date_understanding | 0|multiple_choice_grade|62.06|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|57.75|± | 3.08|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 1.95|± | 0.73|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|30.80|± | 2.07|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|21.29|± | 1.55|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.00|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|57.80|± | 2.21|
|bigbench_navigate | 0|multiple_choice_grade|52.70|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|67.70|± | 1.05|
|bigbench_ruin_names | 0|multiple_choice_grade|52.68|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|41.38|± | 1.56|
|bigbench_snarks | 0|multiple_choice_grade|74.59|± | 3.25|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.56|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.84|± | 1.21|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.00|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.00|± | 2.85|
Average: 49.37%
Average score: 62.13%
Elapsed time: 01:20:48| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[MergeTrix-7B](https://huggingface.co/CultriX/MergeTrix-7B)| 44.93| 76.85| 66.56| 47.18| 58.88|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.94|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|20.87|± | 2.69|
|agieval_lsat_lr | 0|acc |51.96|± | 2.21|
| | |acc_norm|52.35|± | 2.21|
|agieval_lsat_rc | 0|acc |66.54|± | 2.88|
| | |acc_norm|66.17|± | 2.89|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |43.20|± | 3.46|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.45|± | 3.11|
Average: 44.93%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.98|± | 1.37|
| | |acc_norm|67.15|± | 1.37|
|arc_easy | 0|acc |86.91|± | 0.69|
| | |acc_norm|82.95|± | 0.77|
|boolq | 1|acc |88.41|± | 0.56|
|hellaswag | 0|acc |69.08|± | 0.46|
| | |acc_norm|86.01|± | 0.35|
|openbookqa | 0|acc |37.20|± | 2.16|
| | |acc_norm|48.20|± | 2.24|
|piqa | 0|acc |83.41|± | 0.87|
| | |acc_norm|84.66|± | 0.84|
|winogrande | 0|acc |80.58|± | 1.11|
Average: 76.85%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |51.04|± | 1.75|
| | |mc2 |66.56|± | 1.53|
Average: 66.56%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.89|± | 3.59|
|bigbench_date_understanding | 0|multiple_choice_grade|65.58|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|40.31|± | 3.06|
|bigbench_geometric_shapes | 0|multiple_choice_grade|24.79|± | 2.28|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|35.00|± | 2.14|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.29|± | 1.62|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.00|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|43.60|± | 2.22|
|bigbench_navigate | 0|multiple_choice_grade|55.40|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.90|± | 0.99|
|bigbench_ruin_names | 0|multiple_choice_grade|52.68|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|31.16|± | 1.47|
|bigbench_snarks | 0|multiple_choice_grade|71.27|± | 3.37|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.56|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|41.70|± | 1.56|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.80|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.23|± | 0.92|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.00|± | 2.85|
Average: 47.18%
Average score: 58.88%
Elapsed time: 02:12:36| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-V2](https://huggingface.co/CultriX/NeuralTrix-V2)| 44.43| 77.01| 78.2| 49.81| 62.36|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|26.38|± | 2.77|
|agieval_logiqa_en | 0|acc |38.86|± | 1.91|
| | |acc_norm|37.94|± | 1.90|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|20.87|± | 2.69|
|agieval_lsat_lr | 0|acc |52.55|± | 2.21|
| | |acc_norm|53.33|± | 2.21|
|agieval_lsat_rc | 0|acc |65.43|± | 2.91|
| | |acc_norm|64.31|± | 2.93|
|agieval_sat_en | 0|acc |77.67|± | 2.91|
| | |acc_norm|78.64|± | 2.86|
|agieval_sat_en_without_passage| 0|acc |41.75|± | 3.44|
| | |acc_norm|41.26|± | 3.44|
|agieval_sat_math | 0|acc |33.64|± | 3.19|
| | |acc_norm|32.73|± | 3.17|
Average: 44.43%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.61|± | 1.39|
| | |acc_norm|68.00|± | 1.36|
|arc_easy | 0|acc |85.61|± | 0.72|
| | |acc_norm|79.17|± | 0.83|
|boolq | 1|acc |87.61|± | 0.58|
|hellaswag | 0|acc |70.56|± | 0.45|
| | |acc_norm|87.73|± | 0.33|
|openbookqa | 0|acc |39.80|± | 2.19|
| | |acc_norm|49.80|± | 2.24|
|piqa | 0|acc |82.43|± | 0.89|
| | |acc_norm|84.33|± | 0.85|
|winogrande | 0|acc |82.40|± | 1.07|
Average: 77.01%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |63.16|± | 1.69|
| | |mc2 |78.20|± | 1.37|
Average: 78.2%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|60.16|± | 2.55|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|58.91|± | 3.07|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.56|± | 0.39|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|31.00|± | 2.07|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|21.86|± | 1.56|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|58.00|± | 2.21|
|bigbench_navigate | 0|multiple_choice_grade|52.90|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|68.00|± | 1.04|
|bigbench_ruin_names | 0|multiple_choice_grade|56.70|± | 2.34|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|43.59|± | 1.57|
|bigbench_snarks | 0|multiple_choice_grade|72.93|± | 3.31|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.05|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.60|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.84|± | 1.21|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.66|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 49.81%
Average score: 62.36%
Elapsed time: 01:43:39| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[jaskier-7b-dpo-v3.3](https://huggingface.co/bardsai/jaskier-7b-dpo-v3.3)| 44.57| 76.53| 80| 49.22| 62.58|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |37.33|± | 1.90|
| | |acc_norm|37.48|± | 1.90|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |53.73|± | 2.21|
| | |acc_norm|54.71|± | 2.21|
|agieval_lsat_rc | 0|acc |65.43|± | 2.91|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|77.67|± | 2.91|
|agieval_sat_en_without_passage| 0|acc |42.23|± | 3.45|
| | |acc_norm|41.75|± | 3.44|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.00|± | 3.10|
Average: 44.57%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.78|± | 1.39|
| | |acc_norm|67.75|± | 1.37|
|arc_easy | 0|acc |84.55|± | 0.74|
| | |acc_norm|77.86|± | 0.85|
|boolq | 1|acc |86.94|± | 0.59|
|hellaswag | 0|acc |69.17|± | 0.46|
| | |acc_norm|87.18|± | 0.33|
|openbookqa | 0|acc |40.60|± | 2.20|
| | |acc_norm|50.20|± | 2.24|
|piqa | 0|acc |82.48|± | 0.89|
| | |acc_norm|83.90|± | 0.86|
|winogrande | 0|acc |81.85|± | 1.08|
Average: 76.53%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |64.38|± | 1.68|
| | |mc2 |80.00|± | 1.33|
Average: 80.0%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.53|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|61.52|± | 2.54|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|61.63|± | 3.03|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|31.80|± | 2.08|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.86|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|51.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|53.70|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|66.65|± | 1.05|
|bigbench_ruin_names | 0|multiple_choice_grade|54.91|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|39.28|± | 1.55|
|bigbench_snarks | 0|multiple_choice_grade|71.27|± | 3.37|
|bigbench_sports_understanding | 0|multiple_choice_grade|73.63|± | 1.40|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.36|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.66|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 49.22%
Average score: 62.58%
Elapsed time: 05:35:20| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Aphasia-7B](https://huggingface.co/CultriX/Aphasia-7B)| 45.24| 77.25| 71.04| 48.17| 60.43|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |28.35|± | 2.83|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |38.71|± | 1.91|
| | |acc_norm|40.55|± | 1.93|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |52.16|± | 2.21|
| | |acc_norm|52.75|± | 2.21|
|agieval_lsat_rc | 0|acc |66.91|± | 2.87|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |80.58|± | 2.76|
| | |acc_norm|80.10|± | 2.79|
|agieval_sat_en_without_passage| 0|acc |43.20|± | 3.46|
| | |acc_norm|42.72|± | 3.45|
|agieval_sat_math | 0|acc |34.09|± | 3.20|
| | |acc_norm|30.45|± | 3.11|
Average: 45.24%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |68.00|± | 1.36|
| | |acc_norm|67.58|± | 1.37|
|arc_easy | 0|acc |87.16|± | 0.69|
| | |acc_norm|83.54|± | 0.76|
|boolq | 1|acc |88.17|± | 0.56|
|hellaswag | 0|acc |69.77|± | 0.46|
| | |acc_norm|86.73|± | 0.34|
|openbookqa | 0|acc |39.80|± | 2.19|
| | |acc_norm|49.00|± | 2.24|
|piqa | 0|acc |83.30|± | 0.87|
| | |acc_norm|85.15|± | 0.83|
|winogrande | 0|acc |80.58|± | 1.11|
Average: 77.25%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.53|± | 1.73|
| | |mc2 |71.04|± | 1.49|
Average: 71.04%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|55.79|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|65.31|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.74|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.56|± | 2.21|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|36.40|± | 2.15|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.43|± | 1.63|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.67|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|48.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.90|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.75|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.91|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.26|± | 1.45|
|bigbench_snarks | 0|multiple_choice_grade|67.96|± | 3.48|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.66|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|47.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.56|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.94|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.67|± | 2.83|
Average: 48.17%
Average score: 60.43%
Elapsed time: 01:23:27| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[StableBeluga-7B](https://huggingface.co/stabilityai/StableBeluga-7B)| 35.36| 69.37| 50.09| 35.77| 47.65|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.20|± | 2.73|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |32.41|± | 1.84|
| | |acc_norm|32.87|± | 1.84|
|agieval_lsat_ar | 0|acc |19.57|± | 2.62|
| | |acc_norm|17.83|± | 2.53|
|agieval_lsat_lr | 0|acc |33.53|± | 2.09|
| | |acc_norm|36.08|± | 2.13|
|agieval_lsat_rc | 0|acc |43.12|± | 3.03|
| | |acc_norm|43.12|± | 3.03|
|agieval_sat_en | 0|acc |64.56|± | 3.34|
| | |acc_norm|62.62|± | 3.38|
|agieval_sat_en_without_passage| 0|acc |39.81|± | 3.42|
| | |acc_norm|38.83|± | 3.40|
|agieval_sat_math | 0|acc |25.45|± | 2.94|
| | |acc_norm|25.91|± | 2.96|
Average: 35.36%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |49.40|± | 1.46|
| | |acc_norm|52.30|± | 1.46|
|arc_easy | 0|acc |80.22|± | 0.82|
| | |acc_norm|78.24|± | 0.85|
|boolq | 1|acc |82.69|± | 0.66|
|hellaswag | 0|acc |58.32|± | 0.49|
| | |acc_norm|77.13|± | 0.42|
|openbookqa | 0|acc |34.80|± | 2.13|
| | |acc_norm|43.80|± | 2.22|
|piqa | 0|acc |78.78|± | 0.95|
| | |acc_norm|80.03|± | 0.93|
|winogrande | 0|acc |71.43|± | 1.27|
Average: 69.37%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |34.76|± | 1.67|
| | |mc2 |50.09|± | 1.54|
Average: 50.09%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.95|± | 3.58|
|bigbench_date_understanding | 0|multiple_choice_grade|64.77|± | 2.49|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|34.88|± | 2.97|
|bigbench_geometric_shapes | 0|multiple_choice_grade| 0.00|± | 0.00|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|25.60|± | 1.95|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|17.57|± | 1.44|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|42.00|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|29.40|± | 2.04|
|bigbench_navigate | 0|multiple_choice_grade|50.00|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|54.60|± | 1.11|
|bigbench_ruin_names | 0|multiple_choice_grade|29.91|± | 2.17|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|29.66|± | 1.45|
|bigbench_snarks | 0|multiple_choice_grade|61.88|± | 3.62|
|bigbench_sports_understanding | 0|multiple_choice_grade|49.70|± | 1.59|
|bigbench_temporal_sequences | 0|multiple_choice_grade|18.20|± | 1.22|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|19.52|± | 1.12|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|15.26|± | 0.86|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|42.00|± | 2.85|
Average: 35.77%
Average score: 47.65%
Elapsed time: 01:22:36| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[dpo-binarized-NeuralTrix-7B](https://huggingface.co/eren23/dpo-binarized-NeuralTrix-7B)| 44.57| 76.34| 79.81| 49.27| 62.5|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.77|± | 2.78|
| | |acc_norm|24.41|± | 2.70|
|agieval_logiqa_en | 0|acc |37.94|± | 1.90|
| | |acc_norm|37.94|± | 1.90|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |52.94|± | 2.21|
| | |acc_norm|55.49|± | 2.20|
|agieval_lsat_rc | 0|acc |65.06|± | 2.91|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|77.67|± | 2.91|
|agieval_sat_en_without_passage| 0|acc |41.75|± | 3.44|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|30.00|± | 3.10|
Average: 44.57%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |64.85|± | 1.40|
| | |acc_norm|66.89|± | 1.38|
|arc_easy | 0|acc |84.51|± | 0.74|
| | |acc_norm|77.31|± | 0.86|
|boolq | 1|acc |86.91|± | 0.59|
|hellaswag | 0|acc |69.08|± | 0.46|
| | |acc_norm|87.20|± | 0.33|
|openbookqa | 0|acc |41.00|± | 2.20|
| | |acc_norm|50.60|± | 2.24|
|piqa | 0|acc |82.26|± | 0.89|
| | |acc_norm|83.73|± | 0.86|
|winogrande | 0|acc |81.69|± | 1.09|
Average: 76.34%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |63.77|± | 1.68|
| | |mc2 |79.81|± | 1.34|
Average: 79.81%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.53|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|61.52|± | 2.54|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|60.85|± | 3.04|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.40|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.86|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.00|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|51.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|54.70|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|66.05|± | 1.06|
|bigbench_ruin_names | 0|multiple_choice_grade|55.13|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|39.18|± | 1.55|
|bigbench_snarks | 0|multiple_choice_grade|72.38|± | 3.33|
|bigbench_sports_understanding | 0|multiple_choice_grade|72.72|± | 1.42|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.52|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.43|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.00|± | 2.83|
Average: 49.27%
Average score: 62.5%
Elapsed time: 02:07:06| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[NeuralTrix-7B-dpo](https://huggingface.co/CultriX/NeuralTrix-7B-dpo)| 44.61| 76.33| 79.8| 49.24| 62.5|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.17|± | 2.80|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |37.79|± | 1.90|
| | |acc_norm|37.63|± | 1.90|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|25.22|± | 2.87|
|agieval_lsat_lr | 0|acc |52.94|± | 2.21|
| | |acc_norm|55.29|± | 2.20|
|agieval_lsat_rc | 0|acc |64.68|± | 2.92|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |76.70|± | 2.95|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |41.75|± | 3.44|
| | |acc_norm|40.78|± | 3.43|
|agieval_sat_math | 0|acc |31.82|± | 3.15|
| | |acc_norm|29.55|± | 3.08|
Average: 44.61%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |64.93|± | 1.39|
| | |acc_norm|66.89|± | 1.38|
|arc_easy | 0|acc |84.47|± | 0.74|
| | |acc_norm|77.40|± | 0.86|
|boolq | 1|acc |86.97|± | 0.59|
|hellaswag | 0|acc |69.06|± | 0.46|
| | |acc_norm|87.21|± | 0.33|
|openbookqa | 0|acc |41.20|± | 2.20|
| | |acc_norm|50.60|± | 2.24|
|piqa | 0|acc |82.26|± | 0.89|
| | |acc_norm|83.57|± | 0.86|
|winogrande | 0|acc |81.69|± | 1.09|
Average: 76.33%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |63.77|± | 1.68|
| | |mc2 |79.80|± | 1.34|
Average: 79.8%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.53|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|61.52|± | 2.54|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|60.47|± | 3.05|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.40|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.86|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|60.33|± | 2.83|
|bigbench_movie_recommendation | 0|multiple_choice_grade|51.40|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|54.70|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|66.10|± | 1.06|
|bigbench_ruin_names | 0|multiple_choice_grade|54.91|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|39.38|± | 1.55|
|bigbench_snarks | 0|multiple_choice_grade|71.82|± | 3.35|
|bigbench_sports_understanding | 0|multiple_choice_grade|72.72|± | 1.42|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.00|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.36|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.43|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|60.33|± | 2.83|
Average: 49.24%
Average score: 62.5%
Elapsed time: 01:21:31
<!DOCTYPE html>
<html
lang="en"
data-color-mode="auto" data-light-theme="light" data-dark-theme="dark"
data-a11y-animated-images="system" data-a11y-link-underlines="true"
>
<head>
<meta charset="utf-8">
<link rel="dns-prefetch" href="https://github.githubassets.com">
<link rel="dns-prefetch" href="https://avatars.githubusercontent.com">
<link rel="dns-prefetch" href="https://github-cloud.s3.amazonaws.com">
<link rel="dns-prefetch" href="https://user-images.githubusercontent.com/">
<link rel="preconnect" href="https://github.githubassets.com" crossorigin>
<link rel="preconnect" href="https://avatars.githubusercontent.com">
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/light-0eace2597ca3.css" /><link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/dark-a167e256da9c.css" /><link data-color-theme="dark_dimmed" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_dimmed-d11f2cf8009b.css" /><link data-color-theme="dark_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_high_contrast-ea7373db06c8.css" /><link data-color-theme="dark_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_colorblind-afa99dcf40f7.css" /><link data-color-theme="light_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_colorblind-af6c685139ba.css" /><link data-color-theme="light_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_high_contrast-578cdbc8a5a9.css" /><link data-color-theme="light_tritanopia" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_tritanopia-5cb699a7e247.css" /><link data-color-theme="dark_tritanopia" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/dark_tritanopia-9b32204967c6.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/primer-primitives-971c6be3ec9f.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/primer-08e422afeb43.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/global-a8d2cbec31a6.css" />
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/github-36dce55f3db6.css" />
<script type="application/json" id="client-env">{"locale":"en","featureFlags":["billing_net_usage_frontend","copilot_conversational_ux_history_refs","docset_management_ui","failbot_handle_non_errors","geojson_azure_maps","image_metric_tracking","marketing_forms_api_integration_contact_request","turbo_experiment_risky","sample_network_conn_type","no_character_key_shortcuts_in_inputs","custom_inp","remove_child_patch"]}</script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/wp-runtime-fdac6ab0ed49.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_dompurify_dist_purify_js-6890e890956f.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_stacktrace-parser_dist_stack-trace-parser_esm_js-node_modules_github_bro-a4c183-79f9611c275b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_hydro-analytics-client_dist_analytics-client_js-node_modules_gith-6a10dd-e66ebda625fb.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/ui_packages_failbot_failbot_ts-afaa9a250f2e.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/environment-4ff0d843ea45.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_selector-observer_dist_index_esm_js-9f960d9b217c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_behaviors_dist_esm_focus-zone_js-086f7a27bac0.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_relative-time-element_dist_index_js-c76945c5961a.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_combobox-nav_dist_index_js-node_modules_github_markdown-toolbar-e-820fc0-a7dea68af91d.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_delegated-events_dist_index_js-node_modules_github_details-dialog-elemen-29dc30-a2a71f11a507.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_filter-input-element_dist_index_js-node_modules_github_remote-inp-e4ab91-60b24e4f6f42.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_file-attachment-element_dist_index_js-node_modules_primer_view-co-eb424d-fd64db823614.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/github-elements-693343d61474.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/element-registry-572e9d2514ec.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_catalyst_lib_index_js-node_modules_github_hydro-analytics-client_-978abc0-add939c751ce.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_lit-html_lit-html_js-5b376145beff.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_mini-throttle_dist_index_js-node_modules_github_alive-client_dist-bf5aa2-1b562c29ab8e.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_morphdom_dist_morphdom-esm_js-5bff297a06de.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_turbo_dist_turbo_es2017-esm_js-c91f4ad18b62.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_color-convert_index_js-72c9fbde5ad4.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_remote-form_dist_index_js-node_modules_scroll-anchoring_dist_scro-231ccf-aa129238d13b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_behaviors_dist_esm_dimensions_js-node_modules_github_jtml_lib_index_js-95b84ee6bc34.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_paste-markdown_dist_index_esm_js-node_modules_github_quote-select-77da2d-3bdb0030c085.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_updatable-content_ts-5e0904652c1c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_task-list_ts-app_assets_modules_github_onfocus_ts-app_ass-421cec-751caa0072bd.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_sticky-scroll-into-view_ts-cbcee0788fe3.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_ajax-error_ts-app_assets_modules_github_behaviors_include-467754-b59a2b2827ad.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_behaviors_commenting_edit_ts-app_assets_modules_github_behaviors_ht-83c235-b85e9f4f1304.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_blob-anchor_ts-app_assets_modules_github_filter-sort_ts-app_assets_-c96432-ca86212e46a4.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/behaviors-97473afbe590.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_delegated-events_dist_index_js-node_modules_github_catalyst_lib_index_js-d0256ebff5cd.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/notifications-global-99d196517b1b.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_github_remote-form_dist_index_js-node_modules_primer_behaviors_dist_esm_-62b04e-513c880e3a9c.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/app_assets_modules_github_diffs_blob-lines_ts-app_assets_modules_github_diffs_linkable-line-n-d80317-78852bb1c926.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/gist-be0c4546208a.js"></script>
<title>Discover gists · GitHub</title>
<meta name="route-pattern" content="/starred(.:format)" data-turbo-transient>
<meta name="route-controller" content="listings" data-turbo-transient>
<meta name="route-action" content="starred" data-turbo-transient>
<meta name="current-catalog-service-hash" content="56253a530ab9027b25719525dcbe6007461a3202218f6f5dfce5a601c121cbcb">
<meta name="request-id" content="CA8A:2708CE:7131295:72B84EA:65CD4F7F" data-pjax-transient="true"/><meta name="html-safe-nonce" content="673e7d18069182b06517a370ec6685f34b2b53a850455c46d78b155658f4d72c" data-pjax-transient="true"/><meta name="visitor-payload" content="eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDQThBOjI3MDhDRTo3MTMxMjk1OjcyQjg0RUE6NjVDRDRGN0YiLCJ2aXNpdG9yX2lkIjoiMjg3MDE4ODAxMjY3MDM3Mzc1OSIsInJlZ2lvbl9lZGdlIjoiZnJhIiwicmVnaW9uX3JlbmRlciI6ImZyYSJ9" data-pjax-transient="true"/><meta name="visitor-hmac" content="d051a0398e480b5a4ccb0675b23accf4d1bdcc8b6dc346ea5fe36aef3696f498" data-pjax-transient="true"/>
<meta name="github-keyboard-shortcuts" content="copilot" data-turbo-transient="true" />
<meta name="selected-link" value="/starred" data-turbo-transient>
<link rel="assets" href="https://github.githubassets.com/">
<meta name="google-site-verification" content="c1kuD-K2HIVF635lypcsWPoD4kilo5-jA_wBFyT4uMY">
<meta name="google-site-verification" content="KT5gs8h0wvaagLKAVWq8bbeNwnZZK1r1XQysX3xurLU">
<meta name="google-site-verification" content="ZzhVyEFwb7w3e0-uOTltm8Jsck2F5StVihD0exw2fsA">
<meta name="google-site-verification" content="GXs5KoUUkNCoaAZn7wPN-t01Pywp9M3sEjnt_3_ZWPc">
<meta name="google-site-verification" content="Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I">
<meta name="octolytics-url" content="https://collector.github.com/github/collect" />
<meta name="analytics-location" content="/starred" data-turbo-transient="true" />
<meta name="user-login" content="">
<meta name="viewport" content="width=device-width">
<meta name="description" content="GitHub Gist: instantly share code, notes, and snippets.">
<link rel="search" type="application/opensearchdescription+xml" href="/opensearch-gist.xml" title="Gist">
<link rel="fluid-icon" href="https://gist.github.com/fluidicon.png" title="GitHub">
<meta property="fb:app_id" content="1401488693436528">
<meta name="apple-itunes-app" content="app-id=1477376905, app-argument=https://gist.github.com/starred" />
<meta name="twitter:image:src" content="https://github.com/opengraph.png" /><meta name="twitter:site" content="@github" /><meta name="twitter:card" content="summary_large_image" /><meta name="twitter:title" content="Discover gists" /><meta name="twitter:description" content="GitHub Gist: instantly share code, notes, and snippets." />
<meta property="og:image" content="https://github.com/opengraph.png" /><meta property="og:image:alt" content="GitHub Gist: instantly share code, notes, and snippets." /><meta property="og:site_name" content="Gist" /><meta property="og:type" content="website" /><meta property="og:title" content="Discover gists" /><meta property="og:description" content="GitHub Gist: instantly share code, notes, and snippets." />
<meta name="hostname" content="gist.github.com">
<meta name="expected-hostname" content="gist.github.com">
<meta http-equiv="x-pjax-version" content="a880a1655d726633117aba8dfffc2e165eefba9c2bc7cd62065e0a6338264704" data-turbo-track="reload">
<meta http-equiv="x-pjax-csp-version" content="5dcfbec3488c5fd5a334e287ce6a17058b7d4beb91db2d4d184e4d55bbf1d7d7" data-turbo-track="reload">
<meta http-equiv="x-pjax-css-version" content="fc7dfbcc4179b73e820d020658f54500fa28c573604791e50a58cef56e331033" data-turbo-track="reload">
<meta http-equiv="x-pjax-js-version" content="76ce0c0e81d1403d1c5f50f4ff35ca9fe1d30e0bfd54ae1c9c1f020376aabff4" data-turbo-track="reload">
<meta name="turbo-cache-control" content="no-preview" data-turbo-transient="">
<link href="/starred.atom" rel="alternate" title="atom" type="application/atom+xml">
<link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/gist-b55b6bd3753b.css" />
<meta name="turbo-body-classes" content="logged-out env-production page-responsive">
<meta name="browser-stats-url" content="https://api.github.com/_private/browser/stats">
<meta name="browser-errors-url" content="https://api.github.com/_private/browser/errors">
<link rel="mask-icon" href="https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg" color="#000000">
<link rel="alternate icon" class="js-site-favicon" type="image/png" href="https://github.githubassets.com/favicons/favicon.png">
<link rel="icon" class="js-site-favicon" type="image/svg+xml" href="https://github.githubassets.com/favicons/favicon.svg">
<meta name="theme-color" content="#1e2327">
<meta name="color-scheme" content="light dark" />
</head>
<body class="logged-out env-production page-responsive" style="word-wrap: break-word;">
<div data-turbo-body class="logged-out env-production page-responsive" style="word-wrap: break-word;">
<div class="position-relative js-header-wrapper ">
<a href="#start-of-content" class="px-2 py-4 color-bg-accent-emphasis color-fg-on-emphasis show-on-focus js-skip-to-content">Skip to content</a>
<span data-view-component="true" class="progress-pjax-loader Progress position-fixed width-full">
<span style="width: 0%;" data-view-component="true" class="Progress-item progress-pjax-loader-bar left-0 top-0 color-bg-accent-emphasis"></span>
</span>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/react-lib-1fbfc5be2c18.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_octicons-react_dist_index_esm_js-node_modules_primer_react_lib-es-2e8e7c-b299afe58dd7.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Box_Box_js-ebfceb11fb57.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Button_Button_js-0528cb519251.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_ActionList_index_js-e001d0eead25.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/vendors-node_modules_primer_react_lib-esm_Button_IconButton_js-node_modules_primer_react_lib--23bcad-ccf1d5fc6054.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/ui_packages_react-core_create-browser-history_ts-ui_packages_react-core_deferred-registry_ts--ebbb92-64923177f972.js"></script>
<script crossorigin="anonymous" defer="defer" type="application/javascript" src="https://github.githubassets.com/assets/keyboard-shortcuts-dialog-a2ca669523db.js"></script>
<react-partial
partial-name="keyboard-shortcuts-dialog"
data-ssr="false"
>
<script type="application/json" data-target="react-partial.embeddedData">{"props":{}}</script>
<div data-target="react-partial.reactRoot"></div>
</react-partial>
<div class="Header js-details-container Details flex-wrap flex-md-nowrap p-responsive" role="banner" >
<div class="Header-item d-none d-md-flex">
<a class="Header-link" data-hotkey="g d" aria-label="Gist Homepage " href="/">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github v-align-middle d-inline-block d-md-none">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 45 16" version="1.1" width="67" data-view-component="true" class="octicon octicon-logo-github v-align-middle d-none d-md-inline-block">
<path d="M8.81 7.35v5.74c0 .04-.01.11-.06.13 0 0-1.25.89-3.31.89-2.49 0-5.44-.78-5.44-5.92S2.58 1.99 5.1 2c2.18 0 3.06.49 3.2.58.04.05.06.09.06.14L7.94 4.5c0 .09-.09.2-.2.17-.36-.11-.9-.33-2.17-.33-1.47 0-3.05.42-3.05 3.73s1.5 3.7 2.58 3.7c.92 0 1.25-.11 1.25-.11v-2.3H4.88c-.11 0-.19-.08-.19-.17V7.35c0-.09.08-.17.19-.17h3.74c.11 0 .19.08.19.17Zm35.85 2.33c0 3.43-1.11 4.41-3.05 4.41-1.64 0-2.52-.83-2.52-.83s-.04.46-.09.52c-.03.06-.08.08-.14.08h-1.48c-.1 0-.19-.08-.19-.17l.02-11.11c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v3.77s.82-.53 2.02-.53l-.01-.02c1.2 0 2.97.45 2.97 3.88ZM27.68 2.43c.09 0 .17.08.17.17v11.11c0 .09-.08.17-.17.17h-2.13c-.09 0-.17-.08-.17-.17l.02-4.75h-3.31v4.75c0 .09-.08.17-.17.17h-2.13c-.08 0-.17-.08-.17-.17V2.6c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v4.09h3.31V2.6c0-.09.08-.17.17-.17Zm8.26 3.64c.11 0 .19.08.19.17l-.02 7.47c0 .09-.06.17-.17.17H34.6c-.07 0-.14-.04-.16-.09-.03-.06-.08-.45-.08-.45s-1.13.77-2.52.77c-1.69 0-2.92-.55-2.92-2.75V6.25c0-.09.08-.17.17-.17h2.14c.09 0 .17.08.17.17V11c0 .75.22 1.09.97 1.09s1.3-.39 1.3-.39V6.26c0-.11.06-.19.17-.19Zm-17.406 5.971h.005a.177.177 0 0 1 .141.179v1.5c0 .07-.03.14-.09.16-.1.05-.74.22-1.27.22-1.16 0-2.86-.25-2.86-2.69V8.13h-1.11c-.09 0-.17-.08-.17-.19V6.58c0-.08.05-.15.13-.17.07-.01 1.16-.28 1.16-.28V3.96c0-.08.05-.13.14-.13h2.16c.09 0 .14.05.14.13v2.11h1.59c.08 0 .16.08.16.17v1.7c0 .11-.07.19-.16.19h-1.59v3.131c0 .47.27.83 1.05.83.247 0 .481-.049.574-.05ZM12.24 6.06c.09 0 .17.08.17.17v7.37c0 .18-.05.27-.25.27h-1.92c-.17 0-.3-.07-.3-.27V6.26c0-.11.08-.2.17-.2Zm29.99 3.78c0-1.81-.73-2.05-1.5-1.97-.6.04-1.08.34-1.08.34v3.52s.49.34 1.22.36c1.03.03 1.36-.34 1.36-2.25ZM11.19 2.68c.75 0 1.36.61 1.36 1.38 0 .77-.61 1.38-1.36 1.38-.77 0-1.38-.61-1.38-1.38 0-.77.61-1.38 1.38-1.38Zm7.34 9.35v.001l.01.01h-.001l-.005-.001v.001c-.009-.001-.015-.011-.024-.011Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 25 16" version="1.1" width="37" data-view-component="true" class="octicon octicon-logo-gist v-align-middle d-none d-md-inline-block">
<path d="M4.7 8.73v-1h3.52v5.69c-.78.37-1.95.64-3.59.64C1.11 14.06 0 11.37 0 8.03 0 4.69 1.13 2 4.63 2c1.62 0 2.64.33 3.28.66v1.05c-1.22-.5-2-.73-3.28-.73-2.57 0-3.48 2.21-3.48 5.06 0 2.85.91 5.05 3.47 5.05.89 0 1.98-.07 2.53-.34V8.73Zm10.98.69h.03c2.22.2 2.75.95 2.75 2.23 0 1.21-.76 2.41-3.14 2.41-.75 0-1.83-.19-2.33-.39v-.94c.47.17 1.22.36 2.33.36 1.62 0 2.06-.69 2.06-1.42 0-.71-.22-1.21-1.77-1.34-2.26-.2-2.73-1-2.73-2.08 0-1.11.72-2.31 2.92-2.31.73 0 1.56.09 2.25.39v.94c-.61-.2-1.22-.36-2.27-.36-1.55 0-1.88.57-1.88 1.34 0 .69.28 1.04 1.78 1.17Zm8.58-3.33v.85h-2.42v4.87c0 .95.53 1.34 1.5 1.34.2 0 .42 0 .61-.03v.89c-.17.03-.5.05-.69.05-1.31 0-2.5-.6-2.5-2.13v-5H19.2v-.48l1.56-.44V3.9l1.08-.31v2.5h2.42Zm-13.17-.03v6.41c0 .54.19.7.67.7v.89c-1.14 0-1.72-.47-1.72-1.72V6.06h1.05Zm.25-2.33c0 .44-.34.78-.78.78a.76.76 0 0 1-.77-.78c0-.44.32-.78.77-.78s.78.34.78.78Z"></path>
</svg>
</a>
</div>
<div class="Header-item d-md-none">
<button aria-label="Toggle navigation" aria-expanded="false" type="button" data-view-component="true" class="Header-link js-details-target btn-link"> <svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-three-bars">
<path d="M1 2.75A.75.75 0 0 1 1.75 2h12.5a.75.75 0 0 1 0 1.5H1.75A.75.75 0 0 1 1 2.75Zm0 5A.75.75 0 0 1 1.75 7h12.5a.75.75 0 0 1 0 1.5H1.75A.75.75 0 0 1 1 7.75ZM1.75 12h12.5a.75.75 0 0 1 0 1.5H1.75a.75.75 0 0 1 0-1.5Z"></path>
</svg>
</button> </div>
<div class="Header-item Header-item--full js-site-search flex-column flex-md-row width-full flex-order-2 flex-md-order-none mr-0 mr-md-3 mt-3 mt-md-0 Details-content--hidden-not-important d-md-flex">
<div class="header-search flex-self-stretch flex-md-self-auto mr-0 mr-md-3 mb-3 mb-md-0">
<!-- '"` --><!-- </textarea></xmp> --></option></form><form class="position-relative js-quicksearch-form" role="search" aria-label="Site" data-turbo="false" action="/search" accept-charset="UTF-8" method="get">
<div class="header-search-wrapper form-control input-sm js-chromeless-input-container">
<input type="text"
class="form-control input-sm js-site-search-focus header-search-input"
data-hotkey="s,/"
name="q"
aria-label="Search"
placeholder="Search…"
autocorrect="off"
autocomplete="off"
autocapitalize="off">
</div>
</form></div>
<nav aria-label="Global" class="d-flex flex-column flex-md-row flex-self-stretch flex-md-self-auto">
<a class="Header-link mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, go to all gists, text:all gists" href="/discover">All gists</a>
<a class="Header-link mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, go to GitHub, text:Back to GitHub" href="https://github.com">Back to GitHub</a>
<a class="Header-link d-block d-md-none mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, sign in" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;LOG_IN&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="225a86d9264757791845a28f333324d7e939cb14b238b4e1e54d6ed07d633ee4" href="https://gist.github.com/auth/github?return_to=https%3A%2F%2Fgist.github.com%2Fstarred">
Sign in
</a>
<a class="Header-link d-block d-md-none mr-0 mr-md-3 py-2 py-md-0 border-top border-md-top-0 border-white-fade" data-ga-click="Header, sign up" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;SIGN_UP&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="21c68033dfd930a856c07fedf0fe5ecb925c7c44e5a0186c44a57f82f0f21a32" href="/join?return_to=https%3A%2F%2Fgist.github.com%2Fstarred&amp;source=header-gist">
Sign up
</a></nav>
</div>
<div class="Header-item Header-item--full flex-justify-center d-md-none position-relative">
<a class="Header-link" data-hotkey="g d" aria-label="Gist Homepage " href="/">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github v-align-middle d-inline-block d-md-none">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 45 16" version="1.1" width="67" data-view-component="true" class="octicon octicon-logo-github v-align-middle d-none d-md-inline-block">
<path d="M8.81 7.35v5.74c0 .04-.01.11-.06.13 0 0-1.25.89-3.31.89-2.49 0-5.44-.78-5.44-5.92S2.58 1.99 5.1 2c2.18 0 3.06.49 3.2.58.04.05.06.09.06.14L7.94 4.5c0 .09-.09.2-.2.17-.36-.11-.9-.33-2.17-.33-1.47 0-3.05.42-3.05 3.73s1.5 3.7 2.58 3.7c.92 0 1.25-.11 1.25-.11v-2.3H4.88c-.11 0-.19-.08-.19-.17V7.35c0-.09.08-.17.19-.17h3.74c.11 0 .19.08.19.17Zm35.85 2.33c0 3.43-1.11 4.41-3.05 4.41-1.64 0-2.52-.83-2.52-.83s-.04.46-.09.52c-.03.06-.08.08-.14.08h-1.48c-.1 0-.19-.08-.19-.17l.02-11.11c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v3.77s.82-.53 2.02-.53l-.01-.02c1.2 0 2.97.45 2.97 3.88ZM27.68 2.43c.09 0 .17.08.17.17v11.11c0 .09-.08.17-.17.17h-2.13c-.09 0-.17-.08-.17-.17l.02-4.75h-3.31v4.75c0 .09-.08.17-.17.17h-2.13c-.08 0-.17-.08-.17-.17V2.6c0-.09.08-.17.17-.17h2.13c.09 0 .17.08.17.17v4.09h3.31V2.6c0-.09.08-.17.17-.17Zm8.26 3.64c.11 0 .19.08.19.17l-.02 7.47c0 .09-.06.17-.17.17H34.6c-.07 0-.14-.04-.16-.09-.03-.06-.08-.45-.08-.45s-1.13.77-2.52.77c-1.69 0-2.92-.55-2.92-2.75V6.25c0-.09.08-.17.17-.17h2.14c.09 0 .17.08.17.17V11c0 .75.22 1.09.97 1.09s1.3-.39 1.3-.39V6.26c0-.11.06-.19.17-.19Zm-17.406 5.971h.005a.177.177 0 0 1 .141.179v1.5c0 .07-.03.14-.09.16-.1.05-.74.22-1.27.22-1.16 0-2.86-.25-2.86-2.69V8.13h-1.11c-.09 0-.17-.08-.17-.19V6.58c0-.08.05-.15.13-.17.07-.01 1.16-.28 1.16-.28V3.96c0-.08.05-.13.14-.13h2.16c.09 0 .14.05.14.13v2.11h1.59c.08 0 .16.08.16.17v1.7c0 .11-.07.19-.16.19h-1.59v3.131c0 .47.27.83 1.05.83.247 0 .481-.049.574-.05ZM12.24 6.06c.09 0 .17.08.17.17v7.37c0 .18-.05.27-.25.27h-1.92c-.17 0-.3-.07-.3-.27V6.26c0-.11.08-.2.17-.2Zm29.99 3.78c0-1.81-.73-2.05-1.5-1.97-.6.04-1.08.34-1.08.34v3.52s.49.34 1.22.36c1.03.03 1.36-.34 1.36-2.25ZM11.19 2.68c.75 0 1.36.61 1.36 1.38 0 .77-.61 1.38-1.36 1.38-.77 0-1.38-.61-1.38-1.38 0-.77.61-1.38 1.38-1.38Zm7.34 9.35v.001l.01.01h-.001l-.005-.001v.001c-.009-.001-.015-.011-.024-.011Z"></path>
</svg>
<svg aria-hidden="true" height="24" viewBox="0 0 25 16" version="1.1" width="37" data-view-component="true" class="octicon octicon-logo-gist v-align-middle d-none d-md-inline-block">
<path d="M4.7 8.73v-1h3.52v5.69c-.78.37-1.95.64-3.59.64C1.11 14.06 0 11.37 0 8.03 0 4.69 1.13 2 4.63 2c1.62 0 2.64.33 3.28.66v1.05c-1.22-.5-2-.73-3.28-.73-2.57 0-3.48 2.21-3.48 5.06 0 2.85.91 5.05 3.47 5.05.89 0 1.98-.07 2.53-.34V8.73Zm10.98.69h.03c2.22.2 2.75.95 2.75 2.23 0 1.21-.76 2.41-3.14 2.41-.75 0-1.83-.19-2.33-.39v-.94c.47.17 1.22.36 2.33.36 1.62 0 2.06-.69 2.06-1.42 0-.71-.22-1.21-1.77-1.34-2.26-.2-2.73-1-2.73-2.08 0-1.11.72-2.31 2.92-2.31.73 0 1.56.09 2.25.39v.94c-.61-.2-1.22-.36-2.27-.36-1.55 0-1.88.57-1.88 1.34 0 .69.28 1.04 1.78 1.17Zm8.58-3.33v.85h-2.42v4.87c0 .95.53 1.34 1.5 1.34.2 0 .42 0 .61-.03v.89c-.17.03-.5.05-.69.05-1.31 0-2.5-.6-2.5-2.13v-5H19.2v-.48l1.56-.44V3.9l1.08-.31v2.5h2.42Zm-13.17-.03v6.41c0 .54.19.7.67.7v.89c-1.14 0-1.72-.47-1.72-1.72V6.06h1.05Zm.25-2.33c0 .44-.34.78-.78.78a.76.76 0 0 1-.77-.78c0-.44.32-.78.77-.78s.78.34.78.78Z"></path>
</svg>
</a>
</div>
<div class="Header-item f4 mr-0" role="navigation" aria-label="Sign in or sign up">
<a class="Header-link no-underline mr-3" data-ga-click="Header, sign in" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;LOG_IN&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="225a86d9264757791845a28f333324d7e939cb14b238b4e1e54d6ed07d633ee4" href="https://gist.github.com/auth/github?return_to=https%3A%2F%2Fgist.github.com%2Fstarred">
Sign&nbsp;in
</a> <a class="Header-link d-inline-block no-underline border color-border-default rounded px-2 py-1" data-ga-click="Header, sign up" data-hydro-click="{&quot;event_type&quot;:&quot;authentication.click&quot;,&quot;payload&quot;:{&quot;location_in_page&quot;:&quot;gist header&quot;,&quot;repository_id&quot;:null,&quot;auth_type&quot;:&quot;SIGN_UP&quot;,&quot;originating_url&quot;:&quot;https://gist.github.com/starred&quot;,&quot;user_id&quot;:null}}" data-hydro-click-hmac="21c68033dfd930a856c07fedf0fe5ecb925c7c44e5a0186c44a57f82f0f21a32" href="/join?return_to=https%3A%2F%2Fgist.github.com%2Fstarred&amp;source=header-gist">
Sign&nbsp;up
</a> </div>
</div>
<div hidden="hidden" data-view-component="true" class="js-stale-session-flash stale-session-flash flash flash-warn flash-full mb-3">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span class="js-stale-session-flash-signed-in" hidden>You signed in with another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<span class="js-stale-session-flash-signed-out" hidden>You signed out in another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<span class="js-stale-session-flash-switched" hidden>You switched accounts on another tab or window. <a class="Link--inTextBlock" href="">Reload</a> to refresh your session.</span>
<button id="icon-button-0413d99c-7e94-4f11-9027-cabde9036396" aria-labelledby="tooltip-e8a4777f-ee76-456a-89c9-2886b49772c4" type="button" data-view-component="true" class="Button Button--iconOnly Button--invisible Button--medium flash-close js-flash-close"> <svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x Button-visual">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button><tool-tip id="tooltip-e8a4777f-ee76-456a-89c9-2886b49772c4" for="icon-button-0413d99c-7e94-4f11-9027-cabde9036396" popover="manual" data-direction="s" data-type="label" data-view-component="true" class="sr-only position-absolute">Dismiss alert</tool-tip>
</div>
</div>
<div id="start-of-content" class="show-on-focus"></div>
<div id="js-flash-container" data-turbo-replace>
<template class="js-flash-template">
<div class="flash flash-full {{ className }}">
<div class="px-2" >
<button autofocus class="flash-close js-flash-close" type="button" aria-label="Dismiss this message">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
<div aria-atomic="true" role="alert" class="js-flash-alert">
<div>{{ message }}</div>
</div>
</div>
</div>
</template>
</div>
<include-fragment class="js-notification-shelf-include-fragment" data-base-src="https://github.com/notifications/beta/shelf"></include-fragment>
<div
class="application-main "
data-commit-hovercards-enabled
data-discussion-hovercards-enabled
data-issue-and-pr-hovercards-enabled
>
<div itemscope itemtype="http://schema.org/Code">
<main id="gist-pjax-container">
<div class="gist-detail-intro gist-banner pb-3">
<div class="text-center container-lg px-3">
<p class="lead">
Instantly share code, notes, and snippets.
</p>
</div>
</div>
<div class="gisthead pagehead pb-0 pt-3 mb-4">
<div class="px-0">
<div class="px-3">
<div class="mb-3 d-flex">
<h1 class="float-none flex-auto pl-0 width-fit">
<svg height="32" aria-hidden="true" viewBox="0 0 24 24" version="1.1" width="32" data-view-component="true" class="octicon octicon-code-square mt-0 position-static v-align-middle">
<path d="M10.3 8.24a.75.75 0 0 1-.04 1.06L7.352 12l2.908 2.7a.75.75 0 1 1-1.02 1.1l-3.5-3.25a.75.75 0 0 1 0-1.1l3.5-3.25a.75.75 0 0 1 1.06.04Zm3.44 1.06a.75.75 0 1 1 1.02-1.1l3.5 3.25a.75.75 0 0 1 0 1.1l-3.5 3.25a.75.75 0 1 1-1.02-1.1l2.908-2.7-2.908-2.7Z"></path><path d="M2 3.75C2 2.784 2.784 2 3.75 2h16.5c.966 0 1.75.784 1.75 1.75v16.5A1.75 1.75 0 0 1 20.25 22H3.75A1.75 1.75 0 0 1 2 20.25Zm1.75-.25a.25.25 0 0 0-.25.25v16.5c0 .138.112.25.25.25h16.5a.25.25 0 0 0 .25-.25V3.75a.25.25 0 0 0-.25-.25Z"></path>
</svg>
Discover gists
</h1>
<ul class="pagehead-actions float-none">
<li></li>
</ul>
</div>
<nav aria-label="Gist tab" data-view-component="true" class="UnderlineNav">
<ul data-view-component="true" class="UnderlineNav-body list-style-none">
<li data-view-component="true" class="d-inline-flex">
<a href="/discover" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square UnderlineNav-octicon">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
<span data-view-component="true">All gists</span>
</a></li>
<li data-view-component="true" class="d-inline-flex">
<a href="/forked" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-git-branch UnderlineNav-octicon">
<path d="M9.5 3.25a2.25 2.25 0 1 1 3 2.122V6A2.5 2.5 0 0 1 10 8.5H6a1 1 0 0 0-1 1v1.128a2.251 2.251 0 1 1-1.5 0V5.372a2.25 2.25 0 1 1 1.5 0v1.836A2.493 2.493 0 0 1 6 7h4a1 1 0 0 0 1-1v-.628A2.25 2.25 0 0 1 9.5 3.25Zm-6 0a.75.75 0 1 0 1.5 0 .75.75 0 0 0-1.5 0Zm8.25-.75a.75.75 0 1 0 0 1.5.75.75 0 0 0 0-1.5ZM4.25 12a.75.75 0 1 0 0 1.5.75.75 0 0 0 0-1.5Z"></path>
</svg>
<span data-view-component="true">Forked</span>
</a></li>
<li data-view-component="true" class="d-inline-flex">
<a href="/starred" aria-current="page" data-view-component="true" class="UnderlineNav-item">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star UnderlineNav-octicon">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
<span data-view-component="true">Starred</span>
</a></li>
</ul>
</nav>
</div>
</div>
</div>
<div class="container-lg px-3">
<div class="repository-content gist-content" >
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
4 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
18 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/chrisaycock/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/chrisaycock"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/453745?s=60&amp;v=4" width="30" height="30" alt="@chrisaycock" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/chrisaycock/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/chrisaycock">chrisaycock</a>
/ <a href="/chrisaycock/8b7a37b1f97549517cb7789be5b06266"><strong class="css-truncate-target">firms.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:39:43Z" data-view-component="true">February 14, 2024 23:39</relative-time>
</div>
<span class="f6 color-fg-muted">
List of quantitative trading firms
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/chrisaycock/8b7a37b1f97549517cb7789be5b06266">
<span class="link">View <strong>firms.md</strong></span>
</a> <div id="file-firms-md" class="file my-2">
<div id="file-firms-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><ul dir="auto">
<li><a href="https://www.3redpartners.com" rel="nofollow">3Red Partners</a></li>
<li><a href="https://www.aprioriinvestments.com" rel="nofollow">A Priori Investments</a></li>
<li><a href="https://www.acadian-asset.com" rel="nofollow">Acadian Asset Management</a></li>
<li><a href="https://akunacapital.com" rel="nofollow">Akuna Capital</a></li>
<li><a href="https://www.albatrosslabs.io" rel="nofollow">Albatross Labs</a></li>
<li><a href="https://www.alpha-grep.com" rel="nofollow">AlphaGrep</a></li>
<li><a href="https://www.alphasimplex.com" rel="nofollow">AlphaSimplex</a></li>
<li><a href="https://www.alphataraxia.com" rel="nofollow">Alphataraxia Management</a></li>
<li><a href="http://www.alyeskagroup.com" rel="nofollow">Alyeska Investment Group</a></li>
<li><a href="https://ansatz.capital" rel="nofollow">Ansatz Capital</a></li>
</ul>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
108 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
35 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1122 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/cpursley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/cpursley"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/1223773?s=60&amp;v=4" width="30" height="30" alt="@cpursley" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/cpursley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/cpursley">cpursley</a>
/ <a href="/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb"><strong class="css-truncate-target">postgresql_is_enough.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:35:53Z" data-view-component="true">February 14, 2024 23:35</relative-time>
</div>
<span class="f6 color-fg-muted">
Postgres is Enough
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb">
<span class="link">View <strong>postgresql_is_enough.md</strong></span>
</a> <div id="file-postgresql_is_enough-md" class="file my-2">
<div id="file-postgresql_is_enough-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-postgresql-is-enough" class="anchor" aria-hidden="true" tabindex="-1" href="#postgresql-is-enough"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>PostgreSQL is Enough</h1>
<ul dir="auto">
<li><a href="https://sive.rs/pg" rel="nofollow">Simplify: move code into database functions</a></li>
<li><a href="https://www.amazingcto.com/postgres-for-everything/" rel="nofollow">Just Use Postgres for Everything</a></li>
<li><a href="https://www.2ndquadrant.com/en/blog/postgresql-is-the-worlds-best-database/" rel="nofollow">PostgreSQL is the worlds’ best database</a></li>
<li><a href="https://news.ycombinator.com/item?id=39273954" rel="nofollow">Hacker News discussion</a></li>
</ul>
<h2 dir="auto"><a id="user-content-background-and-cron-jobs" class="anchor" aria-hidden="true" tabindex="-1" href="#background-and-cron-jobs"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Background and Cron Jobs</h2>
<ul dir="auto">
<li><a href="https://github.com/citusdata/pg_cron">https://github.com/citusdata/pg_cron</a></li>
</ul>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1 star
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/ajitid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/ajitid"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/26769888?s=60&amp;v=4" width="30" height="30" alt="@ajitid" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/ajitid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/ajitid">ajitid</a>
/ <a href="/ajitid/1bbbf24e47669c5c571571ca3eb189e6"><strong class="css-truncate-target">trigger_scan.py</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:34:00Z" data-view-component="true">February 14, 2024 23:34</relative-time>
</div>
<span class="f6 color-fg-muted">
for <a href="https://github.com/debridmediamanager/zurg-testing/issues/72">https://github.com/debridmediamanager/zurg-testing/issues/72</a>
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/ajitid/1bbbf24e47669c5c571571ca3eb189e6">
<span class="link">View <strong>trigger_scan.py</strong></span>
</a> <div id="file-trigger_scan-py" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-python gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Python" data-tagsearch-path="trigger_scan.py">
<tr>
<td id="file-trigger_scan-py-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-trigger_scan-py-LC1" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>os</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-trigger_scan-py-LC2" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>subprocess</span> <span class=pl-k>import</span> <span class=pl-s1>check_output</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-trigger_scan-py-LC3" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>pprint</span> <span class=pl-k>import</span> <span class=pl-s1>pprint</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-trigger_scan-py-LC4" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-trigger_scan-py-LC5" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>plexapi</span>.<span class=pl-s1>server</span> <span class=pl-k>import</span> <span class=pl-v>PlexServer</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-trigger_scan-py-LC6" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-trigger_scan-py-LC7" class="blob-code blob-code-inner js-file-line"><span class=pl-k>def</span> <span class=pl-en>process_movie_section</span>(<span class=pl-s1>section</span>, <span class=pl-s1>plex_media_paths</span>, <span class=pl-s1>rclone_mount</span>):</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-trigger_scan-py-LC8" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>for</span> <span class=pl-s1>directory</span> <span class=pl-c1>in</span> <span class=pl-s1>section</span>.<span class=pl-en>all</span>():</td>
</tr>
<tr>
<td id="file-trigger_scan-py-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-trigger_scan-py-LC9" class="blob-code blob-code-inner js-file-line"> <span class=pl-c># in case of a movie, this will host a list of files</span></td>
</tr>
<tr>
<td id="file-trigger_scan-py-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-trigger_scan-py-LC10" class="blob-code blob-code-inner js-file-line"> <span class=pl-c># which is actually just 1 file, mentioning the movie&#39;s location</span></td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
9 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
2 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
28 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/iamucil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/iamucil"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/210371?s=60&amp;v=4" width="30" height="30" alt="@iamucil" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/iamucil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/iamucil">iamucil</a>
/ <a href="/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc"><strong class="css-truncate-target">go mod rename module.sh</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:25:52Z" data-view-component="true">February 14, 2024 23:25</relative-time>
</div>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/iamucil/7578dc7df7d72e1d78c8f5543db3fbcc">
<span class="link">View <strong>go mod rename module.sh</strong></span>
</a> <div id="file-go-mod-rename-module-sh" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-shell gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Shell" data-tagsearch-path="go mod rename module.sh">
<tr>
<td id="file-go-mod-rename-module-sh-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-go-mod-rename-module-sh-LC1" class="blob-code blob-code-inner js-file-line">go mod edit -module {NEW_MODULE_NAME}</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-go-mod-rename-module-sh-LC2" class="blob-code blob-code-inner js-file-line">-- rename all imported module</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-go-mod-rename-module-sh-LC3" class="blob-code blob-code-inner js-file-line">find <span class="pl-c1">.</span> -type f -name <span class="pl-s"><span class="pl-pds">&#39;</span>*.go<span class="pl-pds">&#39;</span></span> \</td>
</tr>
<tr>
<td id="file-go-mod-rename-module-sh-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-go-mod-rename-module-sh-LC4" class="blob-code blob-code-inner js-file-line"> -exec sed -i -e <span class="pl-s"><span class="pl-pds">&#39;</span>s,{OLD_MODULE},{NEW_MODULE},g<span class="pl-pds">&#39;</span></span> {} <span class="pl-cce">\;</span></td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
4 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
5 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/LevanKvirkvelia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/LevanKvirkvelia"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/5202843?s=60&amp;v=4" width="30" height="30" alt="@LevanKvirkvelia" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/LevanKvirkvelia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/LevanKvirkvelia">LevanKvirkvelia</a>
/ <a href="/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea"><strong class="css-truncate-target">nanoBERT.py</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:25:14Z" data-view-component="true">February 14, 2024 23:25</relative-time>
</div>
<span class="f6 color-fg-muted">
nanoBERT, inspired by <a class="user-mention" data-hovercard-type="user" data-hovercard-url="/users/karpathy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/karpathy">@karpathy</a>'s nanoGPT
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/LevanKvirkvelia/4ebc00be62b914d3a14811d7a0ea56ea">
<span class="link">View <strong>nanoBERT.py</strong></span>
</a> <div id="file-nanobert-py" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-python gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Python" data-tagsearch-path="nanoBERT.py">
<tr>
<td id="file-nanobert-py-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-nanobert-py-LC1" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>torch</span>.<span class=pl-s1>nn</span> <span class=pl-k>as</span> <span class=pl-s1>nn</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-nanobert-py-LC2" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>torch</span>.<span class=pl-s1>nn</span>.<span class=pl-s1>functional</span> <span class=pl-k>as</span> <span class=pl-v>F</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-nanobert-py-LC3" class="blob-code blob-code-inner js-file-line"><span class=pl-k>import</span> <span class=pl-s1>math</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-nanobert-py-LC4" class="blob-code blob-code-inner js-file-line"><span class=pl-k>from</span> <span class=pl-s1>typing</span> <span class=pl-k>import</span> <span class=pl-v>Optional</span>, <span class=pl-v>Tuple</span></td>
</tr>
<tr>
<td id="file-nanobert-py-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-nanobert-py-LC5" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-nanobert-py-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-nanobert-py-LC6" class="blob-code blob-code-inner js-file-line"><span class=pl-k>class</span> <span class=pl-v>BertSelfAttention</span>(<span class=pl-s1>nn</span>.<span class=pl-v>Module</span>):</td>
</tr>
<tr>
<td id="file-nanobert-py-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-nanobert-py-LC7" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>def</span> <span class=pl-en>__init__</span>(<span class=pl-s1>self</span>, <span class=pl-s1>config</span>):</td>
</tr>
<tr>
<td id="file-nanobert-py-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-nanobert-py-LC8" class="blob-code blob-code-inner js-file-line"> <span class=pl-en>super</span>().<span class=pl-en>__init__</span>()</td>
</tr>
<tr>
<td id="file-nanobert-py-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-nanobert-py-LC9" class="blob-code blob-code-inner js-file-line"> </td>
</tr>
<tr>
<td id="file-nanobert-py-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-nanobert-py-LC10" class="blob-code blob-code-inner js-file-line"> <span class=pl-k>if</span> <span class=pl-s1>config</span>.<span class=pl-s1>hidden_size</span> <span class=pl-c1>%</span> <span class=pl-s1>config</span>.<span class=pl-s1>num_attention_heads</span> <span class=pl-c1>!=</span> <span class=pl-c1>0</span>:</td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
13 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
70 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
121 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/jamesmacwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/jamesmacwhite"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/8067792?s=60&amp;v=4" width="30" height="30" alt="@jamesmacwhite" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/jamesmacwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/jamesmacwhite">jamesmacwhite</a>
/ <a href="/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6"><strong class="css-truncate-target">Workarounds for Netflix and the blocking of IPv6 tunnels.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:18:46Z" data-view-component="true">February 14, 2024 23:18</relative-time>
</div>
<span class="f6 color-fg-muted">
Prevent proxy/VPN streaming error messages from Netflix when using a Hurricane Electric IPv6 tunnel.
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/jamesmacwhite/6a642cb6bad00c5cefa91ec3d742e2a6">
<span class="link">View <strong>Workarounds for Netflix and the blocking of IPv6 tunnels.md</strong></span>
</a> <div id="file-workarounds-for-netflix-and-the-blocking-of-ipv6-tunnels-md" class="file my-2">
<div id="file-workarounds-for-netflix-and-the-blocking-of-ipv6-tunnels-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-workarounds-for-netflix-and-the-blocking-of-hurricane-electric-ipv6-tunnels" class="anchor" aria-hidden="true" tabindex="-1" href="#workarounds-for-netflix-and-the-blocking-of-hurricane-electric-ipv6-tunnels"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Workarounds for Netflix and the blocking of Hurricane Electric IPv6 tunnels</h1>
<h6 dir="auto"><a id="user-content-the-dreaded-you-seem-to-be-using-an-unblocker-or-proxy-error-message-cool-story-bro" class="anchor" aria-hidden="true" tabindex="-1" href="#the-dreaded-you-seem-to-be-using-an-unblocker-or-proxy-error-message-cool-story-bro"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>The dreaded "You seem to be using an unblocker or proxy." error message. Cool story bro.</h6>
<p dir="auto"><em>This gist was essentially created out of my own <a href="https://blog.jmwhite.co.uk/2016/06/12/netflix-starts-blocking-ipv6-tunnels/" rel="nofollow">rant about Netflix being hostile to IPv6 tunnel services since June 2016</a>. You are welcome to read my opinion on the matter, this is the more technical side to the issue and how to combat it within your own network.</em></p>
<p dir="auto">Since I wrote this, various GitHub users have contributed their thoughts and ideas which has been incorporated into this gist. Thank you to everyone who have contributed their own methods and implementations.</p>
<h2 dir="auto"><a id="user-content-the-problem" class="anchor" aria-hidden="true" tabindex="-1" href="#the-problem"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>The problem</h2>
<p dir="auto">Netflix now treats IPv6 tunnel brokers (such as Hurricane Electric) as proxy servers. A while ago it became apparent to users and Netflix that somewhat by accident, IPv6 tunnel users were being served content outside of their geolocation because of the way Netflix was identifyi</p>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
15 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
9 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
90 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/eyecatchup/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/eyecatchup"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/845131?s=60&amp;v=4" width="30" height="30" alt="@eyecatchup" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/eyecatchup/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/eyecatchup">eyecatchup</a>
/ <a href="/eyecatchup/0757b3d8b989fe433979db2ea7d95a01"><strong class="css-truncate-target">id3-ffmpeg.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:16:01Z" data-view-component="true">February 14, 2024 23:16</relative-time>
</div>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/eyecatchup/0757b3d8b989fe433979db2ea7d95a01">
<span class="link">View <strong>id3-ffmpeg.md</strong></span>
</a> <div id="file-id3-ffmpeg-md" class="file my-2">
<div id="file-id3-ffmpeg-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-getset-id3-meta-tags-using-ffmpeg" class="anchor" aria-hidden="true" tabindex="-1" href="#getset-id3-meta-tags-using-ffmpeg"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Get/set ID3 meta tags using ffmpeg</h1>
<p dir="auto">A quick guide on how to read/write/modify <strong>ID3</strong> metadata tags for audio / media files using <strong><code>ffmpeg</code></strong>.</p>
<p dir="auto"><a href="https://ffmpeg.org/" rel="nofollow">FFmpeg</a> has a free-form command line option that allows the user to specify key-value-pairs for encoding metadata. Let's take a look.</p>
<h2 dir="auto"><a id="user-content-1-read-id3-metadata" class="anchor" aria-hidden="true" tabindex="-1" href="#1-read-id3-metadata"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>1. <em><strong>Read</strong></em> ID3 metadata</h2>
<p dir="auto">To list all global metadata tags for a media file, just set an input but no output file.</p>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
189 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
75 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
358 stars
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/Klerith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/Klerith"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/3438503?s=60&amp;v=4" width="30" height="30" alt="@Klerith" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/Klerith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/Klerith">Klerith</a>
/ <a href="/Klerith/ca7e57fae3c9ab92ad08baadc6c26177"><strong class="css-truncate-target">vite-testing-config.md</strong></a>
</span>
<div class="color-fg-muted f6">
Last active
<relative-time tense="past" datetime="2024-02-14T23:13:25Z" data-view-component="true">February 14, 2024 23:13</relative-time>
</div>
<span class="f6 color-fg-muted">
Vite + Jest + React Testing Library - Configuraciones a seguir
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/Klerith/ca7e57fae3c9ab92ad08baadc6c26177">
<span class="link">View <strong>vite-testing-config.md</strong></span>
</a> <div id="file-vite-testing-config-md" class="file my-2">
<div id="file-vite-testing-config-md-readme" class="Box-body readme blob js-code-block-container p-5 p-xl-6 gist-border-0">
<article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-instalación-y-configuracion-de-jest--react-testing-library" class="anchor" aria-hidden="true" tabindex="-1" href="#instalación-y-configuracion-de-jest--react-testing-library"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>Instalación y configuracion de Jest + React Testing Library</h1>
<h2 dir="auto"><a id="user-content-en-proyectos-de-react--vite" class="anchor" aria-hidden="true" tabindex="-1" href="#en-proyectos-de-react--vite"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="m7.775 3.275 1.25-1.25a3.5 3.5 0 1 1 4.95 4.95l-2.5 2.5a3.5 3.5 0 0 1-4.95 0 .751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018 1.998 1.998 0 0 0 2.83 0l2.5-2.5a2.002 2.002 0 0 0-2.83-2.83l-1.25 1.25a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042Zm-4.69 9.64a1.998 1.998 0 0 0 2.83 0l1.25-1.25a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042l-1.25 1.25a3.5 3.5 0 1 1-4.95-4.95l2.5-2.5a3.5 3.5 0 0 1 4.95 0 .751.751 0 0 1-.018 1.042.751.751 0 0 1-1.042.018 1.998 1.998 0 0 0-2.83 0l-2.5 2.5a1.998 1.998 0 0 0 0 2.83Z"></path></svg></a>En proyectos de React + Vite</h2>
<ol dir="auto">
<li>Instalaciones:</li>
</ol>
<pre><code>yarn add --dev jest babel-jest @babel/preset-env @babel/preset-react
yarn add --dev @testing-library/react @types/jest jest-environment-jsdom
</code></pre>
<ol start="2" dir="auto">
<li>Opcional: Si usamos Fetch API en el proyecto:</li>
</ol>
</article>
</div>
</div>
</div>
</div>
<div class="gist-snippet">
<div class="gist-snippet-meta d-flex flex-lg-row flex-column width-full">
<ul class="col-lg-5 col-12 flex-order-2 f6 mt-lg-0 mt-3 mb-lg-0 mb-2 d-flex flex-lg-justify-end">
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-code-square">
<path d="M0 1.75C0 .784.784 0 1.75 0h12.5C15.216 0 16 .784 16 1.75v12.5A1.75 1.75 0 0 1 14.25 16H1.75A1.75 1.75 0 0 1 0 14.25Zm1.75-.25a.25.25 0 0 0-.25.25v12.5c0 .138.112.25.25.25h12.5a.25.25 0 0 0 .25-.25V1.75a.25.25 0 0 0-.25-.25Zm7.47 3.97a.75.75 0 0 1 1.06 0l2 2a.75.75 0 0 1 0 1.06l-2 2a.749.749 0 0 1-1.275-.326.749.749 0 0 1 .215-.734L10.69 8 9.22 6.53a.75.75 0 0 1 0-1.06ZM6.78 6.53 5.31 8l1.47 1.47a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215l-2-2a.75.75 0 0 1 0-1.06l2-2a.751.751 0 0 1 1.042.018.751.751 0 0 1 .018 1.042Z"></path>
</svg>
1 file
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7/forks">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo-forked">
<path d="M5 5.372v.878c0 .414.336.75.75.75h4.5a.75.75 0 0 0 .75-.75v-.878a2.25 2.25 0 1 1 1.5 0v.878a2.25 2.25 0 0 1-2.25 2.25h-1.5v2.128a2.251 2.251 0 1 1-1.5 0V8.5h-1.5A2.25 2.25 0 0 1 3.5 6.25v-.878a2.25 2.25 0 1 1 1.5 0ZM5 3.25a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Zm6.75.75a.75.75 0 1 0 0-1.5.75.75 0 0 0 0 1.5Zm-3 8.75a.75.75 0 1 0-1.5 0 .75.75 0 0 0 1.5 0Z"></path>
</svg>
0 forks
</a>
</li>
<li class="d-inline-block mr-lg-3 mr-2">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7#comments">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-comment">
<path d="M1 2.75C1 1.784 1.784 1 2.75 1h10.5c.966 0 1.75.784 1.75 1.75v7.5A1.75 1.75 0 0 1 13.25 12H9.06l-2.573 2.573A1.458 1.458 0 0 1 4 13.543V12H2.75A1.75 1.75 0 0 1 1 10.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h2a.75.75 0 0 1 .75.75v2.19l2.72-2.72a.749.749 0 0 1 .53-.22h4.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
0 comments
</a>
</li>
<li class="d-inline-block">
<a class="Link--muted" href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7/stargazers">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-star">
<path d="M8 .25a.75.75 0 0 1 .673.418l1.882 3.815 4.21.612a.75.75 0 0 1 .416 1.279l-3.046 2.97.719 4.192a.751.751 0 0 1-1.088.791L8 12.347l-3.766 1.98a.75.75 0 0 1-1.088-.79l.72-4.194L.818 6.374a.75.75 0 0 1 .416-1.28l4.21-.611L7.327.668A.75.75 0 0 1 8 .25Zm0 2.445L6.615 5.5a.75.75 0 0 1-.564.41l-3.097.45 2.24 2.184a.75.75 0 0 1 .216.664l-.528 3.084 2.769-1.456a.75.75 0 0 1 .698 0l2.77 1.456-.53-3.084a.75.75 0 0 1 .216-.664l2.24-2.183-3.096-.45a.75.75 0 0 1-.564-.41L8 2.694Z"></path>
</svg>
1 star
</a>
</li>
</ul>
<div class="flex-order-1 col-lg-7 col-12 d-flex">
<div class="d-lg-inline-block d-none v-align-top mt-1">
<a class="d-inline-block" data-hovercard-type="user" data-hovercard-url="/users/alexpaden/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/alexpaden"><img class=" avatar-user" src="https://avatars.githubusercontent.com/u/97042400?s=60&amp;v=4" width="30" height="30" alt="@alexpaden" /></a>
</div>
<div class="d-inline-block px-lg-2 px-0">
<span>
<a data-hovercard-type="user" data-hovercard-url="/users/alexpaden/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="/alexpaden">alexpaden</a>
/ <a href="/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7"><strong class="css-truncate-target">gist:8ece0b1cfc71d920b4bb99cb16702ab7</strong></a>
</span>
<div class="color-fg-muted f6">
Created
<relative-time tense="past" datetime="2024-02-14T22:58:32Z" data-view-component="true">February 14, 2024 22:58</relative-time>
</div>
<span class="f6 color-fg-muted">
farcaster follower via dune queries
</span>
</div>
</div>
</div>
<div class="js-gist-file-update-container js-task-list-container file-box">
<a class="link-overlay" href="https://gist.github.com/alexpaden/8ece0b1cfc71d920b4bb99cb16702ab7">
<span class="link">View <strong>gist:8ece0b1cfc71d920b4bb99cb16702ab7</strong></span>
</a> <div id="file-gistfile1-txt" class="file my-2">
<div itemprop="text" class="Box-body p-0 blob-wrapper data type-text gist-border-0">
<div class="js-check-bidi js-blob-code-container blob-code-content">
<template class="js-file-alert-template">
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<span>
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
<a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank">Learn more about bidirectional Unicode characters</a>
</span>
<div data-view-component="true" class="flash-action"> <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn"> Show hidden characters
</a>
</div>
</div></template>
<template class="js-line-alert-template">
<span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
</span></template>
<table data-hpc class="highlight tab-size js-file-line-container js-code-nav-container js-tagsearch-file" data-tab-size="8" data-paste-markdown-skip data-tagsearch-lang="Text" data-tagsearch-path="gistfile1.txt">
<tr>
<td id="file-gistfile1-txt-L1" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="1"></td>
<td id="file-gistfile1-txt-LC1" class="blob-code blob-code-inner js-file-line">import requests</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L2" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="2"></td>
<td id="file-gistfile1-txt-LC2" class="blob-code blob-code-inner js-file-line">from dune_client.client import DuneClient</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L3" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="3"></td>
<td id="file-gistfile1-txt-LC3" class="blob-code blob-code-inner js-file-line">from dune_client.query import QueryBase</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L4" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="4"></td>
<td id="file-gistfile1-txt-LC4" class="blob-code blob-code-inner js-file-line">import time</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L5" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="5"></td>
<td id="file-gistfile1-txt-LC5" class="blob-code blob-code-inner js-file-line">import random</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L6" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="6"></td>
<td id="file-gistfile1-txt-LC6" class="blob-code blob-code-inner js-file-line">
</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L7" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="7"></td>
<td id="file-gistfile1-txt-LC7" class="blob-code blob-code-inner js-file-line">NEYNAR_API_KEY = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L8" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="8"></td>
<td id="file-gistfile1-txt-LC8" class="blob-code blob-code-inner js-file-line">DUNE_API_KEY = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L9" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="9"></td>
<td id="file-gistfile1-txt-LC9" class="blob-code blob-code-inner js-file-line">SIGNER_UUID = &quot;&quot;</td>
</tr>
<tr>
<td id="file-gistfile1-txt-L10" class="blob-num js-line-number js-code-nav-line-number js-blob-rnum" data-line-number="10"></td>
<td id="file-gistfile1-txt-LC10" class="blob-code blob-code-inner js-file-line">HEADERS = {&#39;accept&#39;: &#39;application/json&#39;, &#39;api_key&#39;: NEYNAR_API_KEY}</td>
</tr>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="paginate-container">
<div class="pagination"><span class="disabled color-fg-muted">Newer</span><a rel="nofollow" href="https://gist.github.com/starred?page=2">Older</a></div>
</div>
</div>
</div><!-- /.container -->
</main>
</div>
</div>
<footer class="footer pt-8 pb-6 f6 color-fg-muted p-responsive" role="contentinfo" >
<h2 class='sr-only'>Footer</h2>
<div class="d-flex flex-justify-center flex-items-center flex-column-reverse flex-lg-row flex-wrap flex-lg-nowrap">
<div class="d-flex flex-items-center flex-shrink-0 mx-2">
<a aria-label="Homepage" title="GitHub" class="footer-octicon mr-2" href="https://github.com">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
</a>
<span>
&copy; 2024 GitHub,&nbsp;Inc.
</span>
</div>
<nav aria-label="Footer">
<h3 class="sr-only" id="sr-footer-heading">Footer navigation</h3>
<ul class="list-style-none d-flex flex-justify-center flex-wrap mb-2 mb-lg-0" aria-labelledby="sr-footer-heading">
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to Terms&quot;,&quot;label&quot;:&quot;text:terms&quot;}" href="https://docs.github.com/site-policy/github-terms/github-terms-of-service" data-view-component="true" class="Link--secondary Link">Terms</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to privacy&quot;,&quot;label&quot;:&quot;text:privacy&quot;}" href="https://docs.github.com/site-policy/privacy-policies/github-privacy-statement" data-view-component="true" class="Link--secondary Link">Privacy</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to security&quot;,&quot;label&quot;:&quot;text:security&quot;}" href="/security" data-view-component="true" class="Link--secondary Link">Security</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to status&quot;,&quot;label&quot;:&quot;text:status&quot;}" href="https://www.githubstatus.com/" data-view-component="true" class="Link--secondary Link">Status</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to docs&quot;,&quot;label&quot;:&quot;text:docs&quot;}" href="https://docs.github.com" data-view-component="true" class="Link--secondary Link">Docs</a>
</li>
<li class="mx-2">
<a data-analytics-event="{&quot;category&quot;:&quot;Footer&quot;,&quot;action&quot;:&quot;go to contact&quot;,&quot;label&quot;:&quot;text:contact&quot;}" href="https://support.github.com?tags=dotcom-footer" data-view-component="true" class="Link--secondary Link">Contact</a>
</li>
<li class="mx-2" >
<cookie-consent-link>
<button type="button" class="Link--secondary underline-on-hover border-0 p-0 color-bg-transparent" data-action="click:cookie-consent-link#showConsentManagement">
Manage cookies
</button>
</cookie-consent-link>
</li>
<li class="mx-2">
<cookie-consent-link>
<button type="button" class="Link--secondary underline-on-hover border-0 p-0 color-bg-transparent" data-action="click:cookie-consent-link#showConsentManagement">
Do not share my personal information
</button>
</cookie-consent-link>
</li>
</ul>
</nav>
</div>
</footer>
<cookie-consent id="cookie-consent-banner" class="position-fixed bottom-0 left-0" style="z-index: 999999" data-initial-cookie-consent-allowed="" data-cookie-consent-required="true"></cookie-consent>
<div id="ajax-error-message" class="ajax-error-message flash flash-error" hidden>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
<path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg>
<button type="button" class="flash-close js-ajax-error-dismiss" aria-label="Dismiss error">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
You can’t perform that action at this time.
</div>
<template id="site-details-dialog">
<details class="details-reset details-overlay details-overlay-dark lh-default color-fg-default hx_rsm" open>
<summary role="button" aria-label="Close dialog"></summary>
<details-dialog class="Box Box--overlay d-flex flex-column anim-fade-in fast hx_rsm-dialog hx_rsm-modal">
<button class="Box-btn-octicon m-0 btn-octicon position-absolute right-0 top-0" type="button" aria-label="Close dialog" data-close-dialog>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-x">
<path d="M3.72 3.72a.75.75 0 0 1 1.06 0L8 6.94l3.22-3.22a.749.749 0 0 1 1.275.326.749.749 0 0 1-.215.734L9.06 8l3.22 3.22a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215L8 9.06l-3.22 3.22a.751.751 0 0 1-1.042-.018.751.751 0 0 1-.018-1.042L6.94 8 3.72 4.78a.75.75 0 0 1 0-1.06Z"></path>
</svg>
</button>
<div class="octocat-spinner my-6 js-details-dialog-spinner"></div>
</details-dialog>
</details>
</template>
<div class="Popover js-hovercard-content position-absolute" style="display: none; outline: none;" tabindex="0">
<div class="Popover-message Popover-message--bottom-left Popover-message--large Box color-shadow-large" style="width:360px;">
</div>
</div>
<template id="snippet-clipboard-copy-button">
<div class="zeroclipboard-container position-absolute right-0 top-0">
<clipboard-copy aria-label="Copy" class="ClipboardButton btn js-clipboard-copy m-2 p-0 tooltipped-no-delay" data-copy-feedback="Copied!" data-tooltip-direction="w">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-copy js-clipboard-copy-icon m-2">
<path d="M0 6.75C0 5.784.784 5 1.75 5h1.5a.75.75 0 0 1 0 1.5h-1.5a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-1.5a.75.75 0 0 1 1.5 0v1.5A1.75 1.75 0 0 1 9.25 16h-7.5A1.75 1.75 0 0 1 0 14.25Z"></path><path d="M5 1.75C5 .784 5.784 0 6.75 0h7.5C15.216 0 16 .784 16 1.75v7.5A1.75 1.75 0 0 1 14.25 11h-7.5A1.75 1.75 0 0 1 5 9.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-check js-clipboard-check-icon color-fg-success d-none m-2">
<path d="M13.78 4.22a.75.75 0 0 1 0 1.06l-7.25 7.25a.75.75 0 0 1-1.06 0L2.22 9.28a.751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018L6 10.94l6.72-6.72a.75.75 0 0 1 1.06 0Z"></path>
</svg>
</clipboard-copy>
</div>
</template>
<template id="snippet-clipboard-copy-button-unpositioned">
<div class="zeroclipboard-container">
<clipboard-copy aria-label="Copy" class="ClipboardButton btn btn-invisible js-clipboard-copy m-2 p-0 tooltipped-no-delay d-flex flex-justify-center flex-items-center" data-copy-feedback="Copied!" data-tooltip-direction="w">
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-copy js-clipboard-copy-icon">
<path d="M0 6.75C0 5.784.784 5 1.75 5h1.5a.75.75 0 0 1 0 1.5h-1.5a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-1.5a.75.75 0 0 1 1.5 0v1.5A1.75 1.75 0 0 1 9.25 16h-7.5A1.75 1.75 0 0 1 0 14.25Z"></path><path d="M5 1.75C5 .784 5.784 0 6.75 0h7.5C15.216 0 16 .784 16 1.75v7.5A1.75 1.75 0 0 1 14.25 11h-7.5A1.75 1.75 0 0 1 5 9.25Zm1.75-.25a.25.25 0 0 0-.25.25v7.5c0 .138.112.25.25.25h7.5a.25.25 0 0 0 .25-.25v-7.5a.25.25 0 0 0-.25-.25Z"></path>
</svg>
<svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-check js-clipboard-check-icon color-fg-success d-none">
<path d="M13.78 4.22a.75.75 0 0 1 0 1.06l-7.25 7.25a.75.75 0 0 1-1.06 0L2.22 9.28a.751.751 0 0 1 .018-1.042.751.751 0 0 1 1.042-.018L6 10.94l6.72-6.72a.75.75 0 0 1 1.06 0Z"></path>
</svg>
</clipboard-copy>
</div>
</template>
</div>
<div id="js-global-screen-reader-notice" class="sr-only" aria-live="polite" aria-atomic="true" ></div>
<div id="js-global-screen-reader-notice-assertive" class="sr-only" aria-live="assertive" aria-atomic="true"></div>
</body>
</html>
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[supermario_v2](https://huggingface.co/vanillaOVO/supermario_v2)| 45.2| 77.21| 71.67| 48.87| 60.74|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |40.40|± | 1.92|
| | |acc_norm|40.55|± | 1.93|
|agieval_lsat_ar | 0|acc |23.04|± | 2.78|
| | |acc_norm|23.48|± | 2.80|
|agieval_lsat_lr | 0|acc |51.18|± | 2.22|
| | |acc_norm|51.76|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.43|± | 2.91|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |45.15|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |33.18|± | 3.18|
| | |acc_norm|31.36|± | 3.14|
Average: 45.2%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.87|± | 1.39|
| | |acc_norm|67.24|± | 1.37|
|arc_easy | 0|acc |86.83|± | 0.69|
| | |acc_norm|82.74|± | 0.78|
|boolq | 1|acc |88.01|± | 0.57|
|hellaswag | 0|acc |69.11|± | 0.46|
| | |acc_norm|86.96|± | 0.34|
|openbookqa | 0|acc |38.60|± | 2.18|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |83.19|± | 0.87|
| | |acc_norm|85.09|± | 0.83|
|winogrande | 0|acc |81.85|± | 1.08|
Average: 77.21%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.55|± | 1.74|
| | |mc2 |71.67|± | 1.48|
Average: 71.67%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|63.96|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|48.45|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 2.23|± | 0.78|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.20|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.86|± | 1.61|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|58.33|± | 2.85|
|bigbench_movie_recommendation | 0|multiple_choice_grade|48.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|55.60|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.85|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|55.13|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|33.97|± | 1.50|
|bigbench_snarks | 0|multiple_choice_grade|75.14|± | 3.22|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.66|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.10|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.88|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.11|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|58.33|± | 2.85|
Average: 48.87%
Average score: 60.74%
Elapsed time: 02:53:39| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v3](https://huggingface.co/CultriX/Wernicke-7B-v3)| 45.57| 77.39| 71.06| 48.46| 60.62|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |26.38|± | 2.77|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |39.63|± | 1.92|
| | |acc_norm|39.78|± | 1.92|
|agieval_lsat_ar | 0|acc |25.22|± | 2.87|
| | |acc_norm|24.78|± | 2.85|
|agieval_lsat_lr | 0|acc |52.94|± | 2.21|
| | |acc_norm|52.94|± | 2.21|
|agieval_lsat_rc | 0|acc |66.91|± | 2.87|
| | |acc_norm|66.54|± | 2.88|
|agieval_sat_en | 0|acc |81.07|± | 2.74|
| | |acc_norm|81.07|± | 2.74|
|agieval_sat_en_without_passage| 0|acc |45.15|± | 3.48|
| | |acc_norm|44.66|± | 3.47|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|29.55|± | 3.08|
Average: 45.57%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |68.09|± | 1.36|
| | |acc_norm|67.92|± | 1.36|
|arc_easy | 0|acc |87.16|± | 0.69|
| | |acc_norm|83.16|± | 0.77|
|boolq | 1|acc |88.26|± | 0.56|
|hellaswag | 0|acc |69.69|± | 0.46|
| | |acc_norm|86.56|± | 0.34|
|openbookqa | 0|acc |40.00|± | 2.19|
| | |acc_norm|50.00|± | 2.24|
|piqa | 0|acc |83.46|± | 0.87|
| | |acc_norm|85.15|± | 0.83|
|winogrande | 0|acc |80.66|± | 1.11|
Average: 77.39%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |57.65|± | 1.73|
| | |mc2 |71.06|± | 1.48|
Average: 71.06%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|55.79|± | 3.61|
|bigbench_date_understanding | 0|multiple_choice_grade|63.96|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.74|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|37.00|± | 2.16|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|25.43|± | 1.65|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.67|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|51.20|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|57.80|± | 1.56|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.85|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|54.02|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.67|± | 1.49|
|bigbench_snarks | 0|multiple_choice_grade|69.06|± | 3.45|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.05|± | 1.38|
|bigbench_temporal_sequences | 0|multiple_choice_grade|49.60|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|21.68|± | 1.17|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.31|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.67|± | 2.84|
Average: 48.46%
Average score: 60.62%
Elapsed time: 01:39:16| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[SevereNeuralBeagleTrix-7B](https://huggingface.co/CultriX/SevereNeuralBeagleTrix-7B)| 44.37| 77.38| 69.59| 47.95| 59.82|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |25.59|± | 2.74|
| | |acc_norm|24.80|± | 2.72|
|agieval_logiqa_en | 0|acc |39.32|± | 1.92|
| | |acc_norm|39.63|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|23.04|± | 2.78|
|agieval_lsat_lr | 0|acc |53.14|± | 2.21|
| | |acc_norm|53.33|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|64.68|± | 2.92|
|agieval_sat_en | 0|acc |78.16|± | 2.89|
| | |acc_norm|78.16|± | 2.89|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|42.23|± | 3.45|
|agieval_sat_math | 0|acc |31.36|± | 3.14|
| | |acc_norm|29.09|± | 3.07|
Average: 44.37%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.06|± | 1.37|
| | |acc_norm|68.43|± | 1.36|
|arc_easy | 0|acc |87.12|± | 0.69|
| | |acc_norm|83.38|± | 0.76|
|boolq | 1|acc |88.13|± | 0.57|
|hellaswag | 0|acc |69.39|± | 0.46|
| | |acc_norm|86.95|± | 0.34|
|openbookqa | 0|acc |39.60|± | 2.19|
| | |acc_norm|48.40|± | 2.24|
|piqa | 0|acc |83.24|± | 0.87|
| | |acc_norm|84.93|± | 0.83|
|winogrande | 0|acc |81.45|± | 1.09|
Average: 77.38%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |55.81|± | 1.74|
| | |mc2 |69.59|± | 1.50|
Average: 69.59%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|57.37|± | 3.60|
|bigbench_date_understanding | 0|multiple_choice_grade|65.31|± | 2.48|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|44.19|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.28|± | 2.20|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.00|± | 2.12|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.43|± | 1.60|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.00|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.00|± | 2.23|
|bigbench_navigate | 0|multiple_choice_grade|56.00|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|72.40|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|55.13|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.46|± | 1.46|
|bigbench_snarks | 0|multiple_choice_grade|74.59|± | 3.25|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.14|± | 1.40|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.30|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.40|± | 1.18|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.03|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.00|± | 2.86|
Average: 47.95%
Average score: 59.82%
Elapsed time: 02:35:46| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v6](https://huggingface.co/CultriX/Wernicke-7B-v6)| 45.11| 77.39| 71.21| 48.22| 60.48|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |29.13|± | 2.86|
| | |acc_norm|26.38|± | 2.77|
|agieval_logiqa_en | 0|acc |40.40|± | 1.92|
| | |acc_norm|40.71|± | 1.93|
|agieval_lsat_ar | 0|acc |24.35|± | 2.84|
| | |acc_norm|23.04|± | 2.78|
|agieval_lsat_lr | 0|acc |52.55|± | 2.21|
| | |acc_norm|53.33|± | 2.21|
|agieval_lsat_rc | 0|acc |66.91|± | 2.87|
| | |acc_norm|65.06|± | 2.91|
|agieval_sat_en | 0|acc |80.10|± | 2.79|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|43.20|± | 3.46|
|agieval_sat_math | 0|acc |32.73|± | 3.17|
| | |acc_norm|29.55|± | 3.08|
Average: 45.11%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |66.72|± | 1.38|
| | |acc_norm|67.75|± | 1.37|
|arc_easy | 0|acc |87.33|± | 0.68|
| | |acc_norm|83.12|± | 0.77|
|boolq | 1|acc |88.26|± | 0.56|
|hellaswag | 0|acc |69.66|± | 0.46|
| | |acc_norm|86.90|± | 0.34|
|openbookqa | 0|acc |39.40|± | 2.19|
| | |acc_norm|48.60|± | 2.24|
|piqa | 0|acc |83.41|± | 0.87|
| | |acc_norm|85.36|± | 0.82|
|winogrande | 0|acc |81.77|± | 1.09|
Average: 77.39%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.67|± | 1.73|
| | |mc2 |71.21|± | 1.49|
Average: 71.21%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|58.95|± | 3.58|
|bigbench_date_understanding | 0|multiple_choice_grade|63.96|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|45.35|± | 3.11|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|34.60|± | 2.13|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|24.43|± | 1.63|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.67|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|48.20|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.90|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|70.60|± | 1.02|
|bigbench_ruin_names | 0|multiple_choice_grade|53.57|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|30.06|± | 1.45|
|bigbench_snarks | 0|multiple_choice_grade|73.48|± | 3.29|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.76|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|52.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.80|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|18.80|± | 0.93|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.67|± | 2.86|
Average: 48.22%
Average score: 60.48%
Elapsed time: 01:26:17| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2)| 44.27| 77.86| 67.46| 48.09| 59.42|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.17|± | 2.80|
| | |acc_norm|25.20|± | 2.73|
|agieval_logiqa_en | 0|acc |38.25|± | 1.91|
| | |acc_norm|39.02|± | 1.91|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|23.91|± | 2.82|
|agieval_lsat_lr | 0|acc |49.80|± | 2.22|
| | |acc_norm|51.96|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|64.68|± | 2.92|
|agieval_sat_en | 0|acc |79.13|± | 2.84|
| | |acc_norm|79.13|± | 2.84|
|agieval_sat_en_without_passage| 0|acc |41.26|± | 3.44|
| | |acc_norm|40.29|± | 3.43|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|30.00|± | 3.10|
Average: 44.27%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.41|± | 1.37|
| | |acc_norm|67.75|± | 1.37|
|arc_easy | 0|acc |86.83|± | 0.69|
| | |acc_norm|82.37|± | 0.78|
|boolq | 1|acc |88.17|± | 0.56|
|hellaswag | 0|acc |70.46|± | 0.46|
| | |acc_norm|87.42|± | 0.33|
|openbookqa | 0|acc |38.80|± | 2.18|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |83.03|± | 0.88|
| | |acc_norm|85.15|± | 0.83|
|winogrande | 0|acc |85.00|± | 1.00|
Average: 77.86%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |53.86|± | 1.75|
| | |mc2 |67.46|± | 1.53|
Average: 67.46%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|64.23|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|44.96|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.56|± | 0.39|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.40|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.57|± | 1.58|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|57.33|± | 2.86|
|bigbench_movie_recommendation | 0|multiple_choice_grade|52.60|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|52.30|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.00|± | 1.01|
|bigbench_ruin_names | 0|multiple_choice_grade|53.35|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.97|± | 1.49|
|bigbench_snarks | 0|multiple_choice_grade|77.90|± | 3.09|
|bigbench_sports_understanding | 0|multiple_choice_grade|74.54|± | 1.39|
|bigbench_temporal_sequences | 0|multiple_choice_grade|47.40|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.36|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.03|± | 0.94|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|57.33|± | 2.86|
Average: 48.09%
Average score: 59.42%
Elapsed time: 02:27:35| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|------------------------------------------------|------:|------:|---------:|-------:|------:|
|[OGNO-7B](https://huggingface.co/paulml/OGNO-7B)| 45.07| 77.28| 76.91| 49.12| 62.09|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.56|± | 2.81|
| | |acc_norm|25.59|± | 2.74|
|agieval_logiqa_en | 0|acc |39.78|± | 1.92|
| | |acc_norm|40.09|± | 1.92|
|agieval_lsat_ar | 0|acc |26.52|± | 2.92|
| | |acc_norm|24.35|± | 2.84|
|agieval_lsat_lr | 0|acc |53.92|± | 2.21|
| | |acc_norm|54.31|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |78.64|± | 2.86|
| | |acc_norm|78.64|± | 2.86|
|agieval_sat_en_without_passage| 0|acc |43.69|± | 3.46|
| | |acc_norm|42.23|± | 3.45|
|agieval_sat_math | 0|acc |32.27|± | 3.16|
| | |acc_norm|29.55|± | 3.08|
Average: 45.07%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |67.24|± | 1.37|
| | |acc_norm|67.66|± | 1.37|
|arc_easy | 0|acc |86.62|± | 0.70|
| | |acc_norm|80.22|± | 0.82|
|boolq | 1|acc |87.58|± | 0.58|
|hellaswag | 0|acc |70.05|± | 0.46|
| | |acc_norm|87.49|± | 0.33|
|openbookqa | 0|acc |40.20|± | 2.19|
| | |acc_norm|50.00|± | 2.24|
|piqa | 0|acc |83.46|± | 0.87|
| | |acc_norm|85.42|± | 0.82|
|winogrande | 0|acc |82.56|± | 1.07|
Average: 77.28%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |61.44|± | 1.70|
| | |mc2 |76.91|± | 1.39|
Average: 76.91%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|60.00|± | 3.56|
|bigbench_date_understanding | 0|multiple_choice_grade|62.06|± | 2.53|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|55.43|± | 3.10|
|bigbench_geometric_shapes | 0|multiple_choice_grade|22.84|± | 2.22|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|33.20|± | 2.11|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|22.86|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|59.00|± | 2.84|
|bigbench_movie_recommendation | 0|multiple_choice_grade|49.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.20|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|69.40|± | 1.03|
|bigbench_ruin_names | 0|multiple_choice_grade|53.57|± | 2.36|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|38.18|± | 1.54|
|bigbench_snarks | 0|multiple_choice_grade|73.48|± | 3.29|
|bigbench_sports_understanding | 0|multiple_choice_grade|75.56|± | 1.37|
|bigbench_temporal_sequences | 0|multiple_choice_grade|51.10|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|22.88|± | 1.19|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|19.66|± | 0.95|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|59.00|± | 2.84|
Average: 49.12%
Average score: 62.09%
Elapsed time: 03:05:18| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|---------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[Wernicke-7B-v9](https://huggingface.co/CultriX/Wernicke-7B-v9)| 45.63| 77.59| 72.4| 48.86| 61.12|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |27.95|± | 2.82|
| | |acc_norm|25.98|± | 2.76|
|agieval_logiqa_en | 0|acc |40.25|± | 1.92|
| | |acc_norm|40.40|± | 1.92|
|agieval_lsat_ar | 0|acc |23.91|± | 2.82|
| | |acc_norm|25.65|± | 2.89|
|agieval_lsat_lr | 0|acc |51.57|± | 2.22|
| | |acc_norm|52.55|± | 2.21|
|agieval_lsat_rc | 0|acc |65.80|± | 2.90|
| | |acc_norm|65.80|± | 2.90|
|agieval_sat_en | 0|acc |78.64|± | 2.86|
| | |acc_norm|79.61|± | 2.81|
|agieval_sat_en_without_passage| 0|acc |44.66|± | 3.47|
| | |acc_norm|43.20|± | 3.46|
|agieval_sat_math | 0|acc |33.18|± | 3.18|
| | |acc_norm|31.82|± | 3.15|
Average: 45.63%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |65.61|± | 1.39|
| | |acc_norm|68.00|± | 1.36|
|arc_easy | 0|acc |86.53|± | 0.70|
| | |acc_norm|82.91|± | 0.77|
|boolq | 1|acc |87.98|± | 0.57|
|hellaswag | 0|acc |68.56|± | 0.46|
| | |acc_norm|87.10|± | 0.33|
|openbookqa | 0|acc |38.80|± | 2.18|
| | |acc_norm|49.20|± | 2.24|
|piqa | 0|acc |82.97|± | 0.88|
| | |acc_norm|85.20|± | 0.83|
|winogrande | 0|acc |82.72|± | 1.06|
Average: 77.59%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |56.18|± | 1.74|
| | |mc2 |72.40|± | 1.47|
Average: 72.4%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|59.47|± | 3.57|
|bigbench_date_understanding | 0|multiple_choice_grade|63.96|± | 2.50|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|49.61|± | 3.12|
|bigbench_geometric_shapes | 0|multiple_choice_grade|23.12|± | 2.23|
| | |exact_str_match | 1.39|± | 0.62|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|32.40|± | 2.10|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|23.00|± | 1.59|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|56.67|± | 2.87|
|bigbench_movie_recommendation | 0|multiple_choice_grade|47.80|± | 2.24|
|bigbench_navigate | 0|multiple_choice_grade|56.20|± | 1.57|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|71.95|± | 1.00|
|bigbench_ruin_names | 0|multiple_choice_grade|55.13|± | 2.35|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|32.46|± | 1.48|
|bigbench_snarks | 0|multiple_choice_grade|77.35|± | 3.12|
|bigbench_sports_understanding | 0|multiple_choice_grade|76.06|± | 1.36|
|bigbench_temporal_sequences | 0|multiple_choice_grade|54.30|± | 1.58|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|23.28|± | 1.20|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|20.06|± | 0.96|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|56.67|± | 2.87|
Average: 48.86%
Average score: 61.12%
Elapsed time: 01:15:19| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|-------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)| 20.77| 54.28| 37.84| 32.4| 36.32|
### AGIEval
| Task |Version| Metric |Value| |Stderr|
|------------------------------|------:|--------|----:|---|-----:|
|agieval_aqua_rat | 0|acc |16.14|± | 2.31|
| | |acc_norm|17.32|± | 2.38|
|agieval_logiqa_en | 0|acc |26.42|± | 1.73|
| | |acc_norm|31.03|± | 1.81|
|agieval_lsat_ar | 0|acc |20.43|± | 2.66|
| | |acc_norm|20.00|± | 2.64|
|agieval_lsat_lr | 0|acc |20.59|± | 1.79|
| | |acc_norm|20.98|± | 1.80|
|agieval_lsat_rc | 0|acc |18.96|± | 2.39|
| | |acc_norm|19.70|± | 2.43|
|agieval_sat_en | 0|acc |24.27|± | 2.99|
| | |acc_norm|16.02|± | 2.56|
|agieval_sat_en_without_passage| 0|acc |19.90|± | 2.79|
| | |acc_norm|17.48|± | 2.65|
|agieval_sat_math | 0|acc |28.18|± | 3.04|
| | |acc_norm|23.64|± | 2.87|
Average: 20.77%
### GPT4All
| Task |Version| Metric |Value| |Stderr|
|-------------|------:|--------|----:|---|-----:|
|arc_challenge| 0|acc |29.95|± | 1.34|
| | |acc_norm|32.94|± | 1.37|
|arc_easy | 0|acc |61.32|± | 1.00|
| | |acc_norm|54.34|± | 1.02|
|boolq | 1|acc |60.92|± | 0.85|
|hellaswag | 0|acc |46.56|± | 0.50|
| | |acc_norm|60.41|± | 0.49|
|openbookqa | 0|acc |25.40|± | 1.95|
| | |acc_norm|37.20|± | 2.16|
|piqa | 0|acc |74.43|± | 1.02|
| | |acc_norm|74.37|± | 1.02|
|winogrande | 0|acc |59.83|± | 1.38|
Average: 54.28%
### TruthfulQA
| Task |Version|Metric|Value| |Stderr|
|-------------|------:|------|----:|---|-----:|
|truthfulqa_mc| 1|mc1 |23.01|± | 1.47|
| | |mc2 |37.84|± | 1.40|
Average: 37.84%
### Bigbench
| Task |Version| Metric |Value| |Stderr|
|------------------------------------------------|------:|---------------------|----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|47.89|± | 3.63|
|bigbench_date_understanding | 0|multiple_choice_grade|48.78|± | 2.61|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|32.95|± | 2.93|
|bigbench_geometric_shapes | 0|multiple_choice_grade|10.03|± | 1.59|
| | |exact_str_match | 0.00|± | 0.00|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|20.80|± | 1.82|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|14.86|± | 1.35|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|35.33|± | 2.76|
|bigbench_movie_recommendation | 0|multiple_choice_grade|34.00|± | 2.12|
|bigbench_navigate | 0|multiple_choice_grade|50.70|± | 1.58|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|34.15|± | 1.06|
|bigbench_ruin_names | 0|multiple_choice_grade|31.92|± | 2.20|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|24.95|± | 1.37|
|bigbench_snarks | 0|multiple_choice_grade|51.38|± | 3.73|
|bigbench_sports_understanding | 0|multiple_choice_grade|49.59|± | 1.59|
|bigbench_temporal_sequences | 0|multiple_choice_grade|29.40|± | 1.44|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|18.16|± | 1.09|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|13.03|± | 0.80|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|35.33|± | 2.76|
Average: 32.4%
Average score: 36.32%
Elapsed time: 01:03:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment