Skip to content

Instantly share code, notes, and snippets.

@bartowski1182
bartowski1182 / render_corpus.py
Created August 17, 2026 19:03
Rendering script used for shipping the imatrix data, in particular the chat template wrapping
#!/usr/bin/env python3
"""Render the v6 imatrix calibration corpus for a target model.
The corpus data is fixed and ships beside this script:
v6_prose.txt prose component, used verbatim
v6_conversations.json canonical conversations (messages + tools)
Only the RENDERING is per-model: the conversations go through the target
model's own chat encoding, so the corpus contains exactly the bytes the
@bartowski1182
bartowski1182 / v6_conversations.json
Created August 14, 2026 05:06
V6 iteration of calibration data, v6_prose.txt is 54 pieces from calibration_datav5.txt, determined to be the highest value for calibration, v6_conversations.json is 137 tool-calling conversations from interstellarninja/hermes_reasoning_tool_use to be rendered by the target model
This file has been truncated, but you can view the full file.
{
"recipe": "calibration-v6 (validated 2026-08-11)",
"source_dataset": "interstellarninja/hermes_reasoning_tool_use",
"selection": {
"seed": 42,
"row_limit": 0.8,
"n_rows_pool": 250,
"kept_indices": [
0,
2,
@bartowski1182
bartowski1182 / compress_trinity.py
Created February 23, 2026 17:01
AFMoE llm compressor
#!/usr/bin/env python3
"""
FP8 Dynamic Quantization for Trinity AFMOE
Usage:
python compress_trinity_fp8.py \
--model_path /path/to/trinity \
--output_path ./trinity-FP8
"""
@bartowski1182
bartowski1182 / calibration_datav5.txt
Created January 2, 2026 01:29
Calibration data used for latest imatrix. Includes work from Dampf, Kalomaze, and extra dataset from combined_all_small from edaddario
This file has been truncated, but you can view the full file.
In addition to a significant decrease in hepatic lipid accumulation in the IOE group, which inhibited energy intake by propionate enrichment, hepatic lipids were also significantly reduced in the mice in the IOP group, which was largely enriched with butyrate. Compared with the IOE group, IOP had a stronger regulatory effect on hepatic metabolism and triglyceride metabolism and higher levels of TCA cycle in the host. In addition, butyrate has the ability to promote browning of white adipose tissue (WAT) to brown adipose tissue (BAT).^[@ref39],[@ref40]^ WAT stores energy, whereas BAT uses energy for heating and consequently host energy expenditure increases.^[@ref41],[@ref42]^ However, adipose tissue weight does not change after WAT browning.^[@ref43]^ Therefore, the weight of adipose tissue of mice in the IOP group dominated by butyrate was greater than that of the mice in the IOE group dominated by propionate.
In conclusion ([Figure [7](#fig7){ref-type="fig"}](#fig7){ref-type="fig"}C), the improvement of ob
@bartowski1182
bartowski1182 / qwen_calibration_with_chat.txt
Last active August 30, 2026 00:54
Calibration data used for Qwen3, includes original work from Dampf which built on Kalomaze. Chat tokens added thanks to tofumagnate, additional data generated from Qwen3-30B-A3B Q2_K_L
你好!我是你的新朋友,很高兴认识你。😊
我是个喜欢探索和学习的小机器人,在这里我可以给你提供帮助、解答问题以及分享知识。
虽然我没有真实的身体,请不要介意哦~ 我可以通过文字与您交流,并尽力满足您的需求!
我们可以一起聊聊天?或者您可以问我一些有趣的问题?
不管是什么内容都可以告诉我啦! 🌟
@bartowski1182
bartowski1182 / calibration_datav3.txt
Last active September 25, 2026 08:54
Calibration data provided by Dampf, combines his own efforts on top of Kalomaze's. Used for calibrating GGUF imatrix files
In addition to a significant decrease in hepatic lipid accumulation in the IOE group, which inhibited energy intake by propionate enrichment, hepatic lipids were also significantly reduced in the mice in the IOP group, which was largely enriched with butyrate. Compared with the IOE group, IOP had a stronger regulatory effect on hepatic metabolism and triglyceride metabolism and higher levels of TCA cycle in the host. In addition, butyrate has the ability to promote browning of white adipose tissue (WAT) to brown adipose tissue (BAT).^[@ref39],[@ref40]^ WAT stores energy, whereas BAT uses energy for heating and consequently host energy expenditure increases.^[@ref41],[@ref42]^ However, adipose tissue weight does not change after WAT browning.^[@ref43]^ Therefore, the weight of adipose tissue of mice in the IOP group dominated by butyrate was greater than that of the mice in the IOE group dominated by propionate.
In conclusion ([Figure [7](#fig7){ref-type="fig"}](#fig7){ref-type="fig"}C), the improvement of ob
@bartowski1182
bartowski1182 / calibration_data.txt
Last active July 3, 2024 19:38
Calibration data for GGUF. Includes work from Kalomaze, Turboderp, and Dampf.
In addition to a significant decrease in hepatic lipid accumulation in the IOE group, which inhibited energy intake by propionate enrichment, hepatic lipids were also significantly reduced in the mice in the IOP group, which was largely enriched with butyrate. Compared with the IOE group, IOP had a stronger regulatory effect on hepatic metabolism and triglyceride metabolism and higher levels of TCA cycle in the host. In addition, butyrate has the ability to promote browning of white adipose tissue (WAT) to brown adipose tissue (BAT).^[@ref39],[@ref40]^ WAT stores energy, whereas BAT uses energy for heating and consequently host energy expenditure increases.^[@ref41],[@ref42]^ However, adipose tissue weight does not change after WAT browning.^[@ref43]^ Therefore, the weight of adipose tissue of mice in the IOP group dominated by butyrate was greater than that of the mice in the IOE group dominated by propionate.
In conclusion ([Figure [7](#fig7){ref-type="fig"}](#fig7){ref-type="fig"}C), the improvement of ob
.gradle
/local.properties
/.idea/workspace.xml
.DS_Store