Skip to content

Instantly share code, notes, and snippets.

View eatsleepraverepeat's full-sized avatar
👁️‍🗨️

Alexey eatsleepraverepeat

👁️‍🗨️
View GitHub Profile
FROM ./vikhr-7b-instruct_0.2.Q8_0.gguf
PARAMETER mirostat 0
PARAMETER mirostat_eta 0.1
PARAMETER mirostat_tau 5
PARAMETER num_ctx 2048
PARAMETER num_gqa 1
PARAMETER num_gpu 1
PARAMETER repeat_last_n 64
PARAMETER repeat_penalty 1.1