model files to use with https://github.com/ollama/ollama
ollama create example -f modelfile.txt
ollama run example
ollama rm example
model files to use with https://github.com/ollama/ollama
ollama create example -f modelfile.txt
ollama run example
ollama rm example
# download from | |
# - https://huggingface.co/nguyenviet/PhoGPT-4B-Chat-GGUF/tree/main | |
# - https://huggingface.co/nguyenviet/PhoGPT-7B5-Instruct-GGUF/tree/main | |
FROM ./PhoGPT-4B-Chat-q5_k_m.gguf | |
PARAMETER num_gpu 99 | |
PARAMETER num_ctx 4096 | |
PARAMETER temperature 1.0 | |
PARAMETER num_predict 1024 | |
PARAMETER top_k 50 | |
PARAMETER top_p 0.9 | |
TEMPLATE """ | |
### Câu hỏi: {{ .Prompt }} | |
### Trả lời: {{ .Response }} | |
""" |
# download from https://huggingface.co/ndthai/ToRoLaMa-7B-GGUF/tree/main | |
FROM ./ToRoLaMa-7b.Q5_K_M.gguf | |
PARAMETER num_gpu 99 | |
PARAMETER num_ctx 4096 | |
PARAMETER temperature 1.0 | |
PARAMETER num_predict 2048 | |
PARAMETER top_k 50 | |
PARAMETER top_p 0.9 | |
PARAMETER stop </s> | |
SYSTEM "Cuộc hội thoại giữa người dùng và một trí thông minh nhân tạo. Đưa ra câu trả lời chính xác, giúp ích cho người dùng." | |
TEMPLATE """ | |
USER: {{ .Prompt }} | |
ASSISTANT: {{ .Response }}</s> | |
""" |
# download from | |
# - https://huggingface.co/janhq/Vistral-7b-Chat-GGUF/tree/main | |
# - https://huggingface.co/uonlp/Vistral-7B-Chat-gguf/tree/main | |
FROM ./vistral-7b-chat.Q5_K_M.gguf | |
PARAMETER num_gpu 99 | |
PARAMETER num_ctx 4096 | |
PARAMETER temperature 0.1 | |
PARAMETER repeat_penalty 1.05 | |
PARAMETER num_predict 768 | |
PARAMETER top_k 40 | |
PARAMETER top_p 0.95 | |
SYSTEM """ | |
Bạn là một trợ lí Tiếng Việt nhiệt tình và trung thực. Hãy luôn trả lời một cách hữu ích nhất có thể, đồng thời giữ an toàn. | |
Câu trả lời của bạn không nên chứa bất kỳ nội dung gây hại, phân biệt chủng tộc, phân biệt giới tính, độc hại, nguy hiểm hoặc bất hợp pháp nào. Hãy đảm bảo rằng các câu trả lời của bạn không có thiên kiến xã hội và mang tính tích cực. | |
Nếu một câu hỏi không có ý nghĩa hoặc không hợp lý về mặt thông tin, hãy giải thích tại sao thay vì trả lời một điều gì đó không chính xác. Nếu bạn không biết câu trả lời cho một câu hỏi, hãy trẳ lời là bạn không biết và vui lòng không chia sẻ thông tin sai lệch. | |
""" |