Skip to content

Instantly share code, notes, and snippets.

@phineas-pta
Last active April 8, 2024 21:26
Show Gist options
  • Save phineas-pta/d8014f5c29b618cf9a6b476f5732deed to your computer and use it in GitHub Desktop.
Save phineas-pta/d8014f5c29b618cf9a6b476f5732deed to your computer and use it in GitHub Desktop.
ollama model files (vietnamese LLM)
# download from
# - https://huggingface.co/nguyenviet/PhoGPT-4B-Chat-GGUF/tree/main
# - https://huggingface.co/nguyenviet/PhoGPT-7B5-Instruct-GGUF/tree/main
FROM ./PhoGPT-4B-Chat-q5_k_m.gguf
PARAMETER num_gpu 99
PARAMETER num_ctx 4096
PARAMETER temperature 1.0
PARAMETER num_predict 1024
PARAMETER top_k 50
PARAMETER top_p 0.9
TEMPLATE """
### Câu hỏi: {{ .Prompt }}
### Trả lời: {{ .Response }}
"""
# download from https://huggingface.co/ndthai/ToRoLaMa-7B-GGUF/tree/main
FROM ./ToRoLaMa-7b.Q5_K_M.gguf
PARAMETER num_gpu 99
PARAMETER num_ctx 4096
PARAMETER temperature 1.0
PARAMETER num_predict 2048
PARAMETER top_k 50
PARAMETER top_p 0.9
PARAMETER stop </s>
SYSTEM "Cuộc hội thoại giữa người dùng và một trí thông minh nhân tạo. Đưa ra câu trả lời chính xác, giúp ích cho người dùng."
TEMPLATE """
USER: {{ .Prompt }}
ASSISTANT: {{ .Response }}</s>
"""
# download from
# - https://huggingface.co/janhq/Vistral-7b-Chat-GGUF/tree/main
# - https://huggingface.co/uonlp/Vistral-7B-Chat-gguf/tree/main
FROM ./vistral-7b-chat.Q5_K_M.gguf
PARAMETER num_gpu 99
PARAMETER num_ctx 4096
PARAMETER temperature 0.1
PARAMETER repeat_penalty 1.05
PARAMETER num_predict 768
PARAMETER top_k 40
PARAMETER top_p 0.95
SYSTEM """
Bạn là một trợ lí Tiếng Việt nhiệt tình và trung thực. Hãy luôn trả lời một cách hữu ích nhất có thể, đồng thời giữ an toàn.
Câu trả lời của bạn không nên chứa bất kỳ nội dung gây hại, phân biệt chủng tộc, phân biệt giới tính, độc hại, nguy hiểm hoặc bất hợp pháp nào. Hãy đảm bảo rằng các câu trả lời của bạn không có thiên kiến xã hội và mang tính tích cực.
Nếu một câu hỏi không có ý nghĩa hoặc không hợp lý về mặt thông tin, hãy giải thích tại sao thay vì trả lời một điều gì đó không chính xác. Nếu bạn không biết câu trả lời cho một câu hỏi, hãy trẳ lời là bạn không biết và vui lòng không chia sẻ thông tin sai lệch.
"""
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment