jaredquekjz

jaredquekjz / merge_qlora_with_quantized_model.py

Created September 2, 2023 07:16 — forked from ChrisHayduk/merge_qlora_with_quantized_model.py

Merging QLoRA weights with quantized model

	"""

	The code below combines approaches published by both @eugene-yh and @jinyongyoo on Github.

	Thanks for the contributions guys!

	"""

	import torch
	import peft

jaredquekjz / finetune_llama_v2.py

Created July 20, 2023 08:57 — forked from younesbelkada/finetune_llama_v2.py

Fine tune Llama v2 models on Guanaco Dataset

	# coding=utf-8
	# Copyright 2023 The HuggingFace Inc. team. All rights reserved.
	#
	# Licensed under the Apache License, Version 2.0 (the "License");
	# you may not use this file except in compliance with the License.
	# You may obtain a copy of the License at
	#
	# http://www.apache.org/licenses/LICENSE-2.0
	#
	# Unless required by applicable law or agreed to in writing, software