Roy Iversen riversen

I am a security geek. I love red team work, blue team work and any combination of the two.

cmsj / slm.py

Created April 19, 2023 17:04

Quick hack to run SLM locally

	# pip install the following, and make sure you have a pytorch that supports CUDA.
	# accelerate
	# bitsandbytes
	# transformers
	# IPython

	import torch
	from transformers import AutoModelForCausalLM, AutoTokenizer

	from IPython.display import Markdown, display