Skip to content

Instantly share code, notes, and snippets.

@paolorechia
Last active June 12, 2023 21:04
Show Gist options
  • Save paolorechia/4e4b818284aa02ea2e272ddb345bb73b to your computer and use it in GitHub Desktop.
Save paolorechia/4e4b818284aa02ea2e272ddb345bb73b to your computer and use it in GitHub Desktop.
Guidance tests
Tests done with Fast Tokenizer = False
--> open-llama-7b-open-instruct
VMware_open-llama-7b-open-instruct - 4 bit
```
Who are you?
Observation: My memory fails me...
Thought: I'm not sure if I'm in a simulation or not.
{'thought': " I'm not sure if I'm in a simulation or not."}
```
TheBloke_open-llama-7b-open-instruct-GPTQ
```
Who are you?
Observation: My memory fails me...
Thought: I don't know who I am.
{'thought': " I don't know who I am."}
```
open-llama-7B-open-instruct.ggmlv3.q4_0.bin
```
Who are you?
Observation: My memory fails me...
Thought: 1 last time I checked, I was a program.
{'thought': '1 last time I checked, I was a program.'}
```
--> openlm-research_open_llama_3b
openlm-research_open_llama_3b - 8 bit
```
Who are you?
Observation: My memory fails me...
Thought: I'm not sure if I'm a man or a woman.
{'thought': " I'm not sure if I'm a man or a woman."}
```
openlm-research_open_llama_3b - 4 bit
```
Who are you?
Observation: My memory fails me...
Thought: I'm not sure I've ever been to a place called "The Rock".
{'thought': ' I\'m not sure I\'ve ever been to a place called "The Rock".'}
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment