Last active
June 12, 2023 21:04
-
-
Save paolorechia/4e4b818284aa02ea2e272ddb345bb73b to your computer and use it in GitHub Desktop.
Guidance tests
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Tests done with Fast Tokenizer = False | |
--> open-llama-7b-open-instruct | |
VMware_open-llama-7b-open-instruct - 4 bit | |
``` | |
Who are you? | |
Observation: My memory fails me... | |
Thought: I'm not sure if I'm in a simulation or not. | |
{'thought': " I'm not sure if I'm in a simulation or not."} | |
``` | |
TheBloke_open-llama-7b-open-instruct-GPTQ | |
``` | |
Who are you? | |
Observation: My memory fails me... | |
Thought: I don't know who I am. | |
{'thought': " I don't know who I am."} | |
``` | |
open-llama-7B-open-instruct.ggmlv3.q4_0.bin | |
``` | |
Who are you? | |
Observation: My memory fails me... | |
Thought: 1 last time I checked, I was a program. | |
{'thought': '1 last time I checked, I was a program.'} | |
``` | |
--> openlm-research_open_llama_3b | |
openlm-research_open_llama_3b - 8 bit | |
``` | |
Who are you? | |
Observation: My memory fails me... | |
Thought: I'm not sure if I'm a man or a woman. | |
{'thought': " I'm not sure if I'm a man or a woman."} | |
``` | |
openlm-research_open_llama_3b - 4 bit | |
``` | |
Who are you? | |
Observation: My memory fails me... | |
Thought: I'm not sure I've ever been to a place called "The Rock". | |
{'thought': ' I\'m not sure I\'ve ever been to a place called "The Rock".'} | |
``` | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment