Skip to content

Instantly share code, notes, and snippets.

@AmosLewis

AmosLewis/llama_8b_f16_0501.sh

Last active May 2, 2025 22:39
Show Gist options
  • Save AmosLewis/b10b67ff0417f7f588d787c3fa48121f to your computer and use it in GitHub Desktop.
Save AmosLewis/b10b67ff0417f7f588d787c3fa48121f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
llama_8b_f16_0501.sh
python -m sharktank.examples.paged_llm_v1 \
--irpa-file=/shark-dev/8b/instruct/weights/llama3.1_8b_instruct_fp16.irpa \
--tokenizer-config-json=/shark-dev/8b/instruct/tokenizer_config.json \
--prompt="Name the capital of the United States"
# /home/chi/src/shark-ai/.venv/lib/python3.12/site-packages/iree/turbine/aot/params.py:163: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.)
# return torch.from_numpy(wrapper)
# :: Prompt tokens:
# prompt_0:
# b'Name the capital of the United States.'
# [678, 279, 6864, 315, 279, 3723, 4273, 13]
# :: prefill result tokens:
# prompt_0(1, 8): **
# [1035]
# :: decode result tokens:
# prompt_0(2, 9): **
# **
# [1035, 334]
# :: Result tokens: [[1035, 334]]
# :: decode result tokens:
# prompt_0(2, 9): **
# **
# [1035, 334]
# :: decode result tokens:
# prompt_0(3, 10): **
# **Answer
# [1035, 334, 16533]
# :: Result tokens: [[1035, 334, 16533]]
# :: decode result tokens:
# prompt_0(3, 10): **
# **Answer
# [1035, 334, 16533]
# :: decode result tokens:
# prompt_0(4, 11): **
# **Answer:**
# [1035, 334, 16533, 68063]
# :: Result tokens: [[1035, 334, 16533, 68063]]
# :: decode result tokens:
# prompt_0(4, 11): **
# **Answer:**
# [1035, 334, 16533, 68063]
# :: decode result tokens:
# prompt_0(5, 12): **
# **Answer:** Washington
# [1035, 334, 16533, 68063, 6652]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652]]
# :: decode result tokens:
# prompt_0(5, 12): **
# **Answer:** Washington
# [1035, 334, 16533, 68063, 6652]
# :: decode result tokens:
# prompt_0(6, 13): **
# **Answer:** Washington,
# [1035, 334, 16533, 68063, 6652, 11]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11]]
# :: decode result tokens:
# prompt_0(6, 13): **
# **Answer:** Washington,
# [1035, 334, 16533, 68063, 6652, 11]
# :: decode result tokens:
# prompt_0(7, 14): **
# **Answer:** Washington, D
# [1035, 334, 16533, 68063, 6652, 11, 423]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423]]
# :: decode result tokens:
# prompt_0(7, 14): **
# **Answer:** Washington, D
# [1035, 334, 16533, 68063, 6652, 11, 423]
# :: decode result tokens:
# prompt_0(8, 15): **
# **Answer:** Washington, D.C
# [1035, 334, 16533, 68063, 6652, 11, 423, 732]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732]]
# :: decode result tokens:
# prompt_0(8, 15): **
# **Answer:** Washington, D.C
# [1035, 334, 16533, 68063, 6652, 11, 423, 732]
# :: decode result tokens:
# prompt_0(9, 16): **
# **Answer:** Washington, D.C.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627]]
# :: decode result tokens:
# prompt_0(9, 16): **
# **Answer:** Washington, D.C.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627]
# :: decode result tokens:
# prompt_0(10, 17): **
# **Answer:** Washington, D.C.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334]]
# :: decode result tokens:
# prompt_0(10, 17): **
# **Answer:** Washington, D.C.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334]
# :: decode result tokens:
# prompt_0(11, 18): **
# **Answer:** Washington, D.C.
# **2
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17]]
# :: decode result tokens:
# prompt_0(11, 18): **
# **Answer:** Washington, D.C.
# **2
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17]
# :: decode result tokens:
# prompt_0(12, 19): **
# **Answer:** Washington, D.C.
# **2.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13]]
# :: decode result tokens:
# prompt_0(12, 19): **
# **Answer:** Washington, D.C.
# **2.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13]
# :: decode result tokens:
# prompt_0(13, 20): **
# **Answer:** Washington, D.C.
# **2. Name
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076]]
# :: decode result tokens:
# prompt_0(13, 20): **
# **Answer:** Washington, D.C.
# **2. Name
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076]
# :: decode result tokens:
# prompt_0(14, 21): **
# **Answer:** Washington, D.C.
# **2. Name the
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279]]
# :: decode result tokens:
# prompt_0(14, 21): **
# **Answer:** Washington, D.C.
# **2. Name the
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279]
# :: decode result tokens:
# prompt_0(15, 22): **
# **Answer:** Washington, D.C.
# **2. Name the capital
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864]]
# :: decode result tokens:
# prompt_0(15, 22): **
# **Answer:** Washington, D.C.
# **2. Name the capital
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864]
# :: decode result tokens:
# prompt_0(16, 23): **
# **Answer:** Washington, D.C.
# **2. Name the capital of
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315]]
# :: decode result tokens:
# prompt_0(16, 23): **
# **Answer:** Washington, D.C.
# **2. Name the capital of
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315]
# :: decode result tokens:
# prompt_0(17, 24): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822]]
# :: decode result tokens:
# prompt_0(17, 24): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822]
# :: decode result tokens:
# prompt_0(18, 25): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13]]
# :: decode result tokens:
# prompt_0(18, 25): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13]
# :: decode result tokens:
# prompt_0(19, 26): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035]]
# :: decode result tokens:
# prompt_0(19, 26): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035]
# :: decode result tokens:
# prompt_0(20, 27): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334]]
# :: decode result tokens:
# prompt_0(20, 27): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334]
# :: decode result tokens:
# prompt_0(21, 28): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533]]
# :: decode result tokens:
# prompt_0(21, 28): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533]
# :: decode result tokens:
# prompt_0(22, 29): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063]]
# :: decode result tokens:
# prompt_0(22, 29): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063]
# :: decode result tokens:
# prompt_0(23, 30): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366]]
# :: decode result tokens:
# prompt_0(23, 30): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366]
# :: decode result tokens:
# prompt_0(24, 31): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627]]
# :: decode result tokens:
# prompt_0(24, 31): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627]
# :: decode result tokens:
# prompt_0(25, 32): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334]]
# :: decode result tokens:
# prompt_0(25, 32): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334]
# :: decode result tokens:
# prompt_0(26, 33): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18]]
# :: decode result tokens:
# prompt_0(26, 33): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18]
# :: decode result tokens:
# prompt_0(27, 34): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13]]
# :: decode result tokens:
# prompt_0(27, 34): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13]
# :: decode result tokens:
# prompt_0(28, 35): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076]]
# :: decode result tokens:
# prompt_0(28, 35): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076]
# :: decode result tokens:
# prompt_0(29, 36): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279]]
# :: decode result tokens:
# prompt_0(29, 36): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279]
# :: decode result tokens:
# prompt_0(30, 37): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864]]
# :: decode result tokens:
# prompt_0(30, 37): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864]
# :: decode result tokens:
# prompt_0(31, 38): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315]]
# :: decode result tokens:
# prompt_0(31, 38): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315]
# :: decode result tokens:
# prompt_0(32, 39): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494]]
# :: decode result tokens:
# prompt_0(32, 39): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494]
# :: decode result tokens:
# prompt_0(33, 40): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13]]
# :: decode result tokens:
# prompt_0(33, 40): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13]
# :: decode result tokens:
# prompt_0(34, 41): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035]]
# :: decode result tokens:
# prompt_0(34, 41): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035]
# :: decode result tokens:
# prompt_0(35, 42): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334]]
# :: decode result tokens:
# prompt_0(35, 42): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334]
# :: decode result tokens:
# prompt_0(36, 43): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533]]
# :: decode result tokens:
# prompt_0(36, 43): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533]
# :: decode result tokens:
# prompt_0(37, 44): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063]]
# :: decode result tokens:
# prompt_0(37, 44): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063]
# :: decode result tokens:
# prompt_0(38, 45): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890]]
# :: decode result tokens:
# prompt_0(38, 45): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890]
# :: decode result tokens:
# prompt_0(39, 46): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627]]
# :: decode result tokens:
# prompt_0(39, 46): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627]
# :: decode result tokens:
# prompt_0(40, 47): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334]]
# :: decode result tokens:
# prompt_0(40, 47): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334]
# :: decode result tokens:
# prompt_0(41, 48): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19]]
# :: decode result tokens:
# prompt_0(41, 48): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19]
# :: decode result tokens:
# prompt_0(42, 49): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13]]
# :: decode result tokens:
# prompt_0(42, 49): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13]
# :: decode result tokens:
# prompt_0(43, 50): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076]]
# :: decode result tokens:
# prompt_0(43, 50): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076]
# :: decode result tokens:
# prompt_0(44, 51): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279]]
# :: decode result tokens:
# prompt_0(44, 51): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279]
# :: decode result tokens:
# prompt_0(45, 52): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864]]
# :: decode result tokens:
# prompt_0(45, 52): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864]
# :: decode result tokens:
# prompt_0(46, 53): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315]]
# :: decode result tokens:
# prompt_0(46, 53): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315]
# :: decode result tokens:
# prompt_0(47, 54): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734]]
# :: decode result tokens:
# prompt_0(47, 54): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734]
# :: decode result tokens:
# prompt_0(48, 55): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13]]
# :: decode result tokens:
# prompt_0(48, 55): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13]
# :: decode result tokens:
# prompt_0(49, 56): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035]]
# :: decode result tokens:
# prompt_0(49, 56): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035]
# :: decode result tokens:
# prompt_0(50, 57): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334]]
# :: decode result tokens:
# prompt_0(50, 57): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334]
# :: decode result tokens:
# prompt_0(51, 58): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533]]
# :: decode result tokens:
# prompt_0(51, 58): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533]
# :: decode result tokens:
# prompt_0(52, 59): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063]]
# :: decode result tokens:
# prompt_0(52, 59): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:**
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063]
# :: decode result tokens:
# prompt_0(53, 60): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647]]
# :: decode result tokens:
# prompt_0(53, 60): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647]
# :: decode result tokens:
# prompt_0(54, 61): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627]]
# :: decode result tokens:
# prompt_0(54, 61): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627]
# :: decode result tokens:
# prompt_0(55, 62): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334]]
# :: decode result tokens:
# prompt_0(55, 62): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# **
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334]
# :: decode result tokens:
# prompt_0(56, 63): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# **5
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334, 20]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334, 20]]
# :: decode result tokens:
# prompt_0(56, 63): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# **5
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334, 20]
# :: decode result tokens:
# prompt_0(57, 64): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# **5.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334, 20, 13]
# :: Result tokens: [[1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334, 20, 13]]
# :: decode result tokens:
# prompt_0(57, 64): **
# **Answer:** Washington, D.C.
# **2. Name the capital of France.**
# **Answer:** Paris.
# **3. Name the capital of Australia.**
# **Answer:** Canberra.
# **4. Name the capital of China.**
# **Answer:** Beijing.
# **5.
# [1035, 334, 16533, 68063, 6652, 11, 423, 732, 627, 334, 17, 13, 4076, 279, 6864, 315, 9822, 13, 1035, 334, 16533, 68063, 12366, 627, 334, 18, 13, 4076, 279, 6864, 315, 8494, 13, 1035, 334, 16533, 68063, 69890, 627, 334, 19, 13, 4076, 279, 6864, 315, 5734, 13, 1035, 334, 16533, 68063, 27647, 627, 334, 20, 13]
# :: Out of allocated pages, increase page_cache_size to continue generation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment