can't ray.get(objectRef_list)

get_object_ref_rdt_bug.txt

(GeneratorCore pid=70828, ip=10.0.49.144) (Worker_TP2 pid=71026) [vLLM-Worker] Loaded 389 weight(s)
[Generator] Updated weights on all vLLM workers
[Generator] Weight sync completed
[train] step 1/25 called
(GeneratorCore pid=70828, ip=10.0.49.144) (Worker_TP0 pid=71024) [vLLM-Worker] Loaded 389 weight(s)
Adding requests: 100%|██████████| 1/1 [00:00<00:00, 1245.71it/s]
Processed prompts:   0%|          | 0/4 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: James writes a 3-page letter to 2 different friends twice a week.  How many pages does he write a year? | logprobs length: 8 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) A lot of people write a lot
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: James writes a 3-page letter to 2 different friends twice a week.  How many pages does he write a year? | logprobs length: 8 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) James writes a 3-page letter
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: James writes a 3-page letter to 2 different friends twice a week.  How many pages does he write a year? | logprobs length: 8 | response:   At this rate, he’
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: James writes a 3-page letter to 2 different friends twice a week.  How many pages does he write a year? | logprobs length: 8 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) When I first started doing it,
Processed prompts: 100%|██████████| 4/4 [00:00<00:00, 27.60it/s, est. speed input: 718.89 toks/s, output: 221.16 toks/s]
Adding requests: 100%|██████████| 1/1 [00:00<00:00, 1299.75it/s]
Processed prompts:   0%|          | 0/4 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Traceback (most recent call last):
  File "/home/ray/default/rl-gpu-objects/rdt-vllm-simple/grpo_vllm_fsdp_gpu_objects.py", line 183, in <module>
    train(total_steps=args.steps)
  File "/home/ray/default/rl-gpu-objects/rdt-vllm-simple/grpo_vllm_fsdp_gpu_objects.py", line 148, in train
    for step_result in ray.get(step_results):
                       ^^^^^^^^^^^^^^^^^^^^^
  File "/home/ray/anaconda3/lib/python3.11/site-packages/ray/_private/auto_init_hook.py", line 22, in auto_init_wrapper
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/ray/anaconda3/lib/python3.11/site-packages/ray/_private/client_mode_hook.py", line 104, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/ray/anaconda3/lib/python3.11/site-packages/ray/_private/worker.py", line 2961, in get
    values, debugger_breakpoint = worker.get_objects(
                                  ^^^^^^^^^^^^^^^^^^^
  File "/home/ray/anaconda3/lib/python3.11/site-packages/ray/_private/worker.py", line 979, in get_objects
    raise TypeError(
TypeError: Attempting to call `get` on the value [ObjectRef(bfee388c946eff69262805abcd9dc8e32e5a7732cc00000001000000), ObjectRef(acdfe3432deaeeb41df8d0b2dfbaa3ef1190ee9ccc00000001000000), ObjectRef(9814c42b514004898315578b1be1b48d31bbce05cc00000001000000), ObjectRef(e7fae04f55df46ab02ebf08fc984c423a24fe093cc00000001000000)], which is not an ray.ObjectRef.
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: Mark has a garden with flowers. He planted plants of three different colors in it. Ten of them are yellow, and there are 80% more of those in purple. There are only 25% as many green flowers as there are yellow and purple flowers. How many flowers does Mark have in his garden? | logprobs length: 1 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: Mark has a garden with flowers. He planted plants of three different colors in it. Ten of them are yellow, and there are 80% more of those in purple. There are only 25% as many green flowers as there are yellow and purple flowers. How many flowers does Mark have in his garden? | logprobs length: 8 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) 
(GeneratorCore pid=70828, ip=10.0.49.144) He plants two yellow flowers and
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: Mark has a garden with flowers. He planted plants of three different colors in it. Ten of them are yellow, and there are 80% more of those in purple. There are only 25% as many green flowers as there are yellow and purple flowers. How many flowers does Mark have in his garden? | logprobs length: 8 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) 
(GeneratorCore pid=70828, ip=10.0.49.144) 3
(GeneratorCore pid=70828, ip=10.0.49.144) 
(GeneratorCore pid=70828, ip=10.0.49.144) 5
(GeneratorCore pid=70828, ip=10.0.49.144) 
(GeneratorCore pid=70828, ip=10.0.49.144) 
(GeneratorCore pid=70828, ip=10.0.49.144) prompt: Mark has a garden with flowers. He planted plants of three different colors in it. Ten of them are yellow, and there are 80% more of those in purple. There are only 25% as many green flowers as there are yellow and purple flowers. How many flowers does Mark have in his garden? | logprobs length: 8 | response: 
(GeneratorCore pid=70828, ip=10.0.49.144) 
(GeneratorCore pid=70828, ip=10.0.49.144) To find the answer, we
Processed prompts: 100%|██████████| 4/4 [00:00<00:00, 23.48it/s, est. speed input: 1457.85 toks/s, output: 146.95 toks/s]