Skip to content

Instantly share code, notes, and snippets.

@zwpaper
Last active July 16, 2026 07:57
Show Gist options
  • Select an option

  • Save zwpaper/5cdf4f425f5d86d3e15df9cb4b00e62b to your computer and use it in GitHub Desktop.

Select an option

Save zwpaper/5cdf4f425f5d86d3e15df9cb4b00e62b to your computer and use it in GitHub Desktop.
Trajectory Analysis

Trajectory Analysis

This document contains an analysis of trajectory files that spent a significant amount of time executing but had very few steps. The goal was to determine why they took so long and whether this behavior is reasonable.

Task Link: https://app.getpochi.com/share/p-06ca57cc18f24666b0e2ec6999d4a55e

Findings

  1. Why it spends so much time: In many of these cases, the model spent nearly 10 minutes generating a massive block of text or reasoning (often tens of thousands of characters in a single step).
  2. Is it reasonable: For the trajectories where the model generated 20k+ to 90k+ characters in a single step and took ~10 minutes, no, it is not reasonable. The model likely got stuck in a generation loop, was overthinking, or hallucinating excessively long text. For the few trajectories that completed quickly with normal text lengths (e.g., pocketbase_go_migration_create_c__fCeU5X3), the time spent was reasonable.

Detailed Analysis Table

Started At TrajectoryPath Model Why it spend so much time Is it reasonable?
2026-07-03 06:31:55 godot_multiplayer_synchronizer_l glm-5.2 Generated 63843 chars in a single step, duration: 592.1s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-04-29 22:47:55 trpc_async_generator_countdown_s deepseek-ai/deepseek-4-pro Generated 100 chars in a single step, duration: Unknown No, it timed out or got stuck for ~10 minutes with few steps.
2026-04-29 22:47:00 trpc_migrate_v10_to_v11 deepseek-ai/deepseek-4-pro Generated 100 chars in a single step, duration: Unknown No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-15 08:27:50 pocketbase_go_migration_create_c deepseek-4-pro Generated 147 chars in a single step, duration: 65.7s Yes, time was spent reasoning and generating a moderately sized response.
2026-04-29 23:18:15 trpc_v11_sse_subscription deepseek-ai/deepseek-4-pro Generated 96 chars in a single step, duration: Unknown Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 08:17:07 godot_navigation_agent_2d_dynami glm-5.2 Generated 35883 chars in a single step, duration: 587.1s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-06-13 17:05:42 arktype_discriminated_union_morp deepseek-4-pro Generated 111 chars in a single step, duration: 78.8s Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 05:54:19 libgdx_i18n_bundle_localization glm-5.2 Generated 34804 chars in a single step, duration: 592.6s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 06:21:38 libgdx_pooled_projectile_simulat glm-5.2 Generated 36566 chars in a single step, duration: 586.7s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-06-15 10:20:40 bytewax_real_time_apdex_score deepseek-4-pro Generated 918 chars in a single step, duration: 604.7s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:59:08 godot_gridmap_meshlibrary_builde glm-5.2 Generated 12054 chars in a single step, duration: 579.3s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:04:02 libgdx_shape_overlap_collision_r glm-5.2 Generated 39511 chars in a single step, duration: 564.4s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-06-15 08:27:50 pocketbase_signup_rate_limiting deepseek-4-pro Generated 110 chars in a single step, duration: 704.8s No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-15 16:08:37 pocketbase_fix_breaking_hook_api deepseek-4-pro Generated 451 chars in a single step, duration: 210.4s Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 06:33:16 pocketbase_multi_tenant_organiza glm-5.2 Generated 50953 chars in a single step, duration: 555.9s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 07:43:19 altair_seattle_weather_layered glm-5.2 Generated 20601 chars in a single step, duration: 591.2s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 07:20:15 godot_dialog_branching_system glm-5.2 Generated 36630 chars in a single step, duration: 590.4s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 07:55:39 librosa_onset_midi_quantizer glm-5.2 Generated 6246 chars in a single step, duration: 593.4s No, it timed out or got stuck for ~10 minutes with few steps.
2026-04-29 22:36:14 trpc_sse_subscription_link_setup deepseek-ai/deepseek-4-pro Generated 120 chars in a single step, duration: Unknown No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 05:57:35 godot_viewport_render_target_cam glm-5.2 Generated 93907 chars in a single step, duration: 589.6s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 05:39:59 libgdx_interpolation_curve_sampl glm-5.2 Generated 19001 chars in a single step, duration: 620.8s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 06:36:29 libgdx_intersector_polygon_clip glm-5.2 Generated 27185 chars in a single step, duration: 589.3s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 07:58:41 librosa_novelty_segmenter glm-5.2 Generated 4805 chars in a single step, duration: 590.6s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:47:16 libgdx_scripted_input_replay_hea glm-5.2 Generated 23118 chars in a single step, duration: 580.2s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 06:10:11 libgdx_turn_based_command_loop_h glm-5.2 Generated 44025 chars in a single step, duration: 593.4s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 05:43:03 librosa_subsegment_hierarchy glm-5.2 Generated 22610 chars in a single step, duration: 591.9s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 07:55:20 prisma_schema_drift_resolution glm-5.2 Generated 9137 chars in a single step, duration: 592.0s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:08:37 librosa_reassigned_spectrogram_p glm-5.2 Generated 5736 chars in a single step, duration: 578.9s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-10 01:40:23 bytewax_stateful_recovery_pipeli glm-5.2 Generated 38218 chars in a single step, duration: 583.0s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 06:24:15 trpc_hello_world_api_setup glm-5.2 Generated 544 chars in a single step (Total: 544 chars), duration: 593.3s No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-15 16:14:36 project_membership_access_rules deepseek-4-pro Generated 1034 chars in a single step (Total: 1034 chars), duration: 417.8s Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 07:09:00 godot_save_load_resource_seriali glm-5.2 Generated 19571 chars in a single step (Total: 19571 chars), duration: 590.4s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 08:06:50 pocketbase_rate_limited_signup_r glm-5.2 Generated 23994 chars in a single step (Total: 23994 chars), duration: 585.9s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 08:13:57 apideck_upload_file_curl_with_me glm-5.2 Generated 7615 chars in a single step (Total: 7615 chars), duration: 590.6s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 05:58:53 libgdx_scene2d_stage_action_repl glm-5.2 Generated 65228 chars in a single step (Total: 65228 chars), duration: 590.6s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-06-16 06:29:49 apideck_upload_file_curl_with_me deepseek-4-pro Generated 395 chars in a single step (Total: 395 chars), duration: 547.4s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:32:01 bytewax_robust_checkpointing_rec glm-5.2 Generated 15162 chars in a single step (Total: 15162 chars), duration: 592.6s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 06:18:26 godot_tilemap_procedural_dungeon glm-5.2 Generated 27607 chars in a single step (Total: 27607 chars), duration: 588.1s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-06-09 06:09:49 rwsdk_custom_404_error_response deepseek-4-pro Generated 453 chars in a single step (Total: 453 chars), duration: Unknown Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 05:44:28 libgdx_deterministic_tick_simula glm-5.2 Generated 6769 chars in a single step (Total: 6769 chars), duration: 594.1s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-10 01:40:23 convex_rust_sdk_mutation glm-5.2 Generated 5354 chars in a single step (Total: 5354 chars), duration: 131.3s Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 05:54:19 godot_animation_tree_blend_locom glm-5.2 Generated 54169 chars in a single step (Total: 54169 chars), duration: 591.8s No, the model spent nearly 10 minutes generating a massive block of text/reasoning, likely overthinking or hallucinating.
2026-07-03 06:31:55 librosa_griffin_lim_resynthesize glm-5.2 Generated 10050 chars in a single step (Total: 10050 chars), duration: 592.4s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:53:41 arktype_submodule_namespace_scop glm-5.2 Generated 14130 chars in a single step (Total: 14130 chars), duration: 587.8s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 05:39:59 trpc_v11_nextjs_app_router_rsc glm-5.2 Generated 7294 chars in a single step (Total: 7294 chars), duration: 612.4s No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-15 13:24:21 bytewax_stateful_recovery_pipeli deepseek-4-pro Generated 1303 chars in a single step (Total: 1303 chars), duration: 599.0s No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-13 18:40:51 librosa_griffin_lim_resynthesize gemini-3.1-pro Generated 1563 chars in a single step (Total: 1563 chars), duration: 582.7s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:23:46 arktype_recursive_directory_tree glm-5.2 Generated 11185 chars in a single step (Total: 11185 chars), duration: 592.1s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 06:04:59 trpc_v11_nextjs_app_router_setup glm-5.2 Generated 1256 chars in a single step (Total: 1256 chars), duration: 594.8s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:15:04 tigris_snapshot_inventory_aggreg glm-5.2 Generated 5157 chars in a single step (Total: 5157 chars), duration: 588.3s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 03:31:11 trpc_v11_nextjs_app_router_setup gemini-3.5-flash Generated 1105 chars in a single step (Total: 1105 chars), duration: 594.1s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:27:16 llamacloud_auto_generate_extract glm-5.2 Generated 3475 chars in a single step (Total: 3475 chars), duration: 580.6s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-14 04:28:19 typesense_presets_and_stopwords glm-5.2 Generated 6350 chars in a single step (Total: 6350 chars), duration: 591.1s No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-13 18:16:48 librosa_hpss_multi_stem_mixer claude-4-6-sonnet Generated 798 chars in a single step (Total: 798 chars), duration: 612.4s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 08:08:34 tanstack_ecommerce_cart glm-5.2 Generated 352 chars in a single step (Total: 352 chars), duration: 548.0s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-12 16:06:32 langwatch_prompt-materialization deepseek-4-pro Generated 576 chars in a single step (Total: 675 chars), duration: 452.7s Yes, time was spent reasoning and generating a moderately sized response.
2026-06-15 04:15:48 pocketbase_realtime_filtered_sub deepseek-4-pro Generated 357 chars in a single step (Total: 357 chars), duration: 591.5s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 05:39:59 pocketbase_s3_direct_upload_pres glm-5.2 Generated 1320 chars in a single step (Total: 1320 chars), duration: 595.2s No, it timed out or got stuck for ~10 minutes with few steps.
2026-07-03 07:22:18 tigris_cli_sdk_interop_bucket_li glm-5.2 Generated 14532 chars in a single step (Total: 14532 chars), duration: 593.5s No, it timed out or got stuck for ~10 minutes with few steps.
2026-06-08 16:52:35 godot_animation_tree_blend_locom deepseek-4-pro Generated 422 chars in a single step (Total: 422 chars), duration: Unknown Yes, time was spent reasoning and generating a moderately sized response.
2026-07-03 06:40:33 trpc_async_generator_streaming glm-5.2 Generated 642 chars in a single step (Total: 642 chars), duration: 541.4s No, it timed out or got stuck for ~10 minutes with few steps.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment