Skip to content

Instantly share code, notes, and snippets.

@sshleifer
Last active September 14, 2026 20:24
Show Gist options
  • Select an option

  • Save sshleifer/f04f08087825a4e76643127d999b024e to your computer and use it in GitHub Desktop.

Select an option

Save sshleifer/f04f08087825a4e76643127d999b024e to your computer and use it in GitHub Desktop.
Dynamo vs SMG min_load: reproducible causal rolling benchmark, 27,322 requests, paired results

Dynamo and continuously rolling token-ID sessions

This benchmark compares real SMG manual/min_load routing with Dynamo KV routing and Dynamo KV routing with explicit session affinity. New SMG sessions choose a worker with the fewest active requests; later requests reuse that worker. It uses the public SMG implementation, not a Python approximation or a static hash.

The experiment uses the open Qwen3-8B model. It isolates routing behavior that matters for g36 rolling: client-prepared token IDs, grouped branches, growing contexts, actual generated token IDs appended to subsequent requests, a two-second completion-relative turn gap, and immediate replacement of completed sessions. It does not reproduce the private g36 model or its exact prompt distribution.

Results

Default Dynamo lost 23.0% and 22.5% throughput against real SMG load-aware stickiness. Session affinity restored cache locality, with throughput changes of -2.9% and -1.8%. Affinity did not beat SMG in either repeat. This public Qwen3-8B test reproduces the locality-loss pattern seen in the prior g36 study; it is not an executable copy of the private g36 workload.

Measured on 2026-09-14 with two GB300 GPUs, one BF16 Qwen3-8B TP1 worker per GPU, Dynamo 1.4.2, SGLang 0.5.16, and SMG 1.7.0. A runs SMG → KV → affinity; B reverses that order. Each trial runs for 180 seconds and scores backend output tokens during seconds 30–150.

Routing Output tokens/s A Output tokens/s B Change vs SMG A / B
SMG manual/min_load 7,129 7,068 +0.0% / +0.0%
Dynamo KV 5,488 5,478 -23.0% / -22.5%
Dynamo KV + affinity 6,920 6,940 -2.9% / -1.8%
Routing Backend cache reuse A / B Worker moves / successive turns A ; B Uncached prefill tokens per output token A / B
SMG manual/min_load 82.5% / 82.6% 0/4,312 ; 0/4,267 4.36 / 4.34
Dynamo KV 54.2% / 54.0% 1,485/3,324 ; 1,413/3,344 11.39 / 11.51
Dynamo KV + affinity 82.7% / 82.6% 0/4,194 ; 0/4,227 4.35 / 4.44

All 27,322 requests / 6,994,432 generated tokens completed with no errors or cancellations. Independent checks matched backend/client request counts, input-token counts, and completed generation-token counts exactly; Dynamo trace cardinality also matched every completed session. All sticky trials had zero worker moves. Dynamo's warm-cache/flush gates passed before every trial.

The mechanism is visible in the counters: default routing moves growing contexts between workers and performs more uncached prefill work per output token. This configuration has no KV transfer between workers. Explicit affinity preserves the context's worker, restoring the locality the SMG baseline already provides. Inputs are token IDs, so there is no prompt-tokenization work for the Dynamo frontend to accelerate.

The earlier preempted diagnostic attempt is excluded. These six trials ran on one uninterrupted allocation; the container and its worker processes were verified inside that allocation's cgroup, and the job completed with zero restarts. Two repeats do not establish a confidence interval or rule out improvements from other Dynamo configurations or features.

results.json contains all six trials; metrics.json contains the sampled backend counters; requests.csv contains every completed request with worker placement, timing, counts, and token hashes. probes.json, validation.json, and provenance.json contain the protocol/cache checks, independent audits, settings, runtime versions, and hashes of the measured source. All six Python files were downloaded anonymously from this gist, matched the active run's source byte for byte, and passed the CPU contract tests. The pinned runtime manifest was also fetched anonymously and its digest verified.

Reproduce

Use two GB300 GPUs with at least 280 GB per GPU for the default cache allocation. The measured host is ARM64. The pinned digest below is a multi-platform image index with ARM64 and AMD64 variants; Docker selects the host architecture. Results on other architectures should be reported separately. Startup downloads about 16 GB of public model weights. No private code, data, credentials, or patched server is needed.

Clone this gist, change into its directory, then run:

git clone https://gist.github.com/f04f08087825a4e76643127d999b024e.git dynamo-rolling
cd dynamo-rolling
mkdir -p work
docker run --rm -it --gpus all --network host --ipc host \
  -v "$PWD:/bench" -w /bench --entrypoint bash \
  nvcr.io/nvidia/ai-dynamo/sglang-runtime@sha256:3692c0c6a1ae23045f48384a09b539dcb9347ffa66ead5d0426aa90e85865012

# Inside the container:
python3 -m venv work/smg-env
work/smg-env/bin/python -m pip install -r smg-requirements.txt
python3 check_smg.py --python "$PWD/work/smg-env/bin/python" --output work/check-smg
python3 check_rolling.py --output work/check-rolling
python3 rolling_bench.py prepare --work work
python3 rolling_bench.py run --work work --name rolling \
  --smg-python "$PWD/work/smg-env/bin/python"
python3 summarize.py --root work/rolling --output work/shareable

run starts two SGLang workers, two Dynamo sidecars, a public KV event relay, and each gateway in sequence. It stops its child processes on exit. Run one copy at a time on a dedicated host: it uses HTTP 28000–28001 and 31000–31001, gRPC 32000–32001, and event ports 30000–30001. The CPU SMG fixture also uses 29010–29011. Output directories must be new.

The default run performs six 180-second trials in forward then reverse arm order, plus startup, probes, and bounded drain. Each trial scores the 120 seconds between time 30 and time 150. There are 256 active session slots, eight branches per group, twelve turns per session, 256 generated tokens per request, an eleven-second initial ramp, and a two-second gap after each completed request. The initial slots start at different turn depths. Later sessions start at turn zero.

Prompts use a deterministic pool of non-special tokens that individually decode to nonempty ASCII. The client loads the pinned tokenizer before serving begins. Sibling branches share a 512-token prefix; each branch then receives a distinct marker. Target context lengths grow quadratically from 1,024 to 16,384 tokens. Actual generated token IDs are inserted before each next-turn top-up. Outputs use greedy decoding with EOS disabled to fix request work. This synthetic shape is a routing mechanism test; it has no language-quality score.

Both workers use TP1, BF16, 1,048,576 KV token slots, 64 maximum running requests, 8,192-token prefill chunks, 16-token cache pages, and a 256-token stream interval. Every arm shares these engines and backend event publishing. This comparison does not measure the additional deployment cost of enabling event publishing on an otherwise event-free SGLang installation.

Routing and correctness

  • SMG 1.7.0: --policy manual --assignment-mode min_load, with X-SMG-Routing-Key held constant per session. The CPU fixture holds one worker busy, checks that a new session chooses the idle worker, then verifies that the old session stays on its busy worker.
  • Dynamo 1.4.2 KV: --router-mode kv --router-kv-events, with a stable X-Dynamo-Session-ID but no affinity setting.
  • Dynamo 1.4.2 sticky: the same configuration plus --router-session-affinity-ttl-secs 3600.

SMG receives native /generate requests containing token IDs in a one-element batch. Dynamo receives /v1/completions requests containing token IDs and requests nvext.completion_token_ids. Both transports recover and validate every generated token ID. Before each trial, the routed greedy output must match direct SGLang exactly. Dynamo must also observe a prefix warmed directly on worker 1, then report zero overlap after a backend cache flush. The public KvEventPublisher relay binds each SGLang event stream to its sidecar's discovered worker ID. It implements live event forwarding; failover and snapshot recovery are outside this test.

The CPU rolling fixture checks the actual request bodies on both transports: each later prompt begins with the previous prompt plus the returned generated IDs. It also checks refill, mismatched output-count rejection, and that prefill counters are excluded from output throughput. Per-request routing traces must cover completed requests, and sticky sessions must have zero worker changes.

Measurement definitions and limits

Output tokens/s is the sum of the two workers' sglang:realtime_tokens_total{mode="decode"} counter deltas divided by each worker's measured snapshot interval. This includes tokens from requests still running at the interval boundary. Startup, the first thirty seconds, and the final thirty seconds are excluded from scoring. No arrival schedule is replayed independently of response completion. The realtime and completed-generation counters are distinct: their full-trial totals differed by at most 55 tokens in these runs; both totals are published in validation.json. Exact client parity is checked against the completed-generation counter.

Backend cache reuse is 1 - uncached_prompt_tokens_histogram_sum / prompt_tokens_histogram_sum, using counter deltas in the same interior window. These histograms describe completed requests and can span a window boundary; they are diagnostic, not the throughput numerator. Queue depth, running requests, active KV fraction (sglang:token_usage), and free/evictable KV slot counts are sampled every two seconds. mean_kv_utilization reports the active fraction, not total cache residency. Worker movement is counted between successive completed requests of the same session. Requests still pending after the thirty-second drain deadline are explicitly cancelled and recorded; unexpected request errors abort the experiment.

Two reverse-order repeats do not provide a confidence interval. This test covers one model and a fixed two-worker topology on one host. It does not test cross-host communication, disaggregated prefill/decode, KV transfer or offload, autoscaling, fault recovery, multimodal input, or model weight updates. A result here cannot establish a universal Dynamo speedup or slowdown.

Relation to g36 rolling

The existing g36 reference already uses load-aware initial placement followed by strict stickiness. Its SMG gateway selects manual policy with assignment_mode=min_load. The public SMG 1.7.0 manual policy implementation supplies that behavior in this benchmark, and the included busy-worker fixture tests it directly.

In the prior g36 study, each comparison shared two GB300 nodes, one TP4 g36 engine per node, across routers. At 3,072 active rolling sessions, default Dynamo KV routing reduced output token throughput by 28.1% and 29.3% in paired repeats. Backend cache reuse fell from about 75% to about 51–52%. Adding a 3,600-second affinity TTL restored roughly 75% cache reuse and zero worker moves; throughput changes versus the native reference were −1.9% and −0.1%. Those are prior private-model measurements, not new Qwen measurements or an executable g36 reproduction in this gist.

This public workload preserves the routing policy, causal context appends, grouped branches, completion-relative two-second gap, refill behavior, 256-token stream interval, and a 2:1 ratio of active session slots to backend running-request capacity. It substitutes a public 8B model, TP1 workers on one host, synthetic prompt lengths, greedy fixed-length outputs, and a smaller absolute workload. The results therefore test the locality mechanism; they do not establish numerical parity with g36 or prove that no other Dynamo feature or configuration can improve it.

Prior static-hash pilot

The earlier finite Weka replay used static-hash stickiness. Its measured gains were real for that baseline but did not establish an improvement over the g36 reference, which already uses load-aware initial placement. Keep those results as a separate pilot; do not substitute them for this comparison.

License

Apache-2.0 for this harness; see LICENSE.txt. Model and runtime dependencies retain their own licenses.

"""CPU contract test: causal rolling, refill, strict token counts, mode-filtered metrics."""
import argparse
import asyncio
from pathlib import Path
from types import SimpleNamespace
import aiohttp
import rolling_bench as rb
from aiohttp import web
from stream_client import generate
async def check(output):
app = web.Application()
prior = {}
calls = 0
worker_tokens = [0, 0]
worker_prompts = [0, 0]
checks = 0
async def handle(request):
nonlocal calls, checks
p = await request.json()
sid = request.headers["X-SMG-Routing-Key"]
assert sid == request.headers["X-Dynamo-Session-ID"]
native = request.path == "/generate"
ids = p["input_ids"][0] if native else p["prompt"]
if sid in prior:
previous_input, previous_output = prior[sid]
assert (
ids[: len(previous_input) + len(previous_output)]
== previous_input + previous_output
)
checks += 1
generated = [999, 998]
prior[sid] = (ids, generated)
calls += 1
worker_tokens[calls % 2] += 2
worker_prompts[calls % 2] += len(ids)
await asyncio.sleep(0.001)
if native:
chunk = {
"meta_info": {
"output_token_logprobs": [[0, t, None] for t in generated],
"prompt_tokens": len(ids),
"completion_tokens": 2,
"cached_tokens": 0,
}
}
else:
chunk = {
"nvext": {"completion_token_ids": generated},
"usage": {"prompt_tokens": len(ids), "completion_tokens": 2},
}
body = b"data: " + rb.orjson.dumps(chunk) + b"\n\ndata: [DONE]\n\n"
return web.Response(body=body, content_type="text/event-stream")
async def metrics(request):
worker = int(request.match_info["worker"])
tokens = worker_tokens[worker]
prompt_tokens = worker_prompts[worker]
return web.Response(
text=f"""sglang:realtime_tokens_total{{mode="decode",model="fixture"}} {tokens}
sglang:realtime_tokens_total{{mode="prefill",model="fixture"}} {tokens * 10000}
sglang:prompt_tokens_histogram_sum {prompt_tokens}
sglang:uncached_prompt_tokens_histogram_sum {prompt_tokens}
sglang:num_running_reqs 1
sglang:num_queue_reqs 0
sglang:token_usage 0.1
sglang:generation_tokens_total {tokens}
"""
)
app.router.add_post("/generate", handle)
app.router.add_post("/v1/completions", handle)
app.router.add_get("/worker{worker}/metrics", metrics)
runner = web.AppRunner(app)
await runner.setup()
await web.TCPSite(runner, "127.0.0.1", 28000).start()
args = SimpleNamespace(
duration=0.5,
warmup=0.1,
drain=0.1,
ramp=0,
concurrency=2,
turns=3,
context=2048,
output=2,
gap=0.005,
group_size=2,
)
try:
for arm in ("smg_sticky", "dynamo_kv"):
prior.clear()
case = output / arm
case.mkdir(parents=True)
result = await rb.rolling(
args,
arm,
case,
[f"http://127.0.0.1:28000/worker{i}" for i in range(2)],
rb.Workload(list(range(100, 200)), args),
)
assert result["out_tok_s"] < 100000
assert len(prior) > args.concurrency
async with aiohttp.ClientSession() as client:
try:
await generate(client, "dynamo_kv", "negative-count", 0, [100], 3)
except ValueError as error:
assert "output length" in str(error)
else:
raise AssertionError("Missing output count validation")
assert checks > 10
rb.rt.save(
output / "checks.json",
{
"causal_wire_checks": checks,
"refill": True,
"both_transports": True,
"count_mismatch_rejected": True,
"decode_mode_only": True,
},
)
finally:
await runner.cleanup()
print("ROLLING_CONTRACT_PASSED", calls, checks)
if __name__ == "__main__":
p = argparse.ArgumentParser()
p.add_argument("--output", type=Path, required=True)
asyncio.run(check(p.parse_args().output))
#!/usr/bin/env python3
"""Verify released SMG's token-ID forwarding, first placement, and session affinity."""
import argparse
import concurrent.futures
import contextlib
import json
import threading
from http.server import BaseHTTPRequestHandler, ThreadingHTTPServer
from pathlib import Path
import serve_runtime as bench
def check(python: str, output: Path) -> None:
output.mkdir(exist_ok=False, parents=True)
held = threading.Event()
release = threading.Event()
observed = []
def handler(worker):
class Handler(BaseHTTPRequestHandler):
def log_message(self, *_):
pass
def reply(self, obj):
body = json.dumps(obj).encode()
self.send_response(200)
self.send_header("Content-Type", "application/json")
self.send_header("Content-Length", str(len(body)))
self.end_headers()
self.wfile.write(body)
def do_GET(self):
if self.path == "/v1/models":
self.reply({"object": "list", "data": [{"id": "fixture", "object": "model"}]})
else:
self.reply(
{"model_path": "fixture", "is_generation": True, "context_length": 32768}
)
def do_POST(self):
body = json.loads(self.rfile.read(int(self.headers["Content-Length"])))
ids = body["input_ids"]
key = self.headers.get("X-SMG-Routing-Key")
observed.append({"worker": worker, "key": key, "input_ids": ids})
if ids == [3, 4]:
held.set()
if not release.wait(20):
raise TimeoutError("Fixture hold was not released")
self.reply({"worker": worker, "input_ids": ids})
return Handler
with contextlib.ExitStack() as stack:
workers = []
for index in range(2):
server = ThreadingHTTPServer(("127.0.0.1", 0), handler(index))
thread = threading.Thread(target=server.serve_forever, daemon=True)
thread.start()
stack.callback(server.server_close)
stack.callback(server.shutdown)
workers.append(f"http://127.0.0.1:{server.server_port}")
command = [
python,
"-m",
"smg.launch_router",
"--host",
"127.0.0.1",
"--port",
"29010",
"--worker-urls",
*workers,
"--policy",
"manual",
"--assignment-mode",
"min_load",
"--disable-tokenizer-autoload",
"--disable-health-check",
"--log-json",
"--log-level",
"debug",
"--prometheus-port",
"29011",
]
import os
router = stack.enter_context(
bench.process(
command,
output / "smg.log",
os.environ | {"RUST_LOG": "info,smg::observability::events=debug"},
)
)
bench.ready("http://127.0.0.1:29010/health", [router])
bench.wait_smg_workers(
"http://127.0.0.1:29010", workers, [router], output / "registered_workers.json"
)
def send(key, ids):
return bench.request(
"http://127.0.0.1:29010/generate",
{"input_ids": ids, "sampling_params": {"max_new_tokens": 1}, "stream": False},
headers={"X-SMG-Routing-Key": key, "X-Request-ID": f"fixture-{key}-{ids[0]}"},
)
first = send("anchor", [1, 2])
with concurrent.futures.ThreadPoolExecutor(1) as pool:
future = pool.submit(send, "anchor", [3, 4])
try:
if not held.wait(10):
raise TimeoutError("SMG did not send the held request")
other = send("new", [5, 6])
sticky = send("anchor", [7, 8])
if other["worker"] == first["worker"]:
raise ValueError("New key did not choose the idle worker")
if sticky["worker"] != first["worker"]:
raise ValueError("Existing key moved away from its busy worker")
finally:
release.set()
held_result = future.result(timeout=10)
expected = ([1, 2], [3, 4], [5, 6], [7, 8])
if sorted(r["input_ids"] for r in observed) != sorted(expected):
raise ValueError("Gateway changed token-ID payloads")
bench.save(
output / "checks.json",
{
"min_load_first_assignment": True,
"sticky_while_busy": True,
"token_ids_unchanged": True,
"first": first,
"new_key": other,
"sticky": sticky,
"held": held_result,
"observed": observed,
},
)
print("SMG_CONTRACT_PASSED", flush=True)
if __name__ == "__main__":
parser = argparse.ArgumentParser(description=__doc__)
parser.add_argument("--python", required=True)
parser.add_argument("--output", type=Path, required=True)
args = parser.parse_args()
check(args.python, args.output)
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
1. Definitions.
"License" shall mean the terms and conditions for use, reproduction,
and distribution as defined by Sections 1 through 9 of this document.
"Licensor" shall mean the copyright owner or entity authorized by
the copyright owner that is granting the License.
"Legal Entity" shall mean the union of the acting entity and all
other entities that control, are controlled by, or are under common
control with that entity. For the purposes of this definition,
"control" means (i) the power, direct or indirect, to cause the
direction or management of such entity, whether by contract or
otherwise, or (ii) ownership of fifty percent (50%) or more of the
outstanding shares, or (iii) beneficial ownership of such entity.
"You" (or "Your") shall mean an individual or Legal Entity
exercising permissions granted by this License.
"Source" form shall mean the preferred form for making modifications,
including but not limited to software source code, documentation
source, and configuration files.
"Object" form shall mean any form resulting from mechanical
transformation or translation of a Source form, including but
not limited to compiled object code, generated documentation,
and conversions to other media types.
"Work" shall mean the work of authorship, whether in Source or
Object form, made available under the License, as indicated by a
copyright notice that is included in or attached to the work
(an example is provided in the Appendix below).
"Derivative Works" shall mean any work, whether in Source or Object
form, that is based on (or derived from) the Work and for which the
editorial revisions, annotations, elaborations, or other modifications
represent, as a whole, an original work of authorship. For the purposes
of this License, Derivative Works shall not include works that remain
separable from, or merely link (or bind by name) to the interfaces of,
the Work and Derivative Works thereof.
"Contribution" shall mean any work of authorship, including
the original version of the Work and any modifications or additions
to that Work or Derivative Works thereof, that is intentionally
submitted to Licensor for inclusion in the Work by the copyright owner
or by an individual or Legal Entity authorized to submit on behalf of
the copyright owner. For the purposes of this definition, "submitted"
means any form of electronic, verbal, or written communication sent
to the Licensor or its representatives, including but not limited to
communication on electronic mailing lists, source code control systems,
and issue tracking systems that are managed by, or on behalf of, the
Licensor for the purpose of discussing and improving the Work, but
excluding communication that is conspicuously marked or otherwise
designated in writing by the copyright owner as "Not a Contribution."
"Contributor" shall mean Licensor and any individual or Legal Entity
on behalf of whom a Contribution has been received by Licensor and
subsequently incorporated within the Work.
2. Grant of Copyright License. Subject to the terms and conditions of
this License, each Contributor hereby grants to You a perpetual,
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
copyright license to reproduce, prepare Derivative Works of,
publicly display, publicly perform, sublicense, and distribute the
Work and such Derivative Works in Source or Object form.
3. Grant of Patent License. Subject to the terms and conditions of
this License, each Contributor hereby grants to You a perpetual,
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
(except as stated in this section) patent license to make, have made,
use, offer to sell, sell, import, and otherwise transfer the Work,
where such license applies only to those patent claims licensable
by such Contributor that are necessarily infringed by their
Contribution(s) alone or by combination of their Contribution(s)
with the Work to which such Contribution(s) was submitted. If You
institute patent litigation against any entity (including a
cross-claim or counterclaim in a lawsuit) alleging that the Work
or a Contribution incorporated within the Work constitutes direct
or contributory patent infringement, then any patent licenses
granted to You under this License for that Work shall terminate
as of the date such litigation is filed.
4. Redistribution. You may reproduce and distribute copies of the
Work or Derivative Works thereof in any medium, with or without
modifications, and in Source or Object form, provided that You
meet the following conditions:
(a) You must give any other recipients of the Work or
Derivative Works a copy of this License; and
(b) You must cause any modified files to carry prominent notices
stating that You changed the files; and
(c) You must retain, in the Source form of any Derivative Works
that You distribute, all copyright, patent, trademark, and
attribution notices from the Source form of the Work,
excluding those notices that do not pertain to any part of
the Derivative Works; and
(d) If the Work includes a "NOTICE" text file as part of its
distribution, then any Derivative Works that You distribute must
include a readable copy of the attribution notices contained
within such NOTICE file, excluding those notices that do not
pertain to any part of the Derivative Works, in at least one
of the following places: within a NOTICE text file distributed
as part of the Derivative Works; within the Source form or
documentation, if provided along with the Derivative Works; or,
within a display generated by the Derivative Works, if and
wherever such third-party notices normally appear. The contents
of the NOTICE file are for informational purposes only and
do not modify the License. You may add Your own attribution
notices within Derivative Works that You distribute, alongside
or as an addendum to the NOTICE text from the Work, provided
that such additional attribution notices cannot be construed
as modifying the License.
You may add Your own copyright statement to Your modifications and
may provide additional or different license terms and conditions
for use, reproduction, or distribution of Your modifications, or
for any such Derivative Works as a whole, provided Your use,
reproduction, and distribution of the Work otherwise complies with
the conditions stated in this License.
5. Submission of Contributions. Unless You explicitly state otherwise,
any Contribution intentionally submitted for inclusion in the Work
by You to the Licensor shall be under the terms and conditions of
this License, without any additional terms or conditions.
Notwithstanding the above, nothing herein shall supersede or modify
the terms of any separate license agreement you may have executed
with Licensor regarding such Contributions.
6. Trademarks. This License does not grant permission to use the trade
names, trademarks, service marks, or product names of the Licensor,
except as required for reasonable and customary use in describing the
origin of the Work and reproducing the content of the NOTICE file.
7. Disclaimer of Warranty. Unless required by applicable law or
agreed to in writing, Licensor provides the Work (and each
Contributor provides its Contributions) on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied, including, without limitation, any warranties or conditions
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
PARTICULAR PURPOSE. You are solely responsible for determining the
appropriateness of using or redistributing the Work and assume any
risks associated with Your exercise of permissions under this License.
8. Limitation of Liability. In no event and under no legal theory,
whether in tort (including negligence), contract, or otherwise,
unless required by applicable law (such as deliberate and grossly
negligent acts) or agreed to in writing, shall any Contributor be
liable to You for damages, including any direct, indirect, special,
incidental, or consequential damages of any character arising as a
result of this License or out of the use or inability to use the
Work (including but not limited to damages for loss of goodwill,
work stoppage, computer failure or malfunction, or any and all
other commercial damages or losses), even if such Contributor
has been advised of the possibility of such damages.
9. Accepting Warranty or Additional Liability. While redistributing
the Work or Derivative Works thereof, You may choose to offer,
and charge a fee for, acceptance of support, warranty, indemnity,
or other liability obligations and/or rights consistent with this
License. However, in accepting such obligations, You may act only
on Your own behalf and on Your sole responsibility, not on behalf
of any other Contributor, and only if You agree to indemnify,
defend, and hold each Contributor harmless for any liability
incurred by, or claims asserted against, such Contributor by reason
of your accepting any such warranty or additional liability.
END OF TERMS AND CONDITIONS
APPENDIX: How to apply the Apache License to your work.
To apply the Apache License to your work, attach the following
boilerplate notice, with the fields enclosed by brackets "[]"
replaced with your own identifying information. (Don't include
the brackets!) The text should be enclosed in the appropriate
comment syntax for the file format. We also recommend that a
file or class name and description of purpose be included on the
same "printed page" as the copyright notice for easier
identification within third-party archives.
Copyright [yyyy] [name of copyright owner]
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{
"r0_smg_sticky": [
{
"label": "start",
"workers": [
{
"time": 0.006377430632710457,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1047536.0,
"sglang:kv_evictable_tokens": 1040.0,
"sglang:generation_tokens_total": 72.0,
"sglang:prompt_tokens_histogram_sum": 4102.0,
"sglang:prompt_tokens_histogram_count": 5.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2086.0,
"sglang:realtime_tokens_total/prefill_compute": 2144.0,
"sglang:realtime_tokens_total/decode": 75.0,
"sglang:realtime_tokens_total/prefill_cache": 2016.0,
"sglang:queue_time_seconds_sum": 0.002824178896844387,
"sglang:queue_time_seconds_count": 8.0
}
},
{
"time": 0.006884746253490448,
"metrics": {
"sglang:queue_time_seconds_sum": 0.001622919924557209,
"sglang:queue_time_seconds_count": 4.0,
"sglang:realtime_tokens_total/prefill_compute": 64.0,
"sglang:realtime_tokens_total/decode": 11.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1048576.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:prompt_tokens_histogram_sum": 6.0,
"sglang:prompt_tokens_histogram_count": 1.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6.0,
"sglang:generation_tokens_total": 8.0
}
}
]
},
{
"label": "score_start",
"workers": [
{
"time": 30.00728279352188,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2912.0,
"sglang:kv_evictable_tokens": 641088.0,
"sglang:generation_tokens_total": 66120.0,
"sglang:prompt_tokens_histogram_sum": 1632290.0,
"sglang:prompt_tokens_histogram_count": 263.0,
"sglang:uncached_prompt_tokens_histogram_sum": 918482.0,
"sglang:realtime_tokens_total/prefill_compute": 990944.0,
"sglang:realtime_tokens_total/decode": 78428.0,
"sglang:realtime_tokens_total/prefill_cache": 1046528.0,
"sglang:queue_time_seconds_sum": 914.504254180938,
"sglang:queue_time_seconds_count": 330.0
}
},
{
"time": 30.007836237549782,
"metrics": {
"sglang:queue_time_seconds_sum": 848.3945563808084,
"sglang:queue_time_seconds_count": 352.0,
"sglang:realtime_tokens_total/prefill_compute": 996016.0,
"sglang:realtime_tokens_total/decode": 79590.0,
"sglang:realtime_tokens_total/prefill_cache": 1134912.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4640.0,
"sglang:kv_evictable_tokens": 645072.0,
"sglang:prompt_tokens_histogram_sum": 1764557.0,
"sglang:prompt_tokens_histogram_count": 287.0,
"sglang:uncached_prompt_tokens_histogram_sum": 929197.0,
"sglang:generation_tokens_total": 73224.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 32.021446770988405,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 10.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 6464.0,
"sglang:kv_evictable_tokens": 631616.0,
"sglang:generation_tokens_total": 80200.0,
"sglang:prompt_tokens_histogram_sum": 1969932.0,
"sglang:prompt_tokens_histogram_count": 318.0,
"sglang:uncached_prompt_tokens_histogram_sum": 977868.0,
"sglang:realtime_tokens_total/prefill_compute": 1051424.0,
"sglang:realtime_tokens_total/decode": 83686.0,
"sglang:realtime_tokens_total/prefill_cache": 1335088.0,
"sglang:queue_time_seconds_sum": 1056.01658402849,
"sglang:queue_time_seconds_count": 383.0
}
},
{
"time": 32.025508891791105,
"metrics": {
"sglang:queue_time_seconds_sum": 931.5201855795458,
"sglang:queue_time_seconds_count": 382.0,
"sglang:realtime_tokens_total/prefill_compute": 1031232.0,
"sglang:realtime_tokens_total/decode": 86929.0,
"sglang:realtime_tokens_total/prefill_cache": 1306048.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 686960.0,
"sglang:prompt_tokens_histogram_sum": 1960428.0,
"sglang:prompt_tokens_histogram_count": 316.0,
"sglang:uncached_prompt_tokens_histogram_sum": 962332.0,
"sglang:generation_tokens_total": 80648.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 34.024281847290695,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 8848.0,
"sglang:kv_evictable_tokens": 639264.0,
"sglang:generation_tokens_total": 81992.0,
"sglang:prompt_tokens_histogram_sum": 2026733.0,
"sglang:prompt_tokens_histogram_count": 325.0,
"sglang:uncached_prompt_tokens_histogram_sum": 987693.0,
"sglang:realtime_tokens_total/prefill_compute": 1062208.0,
"sglang:realtime_tokens_total/decode": 92189.0,
"sglang:realtime_tokens_total/prefill_cache": 1379264.0,
"sglang:queue_time_seconds_sum": 1075.3815363729373,
"sglang:queue_time_seconds_count": 392.0
}
},
{
"time": 34.02369526773691,
"metrics": {
"sglang:queue_time_seconds_sum": 1015.9137450149283,
"sglang:queue_time_seconds_count": 410.0,
"sglang:realtime_tokens_total/prefill_compute": 1053232.0,
"sglang:realtime_tokens_total/decode": 94922.0,
"sglang:realtime_tokens_total/prefill_cache": 1396320.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 8816.0,
"sglang:kv_evictable_tokens": 692880.0,
"sglang:prompt_tokens_histogram_sum": 2100820.0,
"sglang:prompt_tokens_histogram_count": 343.0,
"sglang:uncached_prompt_tokens_histogram_sum": 989764.0,
"sglang:generation_tokens_total": 87560.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 36.02197618968785,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 5440.0,
"sglang:kv_evictable_tokens": 632400.0,
"sglang:generation_tokens_total": 88648.0,
"sglang:prompt_tokens_histogram_sum": 2182083.0,
"sglang:prompt_tokens_histogram_count": 351.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1015715.0,
"sglang:realtime_tokens_total/prefill_compute": 1090096.0,
"sglang:realtime_tokens_total/decode": 99395.0,
"sglang:realtime_tokens_total/prefill_cache": 1517120.0,
"sglang:queue_time_seconds_sum": 1142.7001753561199,
"sglang:queue_time_seconds_count": 418.0
}
},
{
"time": 36.021561787463725,
"metrics": {
"sglang:queue_time_seconds_sum": 1109.5949552617967,
"sglang:queue_time_seconds_count": 445.0,
"sglang:realtime_tokens_total/prefill_compute": 1097248.0,
"sglang:realtime_tokens_total/decode": 101640.0,
"sglang:realtime_tokens_total/prefill_cache": 1618240.0,
"sglang:num_running_reqs": 56.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 11056.0,
"sglang:kv_evictable_tokens": 675488.0,
"sglang:prompt_tokens_histogram_sum": 2335611.0,
"sglang:prompt_tokens_histogram_count": 379.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1029563.0,
"sglang:generation_tokens_total": 96776.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 38.02139465324581,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3776.0,
"sglang:kv_evictable_tokens": 629456.0,
"sglang:generation_tokens_total": 98376.0,
"sglang:prompt_tokens_histogram_sum": 2439603.0,
"sglang:prompt_tokens_histogram_count": 389.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1060339.0,
"sglang:realtime_tokens_total/prefill_compute": 1138128.0,
"sglang:realtime_tokens_total/decode": 105177.0,
"sglang:realtime_tokens_total/prefill_cache": 1735536.0,
"sglang:queue_time_seconds_sum": 1239.165750731714,
"sglang:queue_time_seconds_count": 456.0
}
},
{
"time": 38.02216537762433,
"metrics": {
"sglang:queue_time_seconds_sum": 1174.4071455998346,
"sglang:queue_time_seconds_count": 465.0,
"sglang:realtime_tokens_total/prefill_compute": 1108768.0,
"sglang:realtime_tokens_total/decode": 110390.0,
"sglang:realtime_tokens_total/prefill_cache": 1671808.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 8208.0,
"sglang:kv_evictable_tokens": 674752.0,
"sglang:prompt_tokens_histogram_sum": 2400651.0,
"sglang:prompt_tokens_histogram_count": 398.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1043307.0,
"sglang:generation_tokens_total": 101640.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 40.02113267034292,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 5248.0,
"sglang:kv_evictable_tokens": 636176.0,
"sglang:generation_tokens_total": 102472.0,
"sglang:prompt_tokens_histogram_sum": 2529115.0,
"sglang:prompt_tokens_histogram_count": 405.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1075595.0,
"sglang:realtime_tokens_total/prefill_compute": 1150272.0,
"sglang:realtime_tokens_total/decode": 112969.0,
"sglang:realtime_tokens_total/prefill_cache": 1798112.0,
"sglang:queue_time_seconds_sum": 1284.567910015583,
"sglang:queue_time_seconds_count": 472.0
}
},
{
"time": 40.023635709658265,
"metrics": {
"sglang:queue_time_seconds_sum": 1280.259652110748,
"sglang:queue_time_seconds_count": 508.0,
"sglang:realtime_tokens_total/prefill_compute": 1163952.0,
"sglang:realtime_tokens_total/decode": 116547.0,
"sglang:realtime_tokens_total/prefill_cache": 1932176.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 12384.0,
"sglang:kv_evictable_tokens": 669632.0,
"sglang:prompt_tokens_histogram_sum": 2713587.0,
"sglang:prompt_tokens_histogram_count": 442.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1095347.0,
"sglang:generation_tokens_total": 112904.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 42.021009809337556,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3056.0,
"sglang:kv_evictable_tokens": 640224.0,
"sglang:generation_tokens_total": 114760.0,
"sglang:prompt_tokens_histogram_sum": 2871510.0,
"sglang:prompt_tokens_histogram_count": 453.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1135974.0,
"sglang:realtime_tokens_total/prefill_compute": 1212800.0,
"sglang:realtime_tokens_total/decode": 118105.0,
"sglang:realtime_tokens_total/prefill_cache": 2082544.0,
"sglang:queue_time_seconds_sum": 1418.1725118150935,
"sglang:queue_time_seconds_count": 520.0
}
},
{
"time": 42.02674121968448,
"metrics": {
"sglang:queue_time_seconds_sum": 1313.474424507469,
"sglang:queue_time_seconds_count": 516.0,
"sglang:realtime_tokens_total/prefill_compute": 1163952.0,
"sglang:realtime_tokens_total/decode": 125863.0,
"sglang:realtime_tokens_total/prefill_cache": 1932176.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 69.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 3456.0,
"sglang:kv_evictable_tokens": 669632.0,
"sglang:prompt_tokens_histogram_sum": 2758972.0,
"sglang:prompt_tokens_histogram_count": 450.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1104012.0,
"sglang:generation_tokens_total": 114952.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 44.021445382386446,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1296.0,
"sglang:kv_evictable_tokens": 644496.0,
"sglang:generation_tokens_total": 115016.0,
"sglang:prompt_tokens_histogram_sum": 2882816.0,
"sglang:prompt_tokens_histogram_count": 454.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1137888.0,
"sglang:realtime_tokens_total/prefill_compute": 1213312.0,
"sglang:realtime_tokens_total/decode": 127192.0,
"sglang:realtime_tokens_total/prefill_cache": 2083056.0,
"sglang:queue_time_seconds_sum": 1421.1449968116358,
"sglang:queue_time_seconds_count": 521.0
}
},
{
"time": 44.02209260221571,
"metrics": {
"sglang:queue_time_seconds_sum": 1441.679727989249,
"sglang:queue_time_seconds_count": 566.0,
"sglang:realtime_tokens_total/prefill_compute": 1202032.0,
"sglang:realtime_tokens_total/decode": 132329.0,
"sglang:realtime_tokens_total/prefill_cache": 2128384.0,
"sglang:num_running_reqs": 38.0,
"sglang:num_queue_reqs": 18.0,
"sglang:token_usage": 0.26,
"sglang:kv_available_tokens": 10464.0,
"sglang:kv_evictable_tokens": 769024.0,
"sglang:prompt_tokens_histogram_sum": 3093954.0,
"sglang:prompt_tokens_histogram_count": 505.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1161778.0,
"sglang:generation_tokens_total": 129032.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 46.02127080783248,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 14.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1920.0,
"sglang:kv_evictable_tokens": 648576.0,
"sglang:generation_tokens_total": 127816.0,
"sglang:prompt_tokens_histogram_sum": 3211528.0,
"sglang:prompt_tokens_histogram_count": 504.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1194232.0,
"sglang:realtime_tokens_total/prefill_compute": 1271936.0,
"sglang:realtime_tokens_total/decode": 132518.0,
"sglang:realtime_tokens_total/prefill_cache": 2356672.0,
"sglang:queue_time_seconds_sum": 1559.3328305436298,
"sglang:queue_time_seconds_count": 571.0
}
},
{
"time": 46.02088923752308,
"metrics": {
"sglang:queue_time_seconds_sum": 1454.6747664362192,
"sglang:queue_time_seconds_count": 571.0,
"sglang:realtime_tokens_total/prefill_compute": 1226992.0,
"sglang:realtime_tokens_total/decode": 140330.0,
"sglang:realtime_tokens_total/prefill_cache": 2245712.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 70.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 6800.0,
"sglang:kv_evictable_tokens": 671776.0,
"sglang:prompt_tokens_histogram_sum": 3093954.0,
"sglang:prompt_tokens_histogram_count": 505.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1161778.0,
"sglang:generation_tokens_total": 129032.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 48.02179919928312,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 653024.0,
"sglang:generation_tokens_total": 131144.0,
"sglang:prompt_tokens_histogram_sum": 3292883.0,
"sglang:prompt_tokens_histogram_count": 517.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1210339.0,
"sglang:realtime_tokens_total/prefill_compute": 1284912.0,
"sglang:realtime_tokens_total/decode": 140825.0,
"sglang:realtime_tokens_total/prefill_cache": 2416848.0,
"sglang:queue_time_seconds_sum": 1588.518188576214,
"sglang:queue_time_seconds_count": 584.0
}
},
{
"time": 48.022651778534055,
"metrics": {
"sglang:queue_time_seconds_sum": 1569.1513135246933,
"sglang:queue_time_seconds_count": 610.0,
"sglang:realtime_tokens_total/prefill_compute": 1264400.0,
"sglang:realtime_tokens_total/decode": 147169.0,
"sglang:realtime_tokens_total/prefill_cache": 2427520.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2672.0,
"sglang:kv_evictable_tokens": 647104.0,
"sglang:prompt_tokens_histogram_sum": 3277496.0,
"sglang:prompt_tokens_histogram_count": 543.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1191576.0,
"sglang:generation_tokens_total": 138760.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 50.022525269538164,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6800.0,
"sglang:kv_evictable_tokens": 651040.0,
"sglang:generation_tokens_total": 137800.0,
"sglang:prompt_tokens_histogram_sum": 3443034.0,
"sglang:prompt_tokens_histogram_count": 543.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1237434.0,
"sglang:realtime_tokens_total/prefill_compute": 1310608.0,
"sglang:realtime_tokens_total/decode": 147967.0,
"sglang:realtime_tokens_total/prefill_cache": 2535840.0,
"sglang:queue_time_seconds_sum": 1657.7335695875809,
"sglang:queue_time_seconds_count": 610.0
}
},
{
"time": 50.02236474119127,
"metrics": {
"sglang:queue_time_seconds_sum": 1636.6701745567843,
"sglang:queue_time_seconds_count": 634.0,
"sglang:realtime_tokens_total/prefill_compute": 1297872.0,
"sglang:realtime_tokens_total/decode": 154348.0,
"sglang:realtime_tokens_total/prefill_cache": 2580624.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5296.0,
"sglang:kv_evictable_tokens": 646624.0,
"sglang:prompt_tokens_histogram_sum": 3470275.0,
"sglang:prompt_tokens_histogram_count": 568.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1224563.0,
"sglang:generation_tokens_total": 145160.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 52.02123031951487,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5776.0,
"sglang:kv_evictable_tokens": 642512.0,
"sglang:generation_tokens_total": 147528.0,
"sglang:prompt_tokens_histogram_sum": 3699029.0,
"sglang:prompt_tokens_histogram_count": 581.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1282181.0,
"sglang:realtime_tokens_total/prefill_compute": 1358928.0,
"sglang:realtime_tokens_total/decode": 154137.0,
"sglang:realtime_tokens_total/prefill_cache": 2755728.0,
"sglang:queue_time_seconds_sum": 1756.96992087923,
"sglang:queue_time_seconds_count": 648.0
}
},
{
"time": 52.0216404190287,
"metrics": {
"sglang:queue_time_seconds_sum": 1760.2771070543677,
"sglang:queue_time_seconds_count": 674.0,
"sglang:realtime_tokens_total/prefill_compute": 1329264.0,
"sglang:realtime_tokens_total/decode": 161407.0,
"sglang:realtime_tokens_total/prefill_cache": 2738112.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3600.0,
"sglang:kv_evictable_tokens": 683520.0,
"sglang:prompt_tokens_histogram_sum": 3689360.0,
"sglang:prompt_tokens_histogram_count": 607.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1261840.0,
"sglang:generation_tokens_total": 155144.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 54.02087766584009,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2320.0,
"sglang:kv_evictable_tokens": 636256.0,
"sglang:generation_tokens_total": 151624.0,
"sglang:prompt_tokens_histogram_sum": 3767856.0,
"sglang:prompt_tokens_histogram_count": 597.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1294240.0,
"sglang:realtime_tokens_total/prefill_compute": 1372288.0,
"sglang:realtime_tokens_total/decode": 162249.0,
"sglang:realtime_tokens_total/prefill_cache": 2817200.0,
"sglang:queue_time_seconds_sum": 1800.7744313646108,
"sglang:queue_time_seconds_count": 664.0
}
},
{
"time": 54.021692806854844,
"metrics": {
"sglang:queue_time_seconds_sum": 1823.0834129704162,
"sglang:queue_time_seconds_count": 697.0,
"sglang:realtime_tokens_total/prefill_compute": 1359728.0,
"sglang:realtime_tokens_total/decode": 169185.0,
"sglang:realtime_tokens_total/prefill_cache": 2882864.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4480.0,
"sglang:kv_evictable_tokens": 690672.0,
"sglang:prompt_tokens_histogram_sum": 3875785.0,
"sglang:prompt_tokens_histogram_count": 631.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1295161.0,
"sglang:generation_tokens_total": 161288.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 56.02112875878811,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 18.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5888.0,
"sglang:kv_evictable_tokens": 647984.0,
"sglang:generation_tokens_total": 163912.0,
"sglang:prompt_tokens_histogram_sum": 4111650.0,
"sglang:prompt_tokens_histogram_count": 645.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1355922.0,
"sglang:realtime_tokens_total/prefill_compute": 1429920.0,
"sglang:realtime_tokens_total/decode": 167513.0,
"sglang:realtime_tokens_total/prefill_cache": 3097008.0,
"sglang:queue_time_seconds_sum": 1931.731800859794,
"sglang:queue_time_seconds_count": 712.0
}
},
{
"time": 56.02062248252332,
"metrics": {
"sglang:queue_time_seconds_sum": 1898.325085438788,
"sglang:queue_time_seconds_count": 730.0,
"sglang:realtime_tokens_total/prefill_compute": 1391440.0,
"sglang:realtime_tokens_total/decode": 176549.0,
"sglang:realtime_tokens_total/prefill_cache": 3038976.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1120.0,
"sglang:kv_evictable_tokens": 650576.0,
"sglang:prompt_tokens_histogram_sum": 4018651.0,
"sglang:prompt_tokens_histogram_count": 663.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1318011.0,
"sglang:generation_tokens_total": 169480.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 58.02238702494651,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 66.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2832.0,
"sglang:kv_evictable_tokens": 641504.0,
"sglang:generation_tokens_total": 164168.0,
"sglang:prompt_tokens_histogram_sum": 4112674.0,
"sglang:prompt_tokens_histogram_count": 646.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1356434.0,
"sglang:realtime_tokens_total/prefill_compute": 1430944.0,
"sglang:realtime_tokens_total/decode": 176536.0,
"sglang:realtime_tokens_total/prefill_cache": 3097008.0,
"sglang:queue_time_seconds_sum": 1935.4275401923805,
"sglang:queue_time_seconds_count": 713.0
}
},
{
"time": 58.02050694916397,
"metrics": {
"sglang:queue_time_seconds_sum": 1974.25172112789,
"sglang:queue_time_seconds_count": 760.0,
"sglang:realtime_tokens_total/prefill_compute": 1439424.0,
"sglang:realtime_tokens_total/decode": 182195.0,
"sglang:realtime_tokens_total/prefill_cache": 3274976.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 12992.0,
"sglang:kv_evictable_tokens": 575840.0,
"sglang:prompt_tokens_histogram_sum": 4239664.0,
"sglang:prompt_tokens_histogram_count": 694.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1356800.0,
"sglang:generation_tokens_total": 177416.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 60.020126374438405,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3696.0,
"sglang:kv_evictable_tokens": 712976.0,
"sglang:generation_tokens_total": 177992.0,
"sglang:prompt_tokens_histogram_sum": 4468079.0,
"sglang:prompt_tokens_histogram_count": 700.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1418655.0,
"sglang:realtime_tokens_total/prefill_compute": 1484576.0,
"sglang:realtime_tokens_total/decode": 181922.0,
"sglang:realtime_tokens_total/prefill_cache": 3332816.0,
"sglang:queue_time_seconds_sum": 2081.3818996092305,
"sglang:queue_time_seconds_count": 767.0
}
},
{
"time": 60.0199263561517,
"metrics": {
"sglang:queue_time_seconds_sum": 1974.25172112789,
"sglang:queue_time_seconds_count": 760.0,
"sglang:realtime_tokens_total/prefill_compute": 1439424.0,
"sglang:realtime_tokens_total/decode": 190511.0,
"sglang:realtime_tokens_total/prefill_cache": 3274976.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 3376.0,
"sglang:kv_evictable_tokens": 575840.0,
"sglang:prompt_tokens_histogram_sum": 4239664.0,
"sglang:prompt_tokens_histogram_count": 694.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1356800.0,
"sglang:generation_tokens_total": 177416.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 62.037073232233524,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3440.0,
"sglang:kv_evictable_tokens": 658784.0,
"sglang:generation_tokens_total": 180296.0,
"sglang:prompt_tokens_histogram_sum": 4523643.0,
"sglang:prompt_tokens_histogram_count": 709.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1426635.0,
"sglang:realtime_tokens_total/prefill_compute": 1501488.0,
"sglang:realtime_tokens_total/decode": 190361.0,
"sglang:realtime_tokens_total/prefill_cache": 3420800.0,
"sglang:queue_time_seconds_sum": 2105.1044331202284,
"sglang:queue_time_seconds_count": 776.0
}
},
{
"time": 62.03775371611118,
"metrics": {
"sglang:queue_time_seconds_sum": 2118.9451097995043,
"sglang:queue_time_seconds_count": 808.0,
"sglang:realtime_tokens_total/prefill_compute": 1474816.0,
"sglang:realtime_tokens_total/decode": 197179.0,
"sglang:realtime_tokens_total/prefill_cache": 3436416.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 23.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2960.0,
"sglang:kv_evictable_tokens": 661952.0,
"sglang:prompt_tokens_histogram_sum": 4711171.0,
"sglang:prompt_tokens_histogram_count": 757.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1436195.0,
"sglang:generation_tokens_total": 193544.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 64.02181251812726,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2592.0,
"sglang:kv_evictable_tokens": 646496.0,
"sglang:generation_tokens_total": 193352.0,
"sglang:prompt_tokens_histogram_sum": 4809712.0,
"sglang:prompt_tokens_histogram_count": 760.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1480192.0,
"sglang:realtime_tokens_total/prefill_compute": 1519312.0,
"sglang:realtime_tokens_total/decode": 197863.0,
"sglang:realtime_tokens_total/prefill_cache": 3502800.0,
"sglang:queue_time_seconds_sum": 2221.8135117664933,
"sglang:queue_time_seconds_count": 814.0
}
},
{
"time": 64.0204630382359,
"metrics": {
"sglang:queue_time_seconds_sum": 2161.8513494925573,
"sglang:queue_time_seconds_count": 823.0,
"sglang:realtime_tokens_total/prefill_compute": 1505616.0,
"sglang:realtime_tokens_total/decode": 204781.0,
"sglang:realtime_tokens_total/prefill_cache": 3583904.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 6432.0,
"sglang:kv_evictable_tokens": 673088.0,
"sglang:prompt_tokens_histogram_sum": 4711171.0,
"sglang:prompt_tokens_histogram_count": 757.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1436195.0,
"sglang:generation_tokens_total": 193544.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 66.01943961158395,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 6576.0,
"sglang:kv_evictable_tokens": 648288.0,
"sglang:generation_tokens_total": 196680.0,
"sglang:prompt_tokens_histogram_sum": 4918746.0,
"sglang:prompt_tokens_histogram_count": 773.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1497946.0,
"sglang:realtime_tokens_total/prefill_compute": 1572560.0,
"sglang:realtime_tokens_total/decode": 203993.0,
"sglang:realtime_tokens_total/prefill_cache": 3757520.0,
"sglang:queue_time_seconds_sum": 2296.5983491083607,
"sglang:queue_time_seconds_count": 840.0
}
},
{
"time": 66.02011140715331,
"metrics": {
"sglang:queue_time_seconds_sum": 2267.9250152688473,
"sglang:queue_time_seconds_count": 866.0,
"sglang:realtime_tokens_total/prefill_compute": 1555472.0,
"sglang:realtime_tokens_total/decode": 211168.0,
"sglang:realtime_tokens_total/prefill_cache": 3789760.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 623584.0,
"sglang:prompt_tokens_histogram_sum": 4907801.0,
"sglang:prompt_tokens_histogram_count": 799.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1471385.0,
"sglang:generation_tokens_total": 204296.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 68.0202762586996,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2560.0,
"sglang:kv_evictable_tokens": 684432.0,
"sglang:generation_tokens_total": 203336.0,
"sglang:prompt_tokens_histogram_sum": 5018516.0,
"sglang:prompt_tokens_histogram_count": 799.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1515716.0,
"sglang:realtime_tokens_total/prefill_compute": 1584912.0,
"sglang:realtime_tokens_total/decode": 212095.0,
"sglang:realtime_tokens_total/prefill_cache": 3808304.0,
"sglang:queue_time_seconds_sum": 2380.846187615767,
"sglang:queue_time_seconds_count": 866.0
}
},
{
"time": 68.023004995659,
"metrics": {
"sglang:queue_time_seconds_sum": 2319.2104148175567,
"sglang:queue_time_seconds_count": 886.0,
"sglang:realtime_tokens_total/prefill_compute": 1585824.0,
"sglang:realtime_tokens_total/decode": 218113.0,
"sglang:realtime_tokens_total/prefill_cache": 3938416.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2096.0,
"sglang:kv_evictable_tokens": 621296.0,
"sglang:prompt_tokens_histogram_sum": 5085956.0,
"sglang:prompt_tokens_histogram_count": 820.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1502052.0,
"sglang:generation_tokens_total": 209672.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 70.01991240307689,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5664.0,
"sglang:kv_evictable_tokens": 665392.0,
"sglang:generation_tokens_total": 213064.0,
"sglang:prompt_tokens_histogram_sum": 5326294.0,
"sglang:prompt_tokens_histogram_count": 837.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1568774.0,
"sglang:realtime_tokens_total/prefill_compute": 1641376.0,
"sglang:realtime_tokens_total/decode": 218009.0,
"sglang:realtime_tokens_total/prefill_cache": 4079984.0,
"sglang:queue_time_seconds_sum": 2488.2643179586157,
"sglang:queue_time_seconds_count": 904.0
}
},
{
"time": 70.02111623436213,
"metrics": {
"sglang:queue_time_seconds_sum": 2416.7094052219763,
"sglang:queue_time_seconds_count": 922.0,
"sglang:realtime_tokens_total/prefill_compute": 1616192.0,
"sglang:realtime_tokens_total/decode": 225094.0,
"sglang:realtime_tokens_total/prefill_cache": 4074320.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1856.0,
"sglang:kv_evictable_tokens": 646128.0,
"sglang:prompt_tokens_histogram_sum": 5273751.0,
"sglang:prompt_tokens_histogram_count": 855.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1539975.0,
"sglang:generation_tokens_total": 218632.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 72.020069479011,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 7360.0,
"sglang:kv_evictable_tokens": 649312.0,
"sglang:generation_tokens_total": 215368.0,
"sglang:prompt_tokens_histogram_sum": 5353292.0,
"sglang:prompt_tokens_histogram_count": 846.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1575708.0,
"sglang:realtime_tokens_total/prefill_compute": 1651360.0,
"sglang:realtime_tokens_total/decode": 226704.0,
"sglang:realtime_tokens_total/prefill_cache": 4104512.0,
"sglang:queue_time_seconds_sum": 2524.920480865054,
"sglang:queue_time_seconds_count": 913.0
}
},
{
"time": 72.01982027851045,
"metrics": {
"sglang:queue_time_seconds_sum": 2483.1244052760303,
"sglang:queue_time_seconds_count": 949.0,
"sglang:realtime_tokens_total/prefill_compute": 1656624.0,
"sglang:realtime_tokens_total/decode": 231816.0,
"sglang:realtime_tokens_total/prefill_cache": 4263264.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4064.0,
"sglang:kv_evictable_tokens": 658832.0,
"sglang:prompt_tokens_histogram_sum": 5520391.0,
"sglang:prompt_tokens_histogram_count": 883.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1581975.0,
"sglang:generation_tokens_total": 225800.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 74.02023946680129,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 3696.0,
"sglang:kv_evictable_tokens": 663904.0,
"sglang:generation_tokens_total": 229448.0,
"sglang:prompt_tokens_histogram_sum": 5717348.0,
"sglang:prompt_tokens_histogram_count": 901.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1637364.0,
"sglang:realtime_tokens_total/prefill_compute": 1712368.0,
"sglang:realtime_tokens_total/decode": 231897.0,
"sglang:realtime_tokens_total/prefill_cache": 4408176.0,
"sglang:queue_time_seconds_sum": 2680.9803398689255,
"sglang:queue_time_seconds_count": 968.0
}
},
{
"time": 74.02095574419945,
"metrics": {
"sglang:queue_time_seconds_sum": 2541.128199296072,
"sglang:queue_time_seconds_count": 973.0,
"sglang:realtime_tokens_total/prefill_compute": 1666704.0,
"sglang:realtime_tokens_total/decode": 239864.0,
"sglang:realtime_tokens_total/prefill_cache": 4311376.0,
"sglang:num_running_reqs": 50.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 448.0,
"sglang:kv_evictable_tokens": 681184.0,
"sglang:prompt_tokens_histogram_sum": 5654812.0,
"sglang:prompt_tokens_histogram_count": 910.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1605740.0,
"sglang:generation_tokens_total": 232712.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 76.02001870144159,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 66.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2432.0,
"sglang:kv_evictable_tokens": 656656.0,
"sglang:generation_tokens_total": 229704.0,
"sglang:prompt_tokens_histogram_sum": 5728654.0,
"sglang:prompt_tokens_histogram_count": 902.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1639278.0,
"sglang:realtime_tokens_total/prefill_compute": 1712368.0,
"sglang:realtime_tokens_total/decode": 241432.0,
"sglang:realtime_tokens_total/prefill_cache": 4408176.0,
"sglang:queue_time_seconds_sum": 2685.6699527576566,
"sglang:queue_time_seconds_count": 969.0
}
},
{
"time": 76.02209253795445,
"metrics": {
"sglang:queue_time_seconds_sum": 2633.5664737652987,
"sglang:queue_time_seconds_count": 1009.0,
"sglang:realtime_tokens_total/prefill_compute": 1711072.0,
"sglang:realtime_tokens_total/decode": 245904.0,
"sglang:realtime_tokens_total/prefill_cache": 4533952.0,
"sglang:num_running_reqs": 45.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4064.0,
"sglang:kv_evictable_tokens": 683104.0,
"sglang:prompt_tokens_histogram_sum": 5915735.0,
"sglang:prompt_tokens_histogram_count": 946.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1652471.0,
"sglang:generation_tokens_total": 241928.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 78.02094474248588,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3136.0,
"sglang:kv_evictable_tokens": 714368.0,
"sglang:generation_tokens_total": 243528.0,
"sglang:prompt_tokens_histogram_sum": 6035586.0,
"sglang:prompt_tokens_histogram_count": 956.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1693922.0,
"sglang:realtime_tokens_total/prefill_compute": 1758912.0,
"sglang:realtime_tokens_total/decode": 247397.0,
"sglang:realtime_tokens_total/prefill_cache": 4624176.0,
"sglang:queue_time_seconds_sum": 2847.3720407290384,
"sglang:queue_time_seconds_count": 1023.0
}
},
{
"time": 78.02049598749727,
"metrics": {
"sglang:queue_time_seconds_sum": 2637.413417091593,
"sglang:queue_time_seconds_count": 1012.0,
"sglang:realtime_tokens_total/prefill_compute": 1733056.0,
"sglang:realtime_tokens_total/decode": 253527.0,
"sglang:realtime_tokens_total/prefill_cache": 4638688.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 1120.0,
"sglang:kv_evictable_tokens": 602592.0,
"sglang:prompt_tokens_histogram_sum": 5915735.0,
"sglang:prompt_tokens_histogram_count": 946.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1652471.0,
"sglang:generation_tokens_total": 241928.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 80.01989035494626,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3024.0,
"sglang:kv_evictable_tokens": 674528.0,
"sglang:generation_tokens_total": 245832.0,
"sglang:prompt_tokens_histogram_sum": 6116269.0,
"sglang:prompt_tokens_histogram_count": 965.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1708093.0,
"sglang:realtime_tokens_total/prefill_compute": 1779648.0,
"sglang:realtime_tokens_total/decode": 255961.0,
"sglang:realtime_tokens_total/prefill_cache": 4721280.0,
"sglang:queue_time_seconds_sum": 2874.061973287724,
"sglang:queue_time_seconds_count": 1032.0
}
},
{
"time": 80.02109197806567,
"metrics": {
"sglang:queue_time_seconds_sum": 2761.575372953899,
"sglang:queue_time_seconds_count": 1058.0,
"sglang:realtime_tokens_total/prefill_compute": 1782736.0,
"sglang:realtime_tokens_total/decode": 259393.0,
"sglang:realtime_tokens_total/prefill_cache": 4858256.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 14.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 3808.0,
"sglang:kv_evictable_tokens": 602656.0,
"sglang:prompt_tokens_histogram_sum": 6182583.0,
"sglang:prompt_tokens_histogram_count": 991.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1698519.0,
"sglang:generation_tokens_total": 253448.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 82.02215173188597,
"metrics": {
"sglang:num_running_reqs": 40.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2320.0,
"sglang:kv_evictable_tokens": 750112.0,
"sglang:generation_tokens_total": 258888.0,
"sglang:prompt_tokens_histogram_sum": 6362250.0,
"sglang:prompt_tokens_histogram_count": 1016.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1752042.0,
"sglang:realtime_tokens_total/prefill_compute": 1800896.0,
"sglang:realtime_tokens_total/decode": 263399.0,
"sglang:realtime_tokens_total/prefill_cache": 4826272.0,
"sglang:queue_time_seconds_sum": 3017.8262255312875,
"sglang:queue_time_seconds_count": 1078.0
}
},
{
"time": 82.02196205034852,
"metrics": {
"sglang:queue_time_seconds_sum": 2801.0198328867555,
"sglang:queue_time_seconds_count": 1075.0,
"sglang:realtime_tokens_total/prefill_compute": 1803888.0,
"sglang:realtime_tokens_total/decode": 266915.0,
"sglang:realtime_tokens_total/prefill_cache": 4964880.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2208.0,
"sglang:kv_evictable_tokens": 657728.0,
"sglang:prompt_tokens_histogram_sum": 6367313.0,
"sglang:prompt_tokens_histogram_count": 1009.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1728625.0,
"sglang:generation_tokens_total": 258056.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 84.0217081643641,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1168.0,
"sglang:kv_evictable_tokens": 677568.0,
"sglang:generation_tokens_total": 262216.0,
"sglang:prompt_tokens_histogram_sum": 6496408.0,
"sglang:prompt_tokens_histogram_count": 1029.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1775128.0,
"sglang:realtime_tokens_total/prefill_compute": 1846000.0,
"sglang:realtime_tokens_total/decode": 270233.0,
"sglang:realtime_tokens_total/prefill_cache": 5037600.0,
"sglang:queue_time_seconds_sum": 3069.2602800773457,
"sglang:queue_time_seconds_count": 1096.0
}
},
{
"time": 84.01980610378087,
"metrics": {
"sglang:queue_time_seconds_sum": 2898.2804034557194,
"sglang:queue_time_seconds_count": 1114.0,
"sglang:realtime_tokens_total/prefill_compute": 1845872.0,
"sglang:realtime_tokens_total/decode": 273518.0,
"sglang:realtime_tokens_total/prefill_cache": 5153408.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 4336.0,
"sglang:kv_evictable_tokens": 630816.0,
"sglang:prompt_tokens_histogram_sum": 6568341.0,
"sglang:prompt_tokens_histogram_count": 1047.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1766709.0,
"sglang:generation_tokens_total": 267784.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 86.0202825749293,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 646416.0,
"sglang:generation_tokens_total": 268872.0,
"sglang:prompt_tokens_histogram_sum": 6622578.0,
"sglang:prompt_tokens_histogram_count": 1055.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1796306.0,
"sglang:realtime_tokens_total/prefill_compute": 1873152.0,
"sglang:realtime_tokens_total/decode": 277759.0,
"sglang:realtime_tokens_total/prefill_cache": 5165648.0,
"sglang:queue_time_seconds_sum": 3165.6447201687843,
"sglang:queue_time_seconds_count": 1122.0
}
},
{
"time": 86.0200424771756,
"metrics": {
"sglang:queue_time_seconds_sum": 2943.628371242434,
"sglang:queue_time_seconds_count": 1138.0,
"sglang:realtime_tokens_total/prefill_compute": 1877984.0,
"sglang:realtime_tokens_total/decode": 280436.0,
"sglang:realtime_tokens_total/prefill_cache": 5313888.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 7056.0,
"sglang:kv_evictable_tokens": 630816.0,
"sglang:prompt_tokens_histogram_sum": 6764062.0,
"sglang:prompt_tokens_histogram_count": 1072.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1799182.0,
"sglang:generation_tokens_total": 274184.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 88.02020280063152,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2064.0,
"sglang:kv_evictable_tokens": 671936.0,
"sglang:generation_tokens_total": 278600.0,
"sglang:prompt_tokens_histogram_sum": 6878822.0,
"sglang:prompt_tokens_histogram_count": 1093.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1841222.0,
"sglang:realtime_tokens_total/prefill_compute": 1913424.0,
"sglang:realtime_tokens_total/decode": 284377.0,
"sglang:realtime_tokens_total/prefill_cache": 5356208.0,
"sglang:queue_time_seconds_sum": 3274.076706367545,
"sglang:queue_time_seconds_count": 1160.0
}
},
{
"time": 88.02276828885078,
"metrics": {
"sglang:queue_time_seconds_sum": 2972.190420093946,
"sglang:queue_time_seconds_count": 1149.0,
"sglang:realtime_tokens_total/prefill_compute": 1887760.0,
"sglang:realtime_tokens_total/decode": 288489.0,
"sglang:realtime_tokens_total/prefill_cache": 5356160.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1536.0,
"sglang:kv_evictable_tokens": 594192.0,
"sglang:prompt_tokens_histogram_sum": 6898096.0,
"sglang:prompt_tokens_histogram_count": 1098.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1824304.0,
"sglang:generation_tokens_total": 280840.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 90.01984765008092,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2720.0,
"sglang:kv_evictable_tokens": 667904.0,
"sglang:generation_tokens_total": 280904.0,
"sglang:prompt_tokens_histogram_sum": 6978166.0,
"sglang:prompt_tokens_histogram_count": 1102.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1857670.0,
"sglang:realtime_tokens_total/prefill_compute": 1929536.0,
"sglang:realtime_tokens_total/decode": 292554.0,
"sglang:realtime_tokens_total/prefill_cache": 5438848.0,
"sglang:queue_time_seconds_sum": 3314.062644331716,
"sglang:queue_time_seconds_count": 1168.0
}
},
{
"time": 90.01963955257088,
"metrics": {
"sglang:queue_time_seconds_sum": 3092.487456751056,
"sglang:queue_time_seconds_count": 1195.0,
"sglang:realtime_tokens_total/prefill_compute": 1933088.0,
"sglang:realtime_tokens_total/decode": 294532.0,
"sglang:realtime_tokens_total/prefill_cache": 5554944.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1744.0,
"sglang:kv_evictable_tokens": 618432.0,
"sglang:prompt_tokens_histogram_sum": 7186964.0,
"sglang:prompt_tokens_histogram_count": 1135.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1873076.0,
"sglang:generation_tokens_total": 290312.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 92.02025994379073,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2560.0,
"sglang:kv_evictable_tokens": 616304.0,
"sglang:generation_tokens_total": 294984.0,
"sglang:prompt_tokens_histogram_sum": 7264533.0,
"sglang:prompt_tokens_histogram_count": 1157.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1908325.0,
"sglang:realtime_tokens_total/prefill_compute": 1987472.0,
"sglang:realtime_tokens_total/decode": 297743.0,
"sglang:realtime_tokens_total/prefill_cache": 5726048.0,
"sglang:queue_time_seconds_sum": 3480.268391676247,
"sglang:queue_time_seconds_count": 1224.0
}
},
{
"time": 92.02275675907731,
"metrics": {
"sglang:queue_time_seconds_sum": 3101.854887164198,
"sglang:queue_time_seconds_count": 1201.0,
"sglang:realtime_tokens_total/prefill_compute": 1948880.0,
"sglang:realtime_tokens_total/decode": 303211.0,
"sglang:realtime_tokens_total/prefill_cache": 5612448.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 864.0,
"sglang:kv_evictable_tokens": 684592.0,
"sglang:prompt_tokens_histogram_sum": 7186964.0,
"sglang:prompt_tokens_histogram_count": 1135.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1873076.0,
"sglang:generation_tokens_total": 290312.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 94.02143875416368,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4720.0,
"sglang:kv_evictable_tokens": 607424.0,
"sglang:generation_tokens_total": 294984.0,
"sglang:prompt_tokens_histogram_sum": 7264533.0,
"sglang:prompt_tokens_histogram_count": 1157.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1908325.0,
"sglang:realtime_tokens_total/prefill_compute": 1987472.0,
"sglang:realtime_tokens_total/decode": 306127.0,
"sglang:realtime_tokens_total/prefill_cache": 5726048.0,
"sglang:queue_time_seconds_sum": 3480.268391676247,
"sglang:queue_time_seconds_count": 1224.0
}
},
{
"time": 94.02180616464466,
"metrics": {
"sglang:queue_time_seconds_sum": 3216.4977594977245,
"sglang:queue_time_seconds_count": 1250.0,
"sglang:realtime_tokens_total/prefill_compute": 2001008.0,
"sglang:realtime_tokens_total/decode": 309737.0,
"sglang:realtime_tokens_total/prefill_cache": 5852064.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3312.0,
"sglang:kv_evictable_tokens": 691712.0,
"sglang:prompt_tokens_histogram_sum": 7482894.0,
"sglang:prompt_tokens_histogram_count": 1183.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1927950.0,
"sglang:generation_tokens_total": 302600.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 96.02098846621811,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2704.0,
"sglang:kv_evictable_tokens": 614704.0,
"sglang:generation_tokens_total": 308040.0,
"sglang:prompt_tokens_histogram_sum": 7617010.0,
"sglang:prompt_tokens_histogram_count": 1208.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1966418.0,
"sglang:realtime_tokens_total/prefill_compute": 2019936.0,
"sglang:realtime_tokens_total/decode": 312541.0,
"sglang:realtime_tokens_total/prefill_cache": 5891952.0,
"sglang:queue_time_seconds_sum": 3652.780701290816,
"sglang:queue_time_seconds_count": 1274.0
}
},
{
"time": 96.02025787066668,
"metrics": {
"sglang:queue_time_seconds_sum": 3242.9978912808,
"sglang:queue_time_seconds_count": 1264.0,
"sglang:realtime_tokens_total/prefill_compute": 2015296.0,
"sglang:realtime_tokens_total/decode": 318370.0,
"sglang:realtime_tokens_total/prefill_cache": 5925296.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2544.0,
"sglang:kv_evictable_tokens": 672672.0,
"sglang:prompt_tokens_histogram_sum": 7556148.0,
"sglang:prompt_tokens_histogram_count": 1198.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1943700.0,
"sglang:generation_tokens_total": 306440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 98.02248004730791,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1568.0,
"sglang:kv_evictable_tokens": 653136.0,
"sglang:generation_tokens_total": 311368.0,
"sglang:prompt_tokens_histogram_sum": 7708136.0,
"sglang:prompt_tokens_histogram_count": 1221.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1982088.0,
"sglang:realtime_tokens_total/prefill_compute": 2057552.0,
"sglang:realtime_tokens_total/decode": 319311.0,
"sglang:realtime_tokens_total/prefill_cache": 6061904.0,
"sglang:queue_time_seconds_sum": 3696.9988618651405,
"sglang:queue_time_seconds_count": 1288.0
}
},
{
"time": 98.02106917463243,
"metrics": {
"sglang:queue_time_seconds_sum": 3352.1509685507044,
"sglang:queue_time_seconds_count": 1314.0,
"sglang:realtime_tokens_total/prefill_compute": 2073952.0,
"sglang:realtime_tokens_total/decode": 324103.0,
"sglang:realtime_tokens_total/prefill_cache": 6194288.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 12.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1456.0,
"sglang:kv_evictable_tokens": 645472.0,
"sglang:prompt_tokens_histogram_sum": 7847659.0,
"sglang:prompt_tokens_histogram_count": 1247.0,
"sglang:uncached_prompt_tokens_histogram_sum": 1995595.0,
"sglang:generation_tokens_total": 318984.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 100.02019968442619,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 4448.0,
"sglang:kv_evictable_tokens": 609616.0,
"sglang:generation_tokens_total": 315464.0,
"sglang:prompt_tokens_histogram_sum": 7859714.0,
"sglang:prompt_tokens_histogram_count": 1237.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2008114.0,
"sglang:realtime_tokens_total/prefill_compute": 2088304.0,
"sglang:realtime_tokens_total/decode": 326015.0,
"sglang:realtime_tokens_total/prefill_cache": 6219216.0,
"sglang:queue_time_seconds_sum": 3762.745939235203,
"sglang:queue_time_seconds_count": 1304.0
}
},
{
"time": 100.02001552283764,
"metrics": {
"sglang:queue_time_seconds_sum": 3379.687340648845,
"sglang:queue_time_seconds_count": 1327.0,
"sglang:realtime_tokens_total/prefill_compute": 2086176.0,
"sglang:realtime_tokens_total/decode": 332451.0,
"sglang:realtime_tokens_total/prefill_cache": 6257888.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1344.0,
"sglang:kv_evictable_tokens": 651568.0,
"sglang:prompt_tokens_histogram_sum": 7935127.0,
"sglang:prompt_tokens_histogram_count": 1261.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2009831.0,
"sglang:generation_tokens_total": 322568.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 102.02236371673644,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 3520.0,
"sglang:kv_evictable_tokens": 572096.0,
"sglang:generation_tokens_total": 327752.0,
"sglang:prompt_tokens_histogram_sum": 8113781.0,
"sglang:prompt_tokens_histogram_count": 1285.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2051877.0,
"sglang:realtime_tokens_total/prefill_compute": 2138000.0,
"sglang:realtime_tokens_total/decode": 331407.0,
"sglang:realtime_tokens_total/prefill_cache": 6468624.0,
"sglang:queue_time_seconds_sum": 3913.9249569429085,
"sglang:queue_time_seconds_count": 1352.0
}
},
{
"time": 102.0221609165892,
"metrics": {
"sglang:queue_time_seconds_sum": 3482.8008695812896,
"sglang:queue_time_seconds_count": 1370.0,
"sglang:realtime_tokens_total/prefill_compute": 2134016.0,
"sglang:realtime_tokens_total/decode": 338612.0,
"sglang:realtime_tokens_total/prefill_cache": 6494176.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3568.0,
"sglang:kv_evictable_tokens": 647648.0,
"sglang:prompt_tokens_histogram_sum": 8211590.0,
"sglang:prompt_tokens_histogram_count": 1303.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2060086.0,
"sglang:generation_tokens_total": 333320.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 104.02075075078756,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1680.0,
"sglang:kv_evictable_tokens": 566768.0,
"sglang:generation_tokens_total": 327752.0,
"sglang:prompt_tokens_histogram_sum": 8113781.0,
"sglang:prompt_tokens_histogram_count": 1285.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2051877.0,
"sglang:realtime_tokens_total/prefill_compute": 2138000.0,
"sglang:realtime_tokens_total/decode": 339343.0,
"sglang:realtime_tokens_total/prefill_cache": 6468624.0,
"sglang:queue_time_seconds_sum": 3913.9249569429085,
"sglang:queue_time_seconds_count": 1352.0
}
},
{
"time": 104.02257468178868,
"metrics": {
"sglang:queue_time_seconds_sum": 3530.288296964951,
"sglang:queue_time_seconds_count": 1390.0,
"sglang:realtime_tokens_total/prefill_compute": 2157472.0,
"sglang:realtime_tokens_total/decode": 345972.0,
"sglang:realtime_tokens_total/prefill_cache": 6619376.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1008.0,
"sglang:kv_evictable_tokens": 624384.0,
"sglang:prompt_tokens_histogram_sum": 8338343.0,
"sglang:prompt_tokens_histogram_count": 1324.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2080455.0,
"sglang:generation_tokens_total": 338696.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 106.02066011354327,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 628288.0,
"sglang:generation_tokens_total": 340808.0,
"sglang:prompt_tokens_histogram_sum": 8509404.0,
"sglang:prompt_tokens_histogram_count": 1336.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2116828.0,
"sglang:realtime_tokens_total/prefill_compute": 2171424.0,
"sglang:realtime_tokens_total/decode": 345309.0,
"sglang:realtime_tokens_total/prefill_cache": 6628352.0,
"sglang:queue_time_seconds_sum": 4080.994715128094,
"sglang:queue_time_seconds_count": 1399.0
}
},
{
"time": 106.02104568481445,
"metrics": {
"sglang:queue_time_seconds_sum": 3596.8052614303306,
"sglang:queue_time_seconds_count": 1415.0,
"sglang:realtime_tokens_total/prefill_compute": 2170704.0,
"sglang:realtime_tokens_total/decode": 353439.0,
"sglang:realtime_tokens_total/prefill_cache": 6679312.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 3744.0,
"sglang:kv_evictable_tokens": 583488.0,
"sglang:prompt_tokens_histogram_sum": 8550395.0,
"sglang:prompt_tokens_histogram_count": 1358.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2115387.0,
"sglang:generation_tokens_total": 347400.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 108.0200134087354,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2368.0,
"sglang:kv_evictable_tokens": 655008.0,
"sglang:generation_tokens_total": 344136.0,
"sglang:prompt_tokens_histogram_sum": 8600667.0,
"sglang:prompt_tokens_histogram_count": 1349.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2132043.0,
"sglang:realtime_tokens_total/prefill_compute": 2211008.0,
"sglang:realtime_tokens_total/decode": 352591.0,
"sglang:realtime_tokens_total/prefill_cache": 6800048.0,
"sglang:queue_time_seconds_sum": 4135.230296481401,
"sglang:queue_time_seconds_count": 1416.0
}
},
{
"time": 108.02040571533144,
"metrics": {
"sglang:queue_time_seconds_sum": 3671.8839012784883,
"sglang:queue_time_seconds_count": 1442.0,
"sglang:realtime_tokens_total/prefill_compute": 2225744.0,
"sglang:realtime_tokens_total/decode": 358922.0,
"sglang:realtime_tokens_total/prefill_cache": 6943456.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 16.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 1568.0,
"sglang:kv_evictable_tokens": 585232.0,
"sglang:prompt_tokens_histogram_sum": 8689285.0,
"sglang:prompt_tokens_histogram_count": 1375.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2139877.0,
"sglang:generation_tokens_total": 351752.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 110.02024218253791,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3360.0,
"sglang:kv_evictable_tokens": 685472.0,
"sglang:generation_tokens_total": 350792.0,
"sglang:prompt_tokens_histogram_sum": 8793725.0,
"sglang:prompt_tokens_histogram_count": 1375.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2165373.0,
"sglang:realtime_tokens_total/prefill_compute": 2239440.0,
"sglang:realtime_tokens_total/decode": 359669.0,
"sglang:realtime_tokens_total/prefill_cache": 6930064.0,
"sglang:queue_time_seconds_sum": 4221.647610367276,
"sglang:queue_time_seconds_count": 1442.0
}
},
{
"time": 110.0237063318491,
"metrics": {
"sglang:queue_time_seconds_sum": 3705.2733376901597,
"sglang:queue_time_seconds_count": 1454.0,
"sglang:realtime_tokens_total/prefill_compute": 2233504.0,
"sglang:realtime_tokens_total/decode": 367038.0,
"sglang:realtime_tokens_total/prefill_cache": 6979760.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2464.0,
"sglang:kv_evictable_tokens": 617888.0,
"sglang:prompt_tokens_histogram_sum": 8770899.0,
"sglang:prompt_tokens_histogram_count": 1387.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2151523.0,
"sglang:generation_tokens_total": 354824.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 112.02266490459442,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2464.0,
"sglang:kv_evictable_tokens": 649696.0,
"sglang:generation_tokens_total": 360520.0,
"sglang:prompt_tokens_histogram_sum": 9004776.0,
"sglang:prompt_tokens_histogram_count": 1413.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2204728.0,
"sglang:realtime_tokens_total/prefill_compute": 2283376.0,
"sglang:realtime_tokens_total/decode": 366031.0,
"sglang:realtime_tokens_total/prefill_cache": 7137376.0,
"sglang:queue_time_seconds_sum": 4326.741174888797,
"sglang:queue_time_seconds_count": 1480.0
}
},
{
"time": 112.02107995096594,
"metrics": {
"sglang:queue_time_seconds_sum": 3866.973644580692,
"sglang:queue_time_seconds_count": 1506.0,
"sglang:realtime_tokens_total/prefill_compute": 2295344.0,
"sglang:realtime_tokens_total/decode": 372035.0,
"sglang:realtime_tokens_total/prefill_cache": 7279776.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 12.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4096.0,
"sglang:kv_evictable_tokens": 653440.0,
"sglang:prompt_tokens_histogram_sum": 9162976.0,
"sglang:prompt_tokens_histogram_count": 1439.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2219520.0,
"sglang:generation_tokens_total": 368136.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 114.02341153658926,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 58.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1696.0,
"sglang:kv_evictable_tokens": 638064.0,
"sglang:generation_tokens_total": 362568.0,
"sglang:prompt_tokens_histogram_sum": 9032898.0,
"sglang:prompt_tokens_histogram_count": 1421.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2211874.0,
"sglang:realtime_tokens_total/prefill_compute": 2291568.0,
"sglang:realtime_tokens_total/decode": 374471.0,
"sglang:realtime_tokens_total/prefill_cache": 7163040.0,
"sglang:queue_time_seconds_sum": 4356.292869852856,
"sglang:queue_time_seconds_count": 1488.0
}
},
{
"time": 114.01979461871088,
"metrics": {
"sglang:queue_time_seconds_sum": 3898.4916513217613,
"sglang:queue_time_seconds_count": 1517.0,
"sglang:realtime_tokens_total/prefill_compute": 2306480.0,
"sglang:realtime_tokens_total/decode": 380084.0,
"sglang:realtime_tokens_total/prefill_cache": 7340000.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1088.0,
"sglang:kv_evictable_tokens": 623104.0,
"sglang:prompt_tokens_histogram_sum": 9207018.0,
"sglang:prompt_tokens_histogram_count": 1451.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2227258.0,
"sglang:generation_tokens_total": 371208.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 116.02050057798624,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 4400.0,
"sglang:kv_evictable_tokens": 663296.0,
"sglang:generation_tokens_total": 376904.0,
"sglang:prompt_tokens_histogram_sum": 9414214.0,
"sglang:prompt_tokens_histogram_count": 1477.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2276838.0,
"sglang:realtime_tokens_total/prefill_compute": 2357344.0,
"sglang:realtime_tokens_total/decode": 379471.0,
"sglang:realtime_tokens_total/prefill_cache": 7462080.0,
"sglang:queue_time_seconds_sum": 4514.24383724574,
"sglang:queue_time_seconds_count": 1544.0
}
},
{
"time": 116.02033980935812,
"metrics": {
"sglang:queue_time_seconds_sum": 3989.5992341395468,
"sglang:queue_time_seconds_count": 1549.0,
"sglang:realtime_tokens_total/prefill_compute": 2336704.0,
"sglang:realtime_tokens_total/decode": 386038.0,
"sglang:realtime_tokens_total/prefill_cache": 7490496.0,
"sglang:num_running_reqs": 49.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 8240.0,
"sglang:kv_evictable_tokens": 625888.0,
"sglang:prompt_tokens_histogram_sum": 9445347.0,
"sglang:prompt_tokens_histogram_count": 1486.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2268019.0,
"sglang:generation_tokens_total": 380168.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 118.02026006858796,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 64.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1760.0,
"sglang:kv_evictable_tokens": 656816.0,
"sglang:generation_tokens_total": 376904.0,
"sglang:prompt_tokens_histogram_sum": 9414214.0,
"sglang:prompt_tokens_histogram_count": 1477.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2276838.0,
"sglang:realtime_tokens_total/prefill_compute": 2357344.0,
"sglang:realtime_tokens_total/decode": 388687.0,
"sglang:realtime_tokens_total/prefill_cache": 7462080.0,
"sglang:queue_time_seconds_sum": 4514.24383724574,
"sglang:queue_time_seconds_count": 1544.0
}
},
{
"time": 118.02063864655793,
"metrics": {
"sglang:queue_time_seconds_sum": 4087.43671539519,
"sglang:queue_time_seconds_count": 1581.0,
"sglang:realtime_tokens_total/prefill_compute": 2381840.0,
"sglang:realtime_tokens_total/decode": 392033.0,
"sglang:realtime_tokens_total/prefill_cache": 7712688.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 2992.0,
"sglang:kv_evictable_tokens": 540240.0,
"sglang:prompt_tokens_histogram_sum": 9639945.0,
"sglang:prompt_tokens_histogram_count": 1514.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2299945.0,
"sglang:generation_tokens_total": 387336.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 120.08234757184982,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 12.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 731856.0,
"sglang:generation_tokens_total": 391752.0,
"sglang:prompt_tokens_histogram_sum": 9755682.0,
"sglang:prompt_tokens_histogram_count": 1535.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2340578.0,
"sglang:realtime_tokens_total/prefill_compute": 2403184.0,
"sglang:realtime_tokens_total/decode": 395094.0,
"sglang:realtime_tokens_total/prefill_cache": 7669392.0,
"sglang:queue_time_seconds_sum": 4680.561908644624,
"sglang:queue_time_seconds_count": 1601.0
}
},
{
"time": 120.08411385398358,
"metrics": {
"sglang:queue_time_seconds_sum": 4087.43671539519,
"sglang:queue_time_seconds_count": 1581.0,
"sglang:realtime_tokens_total/prefill_compute": 2387680.0,
"sglang:realtime_tokens_total/decode": 400022.0,
"sglang:realtime_tokens_total/prefill_cache": 7745728.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 568624.0,
"sglang:prompt_tokens_histogram_sum": 9639945.0,
"sglang:prompt_tokens_histogram_count": 1514.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2299945.0,
"sglang:generation_tokens_total": 387336.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 122.02142441831529,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 735776.0,
"sglang:generation_tokens_total": 393288.0,
"sglang:prompt_tokens_histogram_sum": 9812602.0,
"sglang:prompt_tokens_histogram_count": 1541.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2350522.0,
"sglang:realtime_tokens_total/prefill_compute": 2415584.0,
"sglang:realtime_tokens_total/decode": 404431.0,
"sglang:realtime_tokens_total/prefill_cache": 7725648.0,
"sglang:queue_time_seconds_sum": 4698.111387222074,
"sglang:queue_time_seconds_count": 1608.0
}
},
{
"time": 122.0218313653022,
"metrics": {
"sglang:queue_time_seconds_sum": 4266.4180916836485,
"sglang:queue_time_seconds_count": 1634.0,
"sglang:realtime_tokens_total/prefill_compute": 2450944.0,
"sglang:realtime_tokens_total/decode": 404444.0,
"sglang:realtime_tokens_total/prefill_cache": 8042000.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 16.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1712.0,
"sglang:kv_evictable_tokens": 664576.0,
"sglang:prompt_tokens_histogram_sum": 10087745.0,
"sglang:prompt_tokens_histogram_count": 1567.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2375057.0,
"sglang:generation_tokens_total": 400904.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 124.02109786123037,
"metrics": {
"sglang:num_running_reqs": 47.0,
"sglang:num_queue_reqs": 24.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 6432.0,
"sglang:kv_evictable_tokens": 674352.0,
"sglang:generation_tokens_total": 406344.0,
"sglang:prompt_tokens_histogram_sum": 10043602.0,
"sglang:prompt_tokens_histogram_count": 1592.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2391858.0,
"sglang:realtime_tokens_total/prefill_compute": 2457920.0,
"sglang:realtime_tokens_total/decode": 410845.0,
"sglang:realtime_tokens_total/prefill_cache": 7933856.0,
"sglang:queue_time_seconds_sum": 4820.3031967887655,
"sglang:queue_time_seconds_count": 1658.0
}
},
{
"time": 124.02473148331046,
"metrics": {
"sglang:queue_time_seconds_sum": 4295.314377494156,
"sglang:queue_time_seconds_count": 1644.0,
"sglang:realtime_tokens_total/prefill_compute": 2461488.0,
"sglang:realtime_tokens_total/decode": 412810.0,
"sglang:realtime_tokens_total/prefill_cache": 8093312.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1824.0,
"sglang:kv_evictable_tokens": 639216.0,
"sglang:prompt_tokens_histogram_sum": 10126565.0,
"sglang:prompt_tokens_histogram_count": 1578.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2380837.0,
"sglang:generation_tokens_total": 403720.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 126.01991931349039,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1488.0,
"sglang:kv_evictable_tokens": 643120.0,
"sglang:generation_tokens_total": 409672.0,
"sglang:prompt_tokens_histogram_sum": 10134221.0,
"sglang:prompt_tokens_histogram_count": 1605.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2408573.0,
"sglang:realtime_tokens_total/prefill_compute": 2490656.0,
"sglang:realtime_tokens_total/decode": 418319.0,
"sglang:realtime_tokens_total/prefill_cache": 8069056.0,
"sglang:queue_time_seconds_sum": 4856.153128899634,
"sglang:queue_time_seconds_count": 1672.0
}
},
{
"time": 126.02032193914056,
"metrics": {
"sglang:queue_time_seconds_sum": 4391.111795416102,
"sglang:queue_time_seconds_count": 1677.0,
"sglang:realtime_tokens_total/prefill_compute": 2496736.0,
"sglang:realtime_tokens_total/decode": 418637.0,
"sglang:realtime_tokens_total/prefill_cache": 8255824.0,
"sglang:num_running_reqs": 53.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4208.0,
"sglang:kv_evictable_tokens": 649744.0,
"sglang:prompt_tokens_histogram_sum": 10389638.0,
"sglang:prompt_tokens_histogram_count": 1614.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2427750.0,
"sglang:generation_tokens_total": 412936.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 128.021330781281,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1232.0,
"sglang:kv_evictable_tokens": 680576.0,
"sglang:generation_tokens_total": 416328.0,
"sglang:prompt_tokens_histogram_sum": 10283871.0,
"sglang:prompt_tokens_histogram_count": 1631.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2434463.0,
"sglang:realtime_tokens_total/prefill_compute": 2508288.0,
"sglang:realtime_tokens_total/decode": 426165.0,
"sglang:realtime_tokens_total/prefill_cache": 8162416.0,
"sglang:queue_time_seconds_sum": 4941.758691211231,
"sglang:queue_time_seconds_count": 1698.0
}
},
{
"time": 128.02091034688056,
"metrics": {
"sglang:queue_time_seconds_sum": 4478.5443707359955,
"sglang:queue_time_seconds_count": 1708.0,
"sglang:realtime_tokens_total/prefill_compute": 2538608.0,
"sglang:realtime_tokens_total/decode": 425454.0,
"sglang:realtime_tokens_total/prefill_cache": 8447568.0,
"sglang:num_running_reqs": 54.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 4320.0,
"sglang:kv_evictable_tokens": 628784.0,
"sglang:prompt_tokens_histogram_sum": 10547673.0,
"sglang:prompt_tokens_histogram_count": 1641.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2454361.0,
"sglang:generation_tokens_total": 419848.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 130.02000700123608,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 739360.0,
"sglang:generation_tokens_total": 426056.0,
"sglang:prompt_tokens_histogram_sum": 10552423.0,
"sglang:prompt_tokens_histogram_count": 1669.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2483367.0,
"sglang:realtime_tokens_total/prefill_compute": 2547360.0,
"sglang:realtime_tokens_total/decode": 433807.0,
"sglang:realtime_tokens_total/prefill_cache": 8335376.0,
"sglang:queue_time_seconds_sum": 5044.214975863695,
"sglang:queue_time_seconds_count": 1736.0
}
},
{
"time": 130.02038682624698,
"metrics": {
"sglang:queue_time_seconds_sum": 4511.564011521637,
"sglang:queue_time_seconds_count": 1719.0,
"sglang:realtime_tokens_total/prefill_compute": 2538608.0,
"sglang:realtime_tokens_total/decode": 434542.0,
"sglang:realtime_tokens_total/prefill_cache": 8447568.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1408.0,
"sglang:kv_evictable_tokens": 622944.0,
"sglang:prompt_tokens_histogram_sum": 10590298.0,
"sglang:prompt_tokens_histogram_count": 1652.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2465002.0,
"sglang:generation_tokens_total": 422664.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 132.020681489259,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 1360.0,
"sglang:kv_evictable_tokens": 698176.0,
"sglang:generation_tokens_total": 432712.0,
"sglang:prompt_tokens_histogram_sum": 10663377.0,
"sglang:prompt_tokens_histogram_count": 1695.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2500961.0,
"sglang:realtime_tokens_total/prefill_compute": 2571568.0,
"sglang:realtime_tokens_total/decode": 442357.0,
"sglang:realtime_tokens_total/prefill_cache": 8460656.0,
"sglang:queue_time_seconds_sum": 5111.134800491855,
"sglang:queue_time_seconds_count": 1762.0
}
},
{
"time": 132.02045527938753,
"metrics": {
"sglang:queue_time_seconds_sum": 4623.356937656179,
"sglang:queue_time_seconds_count": 1762.0,
"sglang:realtime_tokens_total/prefill_compute": 2600320.0,
"sglang:realtime_tokens_total/decode": 440184.0,
"sglang:realtime_tokens_total/prefill_cache": 8747696.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1312.0,
"sglang:kv_evictable_tokens": 673248.0,
"sglang:prompt_tokens_histogram_sum": 10950300.0,
"sglang:prompt_tokens_histogram_count": 1695.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2524332.0,
"sglang:generation_tokens_total": 433672.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 134.02176247537136,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1360.0,
"sglang:kv_evictable_tokens": 595760.0,
"sglang:generation_tokens_total": 442440.0,
"sglang:prompt_tokens_histogram_sum": 10875203.0,
"sglang:prompt_tokens_histogram_count": 1733.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2539827.0,
"sglang:realtime_tokens_total/prefill_compute": 2626896.0,
"sglang:realtime_tokens_total/decode": 447631.0,
"sglang:realtime_tokens_total/prefill_cache": 8723456.0,
"sglang:queue_time_seconds_sum": 5198.328053161502,
"sglang:queue_time_seconds_count": 1800.0
}
},
{
"time": 134.02221583761275,
"metrics": {
"sglang:queue_time_seconds_sum": 4646.175782161765,
"sglang:queue_time_seconds_count": 1772.0,
"sglang:realtime_tokens_total/prefill_compute": 2607648.0,
"sglang:realtime_tokens_total/decode": 449454.0,
"sglang:realtime_tokens_total/prefill_cache": 8771344.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3200.0,
"sglang:kv_evictable_tokens": 661808.0,
"sglang:prompt_tokens_histogram_sum": 10978828.0,
"sglang:prompt_tokens_histogram_count": 1705.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2531260.0,
"sglang:generation_tokens_total": 436232.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 136.02047013491392,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 579520.0,
"sglang:generation_tokens_total": 443208.0,
"sglang:prompt_tokens_histogram_sum": 10897951.0,
"sglang:prompt_tokens_histogram_count": 1736.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2544047.0,
"sglang:realtime_tokens_total/prefill_compute": 2632400.0,
"sglang:realtime_tokens_total/decode": 455692.0,
"sglang:realtime_tokens_total/prefill_cache": 8749984.0,
"sglang:queue_time_seconds_sum": 5212.830330284312,
"sglang:queue_time_seconds_count": 1803.0
}
},
{
"time": 136.02197929657996,
"metrics": {
"sglang:queue_time_seconds_sum": 4782.3144460991025,
"sglang:queue_time_seconds_count": 1826.0,
"sglang:realtime_tokens_total/prefill_compute": 2669584.0,
"sglang:realtime_tokens_total/decode": 454584.0,
"sglang:realtime_tokens_total/prefill_cache": 9075952.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 4032.0,
"sglang:kv_evictable_tokens": 664608.0,
"sglang:prompt_tokens_histogram_sum": 11340463.0,
"sglang:prompt_tokens_histogram_count": 1759.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2592767.0,
"sglang:generation_tokens_total": 450056.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 138.02007336821407,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1488.0,
"sglang:kv_evictable_tokens": 674224.0,
"sglang:generation_tokens_total": 458312.0,
"sglang:prompt_tokens_histogram_sum": 11324247.0,
"sglang:prompt_tokens_histogram_count": 1795.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2615767.0,
"sglang:realtime_tokens_total/prefill_compute": 2682032.0,
"sglang:realtime_tokens_total/decode": 461009.0,
"sglang:realtime_tokens_total/prefill_cache": 8995232.0,
"sglang:queue_time_seconds_sum": 5396.468650083058,
"sglang:queue_time_seconds_count": 1862.0
}
},
{
"time": 138.02045194618404,
"metrics": {
"sglang:queue_time_seconds_sum": 4805.41820838768,
"sglang:queue_time_seconds_count": 1836.0,
"sglang:realtime_tokens_total/prefill_compute": 2677104.0,
"sglang:realtime_tokens_total/decode": 463854.0,
"sglang:realtime_tokens_total/prefill_cache": 9104368.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1856.0,
"sglang:kv_evictable_tokens": 656128.0,
"sglang:prompt_tokens_histogram_sum": 11371395.0,
"sglang:prompt_tokens_histogram_count": 1769.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2600051.0,
"sglang:generation_tokens_total": 452616.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 140.02552481368184,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2240.0,
"sglang:kv_evictable_tokens": 671568.0,
"sglang:generation_tokens_total": 458824.0,
"sglang:prompt_tokens_histogram_sum": 11342543.0,
"sglang:prompt_tokens_histogram_count": 1797.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2619087.0,
"sglang:realtime_tokens_total/prefill_compute": 2692272.0,
"sglang:realtime_tokens_total/decode": 470095.0,
"sglang:realtime_tokens_total/prefill_cache": 9043344.0,
"sglang:queue_time_seconds_sum": 5402.325536694378,
"sglang:queue_time_seconds_count": 1864.0
}
},
{
"time": 140.02178679034114,
"metrics": {
"sglang:queue_time_seconds_sum": 4945.06447495427,
"sglang:queue_time_seconds_count": 1890.0,
"sglang:realtime_tokens_total/prefill_compute": 2729520.0,
"sglang:realtime_tokens_total/decode": 469818.0,
"sglang:realtime_tokens_total/prefill_cache": 9347008.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 18.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 3296.0,
"sglang:kv_evictable_tokens": 732096.0,
"sglang:prompt_tokens_histogram_sum": 11737722.0,
"sglang:prompt_tokens_histogram_count": 1823.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2661770.0,
"sglang:generation_tokens_total": 466440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 142.02204198017716,
"metrics": {
"sglang:num_running_reqs": 49.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 5808.0,
"sglang:kv_evictable_tokens": 657200.0,
"sglang:generation_tokens_total": 471880.0,
"sglang:prompt_tokens_histogram_sum": 11609215.0,
"sglang:prompt_tokens_histogram_count": 1848.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2663375.0,
"sglang:realtime_tokens_total/prefill_compute": 2734192.0,
"sglang:realtime_tokens_total/decode": 476381.0,
"sglang:realtime_tokens_total/prefill_cache": 9232576.0,
"sglang:queue_time_seconds_sum": 5538.830166181549,
"sglang:queue_time_seconds_count": 1914.0
}
},
{
"time": 142.0202126726508,
"metrics": {
"sglang:queue_time_seconds_sum": 4967.54149545636,
"sglang:queue_time_seconds_count": 1900.0,
"sglang:realtime_tokens_total/prefill_compute": 2740720.0,
"sglang:realtime_tokens_total/decode": 478958.0,
"sglang:realtime_tokens_total/prefill_cache": 9398800.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 1440.0,
"sglang:kv_evictable_tokens": 703040.0,
"sglang:prompt_tokens_histogram_sum": 11773610.0,
"sglang:prompt_tokens_histogram_count": 1833.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2669242.0,
"sglang:generation_tokens_total": 469000.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 144.02024814859033,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 2352.0,
"sglang:kv_evictable_tokens": 601072.0,
"sglang:generation_tokens_total": 475208.0,
"sglang:prompt_tokens_histogram_sum": 11727506.0,
"sglang:prompt_tokens_histogram_count": 1861.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2684162.0,
"sglang:realtime_tokens_total/prefill_compute": 2772736.0,
"sglang:realtime_tokens_total/decode": 482831.0,
"sglang:realtime_tokens_total/prefill_cache": 9421360.0,
"sglang:queue_time_seconds_sum": 5577.544233957306,
"sglang:queue_time_seconds_count": 1928.0
}
},
{
"time": 144.0221549924463,
"metrics": {
"sglang:queue_time_seconds_sum": 5081.907152830623,
"sglang:queue_time_seconds_count": 1946.0,
"sglang:realtime_tokens_total/prefill_compute": 2786832.0,
"sglang:realtime_tokens_total/decode": 485243.0,
"sglang:realtime_tokens_total/prefill_cache": 9605984.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2080.0,
"sglang:kv_evictable_tokens": 681360.0,
"sglang:prompt_tokens_histogram_sum": 12018139.0,
"sglang:prompt_tokens_histogram_count": 1879.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2713147.0,
"sglang:generation_tokens_total": 480776.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 146.02067057136446,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.49,
"sglang:kv_available_tokens": 2448.0,
"sglang:kv_evictable_tokens": 537008.0,
"sglang:generation_tokens_total": 479304.0,
"sglang:prompt_tokens_histogram_sum": 11808134.0,
"sglang:prompt_tokens_histogram_count": 1877.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2699014.0,
"sglang:realtime_tokens_total/prefill_compute": 2795408.0,
"sglang:realtime_tokens_total/decode": 489855.0,
"sglang:realtime_tokens_total/prefill_cache": 9540944.0,
"sglang:queue_time_seconds_sum": 5630.181711776182,
"sglang:queue_time_seconds_count": 1944.0
}
},
{
"time": 146.02047847397625,
"metrics": {
"sglang:queue_time_seconds_sum": 5121.339212644845,
"sglang:queue_time_seconds_count": 1964.0,
"sglang:realtime_tokens_total/prefill_compute": 2804448.0,
"sglang:realtime_tokens_total/decode": 494055.0,
"sglang:realtime_tokens_total/prefill_cache": 9684208.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2560.0,
"sglang:kv_evictable_tokens": 710896.0,
"sglang:prompt_tokens_histogram_sum": 12131407.0,
"sglang:prompt_tokens_histogram_count": 1897.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2732607.0,
"sglang:generation_tokens_total": 485384.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 148.02063516620547,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 17.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3088.0,
"sglang:kv_evictable_tokens": 628096.0,
"sglang:generation_tokens_total": 491592.0,
"sglang:prompt_tokens_histogram_sum": 12185695.0,
"sglang:prompt_tokens_histogram_count": 1925.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2764335.0,
"sglang:realtime_tokens_total/prefill_compute": 2848736.0,
"sglang:realtime_tokens_total/decode": 495375.0,
"sglang:realtime_tokens_total/prefill_cache": 9782672.0,
"sglang:queue_time_seconds_sum": 5782.593644050881,
"sglang:queue_time_seconds_count": 1992.0
}
},
{
"time": 148.02033567614853,
"metrics": {
"sglang:queue_time_seconds_sum": 5222.3001472326,
"sglang:queue_time_seconds_count": 2008.0,
"sglang:realtime_tokens_total/prefill_compute": 2841744.0,
"sglang:realtime_tokens_total/decode": 501499.0,
"sglang:realtime_tokens_total/prefill_cache": 9861616.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2768.0,
"sglang:kv_evictable_tokens": 752320.0,
"sglang:prompt_tokens_histogram_sum": 12384559.0,
"sglang:prompt_tokens_histogram_count": 1941.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2778575.0,
"sglang:generation_tokens_total": 496648.0
}
}
]
},
{
"label": "score_end",
"workers": [
{
"time": 150.00809330120683,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 67.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2672.0,
"sglang:kv_evictable_tokens": 614128.0,
"sglang:generation_tokens_total": 491848.0,
"sglang:prompt_tokens_histogram_sum": 12197001.0,
"sglang:prompt_tokens_histogram_count": 1926.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2766249.0,
"sglang:realtime_tokens_total/prefill_compute": 2851152.0,
"sglang:realtime_tokens_total/decode": 503886.0,
"sglang:realtime_tokens_total/prefill_cache": 9796640.0,
"sglang:queue_time_seconds_sum": 5787.735378197394,
"sglang:queue_time_seconds_count": 1993.0
}
},
{
"time": 150.00746896117926,
"metrics": {
"sglang:queue_time_seconds_sum": 5261.142871018499,
"sglang:queue_time_seconds_count": 2027.0,
"sglang:realtime_tokens_total/prefill_compute": 2865344.0,
"sglang:realtime_tokens_total/decode": 509623.0,
"sglang:realtime_tokens_total/prefill_cache": 9976640.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3248.0,
"sglang:kv_evictable_tokens": 708640.0,
"sglang:prompt_tokens_histogram_sum": 12480327.0,
"sglang:prompt_tokens_histogram_count": 1961.0,
"sglang:uncached_prompt_tokens_histogram_sum": 2796119.0,
"sglang:generation_tokens_total": 501768.0
}
}
]
},
{
"label": "drained",
"workers": [
{
"time": 189.04687312059104,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1888.0,
"sglang:kv_evictable_tokens": 1046688.0,
"sglang:generation_tokens_total": 621128.0,
"sglang:prompt_tokens_histogram_sum": 15698946.0,
"sglang:prompt_tokens_histogram_count": 2431.0,
"sglang:uncached_prompt_tokens_histogram_sum": 3374546.0,
"sglang:realtime_tokens_total/prefill_compute": 3385200.0,
"sglang:realtime_tokens_total/decode": 621125.0,
"sglang:realtime_tokens_total/prefill_cache": 12324400.0,
"sglang:queue_time_seconds_sum": 7069.878131816164,
"sglang:queue_time_seconds_count": 2434.0
}
},
{
"time": 189.04974621068686,
"metrics": {
"sglang:queue_time_seconds_sum": 6605.992745558731,
"sglang:queue_time_seconds_count": 2536.0,
"sglang:realtime_tokens_total/prefill_compute": 3394752.0,
"sglang:realtime_tokens_total/decode": 648194.0,
"sglang:realtime_tokens_total/prefill_cache": 12459360.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1168.0,
"sglang:kv_evictable_tokens": 1047408.0,
"sglang:prompt_tokens_histogram_sum": 15843339.0,
"sglang:prompt_tokens_histogram_count": 2533.0,
"sglang:uncached_prompt_tokens_histogram_sum": 3383979.0,
"sglang:generation_tokens_total": 648200.0
}
}
]
}
],
"r0_dynamo_kv": [
{
"label": "start",
"workers": [
{
"time": 0.0062896376475691795,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1047536.0,
"sglang:kv_evictable_tokens": 1040.0,
"sglang:generation_tokens_total": 621176.0,
"sglang:prompt_tokens_histogram_sum": 15702018.0,
"sglang:prompt_tokens_histogram_count": 2434.0,
"sglang:uncached_prompt_tokens_histogram_sum": 3375602.0,
"sglang:realtime_tokens_total/prefill_compute": 3386256.0,
"sglang:realtime_tokens_total/decode": 621173.0,
"sglang:realtime_tokens_total/prefill_cache": 12326416.0,
"sglang:queue_time_seconds_sum": 7069.879169230349,
"sglang:queue_time_seconds_count": 2437.0
}
},
{
"time": 0.006687960587441921,
"metrics": {
"sglang:queue_time_seconds_sum": 6605.993883708492,
"sglang:queue_time_seconds_count": 2539.0,
"sglang:realtime_tokens_total/prefill_compute": 3402960.0,
"sglang:realtime_tokens_total/decode": 648242.0,
"sglang:realtime_tokens_total/prefill_cache": 12463440.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1044464.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:prompt_tokens_histogram_sum": 15855627.0,
"sglang:prompt_tokens_histogram_count": 2536.0,
"sglang:uncached_prompt_tokens_histogram_sum": 3392187.0,
"sglang:generation_tokens_total": 648248.0
}
}
]
},
{
"label": "score_start",
"workers": [
{
"time": 30.006598812527955,
"metrics": {
"sglang:num_running_reqs": 56.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4464.0,
"sglang:kv_evictable_tokens": 654992.0,
"sglang:generation_tokens_total": 679288.0,
"sglang:prompt_tokens_histogram_sum": 17117967.0,
"sglang:prompt_tokens_histogram_count": 2661.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4455455.0,
"sglang:realtime_tokens_total/prefill_compute": 4628112.0,
"sglang:realtime_tokens_total/decode": 686849.0,
"sglang:realtime_tokens_total/prefill_cache": 12877056.0,
"sglang:queue_time_seconds_sum": 7942.922664976679,
"sglang:queue_time_seconds_count": 2727.0
}
},
{
"time": 30.01478609535843,
"metrics": {
"sglang:queue_time_seconds_sum": 7595.5272588459775,
"sglang:queue_time_seconds_count": 2855.0,
"sglang:realtime_tokens_total/prefill_compute": 4673408.0,
"sglang:realtime_tokens_total/decode": 715889.0,
"sglang:realtime_tokens_total/prefill_cache": 13116624.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 4512.0,
"sglang:kv_evictable_tokens": 670016.0,
"sglang:prompt_tokens_histogram_sum": 17392881.0,
"sglang:prompt_tokens_histogram_count": 2789.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4510561.0,
"sglang:generation_tokens_total": 713016.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 32.034024248830974,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3296.0,
"sglang:kv_evictable_tokens": 644320.0,
"sglang:generation_tokens_total": 686712.0,
"sglang:prompt_tokens_histogram_sum": 17335288.0,
"sglang:prompt_tokens_histogram_count": 2690.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4512776.0,
"sglang:realtime_tokens_total/prefill_compute": 4735648.0,
"sglang:realtime_tokens_total/decode": 689695.0,
"sglang:realtime_tokens_total/prefill_cache": 13027120.0,
"sglang:queue_time_seconds_sum": 8037.173486745916,
"sglang:queue_time_seconds_count": 2757.0
}
},
{
"time": 32.0358251882717,
"metrics": {
"sglang:queue_time_seconds_sum": 7617.56576269865,
"sglang:queue_time_seconds_count": 2860.0,
"sglang:realtime_tokens_total/prefill_compute": 4694032.0,
"sglang:realtime_tokens_total/decode": 724343.0,
"sglang:realtime_tokens_total/prefill_cache": 13119696.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3968.0,
"sglang:kv_evictable_tokens": 672992.0,
"sglang:prompt_tokens_histogram_sum": 17417926.0,
"sglang:prompt_tokens_histogram_count": 2793.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4533558.0,
"sglang:generation_tokens_total": 714040.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 34.03430639859289,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1120.0,
"sglang:kv_evictable_tokens": 648192.0,
"sglang:generation_tokens_total": 687480.0,
"sglang:prompt_tokens_histogram_sum": 17351181.0,
"sglang:prompt_tokens_histogram_count": 2693.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4527133.0,
"sglang:realtime_tokens_total/prefill_compute": 4737712.0,
"sglang:realtime_tokens_total/decode": 698781.0,
"sglang:realtime_tokens_total/prefill_cache": 13029408.0,
"sglang:queue_time_seconds_sum": 8043.709903971292,
"sglang:queue_time_seconds_count": 2759.0
}
},
{
"time": 34.03742729779333,
"metrics": {
"sglang:queue_time_seconds_sum": 7762.686364886351,
"sglang:queue_time_seconds_count": 2890.0,
"sglang:realtime_tokens_total/prefill_compute": 4759616.0,
"sglang:realtime_tokens_total/decode": 729881.0,
"sglang:realtime_tokens_total/prefill_cache": 13205696.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5184.0,
"sglang:kv_evictable_tokens": 669504.0,
"sglang:prompt_tokens_histogram_sum": 17565699.0,
"sglang:prompt_tokens_histogram_count": 2823.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4569987.0,
"sglang:generation_tokens_total": 721720.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 36.03490407112986,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1904.0,
"sglang:kv_evictable_tokens": 635376.0,
"sglang:generation_tokens_total": 695672.0,
"sglang:prompt_tokens_histogram_sum": 17553811.0,
"sglang:prompt_tokens_histogram_count": 2725.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4630675.0,
"sglang:realtime_tokens_total/prefill_compute": 4816176.0,
"sglang:realtime_tokens_total/decode": 703212.0,
"sglang:realtime_tokens_total/prefill_cache": 13089760.0,
"sglang:queue_time_seconds_sum": 8163.747517064214,
"sglang:queue_time_seconds_count": 2788.0
}
},
{
"time": 36.03526231367141,
"metrics": {
"sglang:queue_time_seconds_sum": 7868.059656141326,
"sglang:queue_time_seconds_count": 2918.0,
"sglang:realtime_tokens_total/prefill_compute": 4830144.0,
"sglang:realtime_tokens_total/decode": 735112.0,
"sglang:realtime_tokens_total/prefill_cache": 13332048.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 8224.0,
"sglang:kv_evictable_tokens": 692656.0,
"sglang:prompt_tokens_histogram_sum": 17786072.0,
"sglang:prompt_tokens_histogram_count": 2852.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4668936.0,
"sglang:generation_tokens_total": 729144.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 38.034630538895726,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4480.0,
"sglang:kv_evictable_tokens": 659072.0,
"sglang:generation_tokens_total": 703096.0,
"sglang:prompt_tokens_histogram_sum": 17750712.0,
"sglang:prompt_tokens_histogram_count": 2754.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4723592.0,
"sglang:realtime_tokens_total/prefill_compute": 4923104.0,
"sglang:realtime_tokens_total/decode": 706318.0,
"sglang:realtime_tokens_total/prefill_cache": 13243536.0,
"sglang:queue_time_seconds_sum": 8292.171244988218,
"sglang:queue_time_seconds_count": 2821.0
}
},
{
"time": 38.034956748597324,
"metrics": {
"sglang:queue_time_seconds_sum": 7899.544863184914,
"sglang:queue_time_seconds_count": 2925.0,
"sglang:realtime_tokens_total/prefill_compute": 4872016.0,
"sglang:realtime_tokens_total/decode": 741468.0,
"sglang:realtime_tokens_total/prefill_cache": 13334608.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 9488.0,
"sglang:kv_evictable_tokens": 648288.0,
"sglang:prompt_tokens_histogram_sum": 17804039.0,
"sglang:prompt_tokens_histogram_count": 2859.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4683319.0,
"sglang:generation_tokens_total": 730936.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 40.03672913182527,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 4208.0,
"sglang:kv_evictable_tokens": 640656.0,
"sglang:generation_tokens_total": 703608.0,
"sglang:prompt_tokens_histogram_sum": 17755044.0,
"sglang:prompt_tokens_histogram_count": 2756.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4725636.0,
"sglang:realtime_tokens_total/prefill_compute": 4936832.0,
"sglang:realtime_tokens_total/decode": 714764.0,
"sglang:realtime_tokens_total/prefill_cache": 13244560.0,
"sglang:queue_time_seconds_sum": 8299.421079209074,
"sglang:queue_time_seconds_count": 2823.0
}
},
{
"time": 40.036389482207596,
"metrics": {
"sglang:queue_time_seconds_sum": 8041.193249907345,
"sglang:queue_time_seconds_count": 2954.0,
"sglang:realtime_tokens_total/prefill_compute": 4952272.0,
"sglang:realtime_tokens_total/decode": 746098.0,
"sglang:realtime_tokens_total/prefill_cache": 13444592.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1232.0,
"sglang:kv_evictable_tokens": 626416.0,
"sglang:prompt_tokens_histogram_sum": 17952934.0,
"sglang:prompt_tokens_histogram_count": 2887.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4747238.0,
"sglang:generation_tokens_total": 738104.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 42.03375004697591,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 5568.0,
"sglang:kv_evictable_tokens": 612736.0,
"sglang:generation_tokens_total": 708728.0,
"sglang:prompt_tokens_histogram_sum": 17867947.0,
"sglang:prompt_tokens_histogram_count": 2776.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4799131.0,
"sglang:realtime_tokens_total/prefill_compute": 5034544.0,
"sglang:realtime_tokens_total/decode": 718492.0,
"sglang:realtime_tokens_total/prefill_cache": 13284464.0,
"sglang:queue_time_seconds_sum": 8388.079212810844,
"sglang:queue_time_seconds_count": 2842.0
}
},
{
"time": 42.03508274350315,
"metrics": {
"sglang:queue_time_seconds_sum": 8145.964946450666,
"sglang:queue_time_seconds_count": 2982.0,
"sglang:realtime_tokens_total/prefill_compute": 5012768.0,
"sglang:realtime_tokens_total/decode": 751761.0,
"sglang:realtime_tokens_total/prefill_cache": 13555968.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3408.0,
"sglang:kv_evictable_tokens": 651152.0,
"sglang:prompt_tokens_histogram_sum": 18149691.0,
"sglang:prompt_tokens_histogram_count": 2915.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4817643.0,
"sglang:generation_tokens_total": 745272.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 44.03479546587914,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 4352.0,
"sglang:kv_evictable_tokens": 610864.0,
"sglang:generation_tokens_total": 718968.0,
"sglang:prompt_tokens_histogram_sum": 18149097.0,
"sglang:prompt_tokens_histogram_count": 2816.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4908857.0,
"sglang:realtime_tokens_total/prefill_compute": 5126320.0,
"sglang:realtime_tokens_total/decode": 721837.0,
"sglang:realtime_tokens_total/prefill_cache": 13476176.0,
"sglang:queue_time_seconds_sum": 8547.333714476787,
"sglang:queue_time_seconds_count": 2881.0
}
},
{
"time": 44.04143776278943,
"metrics": {
"sglang:queue_time_seconds_sum": 8179.011231923476,
"sglang:queue_time_seconds_count": 2990.0,
"sglang:realtime_tokens_total/prefill_compute": 5050176.0,
"sglang:realtime_tokens_total/decode": 758980.0,
"sglang:realtime_tokens_total/prefill_cache": 13569328.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 58.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 5840.0,
"sglang:kv_evictable_tokens": 659552.0,
"sglang:prompt_tokens_histogram_sum": 18214636.0,
"sglang:prompt_tokens_histogram_count": 2924.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4878492.0,
"sglang:generation_tokens_total": 747576.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 46.035666964016855,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 8880.0,
"sglang:kv_evictable_tokens": 557088.0,
"sglang:generation_tokens_total": 719480.0,
"sglang:prompt_tokens_histogram_sum": 18154319.0,
"sglang:prompt_tokens_histogram_count": 2818.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4910783.0,
"sglang:realtime_tokens_total/prefill_compute": 5179280.0,
"sglang:realtime_tokens_total/decode": 727524.0,
"sglang:realtime_tokens_total/prefill_cache": 13483936.0,
"sglang:queue_time_seconds_sum": 8555.247308367863,
"sglang:queue_time_seconds_count": 2885.0
}
},
{
"time": 46.03705846052617,
"metrics": {
"sglang:queue_time_seconds_sum": 8360.646461850964,
"sglang:queue_time_seconds_count": 3029.0,
"sglang:realtime_tokens_total/prefill_compute": 5125632.0,
"sglang:realtime_tokens_total/decode": 763545.0,
"sglang:realtime_tokens_total/prefill_cache": 13666512.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 707888.0,
"sglang:prompt_tokens_histogram_sum": 18426843.0,
"sglang:prompt_tokens_histogram_count": 2962.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4947195.0,
"sglang:generation_tokens_total": 757304.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 48.036286876536906,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 1376.0,
"sglang:kv_evictable_tokens": 582144.0,
"sglang:generation_tokens_total": 722552.0,
"sglang:prompt_tokens_histogram_sum": 18240490.0,
"sglang:prompt_tokens_histogram_count": 2830.0,
"sglang:uncached_prompt_tokens_histogram_sum": 4981818.0,
"sglang:realtime_tokens_total/prefill_compute": 5207328.0,
"sglang:realtime_tokens_total/decode": 734360.0,
"sglang:realtime_tokens_total/prefill_cache": 13518112.0,
"sglang:queue_time_seconds_sum": 8610.680426098406,
"sglang:queue_time_seconds_count": 2897.0
}
},
{
"time": 48.03599524218589,
"metrics": {
"sglang:queue_time_seconds_sum": 8429.176534657367,
"sglang:queue_time_seconds_count": 3046.0,
"sglang:realtime_tokens_total/prefill_compute": 5151072.0,
"sglang:realtime_tokens_total/decode": 772104.0,
"sglang:realtime_tokens_total/prefill_cache": 13754272.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 2480.0,
"sglang:kv_evictable_tokens": 721616.0,
"sglang:prompt_tokens_histogram_sum": 18555973.0,
"sglang:prompt_tokens_histogram_count": 2979.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5000005.0,
"sglang:generation_tokens_total": 761656.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 50.04306297097355,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 18.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2208.0,
"sglang:kv_evictable_tokens": 645984.0,
"sglang:generation_tokens_total": 733560.0,
"sglang:prompt_tokens_histogram_sum": 18563816.0,
"sglang:prompt_tokens_histogram_count": 2873.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5089176.0,
"sglang:realtime_tokens_total/prefill_compute": 5288976.0,
"sglang:realtime_tokens_total/decode": 737957.0,
"sglang:realtime_tokens_total/prefill_cache": 13674464.0,
"sglang:queue_time_seconds_sum": 8762.111505487934,
"sglang:queue_time_seconds_count": 2938.0
}
},
{
"time": 50.036331442184746,
"metrics": {
"sglang:queue_time_seconds_sum": 8519.000043287873,
"sglang:queue_time_seconds_count": 3066.0,
"sglang:realtime_tokens_total/prefill_compute": 5236736.0,
"sglang:realtime_tokens_total/decode": 777110.0,
"sglang:realtime_tokens_total/prefill_cache": 13778832.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 5744.0,
"sglang:kv_evictable_tokens": 706240.0,
"sglang:prompt_tokens_histogram_sum": 18669270.0,
"sglang:prompt_tokens_histogram_count": 3001.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5091270.0,
"sglang:generation_tokens_total": 767288.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 52.035435744561255,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1712.0,
"sglang:kv_evictable_tokens": 660720.0,
"sglang:generation_tokens_total": 735864.0,
"sglang:prompt_tokens_histogram_sum": 18650597.0,
"sglang:prompt_tokens_histogram_count": 2882.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5166661.0,
"sglang:realtime_tokens_total/prefill_compute": 5362624.0,
"sglang:realtime_tokens_total/decode": 743640.0,
"sglang:realtime_tokens_total/prefill_cache": 13697600.0,
"sglang:queue_time_seconds_sum": 8784.15378639102,
"sglang:queue_time_seconds_count": 2949.0
}
},
{
"time": 52.03941872995347,
"metrics": {
"sglang:queue_time_seconds_sum": 8726.403151636943,
"sglang:queue_time_seconds_count": 3110.0,
"sglang:realtime_tokens_total/prefill_compute": 5329088.0,
"sglang:realtime_tokens_total/decode": 781151.0,
"sglang:realtime_tokens_total/prefill_cache": 13938896.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 5760.0,
"sglang:kv_evictable_tokens": 696832.0,
"sglang:prompt_tokens_histogram_sum": 18892295.0,
"sglang:prompt_tokens_histogram_count": 3043.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5138023.0,
"sglang:generation_tokens_total": 778040.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 54.03553256671876,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 51.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2832.0,
"sglang:kv_evictable_tokens": 623312.0,
"sglang:generation_tokens_total": 739960.0,
"sglang:prompt_tokens_histogram_sum": 18724368.0,
"sglang:prompt_tokens_histogram_count": 2898.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5203200.0,
"sglang:realtime_tokens_total/prefill_compute": 5390720.0,
"sglang:realtime_tokens_total/decode": 750920.0,
"sglang:realtime_tokens_total/prefill_cache": 13775456.0,
"sglang:queue_time_seconds_sum": 8837.343162293546,
"sglang:queue_time_seconds_count": 2964.0
}
},
{
"time": 54.03592927288264,
"metrics": {
"sglang:queue_time_seconds_sum": 8761.544079630636,
"sglang:queue_time_seconds_count": 3117.0,
"sglang:realtime_tokens_total/prefill_compute": 5332416.0,
"sglang:realtime_tokens_total/decode": 790552.0,
"sglang:realtime_tokens_total/prefill_cache": 13952768.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2880.0,
"sglang:kv_evictable_tokens": 699136.0,
"sglang:prompt_tokens_histogram_sum": 18925739.0,
"sglang:prompt_tokens_histogram_count": 3050.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5168395.0,
"sglang:generation_tokens_total": 779832.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 56.04200645070523,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 8800.0,
"sglang:kv_evictable_tokens": 593152.0,
"sglang:generation_tokens_total": 751480.0,
"sglang:prompt_tokens_histogram_sum": 19034897.0,
"sglang:prompt_tokens_histogram_count": 2943.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5346433.0,
"sglang:realtime_tokens_total/prefill_compute": 5479360.0,
"sglang:realtime_tokens_total/decode": 754578.0,
"sglang:realtime_tokens_total/prefill_cache": 13975360.0,
"sglang:queue_time_seconds_sum": 8981.882305078208,
"sglang:queue_time_seconds_count": 3006.0
}
},
{
"time": 56.03568210918456,
"metrics": {
"sglang:queue_time_seconds_sum": 8832.338423646055,
"sglang:queue_time_seconds_count": 3134.0,
"sglang:realtime_tokens_total/prefill_compute": 5403936.0,
"sglang:realtime_tokens_total/decode": 794311.0,
"sglang:realtime_tokens_total/prefill_cache": 14011488.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2880.0,
"sglang:kv_evictable_tokens": 687152.0,
"sglang:prompt_tokens_histogram_sum": 19035703.0,
"sglang:prompt_tokens_histogram_count": 3067.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5254823.0,
"sglang:generation_tokens_total": 784184.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 58.03533977549523,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 2848.0,
"sglang:kv_evictable_tokens": 604816.0,
"sglang:generation_tokens_total": 752248.0,
"sglang:prompt_tokens_histogram_sum": 19047363.0,
"sglang:prompt_tokens_histogram_count": 2946.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5349763.0,
"sglang:realtime_tokens_total/prefill_compute": 5530608.0,
"sglang:realtime_tokens_total/decode": 761102.0,
"sglang:realtime_tokens_total/prefill_cache": 13980480.0,
"sglang:queue_time_seconds_sum": 8999.573794232681,
"sglang:queue_time_seconds_count": 3013.0
}
},
{
"time": 58.035890931263566,
"metrics": {
"sglang:queue_time_seconds_sum": 8947.916405615397,
"sglang:queue_time_seconds_count": 3157.0,
"sglang:realtime_tokens_total/prefill_compute": 5522720.0,
"sglang:realtime_tokens_total/decode": 796260.0,
"sglang:realtime_tokens_total/prefill_cache": 14040480.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6432.0,
"sglang:kv_evictable_tokens": 650016.0,
"sglang:prompt_tokens_histogram_sum": 19160055.0,
"sglang:prompt_tokens_histogram_count": 3090.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5299159.0,
"sglang:generation_tokens_total": 790072.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 60.03567235823721,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3952.0,
"sglang:kv_evictable_tokens": 674608.0,
"sglang:generation_tokens_total": 757368.0,
"sglang:prompt_tokens_histogram_sum": 19203670.0,
"sglang:prompt_tokens_histogram_count": 2966.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5391654.0,
"sglang:realtime_tokens_total/prefill_compute": 5562288.0,
"sglang:realtime_tokens_total/decode": 767482.0,
"sglang:realtime_tokens_total/prefill_cache": 14019872.0,
"sglang:queue_time_seconds_sum": 9083.047362707555,
"sglang:queue_time_seconds_count": 3032.0
}
},
{
"time": 60.039580926299095,
"metrics": {
"sglang:queue_time_seconds_sum": 9027.167594260536,
"sglang:queue_time_seconds_count": 3174.0,
"sglang:realtime_tokens_total/prefill_compute": 5547648.0,
"sglang:realtime_tokens_total/decode": 804051.0,
"sglang:realtime_tokens_total/prefill_cache": 14146592.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1808.0,
"sglang:kv_evictable_tokens": 631232.0,
"sglang:prompt_tokens_histogram_sum": 19254650.0,
"sglang:prompt_tokens_histogram_count": 3107.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5315754.0,
"sglang:generation_tokens_total": 794424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 62.03721899725497,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2128.0,
"sglang:kv_evictable_tokens": 701936.0,
"sglang:generation_tokens_total": 767864.0,
"sglang:prompt_tokens_histogram_sum": 19483815.0,
"sglang:prompt_tokens_histogram_count": 3007.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5504871.0,
"sglang:realtime_tokens_total/prefill_compute": 5667728.0,
"sglang:realtime_tokens_total/decode": 770955.0,
"sglang:realtime_tokens_total/prefill_cache": 14189296.0,
"sglang:queue_time_seconds_sum": 9259.095776462927,
"sglang:queue_time_seconds_count": 3074.0
}
},
{
"time": 62.035878716968,
"metrics": {
"sglang:queue_time_seconds_sum": 9098.164052375592,
"sglang:queue_time_seconds_count": 3191.0,
"sglang:realtime_tokens_total/prefill_compute": 5627520.0,
"sglang:realtime_tokens_total/decode": 808491.0,
"sglang:realtime_tokens_total/prefill_cache": 14195792.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4224.0,
"sglang:kv_evictable_tokens": 599568.0,
"sglang:prompt_tokens_histogram_sum": 19358629.0,
"sglang:prompt_tokens_histogram_count": 3124.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5368117.0,
"sglang:generation_tokens_total": 798776.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 64.04152261186391,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 688368.0,
"sglang:generation_tokens_total": 768888.0,
"sglang:prompt_tokens_histogram_sum": 19505177.0,
"sglang:prompt_tokens_histogram_count": 3011.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5524185.0,
"sglang:realtime_tokens_total/prefill_compute": 5686160.0,
"sglang:realtime_tokens_total/decode": 779399.0,
"sglang:realtime_tokens_total/prefill_cache": 14191344.0,
"sglang:queue_time_seconds_sum": 9271.235478082672,
"sglang:queue_time_seconds_count": 3078.0
}
},
{
"time": 64.03544334229082,
"metrics": {
"sglang:queue_time_seconds_sum": 9251.685603421181,
"sglang:queue_time_seconds_count": 3223.0,
"sglang:realtime_tokens_total/prefill_compute": 5708736.0,
"sglang:realtime_tokens_total/decode": 812866.0,
"sglang:realtime_tokens_total/prefill_cache": 14314016.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2080.0,
"sglang:kv_evictable_tokens": 625968.0,
"sglang:prompt_tokens_histogram_sum": 19592913.0,
"sglang:prompt_tokens_histogram_count": 3160.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5518929.0,
"sglang:generation_tokens_total": 807992.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 66.03736628778279,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3808.0,
"sglang:kv_evictable_tokens": 688176.0,
"sglang:generation_tokens_total": 775032.0,
"sglang:prompt_tokens_histogram_sum": 19609484.0,
"sglang:prompt_tokens_histogram_count": 3035.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5570300.0,
"sglang:realtime_tokens_total/prefill_compute": 5766160.0,
"sglang:realtime_tokens_total/decode": 784288.0,
"sglang:realtime_tokens_total/prefill_cache": 14200560.0,
"sglang:queue_time_seconds_sum": 9376.152824587189,
"sglang:queue_time_seconds_count": 3099.0
}
},
{
"time": 66.03715481515974,
"metrics": {
"sglang:queue_time_seconds_sum": 9284.725790297613,
"sglang:queue_time_seconds_count": 3238.0,
"sglang:realtime_tokens_total/prefill_compute": 5801856.0,
"sglang:realtime_tokens_total/decode": 816683.0,
"sglang:realtime_tokens_total/prefill_cache": 14352272.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 6384.0,
"sglang:kv_evictable_tokens": 594672.0,
"sglang:prompt_tokens_histogram_sum": 19680600.0,
"sglang:prompt_tokens_histogram_count": 3171.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5534008.0,
"sglang:generation_tokens_total": 810808.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 68.0343339862302,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2992.0,
"sglang:kv_evictable_tokens": 676528.0,
"sglang:generation_tokens_total": 784248.0,
"sglang:prompt_tokens_histogram_sum": 19860016.0,
"sglang:prompt_tokens_histogram_count": 3071.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5670208.0,
"sglang:realtime_tokens_total/prefill_compute": 5863392.0,
"sglang:realtime_tokens_total/decode": 787515.0,
"sglang:realtime_tokens_total/prefill_cache": 14394560.0,
"sglang:queue_time_seconds_sum": 9553.351915505715,
"sglang:queue_time_seconds_count": 3138.0
}
},
{
"time": 68.03720560390502,
"metrics": {
"sglang:queue_time_seconds_sum": 9314.104423267767,
"sglang:queue_time_seconds_count": 3245.0,
"sglang:realtime_tokens_total/prefill_compute": 5820320.0,
"sglang:realtime_tokens_total/decode": 824164.0,
"sglang:realtime_tokens_total/prefill_cache": 14358128.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 7280.0,
"sglang:kv_evictable_tokens": 619248.0,
"sglang:prompt_tokens_histogram_sum": 19751238.0,
"sglang:prompt_tokens_histogram_count": 3178.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5563238.0,
"sglang:generation_tokens_total": 812600.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 70.03479225002229,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 59.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1392.0,
"sglang:kv_evictable_tokens": 654880.0,
"sglang:generation_tokens_total": 785016.0,
"sglang:prompt_tokens_histogram_sum": 19864112.0,
"sglang:prompt_tokens_histogram_count": 3074.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5672768.0,
"sglang:realtime_tokens_total/prefill_compute": 5882720.0,
"sglang:realtime_tokens_total/decode": 795640.0,
"sglang:realtime_tokens_total/prefill_cache": 14396096.0,
"sglang:queue_time_seconds_sum": 9560.379709300585,
"sglang:queue_time_seconds_count": 3141.0
}
},
{
"time": 70.03683725465089,
"metrics": {
"sglang:queue_time_seconds_sum": 9462.65216217935,
"sglang:queue_time_seconds_count": 3274.0,
"sglang:realtime_tokens_total/prefill_compute": 5914544.0,
"sglang:realtime_tokens_total/decode": 827902.0,
"sglang:realtime_tokens_total/prefill_cache": 14429904.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3664.0,
"sglang:kv_evictable_tokens": 651152.0,
"sglang:prompt_tokens_histogram_sum": 19945584.0,
"sglang:prompt_tokens_histogram_count": 3207.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5673088.0,
"sglang:generation_tokens_total": 820024.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 72.03462129365653,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5024.0,
"sglang:kv_evictable_tokens": 645584.0,
"sglang:generation_tokens_total": 791416.0,
"sglang:prompt_tokens_histogram_sum": 20002823.0,
"sglang:prompt_tokens_histogram_count": 3099.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5774263.0,
"sglang:realtime_tokens_total/prefill_compute": 5952240.0,
"sglang:realtime_tokens_total/decode": 800665.0,
"sglang:realtime_tokens_total/prefill_cache": 14416944.0,
"sglang:queue_time_seconds_sum": 9667.794128781185,
"sglang:queue_time_seconds_count": 3163.0
}
},
{
"time": 72.0374422064051,
"metrics": {
"sglang:queue_time_seconds_sum": 9558.908275086433,
"sglang:queue_time_seconds_count": 3301.0,
"sglang:realtime_tokens_total/prefill_compute": 5995824.0,
"sglang:realtime_tokens_total/decode": 832635.0,
"sglang:realtime_tokens_total/prefill_cache": 14556944.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4208.0,
"sglang:kv_evictable_tokens": 659328.0,
"sglang:prompt_tokens_histogram_sum": 20140178.0,
"sglang:prompt_tokens_histogram_count": 3235.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5787906.0,
"sglang:generation_tokens_total": 827192.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 74.03532559145242,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3072.0,
"sglang:kv_evictable_tokens": 684976.0,
"sglang:generation_tokens_total": 800632.0,
"sglang:prompt_tokens_histogram_sum": 20244335.0,
"sglang:prompt_tokens_histogram_count": 3135.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5849775.0,
"sglang:realtime_tokens_total/prefill_compute": 6018720.0,
"sglang:realtime_tokens_total/decode": 803701.0,
"sglang:realtime_tokens_total/prefill_cache": 14557504.0,
"sglang:queue_time_seconds_sum": 9861.974551275373,
"sglang:queue_time_seconds_count": 3201.0
}
},
{
"time": 74.03585100267082,
"metrics": {
"sglang:queue_time_seconds_sum": 9587.922735752538,
"sglang:queue_time_seconds_count": 3308.0,
"sglang:realtime_tokens_total/prefill_compute": 6030816.0,
"sglang:realtime_tokens_total/decode": 839714.0,
"sglang:realtime_tokens_total/prefill_cache": 14574736.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 6400.0,
"sglang:kv_evictable_tokens": 621328.0,
"sglang:prompt_tokens_histogram_sum": 20164479.0,
"sglang:prompt_tokens_histogram_count": 3241.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5806351.0,
"sglang:generation_tokens_total": 828728.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 76.03444581385702,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1696.0,
"sglang:kv_evictable_tokens": 680560.0,
"sglang:generation_tokens_total": 801400.0,
"sglang:prompt_tokens_histogram_sum": 20265183.0,
"sglang:prompt_tokens_histogram_count": 3138.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5869087.0,
"sglang:realtime_tokens_total/prefill_compute": 6047872.0,
"sglang:realtime_tokens_total/decode": 811761.0,
"sglang:realtime_tokens_total/prefill_cache": 14603872.0,
"sglang:queue_time_seconds_sum": 9870.415211327374,
"sglang:queue_time_seconds_count": 3205.0
}
},
{
"time": 76.03886728081852,
"metrics": {
"sglang:queue_time_seconds_sum": 9737.390316270292,
"sglang:queue_time_seconds_count": 3342.0,
"sglang:realtime_tokens_total/prefill_compute": 6090592.0,
"sglang:realtime_tokens_total/decode": 844736.0,
"sglang:realtime_tokens_total/prefill_cache": 14736640.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1856.0,
"sglang:kv_evictable_tokens": 600608.0,
"sglang:prompt_tokens_histogram_sum": 20396190.0,
"sglang:prompt_tokens_histogram_count": 3275.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5911422.0,
"sglang:generation_tokens_total": 837432.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 78.03516505565494,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 682464.0,
"sglang:generation_tokens_total": 807800.0,
"sglang:prompt_tokens_histogram_sum": 20408469.0,
"sglang:prompt_tokens_histogram_count": 3163.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5977797.0,
"sglang:realtime_tokens_total/prefill_compute": 6119360.0,
"sglang:realtime_tokens_total/decode": 817031.0,
"sglang:realtime_tokens_total/prefill_cache": 14619936.0,
"sglang:queue_time_seconds_sum": 9949.743354366161,
"sglang:queue_time_seconds_count": 3222.0
}
},
{
"time": 78.03549214545637,
"metrics": {
"sglang:queue_time_seconds_sum": 9792.14874079451,
"sglang:queue_time_seconds_count": 3365.0,
"sglang:realtime_tokens_total/prefill_compute": 6157024.0,
"sglang:realtime_tokens_total/decode": 850281.0,
"sglang:realtime_tokens_total/prefill_cache": 14854240.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3264.0,
"sglang:kv_evictable_tokens": 597264.0,
"sglang:prompt_tokens_histogram_sum": 20538568.0,
"sglang:prompt_tokens_histogram_count": 3298.0,
"sglang:uncached_prompt_tokens_histogram_sum": 5981624.0,
"sglang:generation_tokens_total": 843320.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 80.03560100030154,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6688.0,
"sglang:kv_evictable_tokens": 656016.0,
"sglang:generation_tokens_total": 817016.0,
"sglang:prompt_tokens_histogram_sum": 20619146.0,
"sglang:prompt_tokens_histogram_count": 3199.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6016298.0,
"sglang:realtime_tokens_total/prefill_compute": 6219088.0,
"sglang:realtime_tokens_total/decode": 820067.0,
"sglang:realtime_tokens_total/prefill_cache": 14803792.0,
"sglang:queue_time_seconds_sum": 10144.459260364063,
"sglang:queue_time_seconds_count": 3265.0
}
},
{
"time": 80.0353289982304,
"metrics": {
"sglang:queue_time_seconds_sum": 9822.337819097564,
"sglang:queue_time_seconds_count": 3373.0,
"sglang:realtime_tokens_total/prefill_compute": 6200832.0,
"sglang:realtime_tokens_total/decode": 856771.0,
"sglang:realtime_tokens_total/prefill_cache": 14858336.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 7472.0,
"sglang:kv_evictable_tokens": 604928.0,
"sglang:prompt_tokens_histogram_sum": 20605024.0,
"sglang:prompt_tokens_histogram_count": 3306.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6029776.0,
"sglang:generation_tokens_total": 845368.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 82.04017080832273,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3264.0,
"sglang:kv_evictable_tokens": 647760.0,
"sglang:generation_tokens_total": 817784.0,
"sglang:prompt_tokens_histogram_sum": 20637834.0,
"sglang:prompt_tokens_histogram_count": 3202.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6033962.0,
"sglang:realtime_tokens_total/prefill_compute": 6249648.0,
"sglang:realtime_tokens_total/decode": 828127.0,
"sglang:realtime_tokens_total/prefill_cache": 14806352.0,
"sglang:queue_time_seconds_sum": 10154.734191236086,
"sglang:queue_time_seconds_count": 3269.0
}
},
{
"time": 82.0374469999224,
"metrics": {
"sglang:queue_time_seconds_sum": 9982.165844513103,
"sglang:queue_time_seconds_count": 3409.0,
"sglang:realtime_tokens_total/prefill_compute": 6270336.0,
"sglang:realtime_tokens_total/decode": 861407.0,
"sglang:realtime_tokens_total/prefill_cache": 15005632.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5968.0,
"sglang:kv_evictable_tokens": 647104.0,
"sglang:prompt_tokens_histogram_sum": 20883973.0,
"sglang:prompt_tokens_histogram_count": 3342.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6087669.0,
"sglang:generation_tokens_total": 854584.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 84.03538041654974,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5888.0,
"sglang:kv_evictable_tokens": 644816.0,
"sglang:generation_tokens_total": 824184.0,
"sglang:prompt_tokens_histogram_sum": 20782013.0,
"sglang:prompt_tokens_histogram_count": 3227.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6131469.0,
"sglang:realtime_tokens_total/prefill_compute": 6317344.0,
"sglang:realtime_tokens_total/decode": 833412.0,
"sglang:realtime_tokens_total/prefill_cache": 14823808.0,
"sglang:queue_time_seconds_sum": 10260.606635898352,
"sglang:queue_time_seconds_count": 3290.0
}
},
{
"time": 84.03505649510771,
"metrics": {
"sglang:queue_time_seconds_sum": 10022.840810687281,
"sglang:queue_time_seconds_count": 3429.0,
"sglang:realtime_tokens_total/prefill_compute": 6335184.0,
"sglang:realtime_tokens_total/decode": 867147.0,
"sglang:realtime_tokens_total/prefill_cache": 15082240.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5760.0,
"sglang:kv_evictable_tokens": 647120.0,
"sglang:prompt_tokens_histogram_sum": 20996757.0,
"sglang:prompt_tokens_histogram_count": 3362.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6142517.0,
"sglang:generation_tokens_total": 859704.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 86.03427697438747,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2960.0,
"sglang:kv_evictable_tokens": 667152.0,
"sglang:generation_tokens_total": 834168.0,
"sglang:prompt_tokens_histogram_sum": 21041828.0,
"sglang:prompt_tokens_histogram_count": 3266.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6235476.0,
"sglang:realtime_tokens_total/prefill_compute": 6408448.0,
"sglang:realtime_tokens_total/decode": 836829.0,
"sglang:realtime_tokens_total/prefill_cache": 15020048.0,
"sglang:queue_time_seconds_sum": 10441.11714541167,
"sglang:queue_time_seconds_count": 3332.0
}
},
{
"time": 86.03481005039066,
"metrics": {
"sglang:queue_time_seconds_sum": 10057.72739438247,
"sglang:queue_time_seconds_count": 3438.0,
"sglang:realtime_tokens_total/prefill_compute": 6384768.0,
"sglang:realtime_tokens_total/decode": 873619.0,
"sglang:realtime_tokens_total/prefill_cache": 15085312.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 7248.0,
"sglang:kv_evictable_tokens": 637792.0,
"sglang:prompt_tokens_histogram_sum": 21082216.0,
"sglang:prompt_tokens_histogram_count": 3380.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6211016.0,
"sglang:generation_tokens_total": 864312.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 88.03412880282849,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3312.0,
"sglang:kv_evictable_tokens": 649392.0,
"sglang:generation_tokens_total": 834424.0,
"sglang:prompt_tokens_histogram_sum": 21043364.0,
"sglang:prompt_tokens_histogram_count": 3267.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6236500.0,
"sglang:realtime_tokens_total/prefill_compute": 6431392.0,
"sglang:realtime_tokens_total/decode": 844955.0,
"sglang:realtime_tokens_total/prefill_cache": 15021584.0,
"sglang:queue_time_seconds_sum": 10447.33318407461,
"sglang:queue_time_seconds_count": 3334.0
}
},
{
"time": 88.03483130317181,
"metrics": {
"sglang:queue_time_seconds_sum": 10227.444324080832,
"sglang:queue_time_seconds_count": 3477.0,
"sglang:realtime_tokens_total/prefill_compute": 6463392.0,
"sglang:realtime_tokens_total/decode": 877930.0,
"sglang:realtime_tokens_total/prefill_cache": 15291440.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 6176.0,
"sglang:kv_evictable_tokens": 620512.0,
"sglang:prompt_tokens_histogram_sum": 21306536.0,
"sglang:prompt_tokens_histogram_count": 3410.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6263448.0,
"sglang:generation_tokens_total": 871992.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 90.0381312482059,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 10512.0,
"sglang:kv_evictable_tokens": 630320.0,
"sglang:generation_tokens_total": 840568.0,
"sglang:prompt_tokens_histogram_sum": 21171785.0,
"sglang:prompt_tokens_histogram_count": 3291.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6327497.0,
"sglang:realtime_tokens_total/prefill_compute": 6514880.0,
"sglang:realtime_tokens_total/decode": 849724.0,
"sglang:realtime_tokens_total/prefill_cache": 15036496.0,
"sglang:queue_time_seconds_sum": 10532.157221634872,
"sglang:queue_time_seconds_count": 3351.0
}
},
{
"time": 90.03621930070221,
"metrics": {
"sglang:queue_time_seconds_sum": 10263.313671471551,
"sglang:queue_time_seconds_count": 3493.0,
"sglang:realtime_tokens_total/prefill_compute": 6520672.0,
"sglang:realtime_tokens_total/decode": 883738.0,
"sglang:realtime_tokens_total/prefill_cache": 15339472.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2752.0,
"sglang:kv_evictable_tokens": 612064.0,
"sglang:prompt_tokens_histogram_sum": 21402646.0,
"sglang:prompt_tokens_histogram_count": 3426.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6320406.0,
"sglang:generation_tokens_total": 876088.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 92.035271842964,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 7584.0,
"sglang:kv_evictable_tokens": 637712.0,
"sglang:generation_tokens_total": 849784.0,
"sglang:prompt_tokens_histogram_sum": 21414061.0,
"sglang:prompt_tokens_histogram_count": 3327.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6394013.0,
"sglang:realtime_tokens_total/prefill_compute": 6604032.0,
"sglang:realtime_tokens_total/decode": 852815.0,
"sglang:realtime_tokens_total/prefill_cache": 15232224.0,
"sglang:queue_time_seconds_sum": 10715.670778512955,
"sglang:queue_time_seconds_count": 3393.0
}
},
{
"time": 92.03510702680796,
"metrics": {
"sglang:queue_time_seconds_sum": 10335.190006099641,
"sglang:queue_time_seconds_count": 3510.0,
"sglang:realtime_tokens_total/prefill_compute": 6565360.0,
"sglang:realtime_tokens_total/decode": 890057.0,
"sglang:realtime_tokens_total/prefill_cache": 15358304.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 9360.0,
"sglang:kv_evictable_tokens": 651968.0,
"sglang:prompt_tokens_histogram_sum": 21524538.0,
"sglang:prompt_tokens_histogram_count": 3444.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6408858.0,
"sglang:generation_tokens_total": 880696.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 94.0356526831165,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2208.0,
"sglang:kv_evictable_tokens": 634576.0,
"sglang:generation_tokens_total": 850552.0,
"sglang:prompt_tokens_histogram_sum": 21429827.0,
"sglang:prompt_tokens_histogram_count": 3330.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6408755.0,
"sglang:realtime_tokens_total/prefill_compute": 6625824.0,
"sglang:realtime_tokens_total/decode": 861003.0,
"sglang:realtime_tokens_total/prefill_cache": 15237088.0,
"sglang:queue_time_seconds_sum": 10724.65702062007,
"sglang:queue_time_seconds_count": 3397.0
}
},
{
"time": 94.0350793832913,
"metrics": {
"sglang:queue_time_seconds_sum": 10486.978778736666,
"sglang:queue_time_seconds_count": 3541.0,
"sglang:realtime_tokens_total/prefill_compute": 6645264.0,
"sglang:realtime_tokens_total/decode": 894308.0,
"sglang:realtime_tokens_total/prefill_cache": 15448000.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3696.0,
"sglang:kv_evictable_tokens": 702656.0,
"sglang:prompt_tokens_histogram_sum": 21739848.0,
"sglang:prompt_tokens_histogram_count": 3474.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6448408.0,
"sglang:generation_tokens_total": 888376.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 96.0364547567442,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3968.0,
"sglang:kv_evictable_tokens": 651648.0,
"sglang:generation_tokens_total": 854392.0,
"sglang:prompt_tokens_histogram_sum": 21536845.0,
"sglang:prompt_tokens_histogram_count": 3345.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6500349.0,
"sglang:realtime_tokens_total/prefill_compute": 6692752.0,
"sglang:realtime_tokens_total/decode": 865716.0,
"sglang:realtime_tokens_total/prefill_cache": 15244512.0,
"sglang:queue_time_seconds_sum": 10793.148311059922,
"sglang:queue_time_seconds_count": 3411.0
}
},
{
"time": 96.03615267574787,
"metrics": {
"sglang:queue_time_seconds_sum": 10528.717990932986,
"sglang:queue_time_seconds_count": 3557.0,
"sglang:realtime_tokens_total/prefill_compute": 6705376.0,
"sglang:realtime_tokens_total/decode": 901012.0,
"sglang:realtime_tokens_total/prefill_cache": 15523984.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4672.0,
"sglang:kv_evictable_tokens": 683744.0,
"sglang:prompt_tokens_histogram_sum": 21845098.0,
"sglang:prompt_tokens_histogram_count": 3490.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6505626.0,
"sglang:generation_tokens_total": 892472.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 98.03694041352719,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3392.0,
"sglang:kv_evictable_tokens": 637680.0,
"sglang:generation_tokens_total": 864376.0,
"sglang:prompt_tokens_histogram_sum": 21803638.0,
"sglang:prompt_tokens_histogram_count": 3384.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6572950.0,
"sglang:realtime_tokens_total/prefill_compute": 6795712.0,
"sglang:realtime_tokens_total/decode": 868934.0,
"sglang:realtime_tokens_total/prefill_cache": 15442240.0,
"sglang:queue_time_seconds_sum": 10963.144942658022,
"sglang:queue_time_seconds_count": 3450.0
}
},
{
"time": 98.22518257144839,
"metrics": {
"sglang:queue_time_seconds_sum": 10604.045711598359,
"sglang:queue_time_seconds_count": 3575.0,
"sglang:realtime_tokens_total/prefill_compute": 6772944.0,
"sglang:realtime_tokens_total/decode": 906562.0,
"sglang:realtime_tokens_total/prefill_cache": 15562000.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2064.0,
"sglang:kv_evictable_tokens": 656144.0,
"sglang:prompt_tokens_histogram_sum": 21922837.0,
"sglang:prompt_tokens_histogram_count": 3508.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6562997.0,
"sglang:generation_tokens_total": 897080.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 100.0352511452511,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 2752.0,
"sglang:kv_evictable_tokens": 581040.0,
"sglang:generation_tokens_total": 866936.0,
"sglang:prompt_tokens_histogram_sum": 21848166.0,
"sglang:prompt_tokens_histogram_count": 3394.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6611078.0,
"sglang:realtime_tokens_total/prefill_compute": 6865264.0,
"sglang:realtime_tokens_total/decode": 873912.0,
"sglang:realtime_tokens_total/prefill_cache": 15472368.0,
"sglang:queue_time_seconds_sum": 10987.38694688771,
"sglang:queue_time_seconds_count": 3461.0
}
},
{
"time": 100.03474491741508,
"metrics": {
"sglang:queue_time_seconds_sum": 10776.656740610488,
"sglang:queue_time_seconds_count": 3610.0,
"sglang:realtime_tokens_total/prefill_compute": 6848880.0,
"sglang:realtime_tokens_total/decode": 911377.0,
"sglang:realtime_tokens_total/prefill_cache": 15687872.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3952.0,
"sglang:kv_evictable_tokens": 696848.0,
"sglang:prompt_tokens_histogram_sum": 22184955.0,
"sglang:prompt_tokens_histogram_count": 3549.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6663531.0,
"sglang:generation_tokens_total": 907576.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 102.03638845216483,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 3568.0,
"sglang:kv_evictable_tokens": 573248.0,
"sglang:generation_tokens_total": 868472.0,
"sglang:prompt_tokens_histogram_sum": 21881740.0,
"sglang:prompt_tokens_histogram_count": 3400.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6641580.0,
"sglang:realtime_tokens_total/prefill_compute": 6894000.0,
"sglang:realtime_tokens_total/decode": 880691.0,
"sglang:realtime_tokens_total/prefill_cache": 15474416.0,
"sglang:queue_time_seconds_sum": 11015.872634086758,
"sglang:queue_time_seconds_count": 3467.0
}
},
{
"time": 102.04033974092454,
"metrics": {
"sglang:queue_time_seconds_sum": 10829.226090845652,
"sglang:queue_time_seconds_count": 3624.0,
"sglang:realtime_tokens_total/prefill_compute": 6867568.0,
"sglang:realtime_tokens_total/decode": 919621.0,
"sglang:realtime_tokens_total/prefill_cache": 15750080.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 4192.0,
"sglang:kv_evictable_tokens": 677792.0,
"sglang:prompt_tokens_histogram_sum": 22247224.0,
"sglang:prompt_tokens_histogram_count": 3557.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6708760.0,
"sglang:generation_tokens_total": 909624.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 104.0371342068538,
"metrics": {
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3232.0,
"sglang:kv_evictable_tokens": 592320.0,
"sglang:generation_tokens_total": 878712.0,
"sglang:prompt_tokens_histogram_sum": 22164146.0,
"sglang:prompt_tokens_histogram_count": 3440.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6749986.0,
"sglang:realtime_tokens_total/prefill_compute": 6970096.0,
"sglang:realtime_tokens_total/decode": 884363.0,
"sglang:realtime_tokens_total/prefill_cache": 15660592.0,
"sglang:queue_time_seconds_sum": 11187.20843692962,
"sglang:queue_time_seconds_count": 3506.0
}
},
{
"time": 104.0345239341259,
"metrics": {
"sglang:queue_time_seconds_sum": 10903.030018431135,
"sglang:queue_time_seconds_count": 3642.0,
"sglang:realtime_tokens_total/prefill_compute": 6962704.0,
"sglang:realtime_tokens_total/decode": 924017.0,
"sglang:realtime_tokens_total/prefill_cache": 15769456.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 12368.0,
"sglang:kv_evictable_tokens": 665328.0,
"sglang:prompt_tokens_histogram_sum": 22338528.0,
"sglang:prompt_tokens_histogram_count": 3575.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6761296.0,
"sglang:generation_tokens_total": 914232.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 106.041574110277,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 51.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3904.0,
"sglang:kv_evictable_tokens": 674368.0,
"sglang:generation_tokens_total": 883320.0,
"sglang:prompt_tokens_histogram_sum": 22322606.0,
"sglang:prompt_tokens_histogram_count": 3458.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6850238.0,
"sglang:realtime_tokens_total/prefill_compute": 7046944.0,
"sglang:realtime_tokens_total/decode": 890104.0,
"sglang:realtime_tokens_total/prefill_cache": 15674144.0,
"sglang:queue_time_seconds_sum": 11246.765059434809,
"sglang:queue_time_seconds_count": 3525.0
}
},
{
"time": 106.03649918269366,
"metrics": {
"sglang:queue_time_seconds_sum": 11062.371218755841,
"sglang:queue_time_seconds_count": 3674.0,
"sglang:realtime_tokens_total/prefill_compute": 7058336.0,
"sglang:realtime_tokens_total/decode": 927441.0,
"sglang:realtime_tokens_total/prefill_cache": 15865376.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1584.0,
"sglang:kv_evictable_tokens": 669616.0,
"sglang:prompt_tokens_histogram_sum": 22521229.0,
"sglang:prompt_tokens_histogram_count": 3607.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6833357.0,
"sglang:generation_tokens_total": 922424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 108.03512647654861,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 64.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 5520.0,
"sglang:kv_evictable_tokens": 684384.0,
"sglang:generation_tokens_total": 885624.0,
"sglang:prompt_tokens_histogram_sum": 22384506.0,
"sglang:prompt_tokens_histogram_count": 3467.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6884698.0,
"sglang:realtime_tokens_total/prefill_compute": 7065664.0,
"sglang:realtime_tokens_total/decode": 897905.0,
"sglang:realtime_tokens_total/prefill_cache": 15684064.0,
"sglang:queue_time_seconds_sum": 11288.158562545665,
"sglang:queue_time_seconds_count": 3534.0
}
},
{
"time": 108.0343705676496,
"metrics": {
"sglang:queue_time_seconds_sum": 11108.61812890973,
"sglang:queue_time_seconds_count": 3685.0,
"sglang:realtime_tokens_total/prefill_compute": 7079440.0,
"sglang:realtime_tokens_total/decode": 935366.0,
"sglang:realtime_tokens_total/prefill_cache": 15964048.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 944.0,
"sglang:kv_evictable_tokens": 625952.0,
"sglang:prompt_tokens_histogram_sum": 22599015.0,
"sglang:prompt_tokens_histogram_count": 3618.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6849447.0,
"sglang:generation_tokens_total": 925240.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 110.03564454894513,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1072.0,
"sglang:kv_evictable_tokens": 695456.0,
"sglang:generation_tokens_total": 898936.0,
"sglang:prompt_tokens_histogram_sum": 22693063.0,
"sglang:prompt_tokens_histogram_count": 3519.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7020455.0,
"sglang:realtime_tokens_total/prefill_compute": 7152368.0,
"sglang:realtime_tokens_total/decode": 901941.0,
"sglang:realtime_tokens_total/prefill_cache": 15878496.0,
"sglang:queue_time_seconds_sum": 11498.57592550572,
"sglang:queue_time_seconds_count": 3585.0
}
},
{
"time": 110.03858061414212,
"metrics": {
"sglang:queue_time_seconds_sum": 11181.462058154866,
"sglang:queue_time_seconds_count": 3705.0,
"sglang:realtime_tokens_total/prefill_compute": 7155184.0,
"sglang:realtime_tokens_total/decode": 940019.0,
"sglang:realtime_tokens_total/prefill_cache": 16039120.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1680.0,
"sglang:kv_evictable_tokens": 567936.0,
"sglang:prompt_tokens_histogram_sum": 22700112.0,
"sglang:prompt_tokens_histogram_count": 3638.0,
"sglang:uncached_prompt_tokens_histogram_sum": 6931168.0,
"sglang:generation_tokens_total": 930360.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 112.03401004802436,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1088.0,
"sglang:kv_evictable_tokens": 673472.0,
"sglang:generation_tokens_total": 899704.0,
"sglang:prompt_tokens_histogram_sum": 22705785.0,
"sglang:prompt_tokens_histogram_count": 3522.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7031641.0,
"sglang:realtime_tokens_total/prefill_compute": 7181904.0,
"sglang:realtime_tokens_total/decode": 909745.0,
"sglang:realtime_tokens_total/prefill_cache": 15921200.0,
"sglang:queue_time_seconds_sum": 11511.105628387071,
"sglang:queue_time_seconds_count": 3589.0
}
},
{
"time": 112.03434309083968,
"metrics": {
"sglang:queue_time_seconds_sum": 11310.277741306461,
"sglang:queue_time_seconds_count": 3735.0,
"sglang:realtime_tokens_total/prefill_compute": 7241824.0,
"sglang:realtime_tokens_total/decode": 943758.0,
"sglang:realtime_tokens_total/prefill_cache": 16188096.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.49,
"sglang:kv_available_tokens": 4336.0,
"sglang:kv_evictable_tokens": 529984.0,
"sglang:prompt_tokens_histogram_sum": 22951746.0,
"sglang:prompt_tokens_histogram_count": 3671.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7049298.0,
"sglang:generation_tokens_total": 938808.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 114.0381356952712,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 11968.0,
"sglang:kv_evictable_tokens": 626352.0,
"sglang:generation_tokens_total": 903032.0,
"sglang:prompt_tokens_histogram_sum": 22769496.0,
"sglang:prompt_tokens_histogram_count": 3535.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7072824.0,
"sglang:realtime_tokens_total/prefill_compute": 7254080.0,
"sglang:realtime_tokens_total/decode": 914849.0,
"sglang:realtime_tokens_total/prefill_cache": 15925808.0,
"sglang:queue_time_seconds_sum": 11574.936334628612,
"sglang:queue_time_seconds_count": 3601.0
}
},
{
"time": 114.0351815810427,
"metrics": {
"sglang:queue_time_seconds_sum": 11335.042671733536,
"sglang:queue_time_seconds_count": 3749.0,
"sglang:realtime_tokens_total/prefill_compute": 7298480.0,
"sglang:realtime_tokens_total/decode": 949178.0,
"sglang:realtime_tokens_total/prefill_cache": 16228240.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 572592.0,
"sglang:prompt_tokens_histogram_sum": 23027624.0,
"sglang:prompt_tokens_histogram_count": 3682.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7063576.0,
"sglang:generation_tokens_total": 941624.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 116.03540241997689,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 3216.0,
"sglang:kv_evictable_tokens": 603824.0,
"sglang:generation_tokens_total": 913272.0,
"sglang:prompt_tokens_histogram_sum": 23015361.0,
"sglang:prompt_tokens_histogram_count": 3575.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7136865.0,
"sglang:realtime_tokens_total/prefill_compute": 7347504.0,
"sglang:realtime_tokens_total/decode": 918066.0,
"sglang:realtime_tokens_total/prefill_cache": 16137216.0,
"sglang:queue_time_seconds_sum": 11767.92568722926,
"sglang:queue_time_seconds_count": 3642.0
}
},
{
"time": 116.03532539401203,
"metrics": {
"sglang:queue_time_seconds_sum": 11407.761993083172,
"sglang:queue_time_seconds_count": 3766.0,
"sglang:realtime_tokens_total/prefill_compute": 7332160.0,
"sglang:realtime_tokens_total/decode": 955561.0,
"sglang:realtime_tokens_total/prefill_cache": 16285648.0,
"sglang:num_running_reqs": 57.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 6032.0,
"sglang:kv_evictable_tokens": 610880.0,
"sglang:prompt_tokens_histogram_sum": 23174142.0,
"sglang:prompt_tokens_histogram_count": 3700.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7135534.0,
"sglang:generation_tokens_total": 946232.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 118.0346766281873,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 8624.0,
"sglang:kv_evictable_tokens": 600672.0,
"sglang:generation_tokens_total": 916088.0,
"sglang:prompt_tokens_histogram_sum": 23087567.0,
"sglang:prompt_tokens_histogram_count": 3586.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7166367.0,
"sglang:realtime_tokens_total/prefill_compute": 7410176.0,
"sglang:realtime_tokens_total/decode": 923559.0,
"sglang:realtime_tokens_total/prefill_cache": 16142336.0,
"sglang:queue_time_seconds_sum": 11794.89095048979,
"sglang:queue_time_seconds_count": 3653.0
}
},
{
"time": 118.03508179914206,
"metrics": {
"sglang:queue_time_seconds_sum": 11572.693630852737,
"sglang:queue_time_seconds_count": 3799.0,
"sglang:realtime_tokens_total/prefill_compute": 7416656.0,
"sglang:realtime_tokens_total/decode": 960130.0,
"sglang:realtime_tokens_total/prefill_cache": 16356352.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2912.0,
"sglang:kv_evictable_tokens": 712288.0,
"sglang:prompt_tokens_histogram_sum": 23450287.0,
"sglang:prompt_tokens_histogram_count": 3734.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7236799.0,
"sglang:generation_tokens_total": 954936.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 120.03715360816568,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 616400.0,
"sglang:generation_tokens_total": 918648.0,
"sglang:prompt_tokens_histogram_sum": 23164328.0,
"sglang:prompt_tokens_histogram_count": 3596.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7238520.0,
"sglang:realtime_tokens_total/prefill_compute": 7434256.0,
"sglang:realtime_tokens_total/decode": 930974.0,
"sglang:realtime_tokens_total/prefill_cache": 16163936.0,
"sglang:queue_time_seconds_sum": 11845.960906739347,
"sglang:queue_time_seconds_count": 3663.0
}
},
{
"time": 120.03475877735764,
"metrics": {
"sglang:queue_time_seconds_sum": 11618.250987779349,
"sglang:queue_time_seconds_count": 3813.0,
"sglang:realtime_tokens_total/prefill_compute": 7445008.0,
"sglang:realtime_tokens_total/decode": 968308.0,
"sglang:realtime_tokens_total/prefill_cache": 16424672.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2272.0,
"sglang:kv_evictable_tokens": 710176.0,
"sglang:prompt_tokens_histogram_sum": 23510572.0,
"sglang:prompt_tokens_histogram_count": 3746.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7282332.0,
"sglang:generation_tokens_total": 958008.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 122.0352622428909,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 4304.0,
"sglang:kv_evictable_tokens": 661728.0,
"sglang:generation_tokens_total": 929656.0,
"sglang:prompt_tokens_histogram_sum": 23468986.0,
"sglang:prompt_tokens_histogram_count": 3639.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7331770.0,
"sglang:realtime_tokens_total/prefill_compute": 7531600.0,
"sglang:realtime_tokens_total/decode": 934388.0,
"sglang:realtime_tokens_total/prefill_cache": 16323184.0,
"sglang:queue_time_seconds_sum": 12025.93753258232,
"sglang:queue_time_seconds_count": 3706.0
}
},
{
"time": 122.03592730220407,
"metrics": {
"sglang:queue_time_seconds_sum": 11695.042743438855,
"sglang:queue_time_seconds_count": 3833.0,
"sglang:realtime_tokens_total/prefill_compute": 7535344.0,
"sglang:realtime_tokens_total/decode": 972946.0,
"sglang:realtime_tokens_total/prefill_cache": 16474240.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4496.0,
"sglang:kv_evictable_tokens": 682944.0,
"sglang:prompt_tokens_histogram_sum": 23625757.0,
"sglang:prompt_tokens_histogram_count": 3766.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7337037.0,
"sglang:generation_tokens_total": 963128.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 124.03522615227848,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2816.0,
"sglang:kv_evictable_tokens": 674000.0,
"sglang:generation_tokens_total": 932472.0,
"sglang:prompt_tokens_histogram_sum": 23536743.0,
"sglang:prompt_tokens_histogram_count": 3650.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7394407.0,
"sglang:realtime_tokens_total/prefill_compute": 7605744.0,
"sglang:realtime_tokens_total/decode": 939687.0,
"sglang:realtime_tokens_total/prefill_cache": 16329328.0,
"sglang:queue_time_seconds_sum": 12056.41659394186,
"sglang:queue_time_seconds_count": 3717.0
}
},
{
"time": 124.03733744472265,
"metrics": {
"sglang:queue_time_seconds_sum": 11871.179973360151,
"sglang:queue_time_seconds_count": 3871.0,
"sglang:realtime_tokens_total/prefill_compute": 7624528.0,
"sglang:realtime_tokens_total/decode": 976866.0,
"sglang:realtime_tokens_total/prefill_cache": 16616896.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 6096.0,
"sglang:kv_evictable_tokens": 602160.0,
"sglang:prompt_tokens_histogram_sum": 23842166.0,
"sglang:prompt_tokens_histogram_count": 3806.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7419542.0,
"sglang:generation_tokens_total": 973368.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 126.04252583440393,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2784.0,
"sglang:kv_evictable_tokens": 689248.0,
"sglang:generation_tokens_total": 935544.0,
"sglang:prompt_tokens_histogram_sum": 23606032.0,
"sglang:prompt_tokens_histogram_count": 3662.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7433584.0,
"sglang:realtime_tokens_total/prefill_compute": 7634672.0,
"sglang:realtime_tokens_total/decode": 947549.0,
"sglang:realtime_tokens_total/prefill_cache": 16334448.0,
"sglang:queue_time_seconds_sum": 12117.904142292216,
"sglang:queue_time_seconds_count": 3729.0
}
},
{
"time": 126.03735233005136,
"metrics": {
"sglang:queue_time_seconds_sum": 11879.872387404554,
"sglang:queue_time_seconds_count": 3877.0,
"sglang:realtime_tokens_total/prefill_compute": 7651696.0,
"sglang:realtime_tokens_total/decode": 983958.0,
"sglang:realtime_tokens_total/prefill_cache": 16671888.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1872.0,
"sglang:kv_evictable_tokens": 598144.0,
"sglang:prompt_tokens_histogram_sum": 23853250.0,
"sglang:prompt_tokens_histogram_count": 3810.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7428578.0,
"sglang:generation_tokens_total": 974392.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 128.03627605643123,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4176.0,
"sglang:kv_evictable_tokens": 692336.0,
"sglang:generation_tokens_total": 948088.0,
"sglang:prompt_tokens_histogram_sum": 23897537.0,
"sglang:prompt_tokens_histogram_count": 3711.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7569745.0,
"sglang:realtime_tokens_total/prefill_compute": 7729248.0,
"sglang:realtime_tokens_total/decode": 951083.0,
"sglang:realtime_tokens_total/prefill_cache": 16504848.0,
"sglang:queue_time_seconds_sum": 12326.337228506804,
"sglang:queue_time_seconds_count": 3777.0
}
},
{
"time": 128.03581331763417,
"metrics": {
"sglang:queue_time_seconds_sum": 11934.821790642105,
"sglang:queue_time_seconds_count": 3891.0,
"sglang:realtime_tokens_total/prefill_compute": 7722560.0,
"sglang:realtime_tokens_total/decode": 988267.0,
"sglang:realtime_tokens_total/prefill_cache": 16710912.0,
"sglang:num_running_reqs": 56.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 1584.0,
"sglang:kv_evictable_tokens": 601936.0,
"sglang:prompt_tokens_histogram_sum": 23978337.0,
"sglang:prompt_tokens_histogram_count": 3828.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7505121.0,
"sglang:generation_tokens_total": 979000.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 130.03627347014844,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 663216.0,
"sglang:generation_tokens_total": 948856.0,
"sglang:prompt_tokens_histogram_sum": 23919015.0,
"sglang:prompt_tokens_histogram_count": 3714.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7589687.0,
"sglang:realtime_tokens_total/prefill_compute": 7755536.0,
"sglang:realtime_tokens_total/decode": 959143.0,
"sglang:realtime_tokens_total/prefill_cache": 16570896.0,
"sglang:queue_time_seconds_sum": 12340.040199290961,
"sglang:queue_time_seconds_count": 3781.0
}
},
{
"time": 130.03670512139797,
"metrics": {
"sglang:queue_time_seconds_sum": 12073.680093232542,
"sglang:queue_time_seconds_count": 3920.0,
"sglang:realtime_tokens_total/prefill_compute": 7810048.0,
"sglang:realtime_tokens_total/decode": 992334.0,
"sglang:realtime_tokens_total/prefill_cache": 16778736.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 9088.0,
"sglang:kv_evictable_tokens": 596080.0,
"sglang:prompt_tokens_histogram_sum": 24136729.0,
"sglang:prompt_tokens_histogram_count": 3853.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7583593.0,
"sglang:generation_tokens_total": 985400.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 132.03612786065787,
"metrics": {
"sglang:num_running_reqs": 52.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 10544.0,
"sglang:kv_evictable_tokens": 690720.0,
"sglang:generation_tokens_total": 955256.0,
"sglang:prompt_tokens_histogram_sum": 24036394.0,
"sglang:prompt_tokens_histogram_count": 3739.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7640490.0,
"sglang:realtime_tokens_total/prefill_compute": 7816576.0,
"sglang:realtime_tokens_total/decode": 964431.0,
"sglang:realtime_tokens_total/prefill_cache": 16578064.0,
"sglang:queue_time_seconds_sum": 12438.104369753972,
"sglang:queue_time_seconds_count": 3799.0
}
},
{
"time": 132.04150838963687,
"metrics": {
"sglang:queue_time_seconds_sum": 12116.8244644925,
"sglang:queue_time_seconds_count": 3941.0,
"sglang:realtime_tokens_total/prefill_compute": 7871968.0,
"sglang:realtime_tokens_total/decode": 997491.0,
"sglang:realtime_tokens_total/prefill_cache": 16913008.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 7632.0,
"sglang:kv_evictable_tokens": 589184.0,
"sglang:prompt_tokens_histogram_sum": 24306888.0,
"sglang:prompt_tokens_histogram_count": 3874.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7635000.0,
"sglang:generation_tokens_total": 990776.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 134.03479947615415,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 4384.0,
"sglang:kv_evictable_tokens": 681920.0,
"sglang:generation_tokens_total": 965240.0,
"sglang:prompt_tokens_histogram_sum": 24310052.0,
"sglang:prompt_tokens_histogram_count": 3778.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7739156.0,
"sglang:realtime_tokens_total/prefill_compute": 7901136.0,
"sglang:realtime_tokens_total/decode": 968935.0,
"sglang:realtime_tokens_total/prefill_cache": 16802512.0,
"sglang:queue_time_seconds_sum": 12642.641859286465,
"sglang:queue_time_seconds_count": 3845.0
}
},
{
"time": 134.03656316641718,
"metrics": {
"sglang:queue_time_seconds_sum": 12164.822691726498,
"sglang:queue_time_seconds_count": 3953.0,
"sglang:realtime_tokens_total/prefill_compute": 7891040.0,
"sglang:realtime_tokens_total/decode": 1004642.0,
"sglang:realtime_tokens_total/prefill_cache": 16950608.0,
"sglang:num_running_reqs": 54.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 8800.0,
"sglang:kv_evictable_tokens": 670944.0,
"sglang:prompt_tokens_histogram_sum": 24460897.0,
"sglang:prompt_tokens_histogram_count": 3892.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7742609.0,
"sglang:generation_tokens_total": 995384.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 136.03406407032162,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1296.0,
"sglang:kv_evictable_tokens": 672720.0,
"sglang:generation_tokens_total": 966008.0,
"sglang:prompt_tokens_histogram_sum": 24320742.0,
"sglang:prompt_tokens_histogram_count": 3781.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7748310.0,
"sglang:realtime_tokens_total/prefill_compute": 7913232.0,
"sglang:realtime_tokens_total/decode": 977764.0,
"sglang:realtime_tokens_total/prefill_cache": 16804048.0,
"sglang:queue_time_seconds_sum": 12654.378721851856,
"sglang:queue_time_seconds_count": 3848.0
}
},
{
"time": 136.0353613430634,
"metrics": {
"sglang:queue_time_seconds_sum": 12283.223460066132,
"sglang:queue_time_seconds_count": 3979.0,
"sglang:realtime_tokens_total/prefill_compute": 7987488.0,
"sglang:realtime_tokens_total/decode": 1008269.0,
"sglang:realtime_tokens_total/prefill_cache": 17054384.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 8000.0,
"sglang:kv_evictable_tokens": 590560.0,
"sglang:prompt_tokens_histogram_sum": 24571906.0,
"sglang:prompt_tokens_histogram_count": 3913.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7793170.0,
"sglang:generation_tokens_total": 1000760.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 138.03565166983753,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3408.0,
"sglang:kv_evictable_tokens": 636304.0,
"sglang:generation_tokens_total": 971896.0,
"sglang:prompt_tokens_histogram_sum": 24423398.0,
"sglang:prompt_tokens_histogram_count": 3804.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7824246.0,
"sglang:realtime_tokens_total/prefill_compute": 8015232.0,
"sglang:realtime_tokens_total/decode": 981262.0,
"sglang:realtime_tokens_total/prefill_cache": 16831664.0,
"sglang:queue_time_seconds_sum": 12763.962555624545,
"sglang:queue_time_seconds_count": 3871.0
}
},
{
"time": 138.03628490585834,
"metrics": {
"sglang:queue_time_seconds_sum": 12354.438411668874,
"sglang:queue_time_seconds_count": 4005.0,
"sglang:realtime_tokens_total/prefill_compute": 8084912.0,
"sglang:realtime_tokens_total/decode": 1011955.0,
"sglang:realtime_tokens_total/prefill_cache": 17118048.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3088.0,
"sglang:kv_evictable_tokens": 640192.0,
"sglang:prompt_tokens_histogram_sum": 24768006.0,
"sglang:prompt_tokens_histogram_count": 3938.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7854998.0,
"sglang:generation_tokens_total": 1007160.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 140.03527650702745,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2304.0,
"sglang:kv_evictable_tokens": 618224.0,
"sglang:generation_tokens_total": 981624.0,
"sglang:prompt_tokens_histogram_sum": 24687019.0,
"sglang:prompt_tokens_histogram_count": 3842.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7884507.0,
"sglang:realtime_tokens_total/prefill_compute": 8094512.0,
"sglang:realtime_tokens_total/decode": 985255.0,
"sglang:realtime_tokens_total/prefill_cache": 17048528.0,
"sglang:queue_time_seconds_sum": 12932.132059017196,
"sglang:queue_time_seconds_count": 3909.0
}
},
{
"time": 140.04178936220706,
"metrics": {
"sglang:queue_time_seconds_sum": 12372.233649753034,
"sglang:queue_time_seconds_count": 4009.0,
"sglang:realtime_tokens_total/prefill_compute": 8107600.0,
"sglang:realtime_tokens_total/decode": 1019566.0,
"sglang:realtime_tokens_total/prefill_cache": 17120096.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 7056.0,
"sglang:kv_evictable_tokens": 637824.0,
"sglang:prompt_tokens_histogram_sum": 24810194.0,
"sglang:prompt_tokens_histogram_count": 3943.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7861634.0,
"sglang:generation_tokens_total": 1008440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 142.035110399127,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 5216.0,
"sglang:kv_evictable_tokens": 598384.0,
"sglang:generation_tokens_total": 982136.0,
"sglang:prompt_tokens_histogram_sum": 24696429.0,
"sglang:prompt_tokens_histogram_count": 3844.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7892893.0,
"sglang:realtime_tokens_total/prefill_compute": 8112816.0,
"sglang:realtime_tokens_total/decode": 992997.0,
"sglang:realtime_tokens_total/prefill_cache": 17049552.0,
"sglang:queue_time_seconds_sum": 12941.698648224585,
"sglang:queue_time_seconds_count": 3911.0
}
},
{
"time": 142.03683032933623,
"metrics": {
"sglang:queue_time_seconds_sum": 12518.164131667465,
"sglang:queue_time_seconds_count": 4039.0,
"sglang:realtime_tokens_total/prefill_compute": 8175952.0,
"sglang:realtime_tokens_total/decode": 1024126.0,
"sglang:realtime_tokens_total/prefill_cache": 17216896.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 7056.0,
"sglang:kv_evictable_tokens": 621840.0,
"sglang:prompt_tokens_histogram_sum": 24986641.0,
"sglang:prompt_tokens_histogram_count": 3972.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7964369.0,
"sglang:generation_tokens_total": 1015864.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 144.03511702921242,
"metrics": {
"sglang:num_running_reqs": 55.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 6896.0,
"sglang:kv_evictable_tokens": 602768.0,
"sglang:generation_tokens_total": 988024.0,
"sglang:prompt_tokens_histogram_sum": 24830178.0,
"sglang:prompt_tokens_histogram_count": 3867.0,
"sglang:uncached_prompt_tokens_histogram_sum": 7998514.0,
"sglang:realtime_tokens_total/prefill_compute": 8196816.0,
"sglang:realtime_tokens_total/decode": 997199.0,
"sglang:realtime_tokens_total/prefill_cache": 17071312.0,
"sglang:queue_time_seconds_sum": 13045.948802529834,
"sglang:queue_time_seconds_count": 3933.0
}
},
{
"time": 144.03600596170872,
"metrics": {
"sglang:queue_time_seconds_sum": 12630.345474936068,
"sglang:queue_time_seconds_count": 4069.0,
"sglang:realtime_tokens_total/prefill_compute": 8276752.0,
"sglang:realtime_tokens_total/decode": 1028060.0,
"sglang:realtime_tokens_total/prefill_cache": 17328704.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6896.0,
"sglang:kv_evictable_tokens": 654976.0,
"sglang:prompt_tokens_histogram_sum": 25185707.0,
"sglang:prompt_tokens_histogram_count": 4002.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8067659.0,
"sglang:generation_tokens_total": 1023544.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 146.0368873970583,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1248.0,
"sglang:kv_evictable_tokens": 665056.0,
"sglang:generation_tokens_total": 998008.0,
"sglang:prompt_tokens_histogram_sum": 25126173.0,
"sglang:prompt_tokens_histogram_count": 3906.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8077645.0,
"sglang:realtime_tokens_total/prefill_compute": 8273456.0,
"sglang:realtime_tokens_total/decode": 1001639.0,
"sglang:realtime_tokens_total/prefill_cache": 17266240.0,
"sglang:queue_time_seconds_sum": 13216.20534193702,
"sglang:queue_time_seconds_count": 3973.0
}
},
{
"time": 146.03822126146406,
"metrics": {
"sglang:queue_time_seconds_sum": 12644.028117085807,
"sglang:queue_time_seconds_count": 4072.0,
"sglang:realtime_tokens_total/prefill_compute": 8292128.0,
"sglang:realtime_tokens_total/decode": 1035928.0,
"sglang:realtime_tokens_total/prefill_cache": 17329728.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4704.0,
"sglang:kv_evictable_tokens": 648928.0,
"sglang:prompt_tokens_histogram_sum": 25220650.0,
"sglang:prompt_tokens_histogram_count": 4006.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8100554.0,
"sglang:generation_tokens_total": 1024568.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 148.40076164156199,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6656.0,
"sglang:kv_evictable_tokens": 657456.0,
"sglang:generation_tokens_total": 998776.0,
"sglang:prompt_tokens_histogram_sum": 25151079.0,
"sglang:prompt_tokens_histogram_count": 3909.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8101015.0,
"sglang:realtime_tokens_total/prefill_compute": 8287184.0,
"sglang:realtime_tokens_total/decode": 1010020.0,
"sglang:realtime_tokens_total/prefill_cache": 17267264.0,
"sglang:queue_time_seconds_sum": 13226.27543412149,
"sglang:queue_time_seconds_count": 3976.0
}
},
{
"time": 148.03747063875198,
"metrics": {
"sglang:queue_time_seconds_sum": 12811.756937511265,
"sglang:queue_time_seconds_count": 4107.0,
"sglang:realtime_tokens_total/prefill_compute": 8363440.0,
"sglang:realtime_tokens_total/decode": 1040927.0,
"sglang:realtime_tokens_total/prefill_cache": 17455184.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 647648.0,
"sglang:prompt_tokens_histogram_sum": 25418861.0,
"sglang:prompt_tokens_histogram_count": 4040.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8169197.0,
"sglang:generation_tokens_total": 1033272.0
}
}
]
},
{
"label": "score_end",
"workers": [
{
"time": 150.00638791080564,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1280.0,
"sglang:kv_evictable_tokens": 675456.0,
"sglang:generation_tokens_total": 1004664.0,
"sglang:prompt_tokens_histogram_sum": 25280891.0,
"sglang:prompt_tokens_histogram_count": 3932.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8191179.0,
"sglang:realtime_tokens_total/prefill_compute": 8374576.0,
"sglang:realtime_tokens_total/decode": 1014150.0,
"sglang:realtime_tokens_total/prefill_cache": 17301760.0,
"sglang:queue_time_seconds_sum": 13327.366358508356,
"sglang:queue_time_seconds_count": 3999.0
}
},
{
"time": 150.01295783836395,
"metrics": {
"sglang:queue_time_seconds_sum": 12896.625049835071,
"sglang:queue_time_seconds_count": 4133.0,
"sglang:realtime_tokens_total/prefill_compute": 8424576.0,
"sglang:realtime_tokens_total/decode": 1047109.0,
"sglang:realtime_tokens_total/prefill_cache": 17542464.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 5584.0,
"sglang:kv_evictable_tokens": 693776.0,
"sglang:prompt_tokens_histogram_sum": 25587919.0,
"sglang:prompt_tokens_histogram_count": 4066.0,
"sglang:uncached_prompt_tokens_histogram_sum": 8259215.0,
"sglang:generation_tokens_total": 1039928.0
}
}
]
},
{
"label": "drained",
"workers": [
{
"time": 188.5369351292029,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 4480.0,
"sglang:kv_evictable_tokens": 1044096.0,
"sglang:generation_tokens_total": 1115000.0,
"sglang:prompt_tokens_histogram_sum": 28022612.0,
"sglang:prompt_tokens_histogram_count": 4363.0,
"sglang:uncached_prompt_tokens_histogram_sum": 9404996.0,
"sglang:realtime_tokens_total/prefill_compute": 9423872.0,
"sglang:realtime_tokens_total/decode": 1114990.0,
"sglang:realtime_tokens_total/prefill_cache": 18617616.0,
"sglang:queue_time_seconds_sum": 14875.9059400009,
"sglang:queue_time_seconds_count": 4366.0
}
},
{
"time": 188.5375856133178,
"metrics": {
"sglang:queue_time_seconds_sum": 14402.473660431802,
"sglang:queue_time_seconds_count": 4494.0,
"sglang:realtime_tokens_total/prefill_compute": 9522800.0,
"sglang:realtime_tokens_total/decode": 1148703.0,
"sglang:realtime_tokens_total/prefill_cache": 18744304.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 2272.0,
"sglang:kv_evictable_tokens": 1046304.0,
"sglang:prompt_tokens_histogram_sum": 28247865.0,
"sglang:prompt_tokens_histogram_count": 4491.0,
"sglang:uncached_prompt_tokens_histogram_sum": 9503561.0,
"sglang:generation_tokens_total": 1148728.0
}
}
]
}
],
"r0_dynamo_sticky": [
{
"label": "start",
"workers": [
{
"time": 0.007435359992086887,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1048576.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:generation_tokens_total": 1115048.0,
"sglang:prompt_tokens_histogram_sum": 28025684.0,
"sglang:prompt_tokens_histogram_count": 4366.0,
"sglang:uncached_prompt_tokens_histogram_sum": 9406052.0,
"sglang:realtime_tokens_total/prefill_compute": 9424928.0,
"sglang:realtime_tokens_total/decode": 1115038.0,
"sglang:realtime_tokens_total/prefill_cache": 18619632.0,
"sglang:queue_time_seconds_sum": 14875.90676688496,
"sglang:queue_time_seconds_count": 4369.0
}
},
{
"time": 0.007820100523531437,
"metrics": {
"sglang:queue_time_seconds_sum": 14402.474670197815,
"sglang:queue_time_seconds_count": 4497.0,
"sglang:realtime_tokens_total/prefill_compute": 9531008.0,
"sglang:realtime_tokens_total/decode": 1148751.0,
"sglang:realtime_tokens_total/prefill_cache": 18748384.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1044464.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:prompt_tokens_histogram_sum": 28260153.0,
"sglang:prompt_tokens_histogram_count": 4494.0,
"sglang:uncached_prompt_tokens_histogram_sum": 9511769.0,
"sglang:generation_tokens_total": 1148776.0
}
}
]
},
{
"label": "score_start",
"workers": [
{
"time": 30.006490961648524,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 5728.0,
"sglang:kv_evictable_tokens": 616384.0,
"sglang:generation_tokens_total": 1183144.0,
"sglang:prompt_tokens_histogram_sum": 29669693.0,
"sglang:prompt_tokens_histogram_count": 4632.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10312589.0,
"sglang:realtime_tokens_total/prefill_compute": 10399344.0,
"sglang:realtime_tokens_total/decode": 1193928.0,
"sglang:realtime_tokens_total/prefill_cache": 19680800.0,
"sglang:queue_time_seconds_sum": 15706.597598349676,
"sglang:queue_time_seconds_count": 4698.0
}
},
{
"time": 30.008107311092317,
"metrics": {
"sglang:queue_time_seconds_sum": 15232.609318034723,
"sglang:queue_time_seconds_count": 4833.0,
"sglang:realtime_tokens_total/prefill_compute": 10522096.0,
"sglang:realtime_tokens_total/decode": 1229173.0,
"sglang:realtime_tokens_total/prefill_cache": 19816576.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3872.0,
"sglang:kv_evictable_tokens": 677504.0,
"sglang:prompt_tokens_histogram_sum": 29937980.0,
"sglang:prompt_tokens_histogram_count": 4766.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10435580.0,
"sglang:generation_tokens_total": 1218408.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 32.02014009281993,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3712.0,
"sglang:kv_evictable_tokens": 630864.0,
"sglang:generation_tokens_total": 1195688.0,
"sglang:prompt_tokens_histogram_sum": 30003478.0,
"sglang:prompt_tokens_histogram_count": 4681.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10368886.0,
"sglang:realtime_tokens_total/prefill_compute": 10453568.0,
"sglang:realtime_tokens_total/decode": 1199127.0,
"sglang:realtime_tokens_total/prefill_cache": 19937472.0,
"sglang:queue_time_seconds_sum": 15840.772227107547,
"sglang:queue_time_seconds_count": 4747.0
}
},
{
"time": 32.02114194165915,
"metrics": {
"sglang:queue_time_seconds_sum": 15369.932811149396,
"sglang:queue_time_seconds_count": 4880.0,
"sglang:realtime_tokens_total/prefill_compute": 10575904.0,
"sglang:realtime_tokens_total/decode": 1234753.0,
"sglang:realtime_tokens_total/prefill_cache": 20078976.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 10560.0,
"sglang:kv_evictable_tokens": 685792.0,
"sglang:prompt_tokens_histogram_sum": 30262609.0,
"sglang:prompt_tokens_histogram_count": 4813.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10490337.0,
"sglang:generation_tokens_total": 1230440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 34.02154129650444,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 8592.0,
"sglang:kv_evictable_tokens": 652640.0,
"sglang:generation_tokens_total": 1196968.0,
"sglang:prompt_tokens_histogram_sum": 30042364.0,
"sglang:prompt_tokens_histogram_count": 4686.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10376412.0,
"sglang:realtime_tokens_total/prefill_compute": 10465936.0,
"sglang:realtime_tokens_total/decode": 1207377.0,
"sglang:realtime_tokens_total/prefill_cache": 19998784.0,
"sglang:queue_time_seconds_sum": 15848.920669325627,
"sglang:queue_time_seconds_count": 4753.0
}
},
{
"time": 34.02269215416163,
"metrics": {
"sglang:queue_time_seconds_sum": 15400.98931035772,
"sglang:queue_time_seconds_count": 4887.0,
"sglang:realtime_tokens_total/prefill_compute": 10582976.0,
"sglang:realtime_tokens_total/decode": 1243707.0,
"sglang:realtime_tokens_total/prefill_cache": 20115280.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 66.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 659984.0,
"sglang:prompt_tokens_histogram_sum": 30281335.0,
"sglang:prompt_tokens_histogram_count": 4820.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10494471.0,
"sglang:generation_tokens_total": 1232232.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 36.02044248115271,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 7792.0,
"sglang:kv_evictable_tokens": 636864.0,
"sglang:generation_tokens_total": 1205928.0,
"sglang:prompt_tokens_histogram_sum": 30272443.0,
"sglang:prompt_tokens_histogram_count": 4721.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10415563.0,
"sglang:realtime_tokens_total/prefill_compute": 10508240.0,
"sglang:realtime_tokens_total/decode": 1213487.0,
"sglang:realtime_tokens_total/prefill_cache": 20203328.0,
"sglang:queue_time_seconds_sum": 15939.754370247945,
"sglang:queue_time_seconds_count": 4788.0
}
},
{
"time": 36.02208062168211,
"metrics": {
"sglang:queue_time_seconds_sum": 15565.137752291746,
"sglang:queue_time_seconds_count": 4943.0,
"sglang:realtime_tokens_total/prefill_compute": 10630784.0,
"sglang:realtime_tokens_total/decode": 1249597.0,
"sglang:realtime_tokens_total/prefill_cache": 20325552.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 4896.0,
"sglang:kv_evictable_tokens": 702720.0,
"sglang:prompt_tokens_histogram_sum": 30633983.0,
"sglang:prompt_tokens_histogram_count": 4877.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10555007.0,
"sglang:generation_tokens_total": 1246824.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 38.02077804505825,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 6608.0,
"sglang:kv_evictable_tokens": 577776.0,
"sglang:generation_tokens_total": 1213352.0,
"sglang:prompt_tokens_histogram_sum": 30444079.0,
"sglang:prompt_tokens_histogram_count": 4750.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10445295.0,
"sglang:realtime_tokens_total/prefill_compute": 10548208.0,
"sglang:realtime_tokens_total/decode": 1219409.0,
"sglang:realtime_tokens_total/prefill_cache": 20395824.0,
"sglang:queue_time_seconds_sum": 15998.343611574732,
"sglang:queue_time_seconds_count": 4817.0
}
},
{
"time": 38.021767988801,
"metrics": {
"sglang:queue_time_seconds_sum": 15586.073010699823,
"sglang:queue_time_seconds_count": 4948.0,
"sglang:realtime_tokens_total/prefill_compute": 10648832.0,
"sglang:realtime_tokens_total/decode": 1258123.0,
"sglang:realtime_tokens_total/prefill_cache": 20412384.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 66.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 3904.0,
"sglang:kv_evictable_tokens": 670448.0,
"sglang:prompt_tokens_histogram_sum": 30654458.0,
"sglang:prompt_tokens_histogram_count": 4881.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10558218.0,
"sglang:generation_tokens_total": 1247848.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 40.020492403768,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 8368.0,
"sglang:kv_evictable_tokens": 581712.0,
"sglang:generation_tokens_total": 1215912.0,
"sglang:prompt_tokens_histogram_sum": 30516907.0,
"sglang:prompt_tokens_histogram_count": 4760.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10458203.0,
"sglang:realtime_tokens_total/prefill_compute": 10559984.0,
"sglang:realtime_tokens_total/decode": 1226759.0,
"sglang:realtime_tokens_total/prefill_cache": 20446624.0,
"sglang:queue_time_seconds_sum": 16024.732826103456,
"sglang:queue_time_seconds_count": 4827.0
}
},
{
"time": 40.02261214982718,
"metrics": {
"sglang:queue_time_seconds_sum": 15737.947444955818,
"sglang:queue_time_seconds_count": 4994.0,
"sglang:realtime_tokens_total/prefill_compute": 10674192.0,
"sglang:realtime_tokens_total/decode": 1265053.0,
"sglang:realtime_tokens_total/prefill_cache": 20537168.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3968.0,
"sglang:kv_evictable_tokens": 713216.0,
"sglang:prompt_tokens_histogram_sum": 30894413.0,
"sglang:prompt_tokens_histogram_count": 4927.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10602413.0,
"sglang:generation_tokens_total": 1259624.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 42.0234831282869,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 14.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 3600.0,
"sglang:kv_evictable_tokens": 600432.0,
"sglang:generation_tokens_total": 1228456.0,
"sglang:prompt_tokens_histogram_sum": 30885593.0,
"sglang:prompt_tokens_histogram_count": 4809.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10520233.0,
"sglang:realtime_tokens_total/prefill_compute": 10608688.0,
"sglang:realtime_tokens_total/decode": 1231895.0,
"sglang:realtime_tokens_total/prefill_cache": 20688928.0,
"sglang:queue_time_seconds_sum": 16149.060381963849,
"sglang:queue_time_seconds_count": 4875.0
}
},
{
"time": 42.022629984654486,
"metrics": {
"sglang:queue_time_seconds_sum": 15791.455437995493,
"sglang:queue_time_seconds_count": 5011.0,
"sglang:realtime_tokens_total/prefill_compute": 10704560.0,
"sglang:realtime_tokens_total/decode": 1273292.0,
"sglang:realtime_tokens_total/prefill_cache": 20675584.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 64.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 6048.0,
"sglang:kv_evictable_tokens": 734080.0,
"sglang:prompt_tokens_histogram_sum": 31036984.0,
"sglang:prompt_tokens_histogram_count": 4944.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10627016.0,
"sglang:generation_tokens_total": 1263976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 44.02681393548846,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 5168.0,
"sglang:kv_evictable_tokens": 618496.0,
"sglang:generation_tokens_total": 1229736.0,
"sglang:prompt_tokens_histogram_sum": 30923083.0,
"sglang:prompt_tokens_histogram_count": 4814.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10527259.0,
"sglang:realtime_tokens_total/prefill_compute": 10623712.0,
"sglang:realtime_tokens_total/decode": 1239697.0,
"sglang:realtime_tokens_total/prefill_cache": 20757360.0,
"sglang:queue_time_seconds_sum": 16151.303659722209,
"sglang:queue_time_seconds_count": 4881.0
}
},
{
"time": 44.02296491060406,
"metrics": {
"sglang:queue_time_seconds_sum": 15911.6435014233,
"sglang:queue_time_seconds_count": 5046.0,
"sglang:realtime_tokens_total/prefill_compute": 10732240.0,
"sglang:realtime_tokens_total/decode": 1280617.0,
"sglang:realtime_tokens_total/prefill_cache": 20803568.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3520.0,
"sglang:kv_evictable_tokens": 690288.0,
"sglang:prompt_tokens_histogram_sum": 31145745.0,
"sglang:prompt_tokens_histogram_count": 4979.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10645281.0,
"sglang:generation_tokens_total": 1272936.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 46.02241943124682,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 23.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 5344.0,
"sglang:kv_evictable_tokens": 629440.0,
"sglang:generation_tokens_total": 1236648.0,
"sglang:prompt_tokens_histogram_sum": 31115880.0,
"sglang:prompt_tokens_histogram_count": 4841.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10561416.0,
"sglang:realtime_tokens_total/prefill_compute": 10659424.0,
"sglang:realtime_tokens_total/decode": 1246006.0,
"sglang:realtime_tokens_total/prefill_cache": 20920176.0,
"sglang:queue_time_seconds_sum": 16217.379741952755,
"sglang:queue_time_seconds_count": 4908.0
}
},
{
"time": 46.02303377259523,
"metrics": {
"sglang:queue_time_seconds_sum": 15983.76060290169,
"sglang:queue_time_seconds_count": 5071.0,
"sglang:realtime_tokens_total/prefill_compute": 10758944.0,
"sglang:realtime_tokens_total/decode": 1288912.0,
"sglang:realtime_tokens_total/prefill_cache": 20932080.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 2864.0,
"sglang:kv_evictable_tokens": 726384.0,
"sglang:prompt_tokens_histogram_sum": 31335986.0,
"sglang:prompt_tokens_histogram_count": 5004.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10678802.0,
"sglang:generation_tokens_total": 1279336.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 48.02102658431977,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 5.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 3104.0,
"sglang:kv_evictable_tokens": 589184.0,
"sglang:generation_tokens_total": 1246120.0,
"sglang:prompt_tokens_histogram_sum": 31359819.0,
"sglang:prompt_tokens_histogram_count": 4878.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10602459.0,
"sglang:realtime_tokens_total/prefill_compute": 10708912.0,
"sglang:realtime_tokens_total/decode": 1251404.0,
"sglang:realtime_tokens_total/prefill_cache": 21145248.0,
"sglang:queue_time_seconds_sum": 16280.28709022794,
"sglang:queue_time_seconds_count": 4945.0
}
},
{
"time": 48.021415947936475,
"metrics": {
"sglang:queue_time_seconds_sum": 16102.44880747702,
"sglang:queue_time_seconds_count": 5101.0,
"sglang:realtime_tokens_total/prefill_compute": 10796752.0,
"sglang:realtime_tokens_total/decode": 1295722.0,
"sglang:realtime_tokens_total/prefill_cache": 21104096.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 6336.0,
"sglang:kv_evictable_tokens": 669456.0,
"sglang:prompt_tokens_histogram_sum": 31493530.0,
"sglang:prompt_tokens_histogram_count": 5034.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10708106.0,
"sglang:generation_tokens_total": 1287016.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 50.02335557807237,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 4448.0,
"sglang:kv_evictable_tokens": 586416.0,
"sglang:generation_tokens_total": 1248680.0,
"sglang:prompt_tokens_histogram_sum": 31435814.0,
"sglang:prompt_tokens_histogram_count": 4888.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10615830.0,
"sglang:realtime_tokens_total/prefill_compute": 10711744.0,
"sglang:realtime_tokens_total/decode": 1259401.0,
"sglang:realtime_tokens_total/prefill_cache": 21154896.0,
"sglang:queue_time_seconds_sum": 16301.09228563495,
"sglang:queue_time_seconds_count": 4954.0
}
},
{
"time": 50.02247110661119,
"metrics": {
"sglang:queue_time_seconds_sum": 16204.498445284553,
"sglang:queue_time_seconds_count": 5135.0,
"sglang:realtime_tokens_total/prefill_compute": 10817296.0,
"sglang:realtime_tokens_total/decode": 1303367.0,
"sglang:realtime_tokens_total/prefill_cache": 21215792.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 3616.0,
"sglang:kv_evictable_tokens": 719920.0,
"sglang:prompt_tokens_histogram_sum": 31669409.0,
"sglang:prompt_tokens_histogram_count": 5068.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10737329.0,
"sglang:generation_tokens_total": 1295720.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 52.026760533452034,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 6.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2000.0,
"sglang:kv_evictable_tokens": 636144.0,
"sglang:generation_tokens_total": 1258920.0,
"sglang:prompt_tokens_histogram_sum": 31748182.0,
"sglang:prompt_tokens_histogram_count": 4928.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10670598.0,
"sglang:realtime_tokens_total/prefill_compute": 10766320.0,
"sglang:realtime_tokens_total/decode": 1264411.0,
"sglang:realtime_tokens_total/prefill_cache": 21415232.0,
"sglang:queue_time_seconds_sum": 16401.362507571466,
"sglang:queue_time_seconds_count": 4995.0
}
},
{
"time": 52.02486821357161,
"metrics": {
"sglang:queue_time_seconds_sum": 16315.240333619528,
"sglang:queue_time_seconds_count": 5159.0,
"sglang:realtime_tokens_total/prefill_compute": 10845440.0,
"sglang:realtime_tokens_total/decode": 1311157.0,
"sglang:realtime_tokens_total/prefill_cache": 21349728.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 8336.0,
"sglang:kv_evictable_tokens": 717952.0,
"sglang:prompt_tokens_histogram_sum": 31872219.0,
"sglang:prompt_tokens_histogram_count": 5093.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10774331.0,
"sglang:generation_tokens_total": 1302120.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 54.023109703324735,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3776.0,
"sglang:kv_evictable_tokens": 657568.0,
"sglang:generation_tokens_total": 1262504.0,
"sglang:prompt_tokens_histogram_sum": 31832592.0,
"sglang:prompt_tokens_histogram_count": 4942.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10687344.0,
"sglang:realtime_tokens_total/prefill_compute": 10780288.0,
"sglang:realtime_tokens_total/decode": 1272588.0,
"sglang:realtime_tokens_total/prefill_cache": 21471248.0,
"sglang:queue_time_seconds_sum": 16404.563050843775,
"sglang:queue_time_seconds_count": 5009.0
}
},
{
"time": 54.023443209938705,
"metrics": {
"sglang:queue_time_seconds_sum": 16437.67285871785,
"sglang:queue_time_seconds_count": 5199.0,
"sglang:realtime_tokens_total/prefill_compute": 10882448.0,
"sglang:realtime_tokens_total/decode": 1317831.0,
"sglang:realtime_tokens_total/prefill_cache": 21537520.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1344.0,
"sglang:kv_evictable_tokens": 676832.0,
"sglang:prompt_tokens_histogram_sum": 32011213.0,
"sglang:prompt_tokens_histogram_count": 5132.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10795421.0,
"sglang:generation_tokens_total": 1312104.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 56.02229867409915,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1040.0,
"sglang:kv_evictable_tokens": 620784.0,
"sglang:generation_tokens_total": 1269416.0,
"sglang:prompt_tokens_histogram_sum": 32010801.0,
"sglang:prompt_tokens_histogram_count": 4969.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10719281.0,
"sglang:realtime_tokens_total/prefill_compute": 10819488.0,
"sglang:realtime_tokens_total/decode": 1278833.0,
"sglang:realtime_tokens_total/prefill_cache": 21650128.0,
"sglang:queue_time_seconds_sum": 16464.640041483566,
"sglang:queue_time_seconds_count": 5036.0
}
},
{
"time": 56.022186417132616,
"metrics": {
"sglang:queue_time_seconds_sum": 16484.932955252938,
"sglang:queue_time_seconds_count": 5209.0,
"sglang:realtime_tokens_total/prefill_compute": 10894512.0,
"sglang:realtime_tokens_total/decode": 1326333.0,
"sglang:realtime_tokens_total/prefill_cache": 21589184.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 68.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 10560.0,
"sglang:kv_evictable_tokens": 689776.0,
"sglang:prompt_tokens_histogram_sum": 32102949.0,
"sglang:prompt_tokens_histogram_count": 5142.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10810981.0,
"sglang:generation_tokens_total": 1314664.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 58.02137887664139,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1248.0,
"sglang:kv_evictable_tokens": 616432.0,
"sglang:generation_tokens_total": 1278888.0,
"sglang:prompt_tokens_histogram_sum": 32229715.0,
"sglang:prompt_tokens_histogram_count": 5006.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10758467.0,
"sglang:realtime_tokens_total/prefill_compute": 10860928.0,
"sglang:realtime_tokens_total/decode": 1284556.0,
"sglang:realtime_tokens_total/prefill_cache": 21837904.0,
"sglang:queue_time_seconds_sum": 16532.860641078092,
"sglang:queue_time_seconds_count": 5073.0
}
},
{
"time": 58.02517988439649,
"metrics": {
"sglang:queue_time_seconds_sum": 16675.377581690438,
"sglang:queue_time_seconds_count": 5263.0,
"sglang:realtime_tokens_total/prefill_compute": 10950256.0,
"sglang:realtime_tokens_total/decode": 1331719.0,
"sglang:realtime_tokens_total/prefill_cache": 21869552.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1472.0,
"sglang:kv_evictable_tokens": 667584.0,
"sglang:prompt_tokens_histogram_sum": 32397830.0,
"sglang:prompt_tokens_histogram_count": 5196.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10860310.0,
"sglang:generation_tokens_total": 1328488.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 60.02326611150056,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 3904.0,
"sglang:kv_evictable_tokens": 604416.0,
"sglang:generation_tokens_total": 1281448.0,
"sglang:prompt_tokens_histogram_sum": 32303809.0,
"sglang:prompt_tokens_histogram_count": 5016.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10771633.0,
"sglang:realtime_tokens_total/prefill_compute": 10874656.0,
"sglang:realtime_tokens_total/decode": 1292290.0,
"sglang:realtime_tokens_total/prefill_cache": 21900608.0,
"sglang:queue_time_seconds_sum": 16559.560461954214,
"sglang:queue_time_seconds_count": 5083.0
}
},
{
"time": 60.02417568769306,
"metrics": {
"sglang:queue_time_seconds_sum": 16702.13431834709,
"sglang:queue_time_seconds_count": 5269.0,
"sglang:realtime_tokens_total/prefill_compute": 10951968.0,
"sglang:realtime_tokens_total/decode": 1340865.0,
"sglang:realtime_tokens_total/prefill_cache": 21880224.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 69.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3856.0,
"sglang:kv_evictable_tokens": 677216.0,
"sglang:prompt_tokens_histogram_sum": 32429621.0,
"sglang:prompt_tokens_histogram_count": 5202.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10866453.0,
"sglang:generation_tokens_total": 1330024.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 62.02222358062863,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1072.0,
"sglang:kv_evictable_tokens": 693152.0,
"sglang:generation_tokens_total": 1293992.0,
"sglang:prompt_tokens_histogram_sum": 32658143.0,
"sglang:prompt_tokens_histogram_count": 5065.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10835583.0,
"sglang:realtime_tokens_total/prefill_compute": 10923984.0,
"sglang:realtime_tokens_total/decode": 1297617.0,
"sglang:realtime_tokens_total/prefill_cache": 22126736.0,
"sglang:queue_time_seconds_sum": 16681.80982793402,
"sglang:queue_time_seconds_count": 5132.0
}
},
{
"time": 62.02188961021602,
"metrics": {
"sglang:queue_time_seconds_sum": 16837.209266119637,
"sglang:queue_time_seconds_count": 5307.0,
"sglang:realtime_tokens_total/prefill_compute": 11007952.0,
"sglang:realtime_tokens_total/decode": 1346587.0,
"sglang:realtime_tokens_total/prefill_cache": 22143760.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 7360.0,
"sglang:kv_evictable_tokens": 660000.0,
"sglang:prompt_tokens_histogram_sum": 32733601.0,
"sglang:prompt_tokens_histogram_count": 5240.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10918209.0,
"sglang:generation_tokens_total": 1339752.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 64.02173409610987,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3408.0,
"sglang:kv_evictable_tokens": 684560.0,
"sglang:generation_tokens_total": 1295528.0,
"sglang:prompt_tokens_histogram_sum": 32680923.0,
"sglang:prompt_tokens_histogram_count": 5071.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10839723.0,
"sglang:realtime_tokens_total/prefill_compute": 10929360.0,
"sglang:realtime_tokens_total/decode": 1306571.0,
"sglang:realtime_tokens_total/prefill_cache": 22144016.0,
"sglang:queue_time_seconds_sum": 16688.02189342212,
"sglang:queue_time_seconds_count": 5138.0
}
},
{
"time": 64.0215832637623,
"metrics": {
"sglang:queue_time_seconds_sum": 16894.026647487655,
"sglang:queue_time_seconds_count": 5327.0,
"sglang:realtime_tokens_total/prefill_compute": 11020704.0,
"sglang:realtime_tokens_total/decode": 1354695.0,
"sglang:realtime_tokens_total/prefill_cache": 22215184.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1936.0,
"sglang:kv_evictable_tokens": 643200.0,
"sglang:prompt_tokens_histogram_sum": 32801488.0,
"sglang:prompt_tokens_histogram_count": 5263.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10927888.0,
"sglang:generation_tokens_total": 1345640.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 66.02131661493331,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 10080.0,
"sglang:kv_evictable_tokens": 641360.0,
"sglang:generation_tokens_total": 1304744.0,
"sglang:prompt_tokens_histogram_sum": 32936514.0,
"sglang:prompt_tokens_histogram_count": 5107.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10884530.0,
"sglang:realtime_tokens_total/prefill_compute": 10978784.0,
"sglang:realtime_tokens_total/decode": 1312227.0,
"sglang:realtime_tokens_total/prefill_cache": 22390320.0,
"sglang:queue_time_seconds_sum": 16776.45167878084,
"sglang:queue_time_seconds_count": 5174.0
}
},
{
"time": 66.02184698730707,
"metrics": {
"sglang:queue_time_seconds_sum": 17004.9631374795,
"sglang:queue_time_seconds_count": 5356.0,
"sglang:realtime_tokens_total/prefill_compute": 11050496.0,
"sglang:realtime_tokens_total/decode": 1361258.0,
"sglang:realtime_tokens_total/prefill_cache": 22355120.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2448.0,
"sglang:kv_evictable_tokens": 669504.0,
"sglang:prompt_tokens_histogram_sum": 33005837.0,
"sglang:prompt_tokens_histogram_count": 5290.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10964893.0,
"sglang:generation_tokens_total": 1352552.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 68.02115939091891,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2544.0,
"sglang:kv_evictable_tokens": 613600.0,
"sglang:generation_tokens_total": 1311656.0,
"sglang:prompt_tokens_histogram_sum": 33049992.0,
"sglang:prompt_tokens_histogram_count": 5134.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10906488.0,
"sglang:realtime_tokens_total/prefill_compute": 11003744.0,
"sglang:realtime_tokens_total/decode": 1318855.0,
"sglang:realtime_tokens_total/prefill_cache": 22514832.0,
"sglang:queue_time_seconds_sum": 16841.258747011423,
"sglang:queue_time_seconds_count": 5201.0
}
},
{
"time": 68.02150904294103,
"metrics": {
"sglang:queue_time_seconds_sum": 17110.582134153694,
"sglang:queue_time_seconds_count": 5391.0,
"sglang:realtime_tokens_total/prefill_compute": 11095840.0,
"sglang:realtime_tokens_total/decode": 1367367.0,
"sglang:realtime_tokens_total/prefill_cache": 22578656.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3248.0,
"sglang:kv_evictable_tokens": 625616.0,
"sglang:prompt_tokens_histogram_sum": 33213195.0,
"sglang:prompt_tokens_histogram_count": 5324.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10998011.0,
"sglang:generation_tokens_total": 1361256.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 70.02662936877459,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5792.0,
"sglang:kv_evictable_tokens": 660448.0,
"sglang:generation_tokens_total": 1315496.0,
"sglang:prompt_tokens_histogram_sum": 33171480.0,
"sglang:prompt_tokens_histogram_count": 5149.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10927432.0,
"sglang:realtime_tokens_total/prefill_compute": 11017968.0,
"sglang:realtime_tokens_total/decode": 1326456.0,
"sglang:realtime_tokens_total/prefill_cache": 22569200.0,
"sglang:queue_time_seconds_sum": 16886.09408618044,
"sglang:queue_time_seconds_count": 5216.0
}
},
{
"time": 70.02090793009847,
"metrics": {
"sglang:queue_time_seconds_sum": 17153.54005338531,
"sglang:queue_time_seconds_count": 5401.0,
"sglang:realtime_tokens_total/prefill_compute": 11100400.0,
"sglang:realtime_tokens_total/decode": 1375549.0,
"sglang:realtime_tokens_total/prefill_cache": 22600640.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3264.0,
"sglang:kv_evictable_tokens": 630912.0,
"sglang:prompt_tokens_histogram_sum": 33250735.0,
"sglang:prompt_tokens_histogram_count": 5334.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11004415.0,
"sglang:generation_tokens_total": 1363816.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 72.02302371803671,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 23.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2832.0,
"sglang:kv_evictable_tokens": 694896.0,
"sglang:generation_tokens_total": 1328040.0,
"sglang:prompt_tokens_histogram_sum": 33496014.0,
"sglang:prompt_tokens_histogram_count": 5198.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10981182.0,
"sglang:realtime_tokens_total/prefill_compute": 11067776.0,
"sglang:realtime_tokens_total/decode": 1331975.0,
"sglang:realtime_tokens_total/prefill_cache": 22818752.0,
"sglang:queue_time_seconds_sum": 17027.3936841134,
"sglang:queue_time_seconds_count": 5265.0
}
},
{
"time": 72.02138519380242,
"metrics": {
"sglang:queue_time_seconds_sum": 17315.05262707174,
"sglang:queue_time_seconds_count": 5455.0,
"sglang:realtime_tokens_total/prefill_compute": 11164704.0,
"sglang:realtime_tokens_total/decode": 1380551.0,
"sglang:realtime_tokens_total/prefill_cache": 22906544.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2272.0,
"sglang:kv_evictable_tokens": 647120.0,
"sglang:prompt_tokens_histogram_sum": 33651450.0,
"sglang:prompt_tokens_histogram_count": 5388.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11072794.0,
"sglang:generation_tokens_total": 1377640.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 74.02182954642922,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 66.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 5008.0,
"sglang:kv_evictable_tokens": 692368.0,
"sglang:generation_tokens_total": 1328808.0,
"sglang:prompt_tokens_histogram_sum": 33507210.0,
"sglang:prompt_tokens_histogram_count": 5201.0,
"sglang:uncached_prompt_tokens_histogram_sum": 10983866.0,
"sglang:realtime_tokens_total/prefill_compute": 11069312.0,
"sglang:realtime_tokens_total/decode": 1341188.0,
"sglang:realtime_tokens_total/prefill_cache": 22820288.0,
"sglang:queue_time_seconds_sum": 17037.71448158659,
"sglang:queue_time_seconds_count": 5268.0
}
},
{
"time": 74.02102251630276,
"metrics": {
"sglang:queue_time_seconds_sum": 17330.21091435477,
"sglang:queue_time_seconds_count": 5460.0,
"sglang:realtime_tokens_total/prefill_compute": 11172192.0,
"sglang:realtime_tokens_total/decode": 1389442.0,
"sglang:realtime_tokens_total/prefill_cache": 22936272.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2208.0,
"sglang:kv_evictable_tokens": 635280.0,
"sglang:prompt_tokens_histogram_sum": 33664317.0,
"sglang:prompt_tokens_histogram_count": 5393.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11075101.0,
"sglang:generation_tokens_total": 1378920.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 76.02197505161166,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3184.0,
"sglang:kv_evictable_tokens": 640368.0,
"sglang:generation_tokens_total": 1340840.0,
"sglang:prompt_tokens_histogram_sum": 33811405.0,
"sglang:prompt_tokens_histogram_count": 5248.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11036909.0,
"sglang:realtime_tokens_total/prefill_compute": 11133424.0,
"sglang:realtime_tokens_total/decode": 1346453.0,
"sglang:realtime_tokens_total/prefill_cache": 23120960.0,
"sglang:queue_time_seconds_sum": 17174.045844472945,
"sglang:queue_time_seconds_count": 5315.0
}
},
{
"time": 76.02548557613045,
"metrics": {
"sglang:queue_time_seconds_sum": 17421.526392154396,
"sglang:queue_time_seconds_count": 5494.0,
"sglang:realtime_tokens_total/prefill_compute": 11215712.0,
"sglang:realtime_tokens_total/decode": 1395168.0,
"sglang:realtime_tokens_total/prefill_cache": 23145504.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 2144.0,
"sglang:kv_evictable_tokens": 597632.0,
"sglang:prompt_tokens_histogram_sum": 33931700.0,
"sglang:prompt_tokens_histogram_count": 5427.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11121860.0,
"sglang:generation_tokens_total": 1387624.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 78.0214955760166,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 58.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3904.0,
"sglang:kv_evictable_tokens": 644784.0,
"sglang:generation_tokens_total": 1344680.0,
"sglang:prompt_tokens_histogram_sum": 33864739.0,
"sglang:prompt_tokens_histogram_count": 5263.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11045475.0,
"sglang:realtime_tokens_total/prefill_compute": 11138560.0,
"sglang:realtime_tokens_total/decode": 1355015.0,
"sglang:realtime_tokens_total/prefill_cache": 23158800.0,
"sglang:queue_time_seconds_sum": 17216.899272652343,
"sglang:queue_time_seconds_count": 5330.0
}
},
{
"time": 78.0218856902793,
"metrics": {
"sglang:queue_time_seconds_sum": 17479.394721752964,
"sglang:queue_time_seconds_count": 5519.0,
"sglang:realtime_tokens_total/prefill_compute": 11248544.0,
"sglang:realtime_tokens_total/decode": 1402311.0,
"sglang:realtime_tokens_total/prefill_cache": 23292720.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 613856.0,
"sglang:prompt_tokens_histogram_sum": 34068506.0,
"sglang:prompt_tokens_histogram_count": 5452.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11145706.0,
"sglang:generation_tokens_total": 1394024.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 80.02142314612865,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 681920.0,
"sglang:generation_tokens_total": 1353896.0,
"sglang:prompt_tokens_histogram_sum": 34108399.0,
"sglang:prompt_tokens_histogram_count": 5299.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11089919.0,
"sglang:realtime_tokens_total/prefill_compute": 11172768.0,
"sglang:realtime_tokens_total/decode": 1361316.0,
"sglang:realtime_tokens_total/prefill_cache": 23316688.0,
"sglang:queue_time_seconds_sum": 17335.629586177878,
"sglang:queue_time_seconds_count": 5365.0
}
},
{
"time": 80.02180116530508,
"metrics": {
"sglang:queue_time_seconds_sum": 17539.14637287613,
"sglang:queue_time_seconds_count": 5543.0,
"sglang:realtime_tokens_total/prefill_compute": 11269568.0,
"sglang:realtime_tokens_total/decode": 1409519.0,
"sglang:realtime_tokens_total/prefill_cache": 23391280.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 2944.0,
"sglang:kv_evictable_tokens": 588288.0,
"sglang:prompt_tokens_histogram_sum": 34241493.0,
"sglang:prompt_tokens_histogram_count": 5477.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11175973.0,
"sglang:generation_tokens_total": 1400424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 82.02606362197548,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2880.0,
"sglang:kv_evictable_tokens": 697488.0,
"sglang:generation_tokens_total": 1360808.0,
"sglang:prompt_tokens_histogram_sum": 34274318.0,
"sglang:prompt_tokens_histogram_count": 5326.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11115518.0,
"sglang:realtime_tokens_total/prefill_compute": 11201504.0,
"sglang:realtime_tokens_total/decode": 1368391.0,
"sglang:realtime_tokens_total/prefill_cache": 23458208.0,
"sglang:queue_time_seconds_sum": 17419.45728924591,
"sglang:queue_time_seconds_count": 5393.0
}
},
{
"time": 82.02586577925831,
"metrics": {
"sglang:queue_time_seconds_sum": 17625.99120664969,
"sglang:queue_time_seconds_count": 5583.0,
"sglang:realtime_tokens_total/prefill_compute": 11331568.0,
"sglang:realtime_tokens_total/decode": 1414599.0,
"sglang:realtime_tokens_total/prefill_cache": 23679392.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 5.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3072.0,
"sglang:kv_evictable_tokens": 594192.0,
"sglang:prompt_tokens_histogram_sum": 34517539.0,
"sglang:prompt_tokens_histogram_count": 5516.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11224819.0,
"sglang:generation_tokens_total": 1410408.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 84.02095838543028,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1392.0,
"sglang:kv_evictable_tokens": 688768.0,
"sglang:generation_tokens_total": 1365672.0,
"sglang:prompt_tokens_histogram_sum": 34335302.0,
"sglang:prompt_tokens_histogram_count": 5345.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11127270.0,
"sglang:realtime_tokens_total/prefill_compute": 11213632.0,
"sglang:realtime_tokens_total/decode": 1376437.0,
"sglang:realtime_tokens_total/prefill_cache": 23511904.0,
"sglang:queue_time_seconds_sum": 17502.712164173834,
"sglang:queue_time_seconds_count": 5412.0
}
},
{
"time": 84.02132667694241,
"metrics": {
"sglang:queue_time_seconds_sum": 17637.390615963377,
"sglang:queue_time_seconds_count": 5589.0,
"sglang:realtime_tokens_total/prefill_compute": 11338496.0,
"sglang:realtime_tokens_total/decode": 1422849.0,
"sglang:realtime_tokens_total/prefill_cache": 23709616.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2928.0,
"sglang:kv_evictable_tokens": 572096.0,
"sglang:prompt_tokens_histogram_sum": 34540312.0,
"sglang:prompt_tokens_histogram_count": 5522.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11229400.0,
"sglang:generation_tokens_total": 1411944.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 86.0205362951383,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1376.0,
"sglang:kv_evictable_tokens": 674416.0,
"sglang:generation_tokens_total": 1377192.0,
"sglang:prompt_tokens_histogram_sum": 34636429.0,
"sglang:prompt_tokens_histogram_count": 5390.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11178221.0,
"sglang:realtime_tokens_total/prefill_compute": 11266992.0,
"sglang:realtime_tokens_total/decode": 1382279.0,
"sglang:realtime_tokens_total/prefill_cache": 23782688.0,
"sglang:queue_time_seconds_sum": 17648.0153694842,
"sglang:queue_time_seconds_count": 5457.0
}
},
{
"time": 86.02150903921574,
"metrics": {
"sglang:queue_time_seconds_sum": 17720.4180295486,
"sglang:queue_time_seconds_count": 5622.0,
"sglang:realtime_tokens_total/prefill_compute": 11384832.0,
"sglang:realtime_tokens_total/decode": 1427877.0,
"sglang:realtime_tokens_total/prefill_cache": 23936208.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 575472.0,
"sglang:prompt_tokens_histogram_sum": 34857821.0,
"sglang:prompt_tokens_histogram_count": 5555.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11282045.0,
"sglang:generation_tokens_total": 1420392.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 88.02719604130834,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 74.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1408.0,
"sglang:kv_evictable_tokens": 679088.0,
"sglang:generation_tokens_total": 1380008.0,
"sglang:prompt_tokens_histogram_sum": 34694553.0,
"sglang:prompt_tokens_histogram_count": 5401.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11187225.0,
"sglang:realtime_tokens_total/prefill_compute": 11275040.0,
"sglang:realtime_tokens_total/decode": 1391100.0,
"sglang:realtime_tokens_total/prefill_cache": 23822800.0,
"sglang:queue_time_seconds_sum": 17703.241297704168,
"sglang:queue_time_seconds_count": 5468.0
}
},
{
"time": 88.02539264969528,
"metrics": {
"sglang:queue_time_seconds_sum": 17755.076244493015,
"sglang:queue_time_seconds_count": 5647.0,
"sglang:realtime_tokens_total/prefill_compute": 11420624.0,
"sglang:realtime_tokens_total/decode": 1434119.0,
"sglang:realtime_tokens_total/prefill_cache": 24089344.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1824.0,
"sglang:kv_evictable_tokens": 565808.0,
"sglang:prompt_tokens_histogram_sum": 34986881.0,
"sglang:prompt_tokens_histogram_count": 5580.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11307489.0,
"sglang:generation_tokens_total": 1426792.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 90.02128626126796,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 745392.0,
"sglang:generation_tokens_total": 1393576.0,
"sglang:prompt_tokens_histogram_sum": 35026218.0,
"sglang:prompt_tokens_histogram_count": 5454.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11243530.0,
"sglang:realtime_tokens_total/prefill_compute": 11320992.0,
"sglang:realtime_tokens_total/decode": 1396552.0,
"sglang:realtime_tokens_total/prefill_cache": 24034656.0,
"sglang:queue_time_seconds_sum": 17889.304873363115,
"sglang:queue_time_seconds_count": 5521.0
}
},
{
"time": 90.02167237643152,
"metrics": {
"sglang:queue_time_seconds_sum": 17776.1292282464,
"sglang:queue_time_seconds_count": 5657.0,
"sglang:realtime_tokens_total/prefill_compute": 11437216.0,
"sglang:realtime_tokens_total/decode": 1440959.0,
"sglang:realtime_tokens_total/prefill_cache": 24176560.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.5,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 518320.0,
"sglang:prompt_tokens_histogram_sum": 35074554.0,
"sglang:prompt_tokens_histogram_count": 5590.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11322538.0,
"sglang:generation_tokens_total": 1429352.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 92.02293160092086,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 84.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 2128.0,
"sglang:kv_evictable_tokens": 718352.0,
"sglang:generation_tokens_total": 1394344.0,
"sglang:prompt_tokens_histogram_sum": 35041856.0,
"sglang:prompt_tokens_histogram_count": 5457.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11246192.0,
"sglang:realtime_tokens_total/prefill_compute": 11328656.0,
"sglang:realtime_tokens_total/decode": 1406660.0,
"sglang:realtime_tokens_total/prefill_cache": 24073504.0,
"sglang:queue_time_seconds_sum": 17904.283701156266,
"sglang:queue_time_seconds_count": 5524.0
}
},
{
"time": 92.02327090036124,
"metrics": {
"sglang:queue_time_seconds_sum": 17869.278414465487,
"sglang:queue_time_seconds_count": 5699.0,
"sglang:realtime_tokens_total/prefill_compute": 11496304.0,
"sglang:realtime_tokens_total/decode": 1445460.0,
"sglang:realtime_tokens_total/prefill_cache": 24433904.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 1.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 3056.0,
"sglang:kv_evictable_tokens": 552560.0,
"sglang:prompt_tokens_histogram_sum": 35433182.0,
"sglang:prompt_tokens_histogram_count": 5637.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11387262.0,
"sglang:generation_tokens_total": 1441384.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 94.02154928818345,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.22,
"sglang:kv_available_tokens": 2304.0,
"sglang:kv_evictable_tokens": 816688.0,
"sglang:generation_tokens_total": 1409704.0,
"sglang:prompt_tokens_histogram_sum": 35331969.0,
"sglang:prompt_tokens_histogram_count": 5517.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11297313.0,
"sglang:realtime_tokens_total/prefill_compute": 11362560.0,
"sglang:realtime_tokens_total/decode": 1412745.0,
"sglang:realtime_tokens_total/prefill_cache": 24242816.0,
"sglang:queue_time_seconds_sum": 18135.527407333255,
"sglang:queue_time_seconds_count": 5584.0
}
},
{
"time": 94.02623921446502,
"metrics": {
"sglang:queue_time_seconds_sum": 17869.508264335804,
"sglang:queue_time_seconds_count": 5711.0,
"sglang:realtime_tokens_total/prefill_compute": 11520592.0,
"sglang:realtime_tokens_total/decode": 1451634.0,
"sglang:realtime_tokens_total/prefill_cache": 24557424.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.53,
"sglang:kv_available_tokens": 1536.0,
"sglang:kv_evictable_tokens": 491504.0,
"sglang:prompt_tokens_histogram_sum": 35485544.0,
"sglang:prompt_tokens_histogram_count": 5644.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11396200.0,
"sglang:generation_tokens_total": 1443176.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 96.02088230941445,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 87.0,
"sglang:token_usage": 0.22,
"sglang:kv_available_tokens": 1728.0,
"sglang:kv_evictable_tokens": 811856.0,
"sglang:generation_tokens_total": 1412520.0,
"sglang:prompt_tokens_histogram_sum": 35408227.0,
"sglang:prompt_tokens_histogram_count": 5528.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11310979.0,
"sglang:realtime_tokens_total/prefill_compute": 11369104.0,
"sglang:realtime_tokens_total/decode": 1423294.0,
"sglang:realtime_tokens_total/prefill_cache": 24280512.0,
"sglang:queue_time_seconds_sum": 18181.25042967964,
"sglang:queue_time_seconds_count": 5594.0
}
},
{
"time": 96.02164916414768,
"metrics": {
"sglang:queue_time_seconds_sum": 17903.456001830287,
"sglang:queue_time_seconds_count": 5726.0,
"sglang:realtime_tokens_total/prefill_compute": 11543504.0,
"sglang:realtime_tokens_total/decode": 1458019.0,
"sglang:realtime_tokens_total/prefill_cache": 24663696.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 3968.0,
"sglang:kv_evictable_tokens": 537632.0,
"sglang:prompt_tokens_histogram_sum": 35664911.0,
"sglang:prompt_tokens_histogram_count": 5659.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11425503.0,
"sglang:generation_tokens_total": 1447016.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 98.02226459886879,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2064.0,
"sglang:kv_evictable_tokens": 680048.0,
"sglang:generation_tokens_total": 1425832.0,
"sglang:prompt_tokens_histogram_sum": 35581499.0,
"sglang:prompt_tokens_histogram_count": 5580.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11338683.0,
"sglang:realtime_tokens_total/prefill_compute": 11423472.0,
"sglang:realtime_tokens_total/decode": 1428870.0,
"sglang:realtime_tokens_total/prefill_cache": 24553120.0,
"sglang:queue_time_seconds_sum": 18364.936787032522,
"sglang:queue_time_seconds_count": 5645.0
}
},
{
"time": 98.0226494492963,
"metrics": {
"sglang:queue_time_seconds_sum": 17978.14336528629,
"sglang:queue_time_seconds_count": 5769.0,
"sglang:realtime_tokens_total/prefill_compute": 11603040.0,
"sglang:realtime_tokens_total/decode": 1462530.0,
"sglang:realtime_tokens_total/prefill_cache": 24929040.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 2912.0,
"sglang:kv_evictable_tokens": 549824.0,
"sglang:prompt_tokens_histogram_sum": 36053260.0,
"sglang:prompt_tokens_histogram_count": 5708.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11495836.0,
"sglang:generation_tokens_total": 1459560.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 100.02249225601554,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 83.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3024.0,
"sglang:kv_evictable_tokens": 686368.0,
"sglang:generation_tokens_total": 1426600.0,
"sglang:prompt_tokens_histogram_sum": 35608059.0,
"sglang:prompt_tokens_histogram_count": 5583.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11342779.0,
"sglang:realtime_tokens_total/prefill_compute": 11427312.0,
"sglang:realtime_tokens_total/decode": 1437761.0,
"sglang:realtime_tokens_total/prefill_cache": 24574608.0,
"sglang:queue_time_seconds_sum": 18381.05786280334,
"sglang:queue_time_seconds_count": 5650.0
}
},
{
"time": 100.0268170433119,
"metrics": {
"sglang:queue_time_seconds_sum": 17984.617816825397,
"sglang:queue_time_seconds_count": 5779.0,
"sglang:realtime_tokens_total/prefill_compute": 11618912.0,
"sglang:realtime_tokens_total/decode": 1469720.0,
"sglang:realtime_tokens_total/prefill_cache": 25000784.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1584.0,
"sglang:kv_evictable_tokens": 564048.0,
"sglang:prompt_tokens_histogram_sum": 36098866.0,
"sglang:prompt_tokens_histogram_count": 5712.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11503234.0,
"sglang:generation_tokens_total": 1460584.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 102.02162923570722,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 1568.0,
"sglang:kv_evictable_tokens": 701200.0,
"sglang:generation_tokens_total": 1435816.0,
"sglang:prompt_tokens_histogram_sum": 35892465.0,
"sglang:prompt_tokens_histogram_count": 5619.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11390769.0,
"sglang:realtime_tokens_total/prefill_compute": 11474992.0,
"sglang:realtime_tokens_total/decode": 1443613.0,
"sglang:realtime_tokens_total/prefill_cache": 24799968.0,
"sglang:queue_time_seconds_sum": 18555.858611158095,
"sglang:queue_time_seconds_count": 5686.0
}
},
{
"time": 102.0212052166462,
"metrics": {
"sglang:queue_time_seconds_sum": 18041.095463807695,
"sglang:queue_time_seconds_count": 5804.0,
"sglang:realtime_tokens_total/prefill_compute": 11650448.0,
"sglang:realtime_tokens_total/decode": 1475839.0,
"sglang:realtime_tokens_total/prefill_cache": 25136864.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2432.0,
"sglang:kv_evictable_tokens": 577344.0,
"sglang:prompt_tokens_histogram_sum": 36282898.0,
"sglang:prompt_tokens_histogram_count": 5738.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11538210.0,
"sglang:generation_tokens_total": 1467240.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 104.02167144138366,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1232.0,
"sglang:kv_evictable_tokens": 662064.0,
"sglang:generation_tokens_total": 1442728.0,
"sglang:prompt_tokens_histogram_sum": 35974737.0,
"sglang:prompt_tokens_histogram_count": 5646.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11402545.0,
"sglang:realtime_tokens_total/prefill_compute": 11493968.0,
"sglang:realtime_tokens_total/decode": 1451074.0,
"sglang:realtime_tokens_total/prefill_cache": 24902032.0,
"sglang:queue_time_seconds_sum": 18649.260034321807,
"sglang:queue_time_seconds_count": 5713.0
}
},
{
"time": 104.02207406889647,
"metrics": {
"sglang:queue_time_seconds_sum": 18073.413981384598,
"sglang:queue_time_seconds_count": 5839.0,
"sglang:realtime_tokens_total/prefill_compute": 11711312.0,
"sglang:realtime_tokens_total/decode": 1480396.0,
"sglang:realtime_tokens_total/prefill_cache": 25423280.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 2.0,
"sglang:token_usage": 0.51,
"sglang:kv_available_tokens": 2768.0,
"sglang:kv_evictable_tokens": 506816.0,
"sglang:prompt_tokens_histogram_sum": 36553317.0,
"sglang:prompt_tokens_histogram_count": 5772.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11586949.0,
"sglang:generation_tokens_total": 1475944.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 106.02164830546826,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 71.0,
"sglang:token_usage": 0.26,
"sglang:kv_available_tokens": 4336.0,
"sglang:kv_evictable_tokens": 770320.0,
"sglang:generation_tokens_total": 1449640.0,
"sglang:prompt_tokens_histogram_sum": 36174522.0,
"sglang:prompt_tokens_histogram_count": 5673.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11436874.0,
"sglang:realtime_tokens_total/prefill_compute": 11501936.0,
"sglang:realtime_tokens_total/decode": 1458923.0,
"sglang:realtime_tokens_total/prefill_cache": 24952800.0,
"sglang:queue_time_seconds_sum": 18801.689997182228,
"sglang:queue_time_seconds_count": 5740.0
}
},
{
"time": 106.02396016381681,
"metrics": {
"sglang:queue_time_seconds_sum": 18082.067176980898,
"sglang:queue_time_seconds_count": 5844.0,
"sglang:realtime_tokens_total/prefill_compute": 11719120.0,
"sglang:realtime_tokens_total/decode": 1487815.0,
"sglang:realtime_tokens_total/prefill_cache": 25457936.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.52,
"sglang:kv_available_tokens": 1744.0,
"sglang:kv_evictable_tokens": 506320.0,
"sglang:prompt_tokens_histogram_sum": 36600201.0,
"sglang:prompt_tokens_histogram_count": 5777.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11594969.0,
"sglang:generation_tokens_total": 1477224.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 108.02087484393269,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 51.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 735440.0,
"sglang:generation_tokens_total": 1459112.0,
"sglang:prompt_tokens_histogram_sum": 36371625.0,
"sglang:prompt_tokens_histogram_count": 5710.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11469593.0,
"sglang:realtime_tokens_total/prefill_compute": 11553120.0,
"sglang:realtime_tokens_total/decode": 1465090.0,
"sglang:realtime_tokens_total/prefill_cache": 25170656.0,
"sglang:queue_time_seconds_sum": 18945.446562608704,
"sglang:queue_time_seconds_count": 5777.0
}
},
{
"time": 108.0287218047306,
"metrics": {
"sglang:queue_time_seconds_sum": 18148.312802919187,
"sglang:queue_time_seconds_count": 5873.0,
"sglang:realtime_tokens_total/prefill_compute": 11756704.0,
"sglang:realtime_tokens_total/decode": 1493226.0,
"sglang:realtime_tokens_total/prefill_cache": 25655568.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 7.0,
"sglang:token_usage": 0.5,
"sglang:kv_available_tokens": 1088.0,
"sglang:kv_evictable_tokens": 518832.0,
"sglang:prompt_tokens_histogram_sum": 36907435.0,
"sglang:prompt_tokens_histogram_count": 5811.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11647931.0,
"sglang:generation_tokens_total": 1485928.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 110.02231825236231,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 79.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2592.0,
"sglang:kv_evictable_tokens": 703840.0,
"sglang:generation_tokens_total": 1463208.0,
"sglang:prompt_tokens_histogram_sum": 36399843.0,
"sglang:prompt_tokens_histogram_count": 5726.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11472355.0,
"sglang:realtime_tokens_total/prefill_compute": 11560528.0,
"sglang:realtime_tokens_total/decode": 1474035.0,
"sglang:realtime_tokens_total/prefill_cache": 25214832.0,
"sglang:queue_time_seconds_sum": 19031.070101809688,
"sglang:queue_time_seconds_count": 5793.0
}
},
{
"time": 110.02508771512657,
"metrics": {
"sglang:queue_time_seconds_sum": 18158.811508496292,
"sglang:queue_time_seconds_count": 5902.0,
"sglang:realtime_tokens_total/prefill_compute": 11803024.0,
"sglang:realtime_tokens_total/decode": 1498514.0,
"sglang:realtime_tokens_total/prefill_cache": 25859184.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 2.0,
"sglang:token_usage": 0.49,
"sglang:kv_available_tokens": 1936.0,
"sglang:kv_evictable_tokens": 535504.0,
"sglang:prompt_tokens_histogram_sum": 37109227.0,
"sglang:prompt_tokens_histogram_count": 5836.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11685947.0,
"sglang:generation_tokens_total": 1492328.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 112.0271911798045,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 1840.0,
"sglang:kv_evictable_tokens": 720144.0,
"sglang:generation_tokens_total": 1475496.0,
"sglang:prompt_tokens_histogram_sum": 36699084.0,
"sglang:prompt_tokens_histogram_count": 5774.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11528428.0,
"sglang:realtime_tokens_total/prefill_compute": 11614112.0,
"sglang:realtime_tokens_total/decode": 1479618.0,
"sglang:realtime_tokens_total/prefill_cache": 25452832.0,
"sglang:queue_time_seconds_sum": 19231.332628887147,
"sglang:queue_time_seconds_count": 5841.0
}
},
{
"time": 112.03551128040999,
"metrics": {
"sglang:queue_time_seconds_sum": 18173.51754473895,
"sglang:queue_time_seconds_count": 5911.0,
"sglang:realtime_tokens_total/prefill_compute": 11816080.0,
"sglang:realtime_tokens_total/decode": 1505428.0,
"sglang:realtime_tokens_total/prefill_cache": 25932304.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.52,
"sglang:kv_available_tokens": 2224.0,
"sglang:kv_evictable_tokens": 496480.0,
"sglang:prompt_tokens_histogram_sum": 37175811.0,
"sglang:prompt_tokens_histogram_count": 5844.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11698195.0,
"sglang:generation_tokens_total": 1494376.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 114.02018882799894,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 93.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 1408.0,
"sglang:kv_evictable_tokens": 701360.0,
"sglang:generation_tokens_total": 1478056.0,
"sglang:prompt_tokens_histogram_sum": 36738415.0,
"sglang:prompt_tokens_histogram_count": 5784.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11533871.0,
"sglang:realtime_tokens_total/prefill_compute": 11617824.0,
"sglang:realtime_tokens_total/decode": 1488825.0,
"sglang:realtime_tokens_total/prefill_cache": 25467568.0,
"sglang:queue_time_seconds_sum": 19280.342763362452,
"sglang:queue_time_seconds_count": 5850.0
}
},
{
"time": 114.02194871474057,
"metrics": {
"sglang:queue_time_seconds_sum": 18238.233075422235,
"sglang:queue_time_seconds_count": 5947.0,
"sglang:realtime_tokens_total/prefill_compute": 11872528.0,
"sglang:realtime_tokens_total/decode": 1509872.0,
"sglang:realtime_tokens_total/prefill_cache": 26202800.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 2.0,
"sglang:token_usage": 0.54,
"sglang:kv_available_tokens": 2480.0,
"sglang:kv_evictable_tokens": 475904.0,
"sglang:prompt_tokens_histogram_sum": 37466194.0,
"sglang:prompt_tokens_histogram_count": 5880.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11746770.0,
"sglang:generation_tokens_total": 1503592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 116.02136379480362,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.21,
"sglang:kv_available_tokens": 2320.0,
"sglang:kv_evictable_tokens": 822544.0,
"sglang:generation_tokens_total": 1491880.0,
"sglang:prompt_tokens_histogram_sum": 37042034.0,
"sglang:prompt_tokens_histogram_count": 5838.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11589202.0,
"sglang:realtime_tokens_total/prefill_compute": 11658368.0,
"sglang:realtime_tokens_total/decode": 1494914.0,
"sglang:realtime_tokens_total/prefill_cache": 25653056.0,
"sglang:queue_time_seconds_sum": 19524.41871934198,
"sglang:queue_time_seconds_count": 5905.0
}
},
{
"time": 116.02120676916093,
"metrics": {
"sglang:queue_time_seconds_sum": 18240.187051381916,
"sglang:queue_time_seconds_count": 5966.0,
"sglang:realtime_tokens_total/prefill_compute": 11897296.0,
"sglang:realtime_tokens_total/decode": 1515404.0,
"sglang:realtime_tokens_total/prefill_cache": 26338512.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 4.0,
"sglang:token_usage": 0.53,
"sglang:kv_available_tokens": 1360.0,
"sglang:kv_evictable_tokens": 488496.0,
"sglang:prompt_tokens_histogram_sum": 37636580.0,
"sglang:prompt_tokens_histogram_count": 5899.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11777396.0,
"sglang:generation_tokens_total": 1508456.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 118.02513838466257,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 86.0,
"sglang:token_usage": 0.18,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 862224.0,
"sglang:generation_tokens_total": 1494696.0,
"sglang:prompt_tokens_histogram_sum": 37129464.0,
"sglang:prompt_tokens_histogram_count": 5849.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11604888.0,
"sglang:realtime_tokens_total/prefill_compute": 11665696.0,
"sglang:realtime_tokens_total/decode": 1505591.0,
"sglang:realtime_tokens_total/prefill_cache": 25685456.0,
"sglang:queue_time_seconds_sum": 19580.90304897912,
"sglang:queue_time_seconds_count": 5916.0
}
},
{
"time": 118.0228520622477,
"metrics": {
"sglang:queue_time_seconds_sum": 18254.67888164241,
"sglang:queue_time_seconds_count": 5975.0,
"sglang:realtime_tokens_total/prefill_compute": 11911232.0,
"sglang:realtime_tokens_total/decode": 1522179.0,
"sglang:realtime_tokens_total/prefill_cache": 26404016.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.53,
"sglang:kv_available_tokens": 2768.0,
"sglang:kv_evictable_tokens": 487760.0,
"sglang:prompt_tokens_histogram_sum": 37724002.0,
"sglang:prompt_tokens_histogram_count": 5908.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11790434.0,
"sglang:generation_tokens_total": 1510760.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 120.02163272630423,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2112.0,
"sglang:kv_evictable_tokens": 749344.0,
"sglang:generation_tokens_total": 1508264.0,
"sglang:prompt_tokens_histogram_sum": 37286224.0,
"sglang:prompt_tokens_histogram_count": 5902.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11633168.0,
"sglang:realtime_tokens_total/prefill_compute": 11715504.0,
"sglang:realtime_tokens_total/decode": 1511810.0,
"sglang:realtime_tokens_total/prefill_cache": 25909664.0,
"sglang:queue_time_seconds_sum": 19789.01064117253,
"sglang:queue_time_seconds_count": 5969.0
}
},
{
"time": 120.02237820532173,
"metrics": {
"sglang:queue_time_seconds_sum": 18312.98049216997,
"sglang:queue_time_seconds_count": 6009.0,
"sglang:realtime_tokens_total/prefill_compute": 11964480.0,
"sglang:realtime_tokens_total/decode": 1526791.0,
"sglang:realtime_tokens_total/prefill_cache": 26670352.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.51,
"sglang:kv_available_tokens": 896.0,
"sglang:kv_evictable_tokens": 510128.0,
"sglang:prompt_tokens_histogram_sum": 38084720.0,
"sglang:prompt_tokens_histogram_count": 5947.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11852976.0,
"sglang:generation_tokens_total": 1520744.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 122.02005055826157,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 94.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 1936.0,
"sglang:kv_evictable_tokens": 737664.0,
"sglang:generation_tokens_total": 1510824.0,
"sglang:prompt_tokens_histogram_sum": 37320335.0,
"sglang:prompt_tokens_histogram_count": 5912.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11639327.0,
"sglang:realtime_tokens_total/prefill_compute": 11716688.0,
"sglang:realtime_tokens_total/decode": 1521593.0,
"sglang:realtime_tokens_total/prefill_cache": 25916640.0,
"sglang:queue_time_seconds_sum": 19832.338171919808,
"sglang:queue_time_seconds_count": 5978.0
}
},
{
"time": 122.02701378334314,
"metrics": {
"sglang:queue_time_seconds_sum": 18313.00603637658,
"sglang:queue_time_seconds_count": 6030.0,
"sglang:realtime_tokens_total/prefill_compute": 11994192.0,
"sglang:realtime_tokens_total/decode": 1532270.0,
"sglang:realtime_tokens_total/prefill_cache": 26821536.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 9.0,
"sglang:token_usage": 0.54,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 480992.0,
"sglang:prompt_tokens_histogram_sum": 38209918.0,
"sglang:prompt_tokens_histogram_count": 5963.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11871406.0,
"sglang:generation_tokens_total": 1524840.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 124.02119656093419,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1184.0,
"sglang:kv_evictable_tokens": 654912.0,
"sglang:generation_tokens_total": 1523368.0,
"sglang:prompt_tokens_histogram_sum": 37588868.0,
"sglang:prompt_tokens_histogram_count": 5961.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11687956.0,
"sglang:realtime_tokens_total/prefill_compute": 11775872.0,
"sglang:realtime_tokens_total/decode": 1526792.0,
"sglang:realtime_tokens_total/prefill_cache": 26206272.0,
"sglang:queue_time_seconds_sum": 20050.126377169043,
"sglang:queue_time_seconds_count": 6027.0
}
},
{
"time": 124.02206461597234,
"metrics": {
"sglang:queue_time_seconds_sum": 18326.667494000867,
"sglang:queue_time_seconds_count": 6039.0,
"sglang:realtime_tokens_total/prefill_compute": 12013232.0,
"sglang:realtime_tokens_total/decode": 1538533.0,
"sglang:realtime_tokens_total/prefill_cache": 26921952.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.58,
"sglang:kv_available_tokens": 1968.0,
"sglang:kv_evictable_tokens": 438608.0,
"sglang:prompt_tokens_histogram_sum": 38289336.0,
"sglang:prompt_tokens_histogram_count": 5972.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11885320.0,
"sglang:generation_tokens_total": 1527144.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 126.02041965350509,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 73.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1792.0,
"sglang:kv_evictable_tokens": 637344.0,
"sglang:generation_tokens_total": 1524648.0,
"sglang:prompt_tokens_histogram_sum": 37599705.0,
"sglang:prompt_tokens_histogram_count": 5966.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11690041.0,
"sglang:realtime_tokens_total/prefill_compute": 11787792.0,
"sglang:realtime_tokens_total/decode": 1534914.0,
"sglang:realtime_tokens_total/prefill_cache": 26259040.0,
"sglang:queue_time_seconds_sum": 20070.79972039163,
"sglang:queue_time_seconds_count": 6033.0
}
},
{
"time": 126.02241022977978,
"metrics": {
"sglang:queue_time_seconds_sum": 18382.023115394637,
"sglang:queue_time_seconds_count": 6072.0,
"sglang:realtime_tokens_total/prefill_compute": 12052176.0,
"sglang:realtime_tokens_total/decode": 1543645.0,
"sglang:realtime_tokens_total/prefill_cache": 27104304.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 2032.0,
"sglang:kv_evictable_tokens": 538352.0,
"sglang:prompt_tokens_histogram_sum": 38608760.0,
"sglang:prompt_tokens_histogram_count": 6006.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11938408.0,
"sglang:generation_tokens_total": 1535848.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 128.02123429905623,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.24,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 796128.0,
"sglang:generation_tokens_total": 1535656.0,
"sglang:prompt_tokens_histogram_sum": 37902594.0,
"sglang:prompt_tokens_histogram_count": 6009.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11741186.0,
"sglang:realtime_tokens_total/prefill_compute": 11810256.0,
"sglang:realtime_tokens_total/decode": 1542172.0,
"sglang:realtime_tokens_total/prefill_cache": 26348544.0,
"sglang:queue_time_seconds_sum": 20290.63855575584,
"sglang:queue_time_seconds_count": 6071.0
}
},
{
"time": 128.02615374606103,
"metrics": {
"sglang:queue_time_seconds_sum": 18382.334033579566,
"sglang:queue_time_seconds_count": 6094.0,
"sglang:realtime_tokens_total/prefill_compute": 12085600.0,
"sglang:realtime_tokens_total/decode": 1549338.0,
"sglang:realtime_tokens_total/prefill_cache": 27274160.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.51,
"sglang:kv_available_tokens": 2224.0,
"sglang:kv_evictable_tokens": 516720.0,
"sglang:prompt_tokens_histogram_sum": 38789588.0,
"sglang:prompt_tokens_histogram_count": 6027.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11968052.0,
"sglang:generation_tokens_total": 1541224.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 130.02594653051347,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 72.0,
"sglang:token_usage": 0.23,
"sglang:kv_available_tokens": 1216.0,
"sglang:kv_evictable_tokens": 811024.0,
"sglang:generation_tokens_total": 1541288.0,
"sglang:prompt_tokens_histogram_sum": 38024137.0,
"sglang:prompt_tokens_histogram_count": 6031.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11762681.0,
"sglang:realtime_tokens_total/prefill_compute": 11835088.0,
"sglang:realtime_tokens_total/decode": 1552001.0,
"sglang:realtime_tokens_total/prefill_cache": 26463440.0,
"sglang:queue_time_seconds_sum": 20399.41780310031,
"sglang:queue_time_seconds_count": 6098.0
}
},
{
"time": 130.02165257558227,
"metrics": {
"sglang:queue_time_seconds_sum": 18417.532127715647,
"sglang:queue_time_seconds_count": 6113.0,
"sglang:realtime_tokens_total/prefill_compute": 12104784.0,
"sglang:realtime_tokens_total/decode": 1555850.0,
"sglang:realtime_tokens_total/prefill_cache": 27370160.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 17.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 551856.0,
"sglang:prompt_tokens_histogram_sum": 38989940.0,
"sglang:prompt_tokens_histogram_count": 6046.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11999828.0,
"sglang:generation_tokens_total": 1546088.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 132.02240343485028,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.27,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 764624.0,
"sglang:generation_tokens_total": 1556136.0,
"sglang:prompt_tokens_histogram_sum": 38239214.0,
"sglang:prompt_tokens_histogram_count": 6089.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11802718.0,
"sglang:realtime_tokens_total/prefill_compute": 11871568.0,
"sglang:realtime_tokens_total/decode": 1559560.0,
"sglang:realtime_tokens_total/prefill_cache": 26612928.0,
"sglang:queue_time_seconds_sum": 20645.964629943483,
"sglang:queue_time_seconds_count": 6155.0
}
},
{
"time": 132.02222741767764,
"metrics": {
"sglang:queue_time_seconds_sum": 18445.319782606326,
"sglang:queue_time_seconds_count": 6143.0,
"sglang:realtime_tokens_total/prefill_compute": 12152512.0,
"sglang:realtime_tokens_total/decode": 1560994.0,
"sglang:realtime_tokens_total/prefill_cache": 27616992.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 3.0,
"sglang:token_usage": 0.52,
"sglang:kv_available_tokens": 1616.0,
"sglang:kv_evictable_tokens": 501616.0,
"sglang:prompt_tokens_histogram_sum": 39221135.0,
"sglang:prompt_tokens_histogram_count": 6079.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12040047.0,
"sglang:generation_tokens_total": 1554536.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 134.0207172203809,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 91.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 3088.0,
"sglang:kv_evictable_tokens": 739920.0,
"sglang:generation_tokens_total": 1557672.0,
"sglang:prompt_tokens_histogram_sum": 38272522.0,
"sglang:prompt_tokens_histogram_count": 6095.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11809082.0,
"sglang:realtime_tokens_total/prefill_compute": 11892416.0,
"sglang:realtime_tokens_total/decode": 1568449.0,
"sglang:realtime_tokens_total/prefill_cache": 26723792.0,
"sglang:queue_time_seconds_sum": 20665.926577517763,
"sglang:queue_time_seconds_count": 6162.0
}
},
{
"time": 134.0237676622346,
"metrics": {
"sglang:queue_time_seconds_sum": 18450.887247510254,
"sglang:queue_time_seconds_count": 6163.0,
"sglang:realtime_tokens_total/prefill_compute": 12172656.0,
"sglang:realtime_tokens_total/decode": 1567811.0,
"sglang:realtime_tokens_total/prefill_cache": 27711712.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 3616.0,
"sglang:kv_evictable_tokens": 579216.0,
"sglang:prompt_tokens_histogram_sum": 39379447.0,
"sglang:prompt_tokens_histogram_count": 6096.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12066935.0,
"sglang:generation_tokens_total": 1558888.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 136.02113744337112,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 3936.0,
"sglang:kv_evictable_tokens": 671008.0,
"sglang:generation_tokens_total": 1568424.0,
"sglang:prompt_tokens_histogram_sum": 38431712.0,
"sglang:prompt_tokens_histogram_count": 6137.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11840272.0,
"sglang:realtime_tokens_total/prefill_compute": 11933728.0,
"sglang:realtime_tokens_total/decode": 1575127.0,
"sglang:realtime_tokens_total/prefill_cache": 26912272.0,
"sglang:queue_time_seconds_sum": 20858.490496775135,
"sglang:queue_time_seconds_count": 6204.0
}
},
{
"time": 136.0208739535883,
"metrics": {
"sglang:queue_time_seconds_sum": 18488.774453935213,
"sglang:queue_time_seconds_count": 6189.0,
"sglang:realtime_tokens_total/prefill_compute": 12207824.0,
"sglang:realtime_tokens_total/decode": 1573545.0,
"sglang:realtime_tokens_total/prefill_cache": 27900912.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 8.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 3520.0,
"sglang:kv_evictable_tokens": 551168.0,
"sglang:prompt_tokens_histogram_sum": 39575041.0,
"sglang:prompt_tokens_histogram_count": 6122.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12098225.0,
"sglang:generation_tokens_total": 1565544.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 138.02080411091447,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 70.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 716880.0,
"sglang:generation_tokens_total": 1573800.0,
"sglang:prompt_tokens_histogram_sum": 38573568.0,
"sglang:prompt_tokens_histogram_count": 6158.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11863744.0,
"sglang:realtime_tokens_total/prefill_compute": 11953648.0,
"sglang:realtime_tokens_total/decode": 1584258.0,
"sglang:realtime_tokens_total/prefill_cache": 26989280.0,
"sglang:queue_time_seconds_sum": 20925.993111360818,
"sglang:queue_time_seconds_count": 6225.0
}
},
{
"time": 138.02231426816434,
"metrics": {
"sglang:queue_time_seconds_sum": 18502.12932206504,
"sglang:queue_time_seconds_count": 6222.0,
"sglang:realtime_tokens_total/prefill_compute": 12233088.0,
"sglang:realtime_tokens_total/decode": 1580481.0,
"sglang:realtime_tokens_total/prefill_cache": 28017968.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 5.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2160.0,
"sglang:kv_evictable_tokens": 655760.0,
"sglang:prompt_tokens_histogram_sum": 39816777.0,
"sglang:prompt_tokens_histogram_count": 6155.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12139337.0,
"sglang:generation_tokens_total": 1573992.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 140.0214538136497,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 725600.0,
"sglang:generation_tokens_total": 1584808.0,
"sglang:prompt_tokens_histogram_sum": 38819593.0,
"sglang:prompt_tokens_histogram_count": 6201.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11907321.0,
"sglang:realtime_tokens_total/prefill_compute": 11989776.0,
"sglang:realtime_tokens_total/decode": 1591388.0,
"sglang:realtime_tokens_total/prefill_cache": 27174400.0,
"sglang:queue_time_seconds_sum": 21132.318489312194,
"sglang:queue_time_seconds_count": 6268.0
}
},
{
"time": 140.02499728277326,
"metrics": {
"sglang:queue_time_seconds_sum": 18517.4415376978,
"sglang:queue_time_seconds_count": 6233.0,
"sglang:realtime_tokens_total/prefill_compute": 12249408.0,
"sglang:realtime_tokens_total/decode": 1587894.0,
"sglang:realtime_tokens_total/prefill_cache": 28109648.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1760.0,
"sglang:kv_evictable_tokens": 619600.0,
"sglang:prompt_tokens_histogram_sum": 39892920.0,
"sglang:prompt_tokens_histogram_count": 6166.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12150632.0,
"sglang:generation_tokens_total": 1576808.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 142.02329210657626,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1712.0,
"sglang:kv_evictable_tokens": 690944.0,
"sglang:generation_tokens_total": 1590184.0,
"sglang:prompt_tokens_histogram_sum": 38916375.0,
"sglang:prompt_tokens_histogram_count": 6222.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11927095.0,
"sglang:realtime_tokens_total/prefill_compute": 12018080.0,
"sglang:realtime_tokens_total/decode": 1599234.0,
"sglang:realtime_tokens_total/prefill_cache": 27292720.0,
"sglang:queue_time_seconds_sum": 21197.73536313232,
"sglang:queue_time_seconds_count": 6289.0
}
},
{
"time": 142.0226720534265,
"metrics": {
"sglang:queue_time_seconds_sum": 18566.685582134873,
"sglang:queue_time_seconds_count": 6277.0,
"sglang:realtime_tokens_total/prefill_compute": 12288384.0,
"sglang:realtime_tokens_total/decode": 1594246.0,
"sglang:realtime_tokens_total/prefill_cache": 28290832.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 1.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1600.0,
"sglang:kv_evictable_tokens": 661744.0,
"sglang:prompt_tokens_histogram_sum": 40215525.0,
"sglang:prompt_tokens_histogram_count": 6214.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12205045.0,
"sglang:generation_tokens_total": 1589096.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 144.020400011912,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 2032.0,
"sglang:kv_evictable_tokens": 730976.0,
"sglang:generation_tokens_total": 1599144.0,
"sglang:prompt_tokens_histogram_sum": 39123735.0,
"sglang:prompt_tokens_histogram_count": 6257.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11960759.0,
"sglang:realtime_tokens_total/prefill_compute": 12045392.0,
"sglang:realtime_tokens_total/decode": 1606943.0,
"sglang:realtime_tokens_total/prefill_cache": 27435728.0,
"sglang:queue_time_seconds_sum": 21371.333893077448,
"sglang:queue_time_seconds_count": 6324.0
}
},
{
"time": 144.0211136173457,
"metrics": {
"sglang:queue_time_seconds_sum": 18572.273795314133,
"sglang:queue_time_seconds_count": 6292.0,
"sglang:realtime_tokens_total/prefill_compute": 12307600.0,
"sglang:realtime_tokens_total/decode": 1601703.0,
"sglang:realtime_tokens_total/prefill_cache": 28403824.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1024.0,
"sglang:kv_evictable_tokens": 684480.0,
"sglang:prompt_tokens_histogram_sum": 40309187.0,
"sglang:prompt_tokens_histogram_count": 6225.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12218963.0,
"sglang:generation_tokens_total": 1591912.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 146.02068824972957,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1072.0,
"sglang:kv_evictable_tokens": 668800.0,
"sglang:generation_tokens_total": 1606568.0,
"sglang:prompt_tokens_histogram_sum": 39283941.0,
"sglang:prompt_tokens_histogram_count": 6286.0,
"sglang:uncached_prompt_tokens_histogram_sum": 11991221.0,
"sglang:realtime_tokens_total/prefill_compute": 12086576.0,
"sglang:realtime_tokens_total/decode": 1613634.0,
"sglang:realtime_tokens_total/prefill_cache": 27620176.0,
"sglang:queue_time_seconds_sum": 21469.52990925871,
"sglang:queue_time_seconds_count": 6353.0
}
},
{
"time": 146.02583185955882,
"metrics": {
"sglang:queue_time_seconds_sum": 18622.69207715802,
"sglang:queue_time_seconds_count": 6328.0,
"sglang:realtime_tokens_total/prefill_compute": 12330704.0,
"sglang:realtime_tokens_total/decode": 1609027.0,
"sglang:realtime_tokens_total/prefill_cache": 28515568.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 6.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 1728.0,
"sglang:kv_evictable_tokens": 741856.0,
"sglang:prompt_tokens_histogram_sum": 40498528.0,
"sglang:prompt_tokens_histogram_count": 6261.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12252656.0,
"sglang:generation_tokens_total": 1601128.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 148.02507463749498,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 72.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2992.0,
"sglang:kv_evictable_tokens": 629200.0,
"sglang:generation_tokens_total": 1611176.0,
"sglang:prompt_tokens_histogram_sum": 39347956.0,
"sglang:prompt_tokens_histogram_count": 6304.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12002388.0,
"sglang:realtime_tokens_total/prefill_compute": 12105824.0,
"sglang:realtime_tokens_total/decode": 1621936.0,
"sglang:realtime_tokens_total/prefill_cache": 27697168.0,
"sglang:queue_time_seconds_sum": 21565.235318019055,
"sglang:queue_time_seconds_count": 6371.0
}
},
{
"time": 148.02089407574385,
"metrics": {
"sglang:queue_time_seconds_sum": 18634.91030206997,
"sglang:queue_time_seconds_count": 6356.0,
"sglang:realtime_tokens_total/prefill_compute": 12349776.0,
"sglang:realtime_tokens_total/decode": 1617844.0,
"sglang:realtime_tokens_total/prefill_cache": 28597360.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 17.0,
"sglang:token_usage": 0.21,
"sglang:kv_available_tokens": 1056.0,
"sglang:kv_evictable_tokens": 824896.0,
"sglang:prompt_tokens_histogram_sum": 40684389.0,
"sglang:prompt_tokens_histogram_count": 6289.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12280565.0,
"sglang:generation_tokens_total": 1608296.0
}
}
]
},
{
"label": "score_end",
"workers": [
{
"time": 150.0070193754509,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1728.0,
"sglang:kv_evictable_tokens": 672432.0,
"sglang:generation_tokens_total": 1622952.0,
"sglang:prompt_tokens_histogram_sum": 39679554.0,
"sglang:prompt_tokens_histogram_count": 6350.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12059378.0,
"sglang:realtime_tokens_total/prefill_compute": 12156784.0,
"sglang:realtime_tokens_total/decode": 1627970.0,
"sglang:realtime_tokens_total/prefill_cache": 27942736.0,
"sglang:queue_time_seconds_sum": 21745.64284042921,
"sglang:queue_time_seconds_count": 6417.0
}
},
{
"time": 150.00854425132275,
"metrics": {
"sglang:queue_time_seconds_sum": 18676.586039249785,
"sglang:queue_time_seconds_count": 6394.0,
"sglang:realtime_tokens_total/prefill_compute": 12375712.0,
"sglang:realtime_tokens_total/decode": 1625550.0,
"sglang:realtime_tokens_total/prefill_cache": 28716736.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 8.0,
"sglang:token_usage": 0.22,
"sglang:kv_available_tokens": 2080.0,
"sglang:kv_evictable_tokens": 819936.0,
"sglang:prompt_tokens_histogram_sum": 40825528.0,
"sglang:prompt_tokens_histogram_count": 6327.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12304872.0,
"sglang:generation_tokens_total": 1618024.0
}
}
]
},
{
"label": "drained",
"workers": [
{
"time": 197.85196747723967,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 5408.0,
"sglang:kv_evictable_tokens": 1043168.0,
"sglang:generation_tokens_total": 1723304.0,
"sglang:prompt_tokens_histogram_sum": 42722386.0,
"sglang:prompt_tokens_histogram_count": 6742.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13876802.0,
"sglang:realtime_tokens_total/prefill_compute": 13906112.0,
"sglang:realtime_tokens_total/decode": 1723290.0,
"sglang:realtime_tokens_total/prefill_cache": 28845584.0,
"sglang:queue_time_seconds_sum": 24310.928417067043,
"sglang:queue_time_seconds_count": 6745.0
}
},
{
"time": 197.85317252669483,
"metrics": {
"sglang:queue_time_seconds_sum": 19082.89208376687,
"sglang:queue_time_seconds_count": 6919.0,
"sglang:realtime_tokens_total/prefill_compute": 12806704.0,
"sglang:realtime_tokens_total/decode": 1768758.0,
"sglang:realtime_tokens_total/prefill_cache": 30668912.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 304.0,
"sglang:kv_evictable_tokens": 1048272.0,
"sglang:prompt_tokens_histogram_sum": 43445894.0,
"sglang:prompt_tokens_histogram_count": 6916.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12776982.0,
"sglang:generation_tokens_total": 1768808.0
}
}
]
}
],
"r1_smg_sticky": [
{
"label": "start",
"workers": [
{
"time": 0.006164844147861004,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1047536.0,
"sglang:kv_evictable_tokens": 1040.0,
"sglang:generation_tokens_total": 2820424.0,
"sglang:prompt_tokens_histogram_sum": 70513140.0,
"sglang:prompt_tokens_histogram_count": 11037.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23299188.0,
"sglang:realtime_tokens_total/prefill_compute": 23346672.0,
"sglang:realtime_tokens_total/decode": 2820350.0,
"sglang:realtime_tokens_total/prefill_cache": 47213952.0,
"sglang:queue_time_seconds_sum": 38129.90255384613,
"sglang:queue_time_seconds_count": 11042.0
}
},
{
"time": 0.006553422659635544,
"metrics": {
"sglang:queue_time_seconds_sum": 34853.60254111141,
"sglang:queue_time_seconds_count": 11414.0,
"sglang:realtime_tokens_total/prefill_compute": 22719648.0,
"sglang:realtime_tokens_total/decode": 2917744.0,
"sglang:realtime_tokens_total/prefill_cache": 48587376.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1048576.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:prompt_tokens_histogram_sum": 71257824.0,
"sglang:prompt_tokens_histogram_count": 11409.0,
"sglang:uncached_prompt_tokens_histogram_sum": 22670448.0,
"sglang:generation_tokens_total": 2917816.0
}
}
]
},
{
"label": "score_start",
"workers": [
{
"time": 30.006986592896283,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 8688.0,
"sglang:kv_evictable_tokens": 709808.0,
"sglang:generation_tokens_total": 2896968.0,
"sglang:prompt_tokens_histogram_sum": 72221944.0,
"sglang:prompt_tokens_histogram_count": 11336.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24213528.0,
"sglang:realtime_tokens_total/prefill_compute": 24321504.0,
"sglang:realtime_tokens_total/decode": 2902868.0,
"sglang:realtime_tokens_total/prefill_cache": 48292016.0,
"sglang:queue_time_seconds_sum": 38979.782788967714,
"sglang:queue_time_seconds_count": 11404.0
}
},
{
"time": 30.012844170443714,
"metrics": {
"sglang:queue_time_seconds_sum": 35732.51891659666,
"sglang:queue_time_seconds_count": 11736.0,
"sglang:realtime_tokens_total/prefill_compute": 23725264.0,
"sglang:realtime_tokens_total/decode": 2993227.0,
"sglang:realtime_tokens_total/prefill_cache": 49728944.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 8880.0,
"sglang:kv_evictable_tokens": 599216.0,
"sglang:prompt_tokens_histogram_sum": 72967003.0,
"sglang:prompt_tokens_histogram_count": 11667.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23598315.0,
"sglang:generation_tokens_total": 2983864.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 32.03059878014028,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3520.0,
"sglang:kv_evictable_tokens": 689728.0,
"sglang:generation_tokens_total": 2902344.0,
"sglang:prompt_tokens_histogram_sum": 72382580.0,
"sglang:prompt_tokens_histogram_count": 11357.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24240484.0,
"sglang:realtime_tokens_total/prefill_compute": 24353040.0,
"sglang:realtime_tokens_total/decode": 2910904.0,
"sglang:realtime_tokens_total/prefill_cache": 48448144.0,
"sglang:queue_time_seconds_sum": 39042.76829604618,
"sglang:queue_time_seconds_count": 11426.0
}
},
{
"time": 32.0325580900535,
"metrics": {
"sglang:queue_time_seconds_sum": 35832.35327938013,
"sglang:queue_time_seconds_count": 11774.0,
"sglang:realtime_tokens_total/prefill_compute": 23768528.0,
"sglang:realtime_tokens_total/decode": 2999205.0,
"sglang:realtime_tokens_total/prefill_cache": 49931808.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 23.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 7408.0,
"sglang:kv_evictable_tokens": 655280.0,
"sglang:prompt_tokens_histogram_sum": 73247750.0,
"sglang:prompt_tokens_histogram_count": 11705.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23646374.0,
"sglang:generation_tokens_total": 2993592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 34.03016400896013,
"metrics": {
"sglang:num_running_reqs": 57.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 12928.0,
"sglang:kv_evictable_tokens": 708000.0,
"sglang:generation_tokens_total": 2913096.0,
"sglang:prompt_tokens_histogram_sum": 72627962.0,
"sglang:prompt_tokens_histogram_count": 11399.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24282762.0,
"sglang:realtime_tokens_total/prefill_compute": 24374816.0,
"sglang:realtime_tokens_total/decode": 2919131.0,
"sglang:realtime_tokens_total/prefill_cache": 48540176.0,
"sglang:queue_time_seconds_sum": 39149.882577203214,
"sglang:queue_time_seconds_count": 11460.0
}
},
{
"time": 34.036670102737844,
"metrics": {
"sglang:queue_time_seconds_sum": 35880.22033309378,
"sglang:queue_time_seconds_count": 11792.0,
"sglang:realtime_tokens_total/prefill_compute": 23789584.0,
"sglang:realtime_tokens_total/decode": 3006936.0,
"sglang:realtime_tokens_total/prefill_cache": 50032368.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5328.0,
"sglang:kv_evictable_tokens": 649024.0,
"sglang:prompt_tokens_histogram_sum": 73361917.0,
"sglang:prompt_tokens_histogram_count": 11724.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23666605.0,
"sglang:generation_tokens_total": 2998456.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 36.03237272333354,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 5760.0,
"sglang:kv_evictable_tokens": 703920.0,
"sglang:generation_tokens_total": 2918728.0,
"sglang:prompt_tokens_histogram_sum": 72752064.0,
"sglang:prompt_tokens_histogram_count": 11421.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24303920.0,
"sglang:realtime_tokens_total/prefill_compute": 24417024.0,
"sglang:realtime_tokens_total/decode": 2926065.0,
"sglang:realtime_tokens_total/prefill_cache": 48738656.0,
"sglang:queue_time_seconds_sum": 39223.17041801941,
"sglang:queue_time_seconds_count": 11490.0
}
},
{
"time": 36.03158801328391,
"metrics": {
"sglang:queue_time_seconds_sum": 35949.93556337338,
"sglang:queue_time_seconds_count": 11819.0,
"sglang:realtime_tokens_total/prefill_compute": 23826448.0,
"sglang:realtime_tokens_total/decode": 3013333.0,
"sglang:realtime_tokens_total/prefill_cache": 50210112.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 976.0,
"sglang:kv_evictable_tokens": 610512.0,
"sglang:prompt_tokens_histogram_sum": 73536957.0,
"sglang:prompt_tokens_histogram_count": 11751.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23696557.0,
"sglang:generation_tokens_total": 3005368.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 38.03176400717348,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5616.0,
"sglang:kv_evictable_tokens": 668912.0,
"sglang:generation_tokens_total": 2923848.0,
"sglang:prompt_tokens_histogram_sum": 72807217.0,
"sglang:prompt_tokens_histogram_count": 11441.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24315793.0,
"sglang:realtime_tokens_total/prefill_compute": 24431456.0,
"sglang:realtime_tokens_total/decode": 2934561.0,
"sglang:realtime_tokens_total/prefill_cache": 48807952.0,
"sglang:queue_time_seconds_sum": 39293.430298247375,
"sglang:queue_time_seconds_count": 11510.0
}
},
{
"time": 38.03164952527732,
"metrics": {
"sglang:queue_time_seconds_sum": 36035.202472749166,
"sglang:queue_time_seconds_count": 11853.0,
"sglang:realtime_tokens_total/prefill_compute": 23850448.0,
"sglang:realtime_tokens_total/decode": 3019568.0,
"sglang:realtime_tokens_total/prefill_cache": 50325136.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 23.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 5520.0,
"sglang:kv_evictable_tokens": 582944.0,
"sglang:prompt_tokens_histogram_sum": 73770968.0,
"sglang:prompt_tokens_histogram_count": 11787.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23738600.0,
"sglang:generation_tokens_total": 3014584.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 40.03519835323095,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 647904.0,
"sglang:generation_tokens_total": 2935112.0,
"sglang:prompt_tokens_histogram_sum": 73106295.0,
"sglang:prompt_tokens_histogram_count": 11485.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24367639.0,
"sglang:realtime_tokens_total/prefill_compute": 24486448.0,
"sglang:realtime_tokens_total/decode": 2940204.0,
"sglang:realtime_tokens_total/prefill_cache": 49084032.0,
"sglang:queue_time_seconds_sum": 39409.266126959585,
"sglang:queue_time_seconds_count": 11554.0
}
},
{
"time": 40.03169253654778,
"metrics": {
"sglang:queue_time_seconds_sum": 36065.46471453458,
"sglang:queue_time_seconds_count": 11865.0,
"sglang:realtime_tokens_total/prefill_compute": 23878032.0,
"sglang:realtime_tokens_total/decode": 3027093.0,
"sglang:realtime_tokens_total/prefill_cache": 50455936.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 4960.0,
"sglang:kv_evictable_tokens": 632544.0,
"sglang:prompt_tokens_histogram_sum": 73859902.0,
"sglang:prompt_tokens_histogram_count": 11796.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23754798.0,
"sglang:generation_tokens_total": 3016888.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 42.03879895340651,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 69.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4976.0,
"sglang:kv_evictable_tokens": 648896.0,
"sglang:generation_tokens_total": 2936392.0,
"sglang:prompt_tokens_histogram_sum": 73142646.0,
"sglang:prompt_tokens_histogram_count": 11490.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24373782.0,
"sglang:realtime_tokens_total/prefill_compute": 24491184.0,
"sglang:realtime_tokens_total/decode": 2949159.0,
"sglang:realtime_tokens_total/prefill_cache": 49104000.0,
"sglang:queue_time_seconds_sum": 39434.84534002654,
"sglang:queue_time_seconds_count": 11559.0
}
},
{
"time": 42.033158033154905,
"metrics": {
"sglang:queue_time_seconds_sum": 36159.05809335783,
"sglang:queue_time_seconds_count": 11903.0,
"sglang:realtime_tokens_total/prefill_compute": 23918352.0,
"sglang:realtime_tokens_total/decode": 3033647.0,
"sglang:realtime_tokens_total/prefill_cache": 50637632.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 4480.0,
"sglang:kv_evictable_tokens": 676496.0,
"sglang:prompt_tokens_histogram_sum": 74124409.0,
"sglang:prompt_tokens_histogram_count": 11834.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23799273.0,
"sglang:generation_tokens_total": 3026616.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 44.09802520554513,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 16.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 1504.0,
"sglang:kv_evictable_tokens": 714608.0,
"sglang:generation_tokens_total": 2951496.0,
"sglang:prompt_tokens_histogram_sum": 73520832.0,
"sglang:prompt_tokens_histogram_count": 11549.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24436800.0,
"sglang:realtime_tokens_total/prefill_compute": 24548384.0,
"sglang:realtime_tokens_total/decode": 2955171.0,
"sglang:realtime_tokens_total/prefill_cache": 49371776.0,
"sglang:queue_time_seconds_sum": 39609.16697839741,
"sglang:queue_time_seconds_count": 11618.0
}
},
{
"time": 44.09710414335132,
"metrics": {
"sglang:queue_time_seconds_sum": 36208.83668893296,
"sglang:queue_time_seconds_count": 11925.0,
"sglang:realtime_tokens_total/prefill_compute": 23950480.0,
"sglang:realtime_tokens_total/decode": 3041093.0,
"sglang:realtime_tokens_total/prefill_cache": 50792784.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 7328.0,
"sglang:kv_evictable_tokens": 635168.0,
"sglang:prompt_tokens_histogram_sum": 74274786.0,
"sglang:prompt_tokens_histogram_count": 11857.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23825458.0,
"sglang:generation_tokens_total": 3032504.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 46.031000767834485,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 69.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3152.0,
"sglang:kv_evictable_tokens": 692528.0,
"sglang:generation_tokens_total": 2952008.0,
"sglang:prompt_tokens_histogram_sum": 73528592.0,
"sglang:prompt_tokens_histogram_count": 11551.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24438320.0,
"sglang:realtime_tokens_total/prefill_compute": 24551968.0,
"sglang:realtime_tokens_total/decode": 2964449.0,
"sglang:realtime_tokens_total/prefill_cache": 49388656.0,
"sglang:queue_time_seconds_sum": 39618.44116345141,
"sglang:queue_time_seconds_count": 11620.0
}
},
{
"time": 46.0338528836146,
"metrics": {
"sglang:queue_time_seconds_sum": 36289.914338033646,
"sglang:queue_time_seconds_count": 11958.0,
"sglang:realtime_tokens_total/prefill_compute": 23978960.0,
"sglang:realtime_tokens_total/decode": 3047381.0,
"sglang:realtime_tokens_total/prefill_cache": 50918512.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 24.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2768.0,
"sglang:kv_evictable_tokens": 643312.0,
"sglang:prompt_tokens_histogram_sum": 74464229.0,
"sglang:prompt_tokens_histogram_count": 11891.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23859621.0,
"sglang:generation_tokens_total": 3041208.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 48.03144147619605,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 9088.0,
"sglang:kv_evictable_tokens": 633984.0,
"sglang:generation_tokens_total": 2967880.0,
"sglang:prompt_tokens_histogram_sum": 73870246.0,
"sglang:prompt_tokens_histogram_count": 11613.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24498470.0,
"sglang:realtime_tokens_total/prefill_compute": 24621712.0,
"sglang:realtime_tokens_total/decode": 2969443.0,
"sglang:realtime_tokens_total/prefill_cache": 49721504.0,
"sglang:queue_time_seconds_sum": 39807.95498697553,
"sglang:queue_time_seconds_count": 11682.0
}
},
{
"time": 48.034064998850226,
"metrics": {
"sglang:queue_time_seconds_sum": 36341.41479309369,
"sglang:queue_time_seconds_count": 11981.0,
"sglang:realtime_tokens_total/prefill_compute": 24008496.0,
"sglang:realtime_tokens_total/decode": 3054803.0,
"sglang:realtime_tokens_total/prefill_cache": 51066672.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3360.0,
"sglang:kv_evictable_tokens": 652432.0,
"sglang:prompt_tokens_histogram_sum": 74617637.0,
"sglang:prompt_tokens_histogram_count": 11913.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23886677.0,
"sglang:generation_tokens_total": 3046840.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 50.03138246294111,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 70.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3232.0,
"sglang:kv_evictable_tokens": 631312.0,
"sglang:generation_tokens_total": 2968136.0,
"sglang:prompt_tokens_histogram_sum": 73881552.0,
"sglang:prompt_tokens_histogram_count": 11614.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24500384.0,
"sglang:realtime_tokens_total/prefill_compute": 24621712.0,
"sglang:realtime_tokens_total/decode": 2978403.0,
"sglang:realtime_tokens_total/prefill_cache": 49721504.0,
"sglang:queue_time_seconds_sum": 39807.95498697553,
"sglang:queue_time_seconds_count": 11682.0
}
},
{
"time": 50.03120249416679,
"metrics": {
"sglang:queue_time_seconds_sum": 36406.89051268995,
"sglang:queue_time_seconds_count": 12009.0,
"sglang:realtime_tokens_total/prefill_compute": 24032784.0,
"sglang:realtime_tokens_total/decode": 3061776.0,
"sglang:realtime_tokens_total/prefill_cache": 51172944.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 7424.0,
"sglang:kv_evictable_tokens": 671232.0,
"sglang:prompt_tokens_histogram_sum": 74802198.0,
"sglang:prompt_tokens_histogram_count": 11940.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23919014.0,
"sglang:generation_tokens_total": 3053752.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 52.032467807643116,
"metrics": {
"sglang:num_running_reqs": 57.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5232.0,
"sglang:kv_evictable_tokens": 660640.0,
"sglang:generation_tokens_total": 2980168.0,
"sglang:prompt_tokens_histogram_sum": 74157946.0,
"sglang:prompt_tokens_histogram_count": 11661.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24548298.0,
"sglang:realtime_tokens_total/prefill_compute": 24659120.0,
"sglang:realtime_tokens_total/decode": 2985146.0,
"sglang:realtime_tokens_total/prefill_cache": 49896624.0,
"sglang:queue_time_seconds_sum": 39967.536781304516,
"sglang:queue_time_seconds_count": 11730.0
}
},
{
"time": 52.033891417086124,
"metrics": {
"sglang:queue_time_seconds_sum": 36485.94448373653,
"sglang:queue_time_seconds_count": 12044.0,
"sglang:realtime_tokens_total/prefill_compute": 24068272.0,
"sglang:realtime_tokens_total/decode": 3068460.0,
"sglang:realtime_tokens_total/prefill_cache": 51357776.0,
"sglang:num_running_reqs": 50.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3280.0,
"sglang:kv_evictable_tokens": 674736.0,
"sglang:prompt_tokens_histogram_sum": 75023400.0,
"sglang:prompt_tokens_histogram_count": 11976.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23956728.0,
"sglang:generation_tokens_total": 3062968.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 54.034672818146646,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2064.0,
"sglang:kv_evictable_tokens": 687600.0,
"sglang:generation_tokens_total": 2984264.0,
"sglang:prompt_tokens_histogram_sum": 74293019.0,
"sglang:prompt_tokens_histogram_count": 11677.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24571515.0,
"sglang:realtime_tokens_total/prefill_compute": 24687072.0,
"sglang:realtime_tokens_total/decode": 2993123.0,
"sglang:realtime_tokens_total/prefill_cache": 50029808.0,
"sglang:queue_time_seconds_sum": 40012.24447870813,
"sglang:queue_time_seconds_count": 11746.0
}
},
{
"time": 54.030102162621915,
"metrics": {
"sglang:queue_time_seconds_sum": 36515.729581310414,
"sglang:queue_time_seconds_count": 12057.0,
"sglang:realtime_tokens_total/prefill_compute": 24096800.0,
"sglang:realtime_tokens_total/decode": 3075965.0,
"sglang:realtime_tokens_total/prefill_cache": 51486496.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3248.0,
"sglang:kv_evictable_tokens": 625984.0,
"sglang:prompt_tokens_histogram_sum": 75101950.0,
"sglang:prompt_tokens_histogram_count": 11988.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23971390.0,
"sglang:generation_tokens_total": 3066040.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 56.032823332585394,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 5024.0,
"sglang:kv_evictable_tokens": 691344.0,
"sglang:generation_tokens_total": 2991688.0,
"sglang:prompt_tokens_histogram_sum": 74461601.0,
"sglang:prompt_tokens_histogram_count": 11706.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24602737.0,
"sglang:realtime_tokens_total/prefill_compute": 24716720.0,
"sglang:realtime_tokens_total/decode": 3000454.0,
"sglang:realtime_tokens_total/prefill_cache": 50154704.0,
"sglang:queue_time_seconds_sum": 40113.544702099636,
"sglang:queue_time_seconds_count": 11775.0
}
},
{
"time": 56.03031286690384,
"metrics": {
"sglang:queue_time_seconds_sum": 36610.57866496779,
"sglang:queue_time_seconds_count": 12095.0,
"sglang:realtime_tokens_total/prefill_compute": 24135824.0,
"sglang:realtime_tokens_total/decode": 3082263.0,
"sglang:realtime_tokens_total/prefill_cache": 51667984.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2304.0,
"sglang:kv_evictable_tokens": 619920.0,
"sglang:prompt_tokens_histogram_sum": 75313030.0,
"sglang:prompt_tokens_histogram_count": 12026.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24008070.0,
"sglang:generation_tokens_total": 3075768.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 58.035927443765104,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 636512.0,
"sglang:generation_tokens_total": 3000648.0,
"sglang:prompt_tokens_histogram_sum": 74666424.0,
"sglang:prompt_tokens_histogram_count": 11741.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24636616.0,
"sglang:realtime_tokens_total/prefill_compute": 24762816.0,
"sglang:realtime_tokens_total/decode": 3006947.0,
"sglang:realtime_tokens_total/prefill_cache": 50376672.0,
"sglang:queue_time_seconds_sum": 40204.248508886434,
"sglang:queue_time_seconds_count": 11810.0
}
},
{
"time": 58.03048815857619,
"metrics": {
"sglang:queue_time_seconds_sum": 36661.771075260825,
"sglang:queue_time_seconds_count": 12115.0,
"sglang:realtime_tokens_total/prefill_compute": 24149808.0,
"sglang:realtime_tokens_total/decode": 3089904.0,
"sglang:realtime_tokens_total/prefill_cache": 51732720.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 992.0,
"sglang:kv_evictable_tokens": 654960.0,
"sglang:prompt_tokens_histogram_sum": 75517208.0,
"sglang:prompt_tokens_histogram_count": 12047.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24042504.0,
"sglang:generation_tokens_total": 3081144.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 60.03194703999907,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2704.0,
"sglang:kv_evictable_tokens": 631792.0,
"sglang:generation_tokens_total": 3002696.0,
"sglang:prompt_tokens_histogram_sum": 74724378.0,
"sglang:prompt_tokens_histogram_count": 11749.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24647354.0,
"sglang:realtime_tokens_total/prefill_compute": 24773056.0,
"sglang:realtime_tokens_total/decode": 3015195.0,
"sglang:realtime_tokens_total/prefill_cache": 50421248.0,
"sglang:queue_time_seconds_sum": 40240.201870948076,
"sglang:queue_time_seconds_count": 11818.0
}
},
{
"time": 60.41913962736726,
"metrics": {
"sglang:queue_time_seconds_sum": 36738.64948777761,
"sglang:queue_time_seconds_count": 12145.0,
"sglang:realtime_tokens_total/prefill_compute": 24195264.0,
"sglang:realtime_tokens_total/decode": 3096003.0,
"sglang:realtime_tokens_total/prefill_cache": 51956352.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 7584.0,
"sglang:kv_evictable_tokens": 598880.0,
"sglang:prompt_tokens_histogram_sum": 75647833.0,
"sglang:prompt_tokens_histogram_count": 12076.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24066185.0,
"sglang:generation_tokens_total": 3088568.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 62.03191889729351,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3504.0,
"sglang:kv_evictable_tokens": 695088.0,
"sglang:generation_tokens_total": 3017032.0,
"sglang:prompt_tokens_histogram_sum": 75088686.0,
"sglang:prompt_tokens_histogram_count": 11805.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24712014.0,
"sglang:realtime_tokens_total/prefill_compute": 24828272.0,
"sglang:realtime_tokens_total/decode": 3020953.0,
"sglang:realtime_tokens_total/prefill_cache": 50681712.0,
"sglang:queue_time_seconds_sum": 40405.68193719629,
"sglang:queue_time_seconds_count": 11874.0
}
},
{
"time": 62.03147851023823,
"metrics": {
"sglang:queue_time_seconds_sum": 36799.6266133422,
"sglang:queue_time_seconds_count": 12170.0,
"sglang:realtime_tokens_total/prefill_compute": 24223152.0,
"sglang:realtime_tokens_total/decode": 3103111.0,
"sglang:realtime_tokens_total/prefill_cache": 52088640.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 7040.0,
"sglang:kv_evictable_tokens": 624032.0,
"sglang:prompt_tokens_histogram_sum": 75830232.0,
"sglang:prompt_tokens_histogram_count": 12102.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24097512.0,
"sglang:generation_tokens_total": 3095224.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 64.03218644950539,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 71.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 691408.0,
"sglang:generation_tokens_total": 3017544.0,
"sglang:prompt_tokens_histogram_sum": 75107998.0,
"sglang:prompt_tokens_histogram_count": 11807.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24715326.0,
"sglang:realtime_tokens_total/prefill_compute": 24831088.0,
"sglang:realtime_tokens_total/decode": 3030295.0,
"sglang:realtime_tokens_total/prefill_cache": 50693648.0,
"sglang:queue_time_seconds_sum": 40415.50053710956,
"sglang:queue_time_seconds_count": 11876.0
}
},
{
"time": 64.03082843963057,
"metrics": {
"sglang:queue_time_seconds_sum": 36858.9448147919,
"sglang:queue_time_seconds_count": 12196.0,
"sglang:realtime_tokens_total/prefill_compute": 24245424.0,
"sglang:realtime_tokens_total/decode": 3110461.0,
"sglang:realtime_tokens_total/prefill_cache": 52202496.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 8064.0,
"sglang:kv_evictable_tokens": 657264.0,
"sglang:prompt_tokens_histogram_sum": 76002464.0,
"sglang:prompt_tokens_histogram_count": 12127.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24126272.0,
"sglang:generation_tokens_total": 3101624.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 66.07259543146938,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 14.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 4400.0,
"sglang:kv_evictable_tokens": 594400.0,
"sglang:generation_tokens_total": 3033416.0,
"sglang:prompt_tokens_histogram_sum": 75458910.0,
"sglang:prompt_tokens_histogram_count": 11869.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24777198.0,
"sglang:realtime_tokens_total/prefill_compute": 24907040.0,
"sglang:realtime_tokens_total/decode": 3034969.0,
"sglang:realtime_tokens_total/prefill_cache": 51047600.0,
"sglang:queue_time_seconds_sum": 40606.282027461566,
"sglang:queue_time_seconds_count": 11938.0
}
},
{
"time": 66.0778046362102,
"metrics": {
"sglang:queue_time_seconds_sum": 36930.42564835679,
"sglang:queue_time_seconds_count": 12233.0,
"sglang:realtime_tokens_total/prefill_compute": 24286320.0,
"sglang:realtime_tokens_total/decode": 3117587.0,
"sglang:realtime_tokens_total/prefill_cache": 52380176.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 1888.0,
"sglang:kv_evictable_tokens": 704096.0,
"sglang:prompt_tokens_histogram_sum": 76259222.0,
"sglang:prompt_tokens_histogram_count": 12165.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24170582.0,
"sglang:generation_tokens_total": 3111352.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 68.03075888659805,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1120.0,
"sglang:kv_evictable_tokens": 595920.0,
"sglang:generation_tokens_total": 3033416.0,
"sglang:prompt_tokens_histogram_sum": 75458910.0,
"sglang:prompt_tokens_histogram_count": 11869.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24777198.0,
"sglang:realtime_tokens_total/prefill_compute": 24909856.0,
"sglang:realtime_tokens_total/decode": 3043225.0,
"sglang:realtime_tokens_total/prefill_cache": 51061568.0,
"sglang:queue_time_seconds_sum": 40606.282027461566,
"sglang:queue_time_seconds_count": 11938.0
}
},
{
"time": 68.03111943230033,
"metrics": {
"sglang:queue_time_seconds_sum": 36973.43304874934,
"sglang:queue_time_seconds_count": 12252.0,
"sglang:realtime_tokens_total/prefill_compute": 24304032.0,
"sglang:realtime_tokens_total/decode": 3125732.0,
"sglang:realtime_tokens_total/prefill_cache": 52458272.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2688.0,
"sglang:kv_evictable_tokens": 673584.0,
"sglang:prompt_tokens_histogram_sum": 76335053.0,
"sglang:prompt_tokens_histogram_count": 12183.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24183453.0,
"sglang:generation_tokens_total": 3115960.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 70.03636852651834,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5264.0,
"sglang:kv_evictable_tokens": 645264.0,
"sglang:generation_tokens_total": 3040584.0,
"sglang:prompt_tokens_histogram_sum": 75678126.0,
"sglang:prompt_tokens_histogram_count": 11897.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24816670.0,
"sglang:realtime_tokens_total/prefill_compute": 24937888.0,
"sglang:realtime_tokens_total/decode": 3049597.0,
"sglang:realtime_tokens_total/prefill_cache": 51196528.0,
"sglang:queue_time_seconds_sum": 40722.66094946116,
"sglang:queue_time_seconds_count": 11966.0
}
},
{
"time": 70.03016571421176,
"metrics": {
"sglang:queue_time_seconds_sum": 37045.27189588919,
"sglang:queue_time_seconds_count": 12287.0,
"sglang:realtime_tokens_total/prefill_compute": 24346976.0,
"sglang:realtime_tokens_total/decode": 3132351.0,
"sglang:realtime_tokens_total/prefill_cache": 52667408.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3248.0,
"sglang:kv_evictable_tokens": 655376.0,
"sglang:prompt_tokens_histogram_sum": 76561578.0,
"sglang:prompt_tokens_histogram_count": 12218.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24222186.0,
"sglang:generation_tokens_total": 3124920.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 72.02987201325595,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2592.0,
"sglang:kv_evictable_tokens": 676048.0,
"sglang:generation_tokens_total": 3049800.0,
"sglang:prompt_tokens_histogram_sum": 75920013.0,
"sglang:prompt_tokens_histogram_count": 11933.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24858445.0,
"sglang:realtime_tokens_total/prefill_compute": 24976736.0,
"sglang:realtime_tokens_total/decode": 3056914.0,
"sglang:realtime_tokens_total/prefill_cache": 51376464.0,
"sglang:queue_time_seconds_sum": 40837.64408958424,
"sglang:queue_time_seconds_count": 12002.0
}
},
{
"time": 72.03136103227735,
"metrics": {
"sglang:queue_time_seconds_sum": 37099.25252721459,
"sglang:queue_time_seconds_count": 12313.0,
"sglang:realtime_tokens_total/prefill_compute": 24367744.0,
"sglang:realtime_tokens_total/decode": 3140243.0,
"sglang:realtime_tokens_total/prefill_cache": 52759600.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4224.0,
"sglang:kv_evictable_tokens": 682688.0,
"sglang:prompt_tokens_histogram_sum": 76702201.0,
"sglang:prompt_tokens_histogram_count": 12244.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24249769.0,
"sglang:generation_tokens_total": 3131576.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 74.03002114314586,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 58.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3968.0,
"sglang:kv_evictable_tokens": 673536.0,
"sglang:generation_tokens_total": 3053384.0,
"sglang:prompt_tokens_histogram_sum": 76052913.0,
"sglang:prompt_tokens_histogram_count": 11947.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24881873.0,
"sglang:realtime_tokens_total/prefill_compute": 24994368.0,
"sglang:realtime_tokens_total/decode": 3064900.0,
"sglang:realtime_tokens_total/prefill_cache": 51465344.0,
"sglang:queue_time_seconds_sum": 40900.210277009755,
"sglang:queue_time_seconds_count": 12016.0
}
},
{
"time": 74.03111203107983,
"metrics": {
"sglang:queue_time_seconds_sum": 37186.974366875365,
"sglang:queue_time_seconds_count": 12351.0,
"sglang:realtime_tokens_total/prefill_compute": 24412848.0,
"sglang:realtime_tokens_total/decode": 3146477.0,
"sglang:realtime_tokens_total/prefill_cache": 52969504.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2032.0,
"sglang:kv_evictable_tokens": 692400.0,
"sglang:prompt_tokens_histogram_sum": 76961374.0,
"sglang:prompt_tokens_histogram_count": 12282.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24293966.0,
"sglang:generation_tokens_total": 3141304.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 76.03069838508964,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 14.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 3744.0,
"sglang:kv_evictable_tokens": 543104.0,
"sglang:generation_tokens_total": 3066184.0,
"sglang:prompt_tokens_histogram_sum": 76301544.0,
"sglang:prompt_tokens_histogram_count": 11997.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24925080.0,
"sglang:realtime_tokens_total/prefill_compute": 25065856.0,
"sglang:realtime_tokens_total/decode": 3069714.0,
"sglang:realtime_tokens_total/prefill_cache": 51803216.0,
"sglang:queue_time_seconds_sum": 41032.27300829906,
"sglang:queue_time_seconds_count": 12066.0
}
},
{
"time": 76.03161808755249,
"metrics": {
"sglang:queue_time_seconds_sum": 37230.274870792404,
"sglang:queue_time_seconds_count": 12370.0,
"sglang:realtime_tokens_total/prefill_compute": 24427920.0,
"sglang:realtime_tokens_total/decode": 3155226.0,
"sglang:realtime_tokens_total/prefill_cache": 53039200.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3824.0,
"sglang:kv_evictable_tokens": 696224.0,
"sglang:prompt_tokens_histogram_sum": 77054473.0,
"sglang:prompt_tokens_histogram_count": 12301.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24310249.0,
"sglang:generation_tokens_total": 3146168.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 78.03373895119876,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 1392.0,
"sglang:kv_evictable_tokens": 539920.0,
"sglang:generation_tokens_total": 3066440.0,
"sglang:prompt_tokens_histogram_sum": 76315262.0,
"sglang:prompt_tokens_histogram_count": 11998.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24927246.0,
"sglang:realtime_tokens_total/prefill_compute": 25067776.0,
"sglang:realtime_tokens_total/decode": 3077521.0,
"sglang:realtime_tokens_total/prefill_cache": 51812608.0,
"sglang:queue_time_seconds_sum": 41037.378913470544,
"sglang:queue_time_seconds_count": 12067.0
}
},
{
"time": 78.03174863290042,
"metrics": {
"sglang:queue_time_seconds_sum": 37322.401249608025,
"sglang:queue_time_seconds_count": 12406.0,
"sglang:realtime_tokens_total/prefill_compute": 24465888.0,
"sglang:realtime_tokens_total/decode": 3161526.0,
"sglang:realtime_tokens_total/prefill_cache": 53212368.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2000.0,
"sglang:kv_evictable_tokens": 689184.0,
"sglang:prompt_tokens_histogram_sum": 77290659.0,
"sglang:prompt_tokens_histogram_count": 12339.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24353283.0,
"sglang:generation_tokens_total": 3155896.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 80.03098944015801,
"metrics": {
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2928.0,
"sglang:kv_evictable_tokens": 647024.0,
"sglang:generation_tokens_total": 3076424.0,
"sglang:prompt_tokens_histogram_sum": 76645652.0,
"sglang:prompt_tokens_histogram_count": 12037.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24982500.0,
"sglang:realtime_tokens_total/prefill_compute": 25104976.0,
"sglang:realtime_tokens_total/decode": 3083050.0,
"sglang:realtime_tokens_total/prefill_cache": 52000144.0,
"sglang:queue_time_seconds_sum": 41172.2247369485,
"sglang:queue_time_seconds_count": 12106.0
}
},
{
"time": 80.0313639389351,
"metrics": {
"sglang:queue_time_seconds_sum": 37369.79104428366,
"sglang:queue_time_seconds_count": 12424.0,
"sglang:realtime_tokens_total/prefill_compute": 24493072.0,
"sglang:realtime_tokens_total/decode": 3169124.0,
"sglang:realtime_tokens_total/prefill_cache": 53350016.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 633872.0,
"sglang:prompt_tokens_histogram_sum": 77365201.0,
"sglang:prompt_tokens_histogram_count": 12355.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24364993.0,
"sglang:generation_tokens_total": 3159992.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 82.03099925629795,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1600.0,
"sglang:kv_evictable_tokens": 651024.0,
"sglang:generation_tokens_total": 3082568.0,
"sglang:prompt_tokens_histogram_sum": 76817100.0,
"sglang:prompt_tokens_histogram_count": 12061.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25013884.0,
"sglang:realtime_tokens_total/prefill_compute": 25136480.0,
"sglang:realtime_tokens_total/decode": 3090322.0,
"sglang:realtime_tokens_total/prefill_cache": 52138656.0,
"sglang:queue_time_seconds_sum": 41237.14241012558,
"sglang:queue_time_seconds_count": 12130.0
}
},
{
"time": 82.0331365512684,
"metrics": {
"sglang:queue_time_seconds_sum": 37470.69278951455,
"sglang:queue_time_seconds_count": 12457.0,
"sglang:realtime_tokens_total/prefill_compute": 24519920.0,
"sglang:realtime_tokens_total/decode": 3176131.0,
"sglang:realtime_tokens_total/prefill_cache": 53473232.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1248.0,
"sglang:kv_evictable_tokens": 684832.0,
"sglang:prompt_tokens_histogram_sum": 77565167.0,
"sglang:prompt_tokens_histogram_count": 12388.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24401407.0,
"sglang:generation_tokens_total": 3168440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 84.02987630944699,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4208.0,
"sglang:kv_evictable_tokens": 644976.0,
"sglang:generation_tokens_total": 3086152.0,
"sglang:prompt_tokens_histogram_sum": 76930708.0,
"sglang:prompt_tokens_histogram_count": 12075.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25033684.0,
"sglang:realtime_tokens_total/prefill_compute": 25156928.0,
"sglang:realtime_tokens_total/decode": 3097860.0,
"sglang:realtime_tokens_total/prefill_cache": 52233760.0,
"sglang:queue_time_seconds_sum": 41275.901859752834,
"sglang:queue_time_seconds_count": 12144.0
}
},
{
"time": 84.03774332348257,
"metrics": {
"sglang:queue_time_seconds_sum": 37565.33037341479,
"sglang:queue_time_seconds_count": 12488.0,
"sglang:realtime_tokens_total/prefill_compute": 24554208.0,
"sglang:realtime_tokens_total/decode": 3183588.0,
"sglang:realtime_tokens_total/prefill_cache": 53638912.0,
"sglang:num_running_reqs": 55.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3792.0,
"sglang:kv_evictable_tokens": 708032.0,
"sglang:prompt_tokens_histogram_sum": 77789488.0,
"sglang:prompt_tokens_histogram_count": 12419.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24439472.0,
"sglang:generation_tokens_total": 3176376.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 86.0302436389029,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 4.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 1840.0,
"sglang:kv_evictable_tokens": 557968.0,
"sglang:generation_tokens_total": 3098952.0,
"sglang:prompt_tokens_histogram_sum": 77222880.0,
"sglang:prompt_tokens_histogram_count": 12125.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25084224.0,
"sglang:realtime_tokens_total/prefill_compute": 25226608.0,
"sglang:realtime_tokens_total/decode": 3102349.0,
"sglang:realtime_tokens_total/prefill_cache": 52553200.0,
"sglang:queue_time_seconds_sum": 41407.24634371512,
"sglang:queue_time_seconds_count": 12194.0
}
},
{
"time": 86.0328406970948,
"metrics": {
"sglang:queue_time_seconds_sum": 37642.29893977102,
"sglang:queue_time_seconds_count": 12516.0,
"sglang:realtime_tokens_total/prefill_compute": 24572064.0,
"sglang:realtime_tokens_total/decode": 3192011.0,
"sglang:realtime_tokens_total/prefill_cache": 53724944.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 1024.0,
"sglang:kv_evictable_tokens": 712080.0,
"sglang:prompt_tokens_histogram_sum": 77913131.0,
"sglang:prompt_tokens_histogram_count": 12447.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24460971.0,
"sglang:generation_tokens_total": 3183544.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 88.02993011195213,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 58.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 2064.0,
"sglang:kv_evictable_tokens": 549088.0,
"sglang:generation_tokens_total": 3099208.0,
"sglang:prompt_tokens_histogram_sum": 77223904.0,
"sglang:prompt_tokens_histogram_count": 12126.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25084736.0,
"sglang:realtime_tokens_total/prefill_compute": 25227120.0,
"sglang:realtime_tokens_total/decode": 3110220.0,
"sglang:realtime_tokens_total/prefill_cache": 52553712.0,
"sglang:queue_time_seconds_sum": 41409.90115402825,
"sglang:queue_time_seconds_count": 12195.0
}
},
{
"time": 88.03103863168508,
"metrics": {
"sglang:queue_time_seconds_sum": 37713.33543895837,
"sglang:queue_time_seconds_count": 12543.0,
"sglang:realtime_tokens_total/prefill_compute": 24618128.0,
"sglang:realtime_tokens_total/decode": 3198125.0,
"sglang:realtime_tokens_total/prefill_cache": 53956144.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1552.0,
"sglang:kv_evictable_tokens": 644608.0,
"sglang:prompt_tokens_histogram_sum": 78105561.0,
"sglang:prompt_tokens_histogram_count": 12474.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24494713.0,
"sglang:generation_tokens_total": 3190456.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 90.03101302403957,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1728.0,
"sglang:kv_evictable_tokens": 667584.0,
"sglang:generation_tokens_total": 3109192.0,
"sglang:prompt_tokens_histogram_sum": 77551114.0,
"sglang:prompt_tokens_histogram_count": 12165.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25139706.0,
"sglang:realtime_tokens_total/prefill_compute": 25262880.0,
"sglang:realtime_tokens_total/decode": 3115813.0,
"sglang:realtime_tokens_total/prefill_cache": 52728848.0,
"sglang:queue_time_seconds_sum": 41531.08858814556,
"sglang:queue_time_seconds_count": 12234.0
}
},
{
"time": 90.03195807058364,
"metrics": {
"sglang:queue_time_seconds_sum": 37800.50324255042,
"sglang:queue_time_seconds_count": 12569.0,
"sglang:realtime_tokens_total/prefill_compute": 24638864.0,
"sglang:realtime_tokens_total/decode": 3205489.0,
"sglang:realtime_tokens_total/prefill_cache": 54043888.0,
"sglang:num_running_reqs": 57.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1168.0,
"sglang:kv_evictable_tokens": 649712.0,
"sglang:prompt_tokens_histogram_sum": 78222092.0,
"sglang:prompt_tokens_histogram_count": 12500.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24514524.0,
"sglang:generation_tokens_total": 3197112.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 92.0299845887348,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1808.0,
"sglang:kv_evictable_tokens": 674288.0,
"sglang:generation_tokens_total": 3115336.0,
"sglang:prompt_tokens_histogram_sum": 77727258.0,
"sglang:prompt_tokens_histogram_count": 12189.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25174058.0,
"sglang:realtime_tokens_total/prefill_compute": 25296736.0,
"sglang:realtime_tokens_total/decode": 3123789.0,
"sglang:realtime_tokens_total/prefill_cache": 52866768.0,
"sglang:queue_time_seconds_sum": 41595.384558925405,
"sglang:queue_time_seconds_count": 12258.0
}
},
{
"time": 92.03064091317356,
"metrics": {
"sglang:queue_time_seconds_sum": 37919.5930878222,
"sglang:queue_time_seconds_count": 12607.0,
"sglang:realtime_tokens_total/prefill_compute": 24677568.0,
"sglang:realtime_tokens_total/decode": 3211786.0,
"sglang:realtime_tokens_total/prefill_cache": 54239648.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 2464.0,
"sglang:kv_evictable_tokens": 719136.0,
"sglang:prompt_tokens_histogram_sum": 78520234.0,
"sglang:prompt_tokens_histogram_count": 12538.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24564090.0,
"sglang:generation_tokens_total": 3206840.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 94.03019073419273,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 4496.0,
"sglang:kv_evictable_tokens": 638224.0,
"sglang:generation_tokens_total": 3120968.0,
"sglang:prompt_tokens_histogram_sum": 77849568.0,
"sglang:prompt_tokens_histogram_count": 12211.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25195632.0,
"sglang:realtime_tokens_total/prefill_compute": 25321456.0,
"sglang:realtime_tokens_total/decode": 3131321.0,
"sglang:realtime_tokens_total/prefill_cache": 52989808.0,
"sglang:queue_time_seconds_sum": 41643.92248100508,
"sglang:queue_time_seconds_count": 12278.0
}
},
{
"time": 94.03111321944743,
"metrics": {
"sglang:queue_time_seconds_sum": 37977.66770804115,
"sglang:queue_time_seconds_count": 12624.0,
"sglang:realtime_tokens_total/prefill_compute": 24686416.0,
"sglang:realtime_tokens_total/decode": 3220518.0,
"sglang:realtime_tokens_total/prefill_cache": 54281312.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 59.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2688.0,
"sglang:kv_evictable_tokens": 712912.0,
"sglang:prompt_tokens_histogram_sum": 78614333.0,
"sglang:prompt_tokens_histogram_count": 12556.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24582253.0,
"sglang:generation_tokens_total": 3211448.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 96.03006928693503,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 3664.0,
"sglang:kv_evictable_tokens": 550512.0,
"sglang:generation_tokens_total": 3131720.0,
"sglang:prompt_tokens_histogram_sum": 78110673.0,
"sglang:prompt_tokens_histogram_count": 12253.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25243905.0,
"sglang:realtime_tokens_total/prefill_compute": 25384848.0,
"sglang:realtime_tokens_total/decode": 3135752.0,
"sglang:realtime_tokens_total/prefill_cache": 53288384.0,
"sglang:queue_time_seconds_sum": 41757.23333149124,
"sglang:queue_time_seconds_count": 12322.0
}
},
{
"time": 96.03352878428996,
"metrics": {
"sglang:queue_time_seconds_sum": 38086.36295623146,
"sglang:queue_time_seconds_count": 12664.0,
"sglang:realtime_tokens_total/prefill_compute": 24728640.0,
"sglang:realtime_tokens_total/decode": 3226926.0,
"sglang:realtime_tokens_total/prefill_cache": 54491344.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3536.0,
"sglang:kv_evictable_tokens": 701344.0,
"sglang:prompt_tokens_histogram_sum": 78809303.0,
"sglang:prompt_tokens_histogram_count": 12595.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24614359.0,
"sglang:generation_tokens_total": 3221432.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 98.02972092386335,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 542784.0,
"sglang:generation_tokens_total": 3132232.0,
"sglang:prompt_tokens_histogram_sum": 78112977.0,
"sglang:prompt_tokens_histogram_count": 12255.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25244433.0,
"sglang:realtime_tokens_total/prefill_compute": 25385872.0,
"sglang:realtime_tokens_total/decode": 3143366.0,
"sglang:realtime_tokens_total/prefill_cache": 53289408.0,
"sglang:queue_time_seconds_sum": 41764.155217459425,
"sglang:queue_time_seconds_count": 12324.0
}
},
{
"time": 98.03091424424201,
"metrics": {
"sglang:queue_time_seconds_sum": 38122.60875071399,
"sglang:queue_time_seconds_count": 12677.0,
"sglang:realtime_tokens_total/prefill_compute": 24758384.0,
"sglang:realtime_tokens_total/decode": 3234168.0,
"sglang:realtime_tokens_total/prefill_cache": 54648016.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2976.0,
"sglang:kv_evictable_tokens": 616032.0,
"sglang:prompt_tokens_histogram_sum": 78913387.0,
"sglang:prompt_tokens_histogram_count": 12609.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24632075.0,
"sglang:generation_tokens_total": 3225016.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 100.03053643647581,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 1280.0,
"sglang:kv_evictable_tokens": 611504.0,
"sglang:generation_tokens_total": 3141960.0,
"sglang:prompt_tokens_histogram_sum": 78424312.0,
"sglang:prompt_tokens_histogram_count": 12293.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25296888.0,
"sglang:realtime_tokens_total/prefill_compute": 25429616.0,
"sglang:realtime_tokens_total/decode": 3148704.0,
"sglang:realtime_tokens_total/prefill_cache": 53494736.0,
"sglang:queue_time_seconds_sum": 41899.23287123442,
"sglang:queue_time_seconds_count": 12362.0
}
},
{
"time": 100.03208270203322,
"metrics": {
"sglang:queue_time_seconds_sum": 38227.87115615327,
"sglang:queue_time_seconds_count": 12713.0,
"sglang:realtime_tokens_total/prefill_compute": 24783664.0,
"sglang:realtime_tokens_total/decode": 3241242.0,
"sglang:realtime_tokens_total/prefill_cache": 54758352.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2928.0,
"sglang:kv_evictable_tokens": 633568.0,
"sglang:prompt_tokens_histogram_sum": 79087115.0,
"sglang:prompt_tokens_histogram_count": 12644.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24661131.0,
"sglang:generation_tokens_total": 3233976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 102.03027740959078,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1280.0,
"sglang:kv_evictable_tokens": 653904.0,
"sglang:generation_tokens_total": 3148104.0,
"sglang:prompt_tokens_histogram_sum": 78620136.0,
"sglang:prompt_tokens_histogram_count": 12317.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25331752.0,
"sglang:realtime_tokens_total/prefill_compute": 25456848.0,
"sglang:realtime_tokens_total/decode": 3156168.0,
"sglang:realtime_tokens_total/prefill_cache": 53623056.0,
"sglang:queue_time_seconds_sum": 41980.29556654114,
"sglang:queue_time_seconds_count": 12386.0
}
},
{
"time": 102.03164517972618,
"metrics": {
"sglang:queue_time_seconds_sum": 38304.5868975576,
"sglang:queue_time_seconds_count": 12741.0,
"sglang:realtime_tokens_total/prefill_compute": 24816736.0,
"sglang:realtime_tokens_total/decode": 3248382.0,
"sglang:realtime_tokens_total/prefill_cache": 54913456.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 737056.0,
"sglang:prompt_tokens_histogram_sum": 79351784.0,
"sglang:prompt_tokens_histogram_count": 12672.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24703768.0,
"sglang:generation_tokens_total": 3241144.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 104.03068977687508,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3440.0,
"sglang:kv_evictable_tokens": 692976.0,
"sglang:generation_tokens_total": 3155272.0,
"sglang:prompt_tokens_histogram_sum": 78787435.0,
"sglang:prompt_tokens_histogram_count": 12345.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25361531.0,
"sglang:realtime_tokens_total/prefill_compute": 25471248.0,
"sglang:realtime_tokens_total/decode": 3164210.0,
"sglang:realtime_tokens_total/prefill_cache": 53679440.0,
"sglang:queue_time_seconds_sum": 42048.129108147696,
"sglang:queue_time_seconds_count": 12408.0
}
},
{
"time": 104.0317370640114,
"metrics": {
"sglang:queue_time_seconds_sum": 38369.19425632339,
"sglang:queue_time_seconds_count": 12764.0,
"sglang:realtime_tokens_total/prefill_compute": 24841088.0,
"sglang:realtime_tokens_total/decode": 3256404.0,
"sglang:realtime_tokens_total/prefill_cache": 55027632.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1168.0,
"sglang:kv_evictable_tokens": 665456.0,
"sglang:prompt_tokens_histogram_sum": 79431972.0,
"sglang:prompt_tokens_histogram_count": 12695.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24719572.0,
"sglang:generation_tokens_total": 3247032.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 106.02987595554441,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 1392.0,
"sglang:kv_evictable_tokens": 587056.0,
"sglang:generation_tokens_total": 3164488.0,
"sglang:prompt_tokens_histogram_sum": 79026530.0,
"sglang:prompt_tokens_histogram_count": 12381.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25403474.0,
"sglang:realtime_tokens_total/prefill_compute": 25538224.0,
"sglang:realtime_tokens_total/decode": 3168835.0,
"sglang:realtime_tokens_total/prefill_cache": 54016736.0,
"sglang:queue_time_seconds_sum": 42165.77665597666,
"sglang:queue_time_seconds_count": 12450.0
}
},
{
"time": 106.03462107572705,
"metrics": {
"sglang:queue_time_seconds_sum": 38458.09442910738,
"sglang:queue_time_seconds_count": 12799.0,
"sglang:realtime_tokens_total/prefill_compute": 24883872.0,
"sglang:realtime_tokens_total/decode": 3262767.0,
"sglang:realtime_tokens_total/prefill_cache": 55240864.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2976.0,
"sglang:kv_evictable_tokens": 649760.0,
"sglang:prompt_tokens_histogram_sum": 79660909.0,
"sglang:prompt_tokens_histogram_count": 12730.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24757757.0,
"sglang:generation_tokens_total": 3255992.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 108.029914454557,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2704.0,
"sglang:kv_evictable_tokens": 575248.0,
"sglang:generation_tokens_total": 3165000.0,
"sglang:prompt_tokens_histogram_sum": 79028834.0,
"sglang:prompt_tokens_histogram_count": 12383.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25404514.0,
"sglang:realtime_tokens_total/prefill_compute": 25538256.0,
"sglang:realtime_tokens_total/decode": 3177409.0,
"sglang:realtime_tokens_total/prefill_cache": 54019264.0,
"sglang:queue_time_seconds_sum": 42175.65131827351,
"sglang:queue_time_seconds_count": 12452.0
}
},
{
"time": 108.03127950523049,
"metrics": {
"sglang:queue_time_seconds_sum": 38494.15017002355,
"sglang:queue_time_seconds_count": 12813.0,
"sglang:realtime_tokens_total/prefill_compute": 24900896.0,
"sglang:realtime_tokens_total/decode": 3270355.0,
"sglang:realtime_tokens_total/prefill_cache": 55316800.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 4128.0,
"sglang:kv_evictable_tokens": 630704.0,
"sglang:prompt_tokens_histogram_sum": 79741136.0,
"sglang:prompt_tokens_histogram_count": 12745.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24773200.0,
"sglang:generation_tokens_total": 3259832.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 110.03038201015443,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 3856.0,
"sglang:kv_evictable_tokens": 579600.0,
"sglang:generation_tokens_total": 3180360.0,
"sglang:prompt_tokens_histogram_sum": 79488516.0,
"sglang:prompt_tokens_histogram_count": 12443.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25482692.0,
"sglang:realtime_tokens_total/prefill_compute": 25589872.0,
"sglang:realtime_tokens_total/decode": 3182090.0,
"sglang:realtime_tokens_total/prefill_cache": 54263008.0,
"sglang:queue_time_seconds_sum": 42346.23702351097,
"sglang:queue_time_seconds_count": 12505.0
}
},
{
"time": 110.03075778950006,
"metrics": {
"sglang:queue_time_seconds_sum": 38622.190972975455,
"sglang:queue_time_seconds_count": 12861.0,
"sglang:realtime_tokens_total/prefill_compute": 24951200.0,
"sglang:realtime_tokens_total/decode": 3276193.0,
"sglang:realtime_tokens_total/prefill_cache": 55552912.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1888.0,
"sglang:kv_evictable_tokens": 653056.0,
"sglang:prompt_tokens_histogram_sum": 80039490.0,
"sglang:prompt_tokens_histogram_count": 12792.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24824146.0,
"sglang:generation_tokens_total": 3271864.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 112.02942851278931,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 596880.0,
"sglang:generation_tokens_total": 3180872.0,
"sglang:prompt_tokens_histogram_sum": 79501358.0,
"sglang:prompt_tokens_histogram_count": 12445.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25484622.0,
"sglang:realtime_tokens_total/prefill_compute": 25617056.0,
"sglang:realtime_tokens_total/decode": 3189571.0,
"sglang:realtime_tokens_total/prefill_cache": 54398320.0,
"sglang:queue_time_seconds_sum": 42376.029388950206,
"sglang:queue_time_seconds_count": 12514.0
}
},
{
"time": 112.03242163639516,
"metrics": {
"sglang:queue_time_seconds_sum": 38641.1009673113,
"sglang:queue_time_seconds_count": 12869.0,
"sglang:realtime_tokens_total/prefill_compute": 24956400.0,
"sglang:realtime_tokens_total/decode": 3285272.0,
"sglang:realtime_tokens_total/prefill_cache": 55569264.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2080.0,
"sglang:kv_evictable_tokens": 704608.0,
"sglang:prompt_tokens_histogram_sum": 80116484.0,
"sglang:prompt_tokens_histogram_count": 12800.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24837140.0,
"sglang:generation_tokens_total": 3273912.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 114.03078339342028,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1760.0,
"sglang:kv_evictable_tokens": 684208.0,
"sglang:generation_tokens_total": 3188040.0,
"sglang:prompt_tokens_histogram_sum": 79649758.0,
"sglang:prompt_tokens_histogram_count": 12473.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25510158.0,
"sglang:realtime_tokens_total/prefill_compute": 25627472.0,
"sglang:realtime_tokens_total/decode": 3197031.0,
"sglang:realtime_tokens_total/prefill_cache": 54447696.0,
"sglang:queue_time_seconds_sum": 42473.84998033382,
"sglang:queue_time_seconds_count": 12542.0
}
},
{
"time": 114.03061652835459,
"metrics": {
"sglang:queue_time_seconds_sum": 38758.25534188002,
"sglang:queue_time_seconds_count": 12912.0,
"sglang:realtime_tokens_total/prefill_compute": 25000288.0,
"sglang:realtime_tokens_total/decode": 3291689.0,
"sglang:realtime_tokens_total/prefill_cache": 55760400.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 23.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3168.0,
"sglang:kv_evictable_tokens": 697056.0,
"sglang:prompt_tokens_histogram_sum": 80342949.0,
"sglang:prompt_tokens_histogram_count": 12843.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24877909.0,
"sglang:generation_tokens_total": 3284920.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 116.03307358827442,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1312.0,
"sglang:kv_evictable_tokens": 618640.0,
"sglang:generation_tokens_total": 3197256.0,
"sglang:prompt_tokens_histogram_sum": 79961460.0,
"sglang:prompt_tokens_histogram_count": 12509.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25563140.0,
"sglang:realtime_tokens_total/prefill_compute": 25690320.0,
"sglang:realtime_tokens_total/decode": 3202499.0,
"sglang:realtime_tokens_total/prefill_cache": 54767664.0,
"sglang:queue_time_seconds_sum": 42576.75632612035,
"sglang:queue_time_seconds_count": 12578.0
}
},
{
"time": 116.03015475161374,
"metrics": {
"sglang:queue_time_seconds_sum": 38812.34719946608,
"sglang:queue_time_seconds_count": 12933.0,
"sglang:realtime_tokens_total/prefill_compute": 25027680.0,
"sglang:realtime_tokens_total/decode": 3299284.0,
"sglang:realtime_tokens_total/prefill_cache": 55896768.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1920.0,
"sglang:kv_evictable_tokens": 657968.0,
"sglang:prompt_tokens_histogram_sum": 80470202.0,
"sglang:prompt_tokens_histogram_count": 12864.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24900938.0,
"sglang:generation_tokens_total": 3290296.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 118.0343586858362,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2432.0,
"sglang:kv_evictable_tokens": 617728.0,
"sglang:generation_tokens_total": 3198536.0,
"sglang:prompt_tokens_histogram_sum": 79976614.0,
"sglang:prompt_tokens_histogram_count": 12514.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25566230.0,
"sglang:realtime_tokens_total/prefill_compute": 25691408.0,
"sglang:realtime_tokens_total/decode": 3211262.0,
"sglang:realtime_tokens_total/prefill_cache": 54773488.0,
"sglang:queue_time_seconds_sum": 42590.91830967646,
"sglang:queue_time_seconds_count": 12583.0
}
},
{
"time": 118.0310222627595,
"metrics": {
"sglang:queue_time_seconds_sum": 38898.08915995341,
"sglang:queue_time_seconds_count": 12964.0,
"sglang:realtime_tokens_total/prefill_compute": 25060256.0,
"sglang:realtime_tokens_total/decode": 3306485.0,
"sglang:realtime_tokens_total/prefill_cache": 56030000.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1408.0,
"sglang:kv_evictable_tokens": 676288.0,
"sglang:prompt_tokens_histogram_sum": 80653393.0,
"sglang:prompt_tokens_histogram_count": 12895.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24935681.0,
"sglang:generation_tokens_total": 3298232.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 120.03080763388425,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3616.0,
"sglang:kv_evictable_tokens": 597408.0,
"sglang:generation_tokens_total": 3213128.0,
"sglang:prompt_tokens_histogram_sum": 80387915.0,
"sglang:prompt_tokens_histogram_count": 12571.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25633595.0,
"sglang:realtime_tokens_total/prefill_compute": 25764752.0,
"sglang:realtime_tokens_total/decode": 3214905.0,
"sglang:realtime_tokens_total/prefill_cache": 55139696.0,
"sglang:queue_time_seconds_sum": 42754.64851630293,
"sglang:queue_time_seconds_count": 12640.0
}
},
{
"time": 120.03113513905555,
"metrics": {
"sglang:queue_time_seconds_sum": 38970.697578035295,
"sglang:queue_time_seconds_count": 12991.0,
"sglang:realtime_tokens_total/prefill_compute": 25098320.0,
"sglang:realtime_tokens_total/decode": 3313050.0,
"sglang:realtime_tokens_total/prefill_cache": 56211296.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1184.0,
"sglang:kv_evictable_tokens": 623264.0,
"sglang:prompt_tokens_histogram_sum": 80814842.0,
"sglang:prompt_tokens_histogram_count": 12922.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24963770.0,
"sglang:generation_tokens_total": 3305144.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 122.02989301178604,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 59.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 3184.0,
"sglang:kv_evictable_tokens": 560848.0,
"sglang:generation_tokens_total": 3213640.0,
"sglang:prompt_tokens_histogram_sum": 80403799.0,
"sglang:prompt_tokens_histogram_count": 12573.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25636135.0,
"sglang:realtime_tokens_total/prefill_compute": 25773952.0,
"sglang:realtime_tokens_total/decode": 3222839.0,
"sglang:realtime_tokens_total/prefill_cache": 55178048.0,
"sglang:queue_time_seconds_sum": 42756.70743486937,
"sglang:queue_time_seconds_count": 12642.0
}
},
{
"time": 122.03232419770211,
"metrics": {
"sglang:queue_time_seconds_sum": 39055.7164973421,
"sglang:queue_time_seconds_count": 13018.0,
"sglang:realtime_tokens_total/prefill_compute": 25110816.0,
"sglang:realtime_tokens_total/decode": 3321600.0,
"sglang:realtime_tokens_total/prefill_cache": 56266496.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3664.0,
"sglang:kv_evictable_tokens": 699744.0,
"sglang:prompt_tokens_histogram_sum": 80971981.0,
"sglang:prompt_tokens_histogram_count": 12949.0,
"sglang:uncached_prompt_tokens_histogram_sum": 24992669.0,
"sglang:generation_tokens_total": 3312056.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 124.03470489103347,
"metrics": {
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2848.0,
"sglang:kv_evictable_tokens": 664256.0,
"sglang:generation_tokens_total": 3220808.0,
"sglang:prompt_tokens_histogram_sum": 80569346.0,
"sglang:prompt_tokens_histogram_count": 12601.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25663026.0,
"sglang:realtime_tokens_total/prefill_compute": 25784160.0,
"sglang:realtime_tokens_total/decode": 3230171.0,
"sglang:realtime_tokens_total/prefill_cache": 55232928.0,
"sglang:queue_time_seconds_sum": 42849.84503950924,
"sglang:queue_time_seconds_count": 12670.0
}
},
{
"time": 124.02967863157392,
"metrics": {
"sglang:queue_time_seconds_sum": 39157.61476168409,
"sglang:queue_time_seconds_count": 13055.0,
"sglang:realtime_tokens_total/prefill_compute": 25153200.0,
"sglang:realtime_tokens_total/decode": 3328474.0,
"sglang:realtime_tokens_total/prefill_cache": 56462272.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 3952.0,
"sglang:kv_evictable_tokens": 756176.0,
"sglang:prompt_tokens_histogram_sum": 81253596.0,
"sglang:prompt_tokens_histogram_count": 12986.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25042300.0,
"sglang:generation_tokens_total": 3321528.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 126.03378504514694,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1600.0,
"sglang:kv_evictable_tokens": 652704.0,
"sglang:generation_tokens_total": 3230024.0,
"sglang:prompt_tokens_histogram_sum": 80897537.0,
"sglang:prompt_tokens_histogram_count": 12637.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25719489.0,
"sglang:realtime_tokens_total/prefill_compute": 25842144.0,
"sglang:realtime_tokens_total/decode": 3235319.0,
"sglang:realtime_tokens_total/prefill_cache": 55522304.0,
"sglang:queue_time_seconds_sum": 42951.56622747332,
"sglang:queue_time_seconds_count": 12706.0
}
},
{
"time": 126.03179901465774,
"metrics": {
"sglang:queue_time_seconds_sum": 39228.671409586444,
"sglang:queue_time_seconds_count": 13081.0,
"sglang:realtime_tokens_total/prefill_compute": 25179776.0,
"sglang:realtime_tokens_total/decode": 3336241.0,
"sglang:realtime_tokens_total/prefill_cache": 56586544.0,
"sglang:num_running_reqs": 55.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2112.0,
"sglang:kv_evictable_tokens": 665376.0,
"sglang:prompt_tokens_histogram_sum": 81321258.0,
"sglang:prompt_tokens_histogram_count": 13012.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25054762.0,
"sglang:generation_tokens_total": 3328184.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 128.03069167677313,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1632.0,
"sglang:kv_evictable_tokens": 654960.0,
"sglang:generation_tokens_total": 3232072.0,
"sglang:prompt_tokens_histogram_sum": 80920208.0,
"sglang:prompt_tokens_histogram_count": 12645.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25724000.0,
"sglang:realtime_tokens_total/prefill_compute": 25844080.0,
"sglang:realtime_tokens_total/decode": 3244207.0,
"sglang:realtime_tokens_total/prefill_cache": 55526896.0,
"sglang:queue_time_seconds_sum": 42975.40256080963,
"sglang:queue_time_seconds_count": 12714.0
}
},
{
"time": 128.03048837929964,
"metrics": {
"sglang:queue_time_seconds_sum": 39335.93438061047,
"sglang:queue_time_seconds_count": 13119.0,
"sglang:realtime_tokens_total/prefill_compute": 25230816.0,
"sglang:realtime_tokens_total/decode": 3342216.0,
"sglang:realtime_tokens_total/prefill_cache": 56810752.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2128.0,
"sglang:kv_evictable_tokens": 625952.0,
"sglang:prompt_tokens_histogram_sum": 81559228.0,
"sglang:prompt_tokens_histogram_count": 13050.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25096956.0,
"sglang:generation_tokens_total": 3337912.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 130.03074491862208,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3376.0,
"sglang:kv_evictable_tokens": 626272.0,
"sglang:generation_tokens_total": 3246408.0,
"sglang:prompt_tokens_histogram_sum": 81309798.0,
"sglang:prompt_tokens_histogram_count": 12701.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25787494.0,
"sglang:realtime_tokens_total/prefill_compute": 25919904.0,
"sglang:realtime_tokens_total/decode": 3248119.0,
"sglang:realtime_tokens_total/prefill_cache": 55882944.0,
"sglang:queue_time_seconds_sum": 43114.77516630106,
"sglang:queue_time_seconds_count": 12770.0
}
},
{
"time": 130.03057506214827,
"metrics": {
"sglang:queue_time_seconds_sum": 39354.26139688678,
"sglang:queue_time_seconds_count": 13124.0,
"sglang:realtime_tokens_total/prefill_compute": 25240800.0,
"sglang:realtime_tokens_total/decode": 3350339.0,
"sglang:realtime_tokens_total/prefill_cache": 56859248.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2384.0,
"sglang:kv_evictable_tokens": 635104.0,
"sglang:prompt_tokens_histogram_sum": 81620836.0,
"sglang:prompt_tokens_histogram_count": 13055.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25107028.0,
"sglang:generation_tokens_total": 3339192.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 132.02986587863415,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 928.0,
"sglang:kv_evictable_tokens": 620944.0,
"sglang:generation_tokens_total": 3246664.0,
"sglang:prompt_tokens_histogram_sum": 81311964.0,
"sglang:prompt_tokens_histogram_count": 12702.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25787868.0,
"sglang:realtime_tokens_total/prefill_compute": 25919904.0,
"sglang:realtime_tokens_total/decode": 3256951.0,
"sglang:realtime_tokens_total/prefill_cache": 55882944.0,
"sglang:queue_time_seconds_sum": 43117.21330576949,
"sglang:queue_time_seconds_count": 12771.0
}
},
{
"time": 132.03079130873084,
"metrics": {
"sglang:queue_time_seconds_sum": 39501.46412435267,
"sglang:queue_time_seconds_count": 13168.0,
"sglang:realtime_tokens_total/prefill_compute": 25276016.0,
"sglang:realtime_tokens_total/decode": 3356951.0,
"sglang:realtime_tokens_total/prefill_cache": 57041040.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 677232.0,
"sglang:prompt_tokens_histogram_sum": 81876885.0,
"sglang:prompt_tokens_histogram_count": 13099.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25154885.0,
"sglang:generation_tokens_total": 3350456.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 134.03042738791555,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 2144.0,
"sglang:kv_evictable_tokens": 744528.0,
"sglang:generation_tokens_total": 3257672.0,
"sglang:prompt_tokens_histogram_sum": 81610523.0,
"sglang:prompt_tokens_histogram_count": 12745.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25840187.0,
"sglang:realtime_tokens_total/prefill_compute": 25942752.0,
"sglang:realtime_tokens_total/decode": 3263691.0,
"sglang:realtime_tokens_total/prefill_cache": 55980448.0,
"sglang:queue_time_seconds_sum": 43241.9732646076,
"sglang:queue_time_seconds_count": 12814.0
}
},
{
"time": 134.0309919686988,
"metrics": {
"sglang:queue_time_seconds_sum": 39563.48422708269,
"sglang:queue_time_seconds_count": 13188.0,
"sglang:realtime_tokens_total/prefill_compute": 25299872.0,
"sglang:realtime_tokens_total/decode": 3365507.0,
"sglang:realtime_tokens_total/prefill_cache": 57144800.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3584.0,
"sglang:kv_evictable_tokens": 713280.0,
"sglang:prompt_tokens_histogram_sum": 82043476.0,
"sglang:prompt_tokens_histogram_count": 13119.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25184228.0,
"sglang:generation_tokens_total": 3355576.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 136.0300798965618,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2336.0,
"sglang:kv_evictable_tokens": 749552.0,
"sglang:generation_tokens_total": 3262792.0,
"sglang:prompt_tokens_histogram_sum": 81747923.0,
"sglang:prompt_tokens_histogram_count": 12765.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25864979.0,
"sglang:realtime_tokens_total/prefill_compute": 25977088.0,
"sglang:realtime_tokens_total/decode": 3272887.0,
"sglang:realtime_tokens_total/prefill_cache": 56135312.0,
"sglang:queue_time_seconds_sum": 43277.58191890549,
"sglang:queue_time_seconds_count": 12834.0
}
},
{
"time": 136.03135857731104,
"metrics": {
"sglang:queue_time_seconds_sum": 39660.92210982554,
"sglang:queue_time_seconds_count": 13220.0,
"sglang:realtime_tokens_total/prefill_compute": 25337216.0,
"sglang:realtime_tokens_total/decode": 3371986.0,
"sglang:realtime_tokens_total/prefill_cache": 57336496.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 1456.0,
"sglang:kv_evictable_tokens": 608928.0,
"sglang:prompt_tokens_histogram_sum": 82166300.0,
"sglang:prompt_tokens_histogram_count": 13151.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25202572.0,
"sglang:generation_tokens_total": 3363768.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 138.03082583192736,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1520.0,
"sglang:kv_evictable_tokens": 651376.0,
"sglang:generation_tokens_total": 3272776.0,
"sglang:prompt_tokens_histogram_sum": 81868111.0,
"sglang:prompt_tokens_histogram_count": 12804.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25887663.0,
"sglang:realtime_tokens_total/prefill_compute": 26016592.0,
"sglang:realtime_tokens_total/decode": 3279622.0,
"sglang:realtime_tokens_total/prefill_cache": 56316112.0,
"sglang:queue_time_seconds_sum": 43357.276516708545,
"sglang:queue_time_seconds_count": 12873.0
}
},
{
"time": 138.03358567506075,
"metrics": {
"sglang:queue_time_seconds_sum": 39740.02198273409,
"sglang:queue_time_seconds_count": 13247.0,
"sglang:realtime_tokens_total/prefill_compute": 25374144.0,
"sglang:realtime_tokens_total/decode": 3378167.0,
"sglang:realtime_tokens_total/prefill_cache": 57510784.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2864.0,
"sglang:kv_evictable_tokens": 578672.0,
"sglang:prompt_tokens_histogram_sum": 82347424.0,
"sglang:prompt_tokens_histogram_count": 13178.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25235760.0,
"sglang:generation_tokens_total": 3370680.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 140.03535260725766,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2816.0,
"sglang:kv_evictable_tokens": 630672.0,
"sglang:generation_tokens_total": 3279176.0,
"sglang:prompt_tokens_histogram_sum": 82057218.0,
"sglang:prompt_tokens_histogram_count": 12829.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25921906.0,
"sglang:realtime_tokens_total/prefill_compute": 26049328.0,
"sglang:realtime_tokens_total/decode": 3286445.0,
"sglang:realtime_tokens_total/prefill_cache": 56491536.0,
"sglang:queue_time_seconds_sum": 43404.07879143488,
"sglang:queue_time_seconds_count": 12898.0
}
},
{
"time": 140.03524615895003,
"metrics": {
"sglang:queue_time_seconds_sum": 39836.5349439038,
"sglang:queue_time_seconds_count": 13273.0,
"sglang:realtime_tokens_total/prefill_compute": 25397648.0,
"sglang:realtime_tokens_total/decode": 3385359.0,
"sglang:realtime_tokens_total/prefill_cache": 57618960.0,
"sglang:num_running_reqs": 53.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3520.0,
"sglang:kv_evictable_tokens": 636944.0,
"sglang:prompt_tokens_histogram_sum": 82551012.0,
"sglang:prompt_tokens_histogram_count": 13204.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25270484.0,
"sglang:generation_tokens_total": 3377336.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 142.03055843245238,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2624.0,
"sglang:kv_evictable_tokens": 627312.0,
"sglang:generation_tokens_total": 3282760.0,
"sglang:prompt_tokens_histogram_sum": 82087558.0,
"sglang:prompt_tokens_histogram_count": 12843.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25928086.0,
"sglang:realtime_tokens_total/prefill_compute": 26053936.0,
"sglang:realtime_tokens_total/decode": 3294431.0,
"sglang:realtime_tokens_total/prefill_cache": 56516576.0,
"sglang:queue_time_seconds_sum": 43442.136832385324,
"sglang:queue_time_seconds_count": 12912.0
}
},
{
"time": 142.0316975293681,
"metrics": {
"sglang:queue_time_seconds_sum": 39956.5561909182,
"sglang:queue_time_seconds_count": 13311.0,
"sglang:realtime_tokens_total/prefill_compute": 25441088.0,
"sglang:realtime_tokens_total/decode": 3391271.0,
"sglang:realtime_tokens_total/prefill_cache": 57829456.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 3616.0,
"sglang:kv_evictable_tokens": 663552.0,
"sglang:prompt_tokens_histogram_sum": 82827838.0,
"sglang:prompt_tokens_histogram_count": 13242.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25317054.0,
"sglang:generation_tokens_total": 3387064.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 144.03250647801906,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2048.0,
"sglang:kv_evictable_tokens": 750608.0,
"sglang:generation_tokens_total": 3295560.0,
"sglang:prompt_tokens_histogram_sum": 82485461.0,
"sglang:prompt_tokens_histogram_count": 12893.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25993925.0,
"sglang:realtime_tokens_total/prefill_compute": 26103648.0,
"sglang:realtime_tokens_total/decode": 3301037.0,
"sglang:realtime_tokens_total/prefill_cache": 56750064.0,
"sglang:queue_time_seconds_sum": 43575.76037685666,
"sglang:queue_time_seconds_count": 12962.0
}
},
{
"time": 144.03181023336947,
"metrics": {
"sglang:queue_time_seconds_sum": 39975.504533573054,
"sglang:queue_time_seconds_count": 13316.0,
"sglang:realtime_tokens_total/prefill_compute": 25449040.0,
"sglang:realtime_tokens_total/decode": 3400353.0,
"sglang:realtime_tokens_total/prefill_cache": 57863984.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1200.0,
"sglang:kv_evictable_tokens": 668144.0,
"sglang:prompt_tokens_histogram_sum": 82864186.0,
"sglang:prompt_tokens_histogram_count": 13247.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25323818.0,
"sglang:generation_tokens_total": 3388344.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 146.03693820163608,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 1664.0,
"sglang:kv_evictable_tokens": 752160.0,
"sglang:generation_tokens_total": 3299144.0,
"sglang:prompt_tokens_histogram_sum": 82515048.0,
"sglang:prompt_tokens_histogram_count": 12907.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25998472.0,
"sglang:realtime_tokens_total/prefill_compute": 26107296.0,
"sglang:realtime_tokens_total/decode": 3310499.0,
"sglang:realtime_tokens_total/prefill_cache": 56758192.0,
"sglang:queue_time_seconds_sum": 43602.749141833745,
"sglang:queue_time_seconds_count": 12972.0
}
},
{
"time": 146.03680175263435,
"metrics": {
"sglang:queue_time_seconds_sum": 40105.29952394683,
"sglang:queue_time_seconds_count": 13360.0,
"sglang:realtime_tokens_total/prefill_compute": 25493520.0,
"sglang:realtime_tokens_total/decode": 3405988.0,
"sglang:realtime_tokens_total/prefill_cache": 58086224.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 27.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3088.0,
"sglang:kv_evictable_tokens": 597872.0,
"sglang:prompt_tokens_histogram_sum": 83109584.0,
"sglang:prompt_tokens_histogram_count": 13291.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25364304.0,
"sglang:generation_tokens_total": 3399608.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 148.03030104469508,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 7.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1312.0,
"sglang:kv_evictable_tokens": 685776.0,
"sglang:generation_tokens_total": 3311944.0,
"sglang:prompt_tokens_histogram_sum": 82798073.0,
"sglang:prompt_tokens_histogram_count": 12957.0,
"sglang:uncached_prompt_tokens_histogram_sum": 26048009.0,
"sglang:realtime_tokens_total/prefill_compute": 26168560.0,
"sglang:realtime_tokens_total/decode": 3315873.0,
"sglang:realtime_tokens_total/prefill_cache": 57065296.0,
"sglang:queue_time_seconds_sum": 43727.754800041206,
"sglang:queue_time_seconds_count": 13026.0
}
},
{
"time": 148.03856306988746,
"metrics": {
"sglang:queue_time_seconds_sum": 40164.040135713294,
"sglang:queue_time_seconds_count": 13380.0,
"sglang:realtime_tokens_total/prefill_compute": 25531536.0,
"sglang:realtime_tokens_total/decode": 3412236.0,
"sglang:realtime_tokens_total/prefill_cache": 58277536.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 565184.0,
"sglang:prompt_tokens_histogram_sum": 83255608.0,
"sglang:prompt_tokens_histogram_count": 13311.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25391624.0,
"sglang:generation_tokens_total": 3404728.0
}
}
]
},
{
"label": "score_end",
"workers": [
{
"time": 150.00549020431936,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1088.0,
"sglang:kv_evictable_tokens": 675760.0,
"sglang:generation_tokens_total": 3312968.0,
"sglang:prompt_tokens_histogram_sum": 82802681.0,
"sglang:prompt_tokens_histogram_count": 12961.0,
"sglang:uncached_prompt_tokens_histogram_sum": 26050073.0,
"sglang:realtime_tokens_total/prefill_compute": 26169600.0,
"sglang:realtime_tokens_total/decode": 3325215.0,
"sglang:realtime_tokens_total/prefill_cache": 57066816.0,
"sglang:queue_time_seconds_sum": 43734.932099897414,
"sglang:queue_time_seconds_count": 13029.0
}
},
{
"time": 150.00685367081314,
"metrics": {
"sglang:queue_time_seconds_sum": 40234.84305634443,
"sglang:queue_time_seconds_count": 13401.0,
"sglang:realtime_tokens_total/prefill_compute": 25555008.0,
"sglang:realtime_tokens_total/decode": 3419059.0,
"sglang:realtime_tokens_total/prefill_cache": 58378736.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 2272.0,
"sglang:kv_evictable_tokens": 596288.0,
"sglang:prompt_tokens_histogram_sum": 83414470.0,
"sglang:prompt_tokens_histogram_count": 13332.0,
"sglang:uncached_prompt_tokens_histogram_sum": 25418678.0,
"sglang:generation_tokens_total": 3410104.0
}
}
]
},
{
"label": "drained",
"workers": [
{
"time": 188.5288202688098,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1456.0,
"sglang:kv_evictable_tokens": 1047120.0,
"sglang:generation_tokens_total": 3461960.0,
"sglang:prompt_tokens_histogram_sum": 86043683.0,
"sglang:prompt_tokens_histogram_count": 13543.0,
"sglang:uncached_prompt_tokens_histogram_sum": 26620803.0,
"sglang:realtime_tokens_total/prefill_compute": 26678912.0,
"sglang:realtime_tokens_total/decode": 3461848.0,
"sglang:realtime_tokens_total/prefill_cache": 59422880.0,
"sglang:queue_time_seconds_sum": 45192.493140384555,
"sglang:queue_time_seconds_count": 13548.0
}
},
{
"time": 188.52947841677815,
"metrics": {
"sglang:queue_time_seconds_sum": 41421.66175549198,
"sglang:queue_time_seconds_count": 13817.0,
"sglang:realtime_tokens_total/prefill_compute": 26077312.0,
"sglang:realtime_tokens_total/decode": 3532911.0,
"sglang:realtime_tokens_total/prefill_cache": 60850448.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 512.0,
"sglang:kv_evictable_tokens": 1048064.0,
"sglang:prompt_tokens_histogram_sum": 86868076.0,
"sglang:prompt_tokens_histogram_count": 13812.0,
"sglang:uncached_prompt_tokens_histogram_sum": 26017628.0,
"sglang:generation_tokens_total": 3532984.0
}
}
]
}
],
"r1_dynamo_kv": [
{
"label": "start",
"workers": [
{
"time": 0.007416471838951111,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1044464.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:generation_tokens_total": 2326808.0,
"sglang:prompt_tokens_histogram_sum": 58099306.0,
"sglang:prompt_tokens_histogram_count": 9106.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17147578.0,
"sglang:realtime_tokens_total/prefill_compute": 17186736.0,
"sglang:realtime_tokens_total/decode": 2326746.0,
"sglang:realtime_tokens_total/prefill_cache": 40951728.0,
"sglang:queue_time_seconds_sum": 30425.976442387328,
"sglang:queue_time_seconds_count": 9109.0
}
},
{
"time": 0.007812025956809521,
"metrics": {
"sglang:queue_time_seconds_sum": 26917.821167017333,
"sglang:queue_time_seconds_count": 9440.0,
"sglang:realtime_tokens_total/prefill_compute": 16632112.0,
"sglang:realtime_tokens_total/decode": 2412927.0,
"sglang:realtime_tokens_total/prefill_cache": 42225472.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1044448.0,
"sglang:kv_evictable_tokens": 16.0,
"sglang:prompt_tokens_histogram_sum": 58816856.0,
"sglang:prompt_tokens_histogram_count": 9437.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16591384.0,
"sglang:generation_tokens_total": 2412984.0
}
}
]
},
{
"label": "score_start",
"workers": [
{
"time": 30.008577900007367,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 5680.0,
"sglang:kv_evictable_tokens": 621872.0,
"sglang:generation_tokens_total": 2384152.0,
"sglang:prompt_tokens_histogram_sum": 59503033.0,
"sglang:prompt_tokens_histogram_count": 9330.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18187225.0,
"sglang:realtime_tokens_total/prefill_compute": 18419184.0,
"sglang:realtime_tokens_total/decode": 2392277.0,
"sglang:realtime_tokens_total/prefill_cache": 41504672.0,
"sglang:queue_time_seconds_sum": 31367.88080908358,
"sglang:queue_time_seconds_count": 9397.0
}
},
{
"time": 30.015809858217835,
"metrics": {
"sglang:queue_time_seconds_sum": 27824.184837910347,
"sglang:queue_time_seconds_count": 9758.0,
"sglang:realtime_tokens_total/prefill_compute": 17859904.0,
"sglang:realtime_tokens_total/decode": 2481828.0,
"sglang:realtime_tokens_total/prefill_cache": 42974448.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1936.0,
"sglang:kv_evictable_tokens": 651488.0,
"sglang:prompt_tokens_histogram_sum": 60379010.0,
"sglang:prompt_tokens_histogram_count": 9691.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17669058.0,
"sglang:generation_tokens_total": 2478008.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 32.03673254419118,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3744.0,
"sglang:kv_evictable_tokens": 660144.0,
"sglang:generation_tokens_total": 2391576.0,
"sglang:prompt_tokens_histogram_sum": 59710200.0,
"sglang:prompt_tokens_histogram_count": 9359.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18267032.0,
"sglang:realtime_tokens_total/prefill_compute": 18501600.0,
"sglang:realtime_tokens_total/decode": 2397125.0,
"sglang:realtime_tokens_total/prefill_cache": 41649824.0,
"sglang:queue_time_seconds_sum": 31475.857585571706,
"sglang:queue_time_seconds_count": 9425.0
}
},
{
"time": 32.037391684018075,
"metrics": {
"sglang:queue_time_seconds_sum": 27848.76343723666,
"sglang:queue_time_seconds_count": 9763.0,
"sglang:realtime_tokens_total/prefill_compute": 17874544.0,
"sglang:realtime_tokens_total/decode": 2490528.0,
"sglang:realtime_tokens_total/prefill_cache": 42976496.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 51.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 5296.0,
"sglang:kv_evictable_tokens": 631232.0,
"sglang:prompt_tokens_histogram_sum": 60387559.0,
"sglang:prompt_tokens_histogram_count": 9696.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17675047.0,
"sglang:generation_tokens_total": 2479288.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 34.03635096922517,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 4672.0,
"sglang:kv_evictable_tokens": 679776.0,
"sglang:generation_tokens_total": 2394392.0,
"sglang:prompt_tokens_histogram_sum": 59782526.0,
"sglang:prompt_tokens_histogram_count": 9370.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18320542.0,
"sglang:realtime_tokens_total/prefill_compute": 18519120.0,
"sglang:realtime_tokens_total/decode": 2405301.0,
"sglang:realtime_tokens_total/prefill_cache": 41675360.0,
"sglang:queue_time_seconds_sum": 31513.369808558375,
"sglang:queue_time_seconds_count": 9437.0
}
},
{
"time": 34.03750049788505,
"metrics": {
"sglang:queue_time_seconds_sum": 28020.332649834454,
"sglang:queue_time_seconds_count": 9801.0,
"sglang:realtime_tokens_total/prefill_compute": 17950032.0,
"sglang:realtime_tokens_total/decode": 2495148.0,
"sglang:realtime_tokens_total/prefill_cache": 43120336.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5776.0,
"sglang:kv_evictable_tokens": 668416.0,
"sglang:prompt_tokens_histogram_sum": 60637964.0,
"sglang:prompt_tokens_histogram_count": 9734.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17768236.0,
"sglang:generation_tokens_total": 2489016.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 36.038518448360264,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 13552.0,
"sglang:kv_evictable_tokens": 673664.0,
"sglang:generation_tokens_total": 2401816.0,
"sglang:prompt_tokens_histogram_sum": 59960250.0,
"sglang:prompt_tokens_histogram_count": 9399.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18403770.0,
"sglang:realtime_tokens_total/prefill_compute": 18613552.0,
"sglang:realtime_tokens_total/decode": 2408778.0,
"sglang:realtime_tokens_total/prefill_cache": 41752208.0,
"sglang:queue_time_seconds_sum": 31622.673828748986,
"sglang:queue_time_seconds_count": 9464.0
}
},
{
"time": 36.03752869646996,
"metrics": {
"sglang:queue_time_seconds_sum": 28079.544559393078,
"sglang:queue_time_seconds_count": 9821.0,
"sglang:realtime_tokens_total/prefill_compute": 18017280.0,
"sglang:realtime_tokens_total/decode": 2500954.0,
"sglang:realtime_tokens_total/prefill_cache": 43174080.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 51.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2432.0,
"sglang:kv_evictable_tokens": 702800.0,
"sglang:prompt_tokens_histogram_sum": 60792266.0,
"sglang:prompt_tokens_histogram_count": 9755.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17817818.0,
"sglang:generation_tokens_total": 2494392.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 38.03607428446412,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 7872.0,
"sglang:kv_evictable_tokens": 631664.0,
"sglang:generation_tokens_total": 2407704.0,
"sglang:prompt_tokens_histogram_sum": 60110746.0,
"sglang:prompt_tokens_histogram_count": 9422.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18460922.0,
"sglang:realtime_tokens_total/prefill_compute": 18693008.0,
"sglang:realtime_tokens_total/decode": 2413122.0,
"sglang:realtime_tokens_total/prefill_cache": 41885552.0,
"sglang:queue_time_seconds_sum": 31700.854169438593,
"sglang:queue_time_seconds_count": 9488.0
}
},
{
"time": 38.04367466084659,
"metrics": {
"sglang:queue_time_seconds_sum": 28115.426204770803,
"sglang:queue_time_seconds_count": 9829.0,
"sglang:realtime_tokens_total/prefill_compute": 18053520.0,
"sglang:realtime_tokens_total/decode": 2508342.0,
"sglang:realtime_tokens_total/prefill_cache": 43177664.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2880.0,
"sglang:kv_evictable_tokens": 690736.0,
"sglang:prompt_tokens_histogram_sum": 60826349.0,
"sglang:prompt_tokens_histogram_count": 9762.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17848317.0,
"sglang:generation_tokens_total": 2496184.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 40.03858642373234,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 4960.0,
"sglang:kv_evictable_tokens": 587312.0,
"sglang:generation_tokens_total": 2409496.0,
"sglang:prompt_tokens_histogram_sum": 60137086.0,
"sglang:prompt_tokens_histogram_count": 9429.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18469102.0,
"sglang:realtime_tokens_total/prefill_compute": 18733696.0,
"sglang:realtime_tokens_total/decode": 2419730.0,
"sglang:realtime_tokens_total/prefill_cache": 41911472.0,
"sglang:queue_time_seconds_sum": 31729.55723867193,
"sglang:queue_time_seconds_count": 9496.0
}
},
{
"time": 40.03847133461386,
"metrics": {
"sglang:queue_time_seconds_sum": 28294.440330484882,
"sglang:queue_time_seconds_count": 9869.0,
"sglang:realtime_tokens_total/prefill_compute": 18158976.0,
"sglang:realtime_tokens_total/decode": 2512126.0,
"sglang:realtime_tokens_total/prefill_cache": 43291552.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 4848.0,
"sglang:kv_evictable_tokens": 712816.0,
"sglang:prompt_tokens_histogram_sum": 61066503.0,
"sglang:prompt_tokens_histogram_count": 9802.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17914423.0,
"sglang:generation_tokens_total": 2506424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 42.03899714816362,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 3344.0,
"sglang:kv_evictable_tokens": 608320.0,
"sglang:generation_tokens_total": 2415384.0,
"sglang:prompt_tokens_histogram_sum": 60289624.0,
"sglang:prompt_tokens_histogram_count": 9452.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18559128.0,
"sglang:realtime_tokens_total/prefill_compute": 18795392.0,
"sglang:realtime_tokens_total/decode": 2424438.0,
"sglang:realtime_tokens_total/prefill_cache": 41966992.0,
"sglang:queue_time_seconds_sum": 31834.049208685756,
"sglang:queue_time_seconds_count": 9518.0
}
},
{
"time": 42.03939259145409,
"metrics": {
"sglang:queue_time_seconds_sum": 28353.383768217638,
"sglang:queue_time_seconds_count": 9885.0,
"sglang:realtime_tokens_total/prefill_compute": 18191552.0,
"sglang:realtime_tokens_total/decode": 2519469.0,
"sglang:realtime_tokens_total/prefill_cache": 43413200.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4320.0,
"sglang:kv_evictable_tokens": 643872.0,
"sglang:prompt_tokens_histogram_sum": 61149035.0,
"sglang:prompt_tokens_histogram_count": 9818.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17974955.0,
"sglang:generation_tokens_total": 2510520.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 44.03839514032006,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1408.0,
"sglang:kv_evictable_tokens": 651408.0,
"sglang:generation_tokens_total": 2423832.0,
"sglang:prompt_tokens_histogram_sum": 60537581.0,
"sglang:prompt_tokens_histogram_count": 9485.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18652029.0,
"sglang:realtime_tokens_total/prefill_compute": 18886784.0,
"sglang:realtime_tokens_total/decode": 2428336.0,
"sglang:realtime_tokens_total/prefill_cache": 42104544.0,
"sglang:queue_time_seconds_sum": 31954.89162017964,
"sglang:queue_time_seconds_count": 9551.0
}
},
{
"time": 44.04310970194638,
"metrics": {
"sglang:queue_time_seconds_sum": 28406.87694479432,
"sglang:queue_time_seconds_count": 9897.0,
"sglang:realtime_tokens_total/prefill_compute": 18240768.0,
"sglang:realtime_tokens_total/decode": 2525473.0,
"sglang:realtime_tokens_total/prefill_cache": 43416272.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3680.0,
"sglang:kv_evictable_tokens": 652896.0,
"sglang:prompt_tokens_histogram_sum": 61229752.0,
"sglang:prompt_tokens_histogram_count": 9830.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18049528.0,
"sglang:generation_tokens_total": 2513592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 46.037909974344075,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 5696.0,
"sglang:kv_evictable_tokens": 672448.0,
"sglang:generation_tokens_total": 2425880.0,
"sglang:prompt_tokens_histogram_sum": 60604166.0,
"sglang:prompt_tokens_histogram_count": 9493.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18692694.0,
"sglang:realtime_tokens_total/prefill_compute": 18911760.0,
"sglang:realtime_tokens_total/decode": 2436111.0,
"sglang:realtime_tokens_total/prefill_cache": 42110784.0,
"sglang:queue_time_seconds_sum": 31986.76527110953,
"sglang:queue_time_seconds_count": 9560.0
}
},
{
"time": 46.03848604205996,
"metrics": {
"sglang:queue_time_seconds_sum": 28617.680292395875,
"sglang:queue_time_seconds_count": 9941.0,
"sglang:realtime_tokens_total/prefill_compute": 18343056.0,
"sglang:realtime_tokens_total/decode": 2529063.0,
"sglang:realtime_tokens_total/prefill_cache": 43534016.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 4176.0,
"sglang:kv_evictable_tokens": 711504.0,
"sglang:prompt_tokens_histogram_sum": 61518063.0,
"sglang:prompt_tokens_histogram_count": 9876.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18134719.0,
"sglang:generation_tokens_total": 2525368.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 48.036221974529326,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3664.0,
"sglang:kv_evictable_tokens": 677552.0,
"sglang:generation_tokens_total": 2433304.0,
"sglang:prompt_tokens_histogram_sum": 60767047.0,
"sglang:prompt_tokens_histogram_count": 9522.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18772247.0,
"sglang:realtime_tokens_total/prefill_compute": 18987360.0,
"sglang:realtime_tokens_total/decode": 2441010.0,
"sglang:realtime_tokens_total/prefill_cache": 42162544.0,
"sglang:queue_time_seconds_sum": 32120.54908054322,
"sglang:queue_time_seconds_count": 9589.0
}
},
{
"time": 48.0371750863269,
"metrics": {
"sglang:queue_time_seconds_sum": 28634.083018173464,
"sglang:queue_time_seconds_count": 9948.0,
"sglang:realtime_tokens_total/prefill_compute": 18399648.0,
"sglang:realtime_tokens_total/decode": 2535555.0,
"sglang:realtime_tokens_total/prefill_cache": 43559056.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3568.0,
"sglang:kv_evictable_tokens": 703152.0,
"sglang:prompt_tokens_histogram_sum": 61562166.0,
"sglang:prompt_tokens_histogram_count": 9882.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18148966.0,
"sglang:generation_tokens_total": 2526904.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 50.06674993503839,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3984.0,
"sglang:kv_evictable_tokens": 653264.0,
"sglang:generation_tokens_total": 2439960.0,
"sglang:prompt_tokens_histogram_sum": 60950075.0,
"sglang:prompt_tokens_histogram_count": 9548.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18845531.0,
"sglang:realtime_tokens_total/prefill_compute": 19063888.0,
"sglang:realtime_tokens_total/decode": 2445987.0,
"sglang:realtime_tokens_total/prefill_cache": 42335248.0,
"sglang:queue_time_seconds_sum": 32197.967177364975,
"sglang:queue_time_seconds_count": 9614.0
}
},
{
"time": 50.06647620443255,
"metrics": {
"sglang:queue_time_seconds_sum": 28691.528633805923,
"sglang:queue_time_seconds_count": 9961.0,
"sglang:realtime_tokens_total/prefill_compute": 18460608.0,
"sglang:realtime_tokens_total/decode": 2541779.0,
"sglang:realtime_tokens_total/prefill_cache": 43597824.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1296.0,
"sglang:kv_evictable_tokens": 670768.0,
"sglang:prompt_tokens_histogram_sum": 61632339.0,
"sglang:prompt_tokens_histogram_count": 9894.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18212259.0,
"sglang:generation_tokens_total": 2529976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 52.0372342960909,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4496.0,
"sglang:kv_evictable_tokens": 606480.0,
"sglang:generation_tokens_total": 2442264.0,
"sglang:prompt_tokens_histogram_sum": 60981254.0,
"sglang:prompt_tokens_histogram_count": 9557.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18870470.0,
"sglang:realtime_tokens_total/prefill_compute": 19110672.0,
"sglang:realtime_tokens_total/decode": 2452155.0,
"sglang:realtime_tokens_total/prefill_cache": 42347952.0,
"sglang:queue_time_seconds_sum": 32235.196312791668,
"sglang:queue_time_seconds_count": 9624.0
}
},
{
"time": 52.04047758411616,
"metrics": {
"sglang:queue_time_seconds_sum": 28906.383852914907,
"sglang:queue_time_seconds_count": 10012.0,
"sglang:realtime_tokens_total/prefill_compute": 18540592.0,
"sglang:realtime_tokens_total/decode": 2545940.0,
"sglang:realtime_tokens_total/prefill_cache": 43801216.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 144.0,
"sglang:kv_evictable_tokens": 675520.0,
"sglang:prompt_tokens_histogram_sum": 61915892.0,
"sglang:prompt_tokens_histogram_count": 9945.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18356836.0,
"sglang:generation_tokens_total": 2543032.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 54.036485308781266,
"metrics": {
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 6384.0,
"sglang:kv_evictable_tokens": 589888.0,
"sglang:generation_tokens_total": 2447640.0,
"sglang:prompt_tokens_histogram_sum": 61106340.0,
"sglang:prompt_tokens_histogram_count": 9578.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18945588.0,
"sglang:realtime_tokens_total/prefill_compute": 19186288.0,
"sglang:realtime_tokens_total/decode": 2456540.0,
"sglang:realtime_tokens_total/prefill_cache": 42420912.0,
"sglang:queue_time_seconds_sum": 32332.4067745395,
"sglang:queue_time_seconds_count": 9645.0
}
},
{
"time": 54.03813229687512,
"metrics": {
"sglang:queue_time_seconds_sum": 28917.619003619067,
"sglang:queue_time_seconds_count": 10015.0,
"sglang:realtime_tokens_total/prefill_compute": 18560160.0,
"sglang:realtime_tokens_total/decode": 2554563.0,
"sglang:realtime_tokens_total/prefill_cache": 43802752.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 7216.0,
"sglang:kv_evictable_tokens": 669536.0,
"sglang:prompt_tokens_histogram_sum": 61938774.0,
"sglang:prompt_tokens_histogram_count": 9949.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18361654.0,
"sglang:generation_tokens_total": 2544056.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 56.03702987730503,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 7184.0,
"sglang:kv_evictable_tokens": 659376.0,
"sglang:generation_tokens_total": 2456088.0,
"sglang:prompt_tokens_histogram_sum": 61357594.0,
"sglang:prompt_tokens_histogram_count": 9611.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19022346.0,
"sglang:realtime_tokens_total/prefill_compute": 19266016.0,
"sglang:realtime_tokens_total/decode": 2461201.0,
"sglang:realtime_tokens_total/prefill_cache": 42530528.0,
"sglang:queue_time_seconds_sum": 32430.688656828366,
"sglang:queue_time_seconds_count": 9677.0
}
},
{
"time": 56.0385576011613,
"metrics": {
"sglang:queue_time_seconds_sum": 28998.932233946398,
"sglang:queue_time_seconds_count": 10032.0,
"sglang:realtime_tokens_total/prefill_compute": 18654144.0,
"sglang:realtime_tokens_total/decode": 2558930.0,
"sglang:realtime_tokens_total/prefill_cache": 43815120.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 6336.0,
"sglang:kv_evictable_tokens": 673968.0,
"sglang:prompt_tokens_histogram_sum": 62049869.0,
"sglang:prompt_tokens_histogram_count": 9966.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18437933.0,
"sglang:generation_tokens_total": 2548408.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 58.03970317542553,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 8288.0,
"sglang:kv_evictable_tokens": 672368.0,
"sglang:generation_tokens_total": 2458648.0,
"sglang:prompt_tokens_histogram_sum": 61435496.0,
"sglang:prompt_tokens_histogram_count": 9621.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19081560.0,
"sglang:realtime_tokens_total/prefill_compute": 19295104.0,
"sglang:realtime_tokens_total/decode": 2468436.0,
"sglang:realtime_tokens_total/prefill_cache": 42545776.0,
"sglang:queue_time_seconds_sum": 32472.653680797666,
"sglang:queue_time_seconds_count": 9687.0
}
},
{
"time": 58.04526367969811,
"metrics": {
"sglang:queue_time_seconds_sum": 29196.469092444517,
"sglang:queue_time_seconds_count": 10076.0,
"sglang:realtime_tokens_total/prefill_compute": 18747344.0,
"sglang:realtime_tokens_total/decode": 2562338.0,
"sglang:realtime_tokens_total/prefill_cache": 44015856.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 30.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 8496.0,
"sglang:kv_evictable_tokens": 644416.0,
"sglang:prompt_tokens_histogram_sum": 62308716.0,
"sglang:prompt_tokens_histogram_count": 10009.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18507500.0,
"sglang:generation_tokens_total": 2559416.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 60.041322347708046,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 1424.0,
"sglang:kv_evictable_tokens": 734160.0,
"sglang:generation_tokens_total": 2467352.0,
"sglang:prompt_tokens_histogram_sum": 61686369.0,
"sglang:prompt_tokens_histogram_count": 9655.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19166065.0,
"sglang:realtime_tokens_total/prefill_compute": 19357936.0,
"sglang:realtime_tokens_total/decode": 2473954.0,
"sglang:realtime_tokens_total/prefill_cache": 42696368.0,
"sglang:queue_time_seconds_sum": 32622.147944957018,
"sglang:queue_time_seconds_count": 9722.0
}
},
{
"time": 60.04214984085411,
"metrics": {
"sglang:queue_time_seconds_sum": 29203.373242765665,
"sglang:queue_time_seconds_count": 10078.0,
"sglang:realtime_tokens_total/prefill_compute": 18757152.0,
"sglang:realtime_tokens_total/decode": 2570835.0,
"sglang:realtime_tokens_total/prefill_cache": 44015856.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 49.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 7664.0,
"sglang:kv_evictable_tokens": 638544.0,
"sglang:prompt_tokens_histogram_sum": 62319788.0,
"sglang:prompt_tokens_histogram_count": 10012.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18517036.0,
"sglang:generation_tokens_total": 2560184.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 62.036901724524796,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2416.0,
"sglang:kv_evictable_tokens": 648704.0,
"sglang:generation_tokens_total": 2472216.0,
"sglang:prompt_tokens_histogram_sum": 61754729.0,
"sglang:prompt_tokens_histogram_count": 9674.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19224201.0,
"sglang:realtime_tokens_total/prefill_compute": 19398240.0,
"sglang:realtime_tokens_total/decode": 2480694.0,
"sglang:realtime_tokens_total/prefill_cache": 42807616.0,
"sglang:queue_time_seconds_sum": 32680.17985395342,
"sglang:queue_time_seconds_count": 9740.0
}
},
{
"time": 62.03974708914757,
"metrics": {
"sglang:queue_time_seconds_sum": 29273.043437262997,
"sglang:queue_time_seconds_count": 10094.0,
"sglang:realtime_tokens_total/prefill_compute": 18831040.0,
"sglang:realtime_tokens_total/decode": 2575207.0,
"sglang:realtime_tokens_total/prefill_cache": 44073280.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 4448.0,
"sglang:kv_evictable_tokens": 587328.0,
"sglang:prompt_tokens_histogram_sum": 62426054.0,
"sglang:prompt_tokens_histogram_count": 10029.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18610934.0,
"sglang:generation_tokens_total": 2564536.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 64.0361139215529,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1168.0,
"sglang:kv_evictable_tokens": 642976.0,
"sglang:generation_tokens_total": 2476568.0,
"sglang:prompt_tokens_histogram_sum": 61841198.0,
"sglang:prompt_tokens_histogram_count": 9691.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19278894.0,
"sglang:realtime_tokens_total/prefill_compute": 19451600.0,
"sglang:realtime_tokens_total/decode": 2486714.0,
"sglang:realtime_tokens_total/prefill_cache": 42840304.0,
"sglang:queue_time_seconds_sum": 32750.702203501016,
"sglang:queue_time_seconds_count": 9758.0
}
},
{
"time": 64.04324830975384,
"metrics": {
"sglang:queue_time_seconds_sum": 29431.965555918403,
"sglang:queue_time_seconds_count": 10136.0,
"sglang:realtime_tokens_total/prefill_compute": 18939424.0,
"sglang:realtime_tokens_total/decode": 2578484.0,
"sglang:realtime_tokens_total/prefill_cache": 44206016.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5488.0,
"sglang:kv_evictable_tokens": 665696.0,
"sglang:prompt_tokens_histogram_sum": 62719812.0,
"sglang:prompt_tokens_histogram_count": 10073.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18703956.0,
"sglang:generation_tokens_total": 2575800.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 66.03703878168017,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2416.0,
"sglang:kv_evictable_tokens": 649392.0,
"sglang:generation_tokens_total": 2485272.0,
"sglang:prompt_tokens_histogram_sum": 62085982.0,
"sglang:prompt_tokens_histogram_count": 9725.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19327918.0,
"sglang:realtime_tokens_total/prefill_compute": 19543776.0,
"sglang:realtime_tokens_total/decode": 2490450.0,
"sglang:realtime_tokens_total/prefill_cache": 42968960.0,
"sglang:queue_time_seconds_sum": 32901.265273627825,
"sglang:queue_time_seconds_count": 9791.0
}
},
{
"time": 66.03946652729064,
"metrics": {
"sglang:queue_time_seconds_sum": 29449.855143255554,
"sglang:queue_time_seconds_count": 10142.0,
"sglang:realtime_tokens_total/prefill_compute": 18959888.0,
"sglang:realtime_tokens_total/decode": 2586292.0,
"sglang:realtime_tokens_total/prefill_cache": 44207552.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2768.0,
"sglang:kv_evictable_tokens": 648304.0,
"sglang:prompt_tokens_histogram_sum": 62729604.0,
"sglang:prompt_tokens_histogram_count": 10075.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18713748.0,
"sglang:generation_tokens_total": 2576312.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 68.03593521937728,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2576.0,
"sglang:kv_evictable_tokens": 637072.0,
"sglang:generation_tokens_total": 2488344.0,
"sglang:prompt_tokens_histogram_sum": 62163774.0,
"sglang:prompt_tokens_histogram_count": 9737.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19356158.0,
"sglang:realtime_tokens_total/prefill_compute": 19597696.0,
"sglang:realtime_tokens_total/decode": 2496621.0,
"sglang:realtime_tokens_total/prefill_cache": 43028416.0,
"sglang:queue_time_seconds_sum": 32925.52319076285,
"sglang:queue_time_seconds_count": 9803.0
}
},
{
"time": 68.03897516150028,
"metrics": {
"sglang:queue_time_seconds_sum": 29587.29358336702,
"sglang:queue_time_seconds_count": 10171.0,
"sglang:realtime_tokens_total/prefill_compute": 19032896.0,
"sglang:realtime_tokens_total/decode": 2591818.0,
"sglang:realtime_tokens_total/prefill_cache": 44265264.0,
"sglang:num_running_reqs": 51.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 10544.0,
"sglang:kv_evictable_tokens": 703024.0,
"sglang:prompt_tokens_histogram_sum": 62946958.0,
"sglang:prompt_tokens_histogram_count": 10107.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18819054.0,
"sglang:generation_tokens_total": 2584504.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 70.03798252250999,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 7360.0,
"sglang:kv_evictable_tokens": 596080.0,
"sglang:generation_tokens_total": 2492184.0,
"sglang:prompt_tokens_histogram_sum": 62236910.0,
"sglang:prompt_tokens_histogram_count": 9752.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19397630.0,
"sglang:realtime_tokens_total/prefill_compute": 19653952.0,
"sglang:realtime_tokens_total/decode": 2501930.0,
"sglang:realtime_tokens_total/prefill_cache": 43066640.0,
"sglang:queue_time_seconds_sum": 32989.88241128251,
"sglang:queue_time_seconds_count": 9819.0
}
},
{
"time": 70.04070953372866,
"metrics": {
"sglang:queue_time_seconds_sum": 29717.907723341137,
"sglang:queue_time_seconds_count": 10203.0,
"sglang:realtime_tokens_total/prefill_compute": 19088336.0,
"sglang:realtime_tokens_total/decode": 2597994.0,
"sglang:realtime_tokens_total/prefill_cache": 44477536.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4448.0,
"sglang:kv_evictable_tokens": 659488.0,
"sglang:prompt_tokens_histogram_sum": 63123800.0,
"sglang:prompt_tokens_histogram_count": 10136.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18916248.0,
"sglang:generation_tokens_total": 2591928.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 72.0460147112608,
"metrics": {
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 8384.0,
"sglang:kv_evictable_tokens": 653888.0,
"sglang:generation_tokens_total": 2502936.0,
"sglang:prompt_tokens_histogram_sum": 62539152.0,
"sglang:prompt_tokens_histogram_count": 9794.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19528784.0,
"sglang:realtime_tokens_total/prefill_compute": 19715648.0,
"sglang:realtime_tokens_total/decode": 2507004.0,
"sglang:realtime_tokens_total/prefill_cache": 43256992.0,
"sglang:queue_time_seconds_sum": 33152.03312685061,
"sglang:queue_time_seconds_count": 9860.0
}
},
{
"time": 72.04118185956031,
"metrics": {
"sglang:queue_time_seconds_sum": 29752.446891411208,
"sglang:queue_time_seconds_count": 10212.0,
"sglang:realtime_tokens_total/prefill_compute": 19117360.0,
"sglang:realtime_tokens_total/decode": 2605650.0,
"sglang:realtime_tokens_total/prefill_cache": 44480608.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 6960.0,
"sglang:kv_evictable_tokens": 660400.0,
"sglang:prompt_tokens_histogram_sum": 63170974.0,
"sglang:prompt_tokens_histogram_count": 10145.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18946510.0,
"sglang:generation_tokens_total": 2594232.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 74.03945448342711,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1840.0,
"sglang:kv_evictable_tokens": 674448.0,
"sglang:generation_tokens_total": 2504472.0,
"sglang:prompt_tokens_histogram_sum": 62583758.0,
"sglang:prompt_tokens_histogram_count": 9800.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19555342.0,
"sglang:realtime_tokens_total/prefill_compute": 19747424.0,
"sglang:realtime_tokens_total/decode": 2514755.0,
"sglang:realtime_tokens_total/prefill_cache": 43260064.0,
"sglang:queue_time_seconds_sum": 33165.28692965396,
"sglang:queue_time_seconds_count": 9866.0
}
},
{
"time": 74.04127505607903,
"metrics": {
"sglang:queue_time_seconds_sum": 29872.656661509536,
"sglang:queue_time_seconds_count": 10238.0,
"sglang:realtime_tokens_total/prefill_compute": 19232272.0,
"sglang:realtime_tokens_total/decode": 2608683.0,
"sglang:realtime_tokens_total/prefill_cache": 44583136.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 7328.0,
"sglang:kv_evictable_tokens": 580800.0,
"sglang:prompt_tokens_histogram_sum": 63305501.0,
"sglang:prompt_tokens_histogram_count": 10171.0,
"sglang:uncached_prompt_tokens_histogram_sum": 18998221.0,
"sglang:generation_tokens_total": 2600888.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 76.03918735124171,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 4112.0,
"sglang:kv_evictable_tokens": 708112.0,
"sglang:generation_tokens_total": 2510360.0,
"sglang:prompt_tokens_histogram_sum": 62714087.0,
"sglang:prompt_tokens_histogram_count": 9823.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19619991.0,
"sglang:realtime_tokens_total/prefill_compute": 19818064.0,
"sglang:realtime_tokens_total/decode": 2520530.0,
"sglang:realtime_tokens_total/prefill_cache": 43282288.0,
"sglang:queue_time_seconds_sum": 33266.09833654296,
"sglang:queue_time_seconds_count": 9890.0
}
},
{
"time": 76.03869273886085,
"metrics": {
"sglang:queue_time_seconds_sum": 29945.811857975088,
"sglang:queue_time_seconds_count": 10266.0,
"sglang:realtime_tokens_total/prefill_compute": 19313328.0,
"sglang:realtime_tokens_total/decode": 2613230.0,
"sglang:realtime_tokens_total/prefill_cache": 44664448.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5232.0,
"sglang:kv_evictable_tokens": 643296.0,
"sglang:prompt_tokens_histogram_sum": 63521936.0,
"sglang:prompt_tokens_histogram_count": 10200.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19044400.0,
"sglang:generation_tokens_total": 2608312.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 78.03897144459188,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 3376.0,
"sglang:kv_evictable_tokens": 675008.0,
"sglang:generation_tokens_total": 2520600.0,
"sglang:prompt_tokens_histogram_sum": 62964908.0,
"sglang:prompt_tokens_histogram_count": 9863.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19704844.0,
"sglang:realtime_tokens_total/prefill_compute": 19919440.0,
"sglang:realtime_tokens_total/decode": 2523811.0,
"sglang:realtime_tokens_total/prefill_cache": 43474144.0,
"sglang:queue_time_seconds_sum": 33448.5658565769,
"sglang:queue_time_seconds_count": 9930.0
}
},
{
"time": 78.0388426752761,
"metrics": {
"sglang:queue_time_seconds_sum": 29969.999658656307,
"sglang:queue_time_seconds_count": 10272.0,
"sglang:realtime_tokens_total/prefill_compute": 19349216.0,
"sglang:realtime_tokens_total/decode": 2619903.0,
"sglang:realtime_tokens_total/prefill_cache": 44673472.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4976.0,
"sglang:kv_evictable_tokens": 601776.0,
"sglang:prompt_tokens_histogram_sum": 63540264.0,
"sglang:prompt_tokens_histogram_count": 10205.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19060168.0,
"sglang:generation_tokens_total": 2609592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 80.03889268543571,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2016.0,
"sglang:kv_evictable_tokens": 652560.0,
"sglang:generation_tokens_total": 2522136.0,
"sglang:prompt_tokens_histogram_sum": 62982999.0,
"sglang:prompt_tokens_histogram_count": 9869.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19719863.0,
"sglang:realtime_tokens_total/prefill_compute": 19952208.0,
"sglang:realtime_tokens_total/decode": 2531485.0,
"sglang:realtime_tokens_total/prefill_cache": 43474656.0,
"sglang:queue_time_seconds_sum": 33468.60225803219,
"sglang:queue_time_seconds_count": 9935.0
}
},
{
"time": 80.03882876504213,
"metrics": {
"sglang:queue_time_seconds_sum": 30113.506458467804,
"sglang:queue_time_seconds_count": 10302.0,
"sglang:realtime_tokens_total/prefill_compute": 19421728.0,
"sglang:realtime_tokens_total/decode": 2624481.0,
"sglang:realtime_tokens_total/prefill_cache": 44748656.0,
"sglang:num_running_reqs": 56.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 8560.0,
"sglang:kv_evictable_tokens": 695008.0,
"sglang:prompt_tokens_histogram_sum": 63771303.0,
"sglang:prompt_tokens_histogram_count": 10235.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19188167.0,
"sglang:generation_tokens_total": 2617272.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 82.04759089648724,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2528.0,
"sglang:kv_evictable_tokens": 578016.0,
"sglang:generation_tokens_total": 2526488.0,
"sglang:prompt_tokens_histogram_sum": 63048521.0,
"sglang:prompt_tokens_histogram_count": 9886.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19766745.0,
"sglang:realtime_tokens_total/prefill_compute": 20033904.0,
"sglang:realtime_tokens_total/decode": 2536119.0,
"sglang:realtime_tokens_total/prefill_cache": 43511024.0,
"sglang:queue_time_seconds_sum": 33549.509866205044,
"sglang:queue_time_seconds_count": 9953.0
}
},
{
"time": 82.04042841214687,
"metrics": {
"sglang:queue_time_seconds_sum": 30210.717580234632,
"sglang:queue_time_seconds_count": 10330.0,
"sglang:realtime_tokens_total/prefill_compute": 19518096.0,
"sglang:realtime_tokens_total/decode": 2628485.0,
"sglang:realtime_tokens_total/prefill_cache": 44871344.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 51.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5936.0,
"sglang:kv_evictable_tokens": 645808.0,
"sglang:prompt_tokens_histogram_sum": 63933533.0,
"sglang:prompt_tokens_histogram_count": 10263.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19269085.0,
"sglang:generation_tokens_total": 2624440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 84.03846007492393,
"metrics": {
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 8800.0,
"sglang:kv_evictable_tokens": 644304.0,
"sglang:generation_tokens_total": 2535704.0,
"sglang:prompt_tokens_histogram_sum": 63325821.0,
"sglang:prompt_tokens_histogram_count": 9922.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19868445.0,
"sglang:realtime_tokens_total/prefill_compute": 20119232.0,
"sglang:realtime_tokens_total/decode": 2539604.0,
"sglang:realtime_tokens_total/prefill_cache": 43648928.0,
"sglang:queue_time_seconds_sum": 33700.91248593386,
"sglang:queue_time_seconds_count": 9985.0
}
},
{
"time": 84.03908150363714,
"metrics": {
"sglang:queue_time_seconds_sum": 30232.52012916282,
"sglang:queue_time_seconds_count": 10335.0,
"sglang:realtime_tokens_total/prefill_compute": 19540656.0,
"sglang:realtime_tokens_total/decode": 2636271.0,
"sglang:realtime_tokens_total/prefill_cache": 44877328.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4400.0,
"sglang:kv_evictable_tokens": 657856.0,
"sglang:prompt_tokens_histogram_sum": 63987279.0,
"sglang:prompt_tokens_histogram_count": 10269.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19313807.0,
"sglang:generation_tokens_total": 2625976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 86.03885192517191,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3680.0,
"sglang:kv_evictable_tokens": 625712.0,
"sglang:generation_tokens_total": 2536984.0,
"sglang:prompt_tokens_histogram_sum": 63350746.0,
"sglang:prompt_tokens_histogram_count": 9927.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19876602.0,
"sglang:realtime_tokens_total/prefill_compute": 20167888.0,
"sglang:realtime_tokens_total/decode": 2546348.0,
"sglang:realtime_tokens_total/prefill_cache": 43654048.0,
"sglang:queue_time_seconds_sum": 33717.491984750144,
"sglang:queue_time_seconds_count": 9993.0
}
},
{
"time": 86.03875549137592,
"metrics": {
"sglang:queue_time_seconds_sum": 30337.329421796836,
"sglang:queue_time_seconds_count": 10354.0,
"sglang:realtime_tokens_total/prefill_compute": 19597152.0,
"sglang:realtime_tokens_total/decode": 2640766.0,
"sglang:realtime_tokens_total/prefill_cache": 44890736.0,
"sglang:num_running_reqs": 50.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2336.0,
"sglang:kv_evictable_tokens": 747504.0,
"sglang:prompt_tokens_histogram_sum": 64149523.0,
"sglang:prompt_tokens_histogram_count": 10299.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19380931.0,
"sglang:generation_tokens_total": 2633656.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 88.03803902305663,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3024.0,
"sglang:kv_evictable_tokens": 641344.0,
"sglang:generation_tokens_total": 2541592.0,
"sglang:prompt_tokens_histogram_sum": 63469719.0,
"sglang:prompt_tokens_histogram_count": 9945.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19960231.0,
"sglang:realtime_tokens_total/prefill_compute": 20233312.0,
"sglang:realtime_tokens_total/decode": 2550945.0,
"sglang:realtime_tokens_total/prefill_cache": 43672384.0,
"sglang:queue_time_seconds_sum": 33799.10378135368,
"sglang:queue_time_seconds_count": 10012.0
}
},
{
"time": 88.03885882068425,
"metrics": {
"sglang:queue_time_seconds_sum": 30526.2797891628,
"sglang:queue_time_seconds_count": 10394.0,
"sglang:realtime_tokens_total/prefill_compute": 19689392.0,
"sglang:realtime_tokens_total/decode": 2644959.0,
"sglang:realtime_tokens_total/prefill_cache": 45086048.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 992.0,
"sglang:kv_evictable_tokens": 676176.0,
"sglang:prompt_tokens_histogram_sum": 64344885.0,
"sglang:prompt_tokens_histogram_count": 10327.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19473541.0,
"sglang:generation_tokens_total": 2640824.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 90.04532844666392,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 1872.0,
"sglang:kv_evictable_tokens": 661376.0,
"sglang:generation_tokens_total": 2549272.0,
"sglang:prompt_tokens_histogram_sum": 63672470.0,
"sglang:prompt_tokens_histogram_count": 9975.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20053014.0,
"sglang:realtime_tokens_total/prefill_compute": 20291072.0,
"sglang:realtime_tokens_total/decode": 2555006.0,
"sglang:realtime_tokens_total/prefill_cache": 43773472.0,
"sglang:queue_time_seconds_sum": 33945.54404719081,
"sglang:queue_time_seconds_count": 10040.0
}
},
{
"time": 90.04292337410152,
"metrics": {
"sglang:queue_time_seconds_sum": 30543.428014442325,
"sglang:queue_time_seconds_count": 10398.0,
"sglang:realtime_tokens_total/prefill_compute": 19716576.0,
"sglang:realtime_tokens_total/decode": 2652618.0,
"sglang:realtime_tokens_total/prefill_cache": 45087584.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 7280.0,
"sglang:kv_evictable_tokens": 660208.0,
"sglang:prompt_tokens_histogram_sum": 64380725.0,
"sglang:prompt_tokens_histogram_count": 10332.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19502885.0,
"sglang:generation_tokens_total": 2642104.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 92.03820726461709,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1056.0,
"sglang:kv_evictable_tokens": 629072.0,
"sglang:generation_tokens_total": 2553112.0,
"sglang:prompt_tokens_histogram_sum": 63778859.0,
"sglang:prompt_tokens_histogram_count": 9990.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20124811.0,
"sglang:realtime_tokens_total/prefill_compute": 20356720.0,
"sglang:realtime_tokens_total/decode": 2560877.0,
"sglang:realtime_tokens_total/prefill_cache": 43894224.0,
"sglang:queue_time_seconds_sum": 34000.278683867306,
"sglang:queue_time_seconds_count": 10057.0
}
},
{
"time": 92.03857504297048,
"metrics": {
"sglang:queue_time_seconds_sum": 30703.94057590142,
"sglang:queue_time_seconds_count": 10433.0,
"sglang:realtime_tokens_total/prefill_compute": 19797472.0,
"sglang:realtime_tokens_total/decode": 2657819.0,
"sglang:realtime_tokens_total/prefill_cache": 45177872.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1456.0,
"sglang:kv_evictable_tokens": 689696.0,
"sglang:prompt_tokens_histogram_sum": 64572837.0,
"sglang:prompt_tokens_histogram_count": 10366.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19593589.0,
"sglang:generation_tokens_total": 2650808.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 94.03798113390803,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 2208.0,
"sglang:kv_evictable_tokens": 609104.0,
"sglang:generation_tokens_total": 2556696.0,
"sglang:prompt_tokens_histogram_sum": 63851209.0,
"sglang:prompt_tokens_histogram_count": 10004.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20179849.0,
"sglang:realtime_tokens_total/prefill_compute": 20411632.0,
"sglang:realtime_tokens_total/decode": 2566847.0,
"sglang:realtime_tokens_total/prefill_cache": 43925232.0,
"sglang:queue_time_seconds_sum": 34059.42255511787,
"sglang:queue_time_seconds_count": 10071.0
}
},
{
"time": 94.03680763673037,
"metrics": {
"sglang:queue_time_seconds_sum": 30796.781476014294,
"sglang:queue_time_seconds_count": 10458.0,
"sglang:realtime_tokens_total/prefill_compute": 19842064.0,
"sglang:realtime_tokens_total/decode": 2663807.0,
"sglang:realtime_tokens_total/prefill_cache": 45355152.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1104.0,
"sglang:kv_evictable_tokens": 635552.0,
"sglang:prompt_tokens_histogram_sum": 64730600.0,
"sglang:prompt_tokens_histogram_count": 10391.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19644552.0,
"sglang:generation_tokens_total": 2657208.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 96.03801107872277,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 7888.0,
"sglang:kv_evictable_tokens": 599632.0,
"sglang:generation_tokens_total": 2565656.0,
"sglang:prompt_tokens_histogram_sum": 64091310.0,
"sglang:prompt_tokens_histogram_count": 10039.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20258430.0,
"sglang:realtime_tokens_total/prefill_compute": 20474464.0,
"sglang:realtime_tokens_total/decode": 2571345.0,
"sglang:realtime_tokens_total/prefill_cache": 44039520.0,
"sglang:queue_time_seconds_sum": 34201.511829864234,
"sglang:queue_time_seconds_count": 10104.0
}
},
{
"time": 96.0395058421418,
"metrics": {
"sglang:queue_time_seconds_sum": 30834.435389557853,
"sglang:queue_time_seconds_count": 10468.0,
"sglang:realtime_tokens_total/prefill_compute": 19874032.0,
"sglang:realtime_tokens_total/decode": 2671029.0,
"sglang:realtime_tokens_total/prefill_cache": 45380304.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 3040.0,
"sglang:kv_evictable_tokens": 644224.0,
"sglang:prompt_tokens_histogram_sum": 64801392.0,
"sglang:prompt_tokens_histogram_count": 10401.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19699456.0,
"sglang:generation_tokens_total": 2659768.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 98.03837790060788,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 6576.0,
"sglang:kv_evictable_tokens": 632576.0,
"sglang:generation_tokens_total": 2569496.0,
"sglang:prompt_tokens_histogram_sum": 64207589.0,
"sglang:prompt_tokens_histogram_count": 10054.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20313365.0,
"sglang:realtime_tokens_total/prefill_compute": 20604528.0,
"sglang:realtime_tokens_total/decode": 2573610.0,
"sglang:realtime_tokens_total/prefill_cache": 44069680.0,
"sglang:queue_time_seconds_sum": 34247.84816603083,
"sglang:queue_time_seconds_count": 10120.0
}
},
{
"time": 98.0369288502261,
"metrics": {
"sglang:queue_time_seconds_sum": 30953.09666461032,
"sglang:queue_time_seconds_count": 10493.0,
"sglang:realtime_tokens_total/prefill_compute": 19987424.0,
"sglang:realtime_tokens_total/decode": 2674054.0,
"sglang:realtime_tokens_total/prefill_cache": 45419600.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 6528.0,
"sglang:kv_evictable_tokens": 618720.0,
"sglang:prompt_tokens_histogram_sum": 64930343.0,
"sglang:prompt_tokens_histogram_count": 10427.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19752471.0,
"sglang:generation_tokens_total": 2666424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 100.04968266747892,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6816.0,
"sglang:kv_evictable_tokens": 649808.0,
"sglang:generation_tokens_total": 2571544.0,
"sglang:prompt_tokens_histogram_sum": 64266303.0,
"sglang:prompt_tokens_histogram_count": 10062.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20355055.0,
"sglang:realtime_tokens_total/prefill_compute": 20625296.0,
"sglang:realtime_tokens_total/decode": 2581368.0,
"sglang:realtime_tokens_total/prefill_cache": 44083152.0,
"sglang:queue_time_seconds_sum": 34287.13955052942,
"sglang:queue_time_seconds_count": 10128.0
}
},
{
"time": 100.03785149380565,
"metrics": {
"sglang:queue_time_seconds_sum": 31074.382704447955,
"sglang:queue_time_seconds_count": 10522.0,
"sglang:realtime_tokens_total/prefill_compute": 20044752.0,
"sglang:realtime_tokens_total/decode": 2679463.0,
"sglang:realtime_tokens_total/prefill_cache": 45572864.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 2992.0,
"sglang:kv_evictable_tokens": 638688.0,
"sglang:prompt_tokens_histogram_sum": 65152114.0,
"sglang:prompt_tokens_histogram_count": 10455.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19796962.0,
"sglang:generation_tokens_total": 2673592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 102.03988311532885,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4256.0,
"sglang:kv_evictable_tokens": 683312.0,
"sglang:generation_tokens_total": 2582040.0,
"sglang:prompt_tokens_histogram_sum": 64512304.0,
"sglang:prompt_tokens_histogram_count": 10103.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20448768.0,
"sglang:realtime_tokens_total/prefill_compute": 20675264.0,
"sglang:realtime_tokens_total/decode": 2587586.0,
"sglang:realtime_tokens_total/prefill_cache": 44209472.0,
"sglang:queue_time_seconds_sum": 34462.29970825277,
"sglang:queue_time_seconds_count": 10165.0
}
},
{
"time": 102.03969628270715,
"metrics": {
"sglang:queue_time_seconds_sum": 31098.67178841494,
"sglang:queue_time_seconds_count": 10528.0,
"sglang:realtime_tokens_total/prefill_compute": 20076160.0,
"sglang:realtime_tokens_total/decode": 2686541.0,
"sglang:realtime_tokens_total/prefill_cache": 45584816.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 4816.0,
"sglang:kv_evictable_tokens": 627776.0,
"sglang:prompt_tokens_histogram_sum": 65193304.0,
"sglang:prompt_tokens_histogram_count": 10462.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19814536.0,
"sglang:generation_tokens_total": 2675384.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 104.03684307914227,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 11376.0,
"sglang:kv_evictable_tokens": 667936.0,
"sglang:generation_tokens_total": 2585624.0,
"sglang:prompt_tokens_histogram_sum": 64630603.0,
"sglang:prompt_tokens_histogram_count": 10117.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20560923.0,
"sglang:realtime_tokens_total/prefill_compute": 20755792.0,
"sglang:realtime_tokens_total/decode": 2592128.0,
"sglang:realtime_tokens_total/prefill_cache": 44299424.0,
"sglang:queue_time_seconds_sum": 34529.358732366934,
"sglang:queue_time_seconds_count": 10183.0
}
},
{
"time": 104.03598123323172,
"metrics": {
"sglang:queue_time_seconds_sum": 31234.24211813882,
"sglang:queue_time_seconds_count": 10557.0,
"sglang:realtime_tokens_total/prefill_compute": 20171088.0,
"sglang:realtime_tokens_total/decode": 2690469.0,
"sglang:realtime_tokens_total/prefill_cache": 45668016.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2112.0,
"sglang:kv_evictable_tokens": 622032.0,
"sglang:prompt_tokens_histogram_sum": 65382471.0,
"sglang:prompt_tokens_histogram_count": 10494.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19945975.0,
"sglang:generation_tokens_total": 2683576.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 106.03889478649944,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 9792.0,
"sglang:kv_evictable_tokens": 654336.0,
"sglang:generation_tokens_total": 2588952.0,
"sglang:prompt_tokens_histogram_sum": 64686708.0,
"sglang:prompt_tokens_histogram_count": 10130.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20590084.0,
"sglang:realtime_tokens_total/prefill_compute": 20807040.0,
"sglang:realtime_tokens_total/decode": 2598541.0,
"sglang:realtime_tokens_total/prefill_cache": 44305568.0,
"sglang:queue_time_seconds_sum": 34593.446827942505,
"sglang:queue_time_seconds_count": 10196.0
}
},
{
"time": 106.04215615335852,
"metrics": {
"sglang:queue_time_seconds_sum": 31332.34443395585,
"sglang:queue_time_seconds_count": 10585.0,
"sglang:realtime_tokens_total/prefill_compute": 20259088.0,
"sglang:realtime_tokens_total/decode": 2694505.0,
"sglang:realtime_tokens_total/prefill_cache": 45766096.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 10592.0,
"sglang:kv_evictable_tokens": 643616.0,
"sglang:prompt_tokens_histogram_sum": 65572226.0,
"sglang:prompt_tokens_histogram_count": 10519.0,
"sglang:uncached_prompt_tokens_histogram_sum": 19999362.0,
"sglang:generation_tokens_total": 2689976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 108.03738807607442,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 5408.0,
"sglang:kv_evictable_tokens": 614144.0,
"sglang:generation_tokens_total": 2596376.0,
"sglang:prompt_tokens_histogram_sum": 64840949.0,
"sglang:prompt_tokens_histogram_count": 10159.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20631477.0,
"sglang:realtime_tokens_total/prefill_compute": 20866928.0,
"sglang:realtime_tokens_total/decode": 2603552.0,
"sglang:realtime_tokens_total/prefill_cache": 44442304.0,
"sglang:queue_time_seconds_sum": 34743.83628684096,
"sglang:queue_time_seconds_count": 10226.0
}
},
{
"time": 108.03683128859848,
"metrics": {
"sglang:queue_time_seconds_sum": 31355.205819701776,
"sglang:queue_time_seconds_count": 10591.0,
"sglang:realtime_tokens_total/prefill_compute": 20265472.0,
"sglang:realtime_tokens_total/decode": 2702595.0,
"sglang:realtime_tokens_total/prefill_cache": 45787936.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 4368.0,
"sglang:kv_evictable_tokens": 644064.0,
"sglang:prompt_tokens_histogram_sum": 65615574.0,
"sglang:prompt_tokens_histogram_count": 10525.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20030758.0,
"sglang:generation_tokens_total": 2691512.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 110.04697145801038,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1792.0,
"sglang:kv_evictable_tokens": 671776.0,
"sglang:generation_tokens_total": 2601752.0,
"sglang:prompt_tokens_histogram_sum": 65011361.0,
"sglang:prompt_tokens_histogram_count": 10180.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20711937.0,
"sglang:realtime_tokens_total/prefill_compute": 20925120.0,
"sglang:realtime_tokens_total/decode": 2609931.0,
"sglang:realtime_tokens_total/prefill_cache": 44515824.0,
"sglang:queue_time_seconds_sum": 34824.05143249966,
"sglang:queue_time_seconds_count": 10247.0
}
},
{
"time": 110.03688876051456,
"metrics": {
"sglang:queue_time_seconds_sum": 31465.331302516162,
"sglang:queue_time_seconds_count": 10614.0,
"sglang:realtime_tokens_total/prefill_compute": 20369984.0,
"sglang:realtime_tokens_total/decode": 2706058.0,
"sglang:realtime_tokens_total/prefill_cache": 45844384.0,
"sglang:num_running_reqs": 53.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2496.0,
"sglang:kv_evictable_tokens": 669104.0,
"sglang:prompt_tokens_histogram_sum": 65793549.0,
"sglang:prompt_tokens_histogram_count": 10554.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20125533.0,
"sglang:generation_tokens_total": 2698936.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 112.03679905831814,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1056.0,
"sglang:kv_evictable_tokens": 682080.0,
"sglang:generation_tokens_total": 2605592.0,
"sglang:prompt_tokens_histogram_sum": 65100731.0,
"sglang:prompt_tokens_histogram_count": 10195.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20793627.0,
"sglang:realtime_tokens_total/prefill_compute": 20987520.0,
"sglang:realtime_tokens_total/decode": 2615647.0,
"sglang:realtime_tokens_total/prefill_cache": 44521968.0,
"sglang:queue_time_seconds_sum": 34895.6041730009,
"sglang:queue_time_seconds_count": 10261.0
}
},
{
"time": 112.03720400575548,
"metrics": {
"sglang:queue_time_seconds_sum": 31571.654055333696,
"sglang:queue_time_seconds_count": 10643.0,
"sglang:realtime_tokens_total/prefill_compute": 20474192.0,
"sglang:realtime_tokens_total/decode": 2708463.0,
"sglang:realtime_tokens_total/prefill_cache": 45981408.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 12592.0,
"sglang:kv_evictable_tokens": 578560.0,
"sglang:prompt_tokens_histogram_sum": 65960968.0,
"sglang:prompt_tokens_histogram_count": 10580.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20195896.0,
"sglang:generation_tokens_total": 2705592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 114.03594157006592,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 1312.0,
"sglang:kv_evictable_tokens": 727504.0,
"sglang:generation_tokens_total": 2614808.0,
"sglang:prompt_tokens_histogram_sum": 65332849.0,
"sglang:prompt_tokens_histogram_count": 10231.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20852865.0,
"sglang:realtime_tokens_total/prefill_compute": 21073168.0,
"sglang:realtime_tokens_total/decode": 2620400.0,
"sglang:realtime_tokens_total/prefill_cache": 44637184.0,
"sglang:queue_time_seconds_sum": 35090.965511444956,
"sglang:queue_time_seconds_count": 10298.0
}
},
{
"time": 114.03655360545963,
"metrics": {
"sglang:queue_time_seconds_sum": 31585.531823524274,
"sglang:queue_time_seconds_count": 10649.0,
"sglang:realtime_tokens_total/prefill_compute": 20524816.0,
"sglang:realtime_tokens_total/decode": 2714412.0,
"sglang:realtime_tokens_total/prefill_cache": 46001136.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 2800.0,
"sglang:kv_evictable_tokens": 552592.0,
"sglang:prompt_tokens_histogram_sum": 65979518.0,
"sglang:prompt_tokens_histogram_count": 10582.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20213422.0,
"sglang:generation_tokens_total": 2706104.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 116.03640917036682,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 4640.0,
"sglang:kv_evictable_tokens": 688480.0,
"sglang:generation_tokens_total": 2618136.0,
"sglang:prompt_tokens_histogram_sum": 65396819.0,
"sglang:prompt_tokens_histogram_count": 10244.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20880995.0,
"sglang:realtime_tokens_total/prefill_compute": 21116880.0,
"sglang:realtime_tokens_total/decode": 2627235.0,
"sglang:realtime_tokens_total/prefill_cache": 44689744.0,
"sglang:queue_time_seconds_sum": 35148.209905106574,
"sglang:queue_time_seconds_count": 10311.0
}
},
{
"time": 116.03717764094472,
"metrics": {
"sglang:queue_time_seconds_sum": 31628.55605234299,
"sglang:queue_time_seconds_count": 10658.0,
"sglang:realtime_tokens_total/prefill_compute": 20573136.0,
"sglang:realtime_tokens_total/decode": 2720032.0,
"sglang:realtime_tokens_total/prefill_cache": 46032144.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 1344.0,
"sglang:kv_evictable_tokens": 545072.0,
"sglang:prompt_tokens_histogram_sum": 66054633.0,
"sglang:prompt_tokens_histogram_count": 10592.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20263625.0,
"sglang:generation_tokens_total": 2708664.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 118.03787629492581,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 9888.0,
"sglang:kv_evictable_tokens": 680048.0,
"sglang:generation_tokens_total": 2623256.0,
"sglang:prompt_tokens_histogram_sum": 65521904.0,
"sglang:prompt_tokens_histogram_count": 10264.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20984688.0,
"sglang:realtime_tokens_total/prefill_compute": 21194976.0,
"sglang:realtime_tokens_total/decode": 2632429.0,
"sglang:realtime_tokens_total/prefill_cache": 44712144.0,
"sglang:queue_time_seconds_sum": 35249.165722516365,
"sglang:queue_time_seconds_count": 10331.0
}
},
{
"time": 118.0396192362532,
"metrics": {
"sglang:queue_time_seconds_sum": 31801.940376540646,
"sglang:queue_time_seconds_count": 10697.0,
"sglang:realtime_tokens_total/prefill_compute": 20665072.0,
"sglang:realtime_tokens_total/decode": 2723496.0,
"sglang:realtime_tokens_total/prefill_cache": 46178208.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 8512.0,
"sglang:kv_evictable_tokens": 634176.0,
"sglang:prompt_tokens_histogram_sum": 66380559.0,
"sglang:prompt_tokens_histogram_count": 10630.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20402223.0,
"sglang:generation_tokens_total": 2718392.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 120.03760541696101,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 6864.0,
"sglang:kv_evictable_tokens": 653856.0,
"sglang:generation_tokens_total": 2631192.0,
"sglang:prompt_tokens_histogram_sum": 65666003.0,
"sglang:prompt_tokens_histogram_count": 10295.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21028819.0,
"sglang:realtime_tokens_total/prefill_compute": 21284208.0,
"sglang:realtime_tokens_total/decode": 2636551.0,
"sglang:realtime_tokens_total/prefill_cache": 44824800.0,
"sglang:queue_time_seconds_sum": 35413.1130489707,
"sglang:queue_time_seconds_count": 10362.0
}
},
{
"time": 120.03740714397281,
"metrics": {
"sglang:queue_time_seconds_sum": 31842.737949837,
"sglang:queue_time_seconds_count": 10713.0,
"sglang:realtime_tokens_total/prefill_compute": 20736560.0,
"sglang:realtime_tokens_total/decode": 2728600.0,
"sglang:realtime_tokens_total/prefill_cache": 46192864.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 3856.0,
"sglang:kv_evictable_tokens": 652336.0,
"sglang:prompt_tokens_histogram_sum": 66479975.0,
"sglang:prompt_tokens_histogram_count": 10646.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20478839.0,
"sglang:generation_tokens_total": 2722488.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 122.03667895961553,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1312.0,
"sglang:kv_evictable_tokens": 633600.0,
"sglang:generation_tokens_total": 2634520.0,
"sglang:prompt_tokens_histogram_sum": 65762223.0,
"sglang:prompt_tokens_histogram_count": 10308.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21072479.0,
"sglang:realtime_tokens_total/prefill_compute": 21304720.0,
"sglang:realtime_tokens_total/decode": 2644282.0,
"sglang:realtime_tokens_total/prefill_cache": 44923456.0,
"sglang:queue_time_seconds_sum": 35471.008513227105,
"sglang:queue_time_seconds_count": 10375.0
}
},
{
"time": 122.03804024960846,
"metrics": {
"sglang:queue_time_seconds_sum": 31893.65362179838,
"sglang:queue_time_seconds_count": 10725.0,
"sglang:realtime_tokens_total/prefill_compute": 20747056.0,
"sglang:realtime_tokens_total/decode": 2736972.0,
"sglang:realtime_tokens_total/prefill_cache": 46228976.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3280.0,
"sglang:kv_evictable_tokens": 684592.0,
"sglang:prompt_tokens_histogram_sum": 66564626.0,
"sglang:prompt_tokens_histogram_count": 10658.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20530706.0,
"sglang:generation_tokens_total": 2725560.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 124.03672164026648,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 5472.0,
"sglang:kv_evictable_tokens": 648768.0,
"sglang:generation_tokens_total": 2639640.0,
"sglang:prompt_tokens_histogram_sum": 65907488.0,
"sglang:prompt_tokens_histogram_count": 10328.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21171344.0,
"sglang:realtime_tokens_total/prefill_compute": 21387968.0,
"sglang:realtime_tokens_total/decode": 2648772.0,
"sglang:realtime_tokens_total/prefill_cache": 44947120.0,
"sglang:queue_time_seconds_sum": 35556.04445906449,
"sglang:queue_time_seconds_count": 10394.0
}
},
{
"time": 124.03866485413164,
"metrics": {
"sglang:queue_time_seconds_sum": 32043.145533763804,
"sglang:queue_time_seconds_count": 10761.0,
"sglang:realtime_tokens_total/prefill_compute": 20859296.0,
"sglang:realtime_tokens_total/decode": 2739750.0,
"sglang:realtime_tokens_total/prefill_cache": 46416272.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3584.0,
"sglang:kv_evictable_tokens": 625392.0,
"sglang:prompt_tokens_histogram_sum": 66797124.0,
"sglang:prompt_tokens_histogram_count": 10694.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20618916.0,
"sglang:generation_tokens_total": 2734776.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 126.0364542324096,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1712.0,
"sglang:kv_evictable_tokens": 590896.0,
"sglang:generation_tokens_total": 2647576.0,
"sglang:prompt_tokens_histogram_sum": 66087259.0,
"sglang:prompt_tokens_histogram_count": 10359.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21243419.0,
"sglang:realtime_tokens_total/prefill_compute": 21473632.0,
"sglang:realtime_tokens_total/decode": 2652826.0,
"sglang:realtime_tokens_total/prefill_cache": 45046960.0,
"sglang:queue_time_seconds_sum": 35692.711906770244,
"sglang:queue_time_seconds_count": 10424.0
}
},
{
"time": 126.03726299013942,
"metrics": {
"sglang:queue_time_seconds_sum": 32093.33377541229,
"sglang:queue_time_seconds_count": 10777.0,
"sglang:realtime_tokens_total/prefill_compute": 20894320.0,
"sglang:realtime_tokens_total/decode": 2746837.0,
"sglang:realtime_tokens_total/prefill_cache": 46440336.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1184.0,
"sglang:kv_evictable_tokens": 653856.0,
"sglang:prompt_tokens_histogram_sum": 66883225.0,
"sglang:prompt_tokens_histogram_count": 10710.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20690361.0,
"sglang:generation_tokens_total": 2738872.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 128.03720145020634,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 6672.0,
"sglang:kv_evictable_tokens": 582208.0,
"sglang:generation_tokens_total": 2650904.0,
"sglang:prompt_tokens_histogram_sum": 66183465.0,
"sglang:prompt_tokens_histogram_count": 10372.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21260009.0,
"sglang:realtime_tokens_total/prefill_compute": 21532448.0,
"sglang:realtime_tokens_total/decode": 2658187.0,
"sglang:realtime_tokens_total/prefill_cache": 45163376.0,
"sglang:queue_time_seconds_sum": 35733.33645063266,
"sglang:queue_time_seconds_count": 10439.0
}
},
{
"time": 128.03977923002094,
"metrics": {
"sglang:queue_time_seconds_sum": 32140.874975477345,
"sglang:queue_time_seconds_count": 10786.0,
"sglang:realtime_tokens_total/prefill_compute": 20947840.0,
"sglang:realtime_tokens_total/decode": 2753021.0,
"sglang:realtime_tokens_total/prefill_cache": 46444944.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 3568.0,
"sglang:kv_evictable_tokens": 612272.0,
"sglang:prompt_tokens_histogram_sum": 66908308.0,
"sglang:prompt_tokens_histogram_count": 10719.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20697124.0,
"sglang:generation_tokens_total": 2741176.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 130.03751973249018,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2944.0,
"sglang:kv_evictable_tokens": 571072.0,
"sglang:generation_tokens_total": 2653976.0,
"sglang:prompt_tokens_histogram_sum": 66249329.0,
"sglang:prompt_tokens_histogram_count": 10384.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21306161.0,
"sglang:realtime_tokens_total/prefill_compute": 21568704.0,
"sglang:realtime_tokens_total/decode": 2664676.0,
"sglang:realtime_tokens_total/prefill_cache": 45202880.0,
"sglang:queue_time_seconds_sum": 35780.35512830131,
"sglang:queue_time_seconds_count": 10451.0
}
},
{
"time": 130.04238543193787,
"metrics": {
"sglang:queue_time_seconds_sum": 32355.09337311238,
"sglang:queue_time_seconds_count": 10829.0,
"sglang:realtime_tokens_total/prefill_compute": 21041088.0,
"sglang:realtime_tokens_total/decode": 2757011.0,
"sglang:realtime_tokens_total/prefill_cache": 46573744.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 8224.0,
"sglang:kv_evictable_tokens": 723968.0,
"sglang:prompt_tokens_histogram_sum": 67240253.0,
"sglang:prompt_tokens_histogram_count": 10762.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20821421.0,
"sglang:generation_tokens_total": 2752184.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 132.03721402026713,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 10096.0,
"sglang:kv_evictable_tokens": 583584.0,
"sglang:generation_tokens_total": 2660888.0,
"sglang:prompt_tokens_histogram_sum": 66452030.0,
"sglang:prompt_tokens_histogram_count": 10411.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21408878.0,
"sglang:realtime_tokens_total/prefill_compute": 21656368.0,
"sglang:realtime_tokens_total/decode": 2668599.0,
"sglang:realtime_tokens_total/prefill_cache": 45296640.0,
"sglang:queue_time_seconds_sum": 35902.53496227879,
"sglang:queue_time_seconds_count": 10478.0
}
},
{
"time": 132.03756059799343,
"metrics": {
"sglang:queue_time_seconds_sum": 32395.977020472288,
"sglang:queue_time_seconds_count": 10841.0,
"sglang:realtime_tokens_total/prefill_compute": 21066352.0,
"sglang:realtime_tokens_total/decode": 2765382.0,
"sglang:realtime_tokens_total/prefill_cache": 46622160.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 58.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2160.0,
"sglang:kv_evictable_tokens": 701728.0,
"sglang:prompt_tokens_histogram_sum": 67288228.0,
"sglang:prompt_tokens_histogram_count": 10774.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20847892.0,
"sglang:generation_tokens_total": 2755256.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 134.03609293606132,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 1568.0,
"sglang:kv_evictable_tokens": 602544.0,
"sglang:generation_tokens_total": 2667288.0,
"sglang:prompt_tokens_histogram_sum": 66650789.0,
"sglang:prompt_tokens_histogram_count": 10436.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21487413.0,
"sglang:realtime_tokens_total/prefill_compute": 21742208.0,
"sglang:realtime_tokens_total/decode": 2672605.0,
"sglang:realtime_tokens_total/prefill_cache": 45410320.0,
"sglang:queue_time_seconds_sum": 35985.990812419914,
"sglang:queue_time_seconds_count": 10503.0
}
},
{
"time": 134.0391803989187,
"metrics": {
"sglang:queue_time_seconds_sum": 32463.96070827078,
"sglang:queue_time_seconds_count": 10855.0,
"sglang:realtime_tokens_total/prefill_compute": 21146992.0,
"sglang:realtime_tokens_total/decode": 2770257.0,
"sglang:realtime_tokens_total/prefill_cache": 46632464.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1008.0,
"sglang:kv_evictable_tokens": 691408.0,
"sglang:prompt_tokens_histogram_sum": 67369596.0,
"sglang:prompt_tokens_histogram_count": 10788.0,
"sglang:uncached_prompt_tokens_histogram_sum": 20922092.0,
"sglang:generation_tokens_total": 2758840.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 136.036342096515,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 4976.0,
"sglang:kv_evictable_tokens": 581296.0,
"sglang:generation_tokens_total": 2668568.0,
"sglang:prompt_tokens_histogram_sum": 66684597.0,
"sglang:prompt_tokens_histogram_count": 10441.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21502549.0,
"sglang:realtime_tokens_total/prefill_compute": 21775376.0,
"sglang:realtime_tokens_total/decode": 2679241.0,
"sglang:realtime_tokens_total/prefill_cache": 45414128.0,
"sglang:queue_time_seconds_sum": 36006.65638878383,
"sglang:queue_time_seconds_count": 10508.0
}
},
{
"time": 136.038464079611,
"metrics": {
"sglang:queue_time_seconds_sum": 32674.312285372987,
"sglang:queue_time_seconds_count": 10905.0,
"sglang:realtime_tokens_total/prefill_compute": 21224176.0,
"sglang:realtime_tokens_total/decode": 2774878.0,
"sglang:realtime_tokens_total/prefill_cache": 46852112.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 39.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 6896.0,
"sglang:kv_evictable_tokens": 669072.0,
"sglang:prompt_tokens_histogram_sum": 67641841.0,
"sglang:prompt_tokens_histogram_count": 10838.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21019681.0,
"sglang:generation_tokens_total": 2771640.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 138.03635835368186,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 1808.0,
"sglang:kv_evictable_tokens": 586224.0,
"sglang:generation_tokens_total": 2677016.0,
"sglang:prompt_tokens_histogram_sum": 66907795.0,
"sglang:prompt_tokens_histogram_count": 10474.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21611155.0,
"sglang:realtime_tokens_total/prefill_compute": 21819040.0,
"sglang:realtime_tokens_total/decode": 2684574.0,
"sglang:realtime_tokens_total/prefill_cache": 45529328.0,
"sglang:queue_time_seconds_sum": 36153.429444056004,
"sglang:queue_time_seconds_count": 10540.0
}
},
{
"time": 138.03720700088888,
"metrics": {
"sglang:queue_time_seconds_sum": 32683.690956265666,
"sglang:queue_time_seconds_count": 10907.0,
"sglang:realtime_tokens_total/prefill_compute": 21232816.0,
"sglang:realtime_tokens_total/decode": 2783371.0,
"sglang:realtime_tokens_total/prefill_cache": 46852624.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 2224.0,
"sglang:kv_evictable_tokens": 674080.0,
"sglang:prompt_tokens_histogram_sum": 67673475.0,
"sglang:prompt_tokens_histogram_count": 10841.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21050291.0,
"sglang:generation_tokens_total": 2772408.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 140.03783564083278,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3232.0,
"sglang:kv_evictable_tokens": 627328.0,
"sglang:generation_tokens_total": 2683672.0,
"sglang:prompt_tokens_histogram_sum": 67107187.0,
"sglang:prompt_tokens_histogram_count": 10500.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21696867.0,
"sglang:realtime_tokens_total/prefill_compute": 21916416.0,
"sglang:realtime_tokens_total/decode": 2688515.0,
"sglang:realtime_tokens_total/prefill_cache": 45664848.0,
"sglang:queue_time_seconds_sum": 36225.609137274325,
"sglang:queue_time_seconds_count": 10567.0
}
},
{
"time": 140.0382657237351,
"metrics": {
"sglang:queue_time_seconds_sum": 32792.633826583624,
"sglang:queue_time_seconds_count": 10929.0,
"sglang:realtime_tokens_total/prefill_compute": 21322448.0,
"sglang:realtime_tokens_total/decode": 2787841.0,
"sglang:realtime_tokens_total/prefill_cache": 46862864.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1120.0,
"sglang:kv_evictable_tokens": 654096.0,
"sglang:prompt_tokens_histogram_sum": 67812522.0,
"sglang:prompt_tokens_histogram_count": 10873.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21122282.0,
"sglang:generation_tokens_total": 2780600.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 142.03785524703562,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 6224.0,
"sglang:kv_evictable_tokens": 612272.0,
"sglang:generation_tokens_total": 2684952.0,
"sglang:prompt_tokens_histogram_sum": 67151283.0,
"sglang:prompt_tokens_histogram_count": 10505.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21731187.0,
"sglang:realtime_tokens_total/prefill_compute": 21946688.0,
"sglang:realtime_tokens_total/decode": 2695741.0,
"sglang:realtime_tokens_total/prefill_cache": 45684912.0,
"sglang:queue_time_seconds_sum": 36241.94574967399,
"sglang:queue_time_seconds_count": 10571.0
}
},
{
"time": 142.03761593345553,
"metrics": {
"sglang:queue_time_seconds_sum": 32983.29601790104,
"sglang:queue_time_seconds_count": 10969.0,
"sglang:realtime_tokens_total/prefill_compute": 21430096.0,
"sglang:realtime_tokens_total/decode": 2790883.0,
"sglang:realtime_tokens_total/prefill_cache": 47033184.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 8672.0,
"sglang:kv_evictable_tokens": 657840.0,
"sglang:prompt_tokens_histogram_sum": 68029347.0,
"sglang:prompt_tokens_histogram_count": 10902.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21177235.0,
"sglang:generation_tokens_total": 2788024.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 144.04417299013585,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 40.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 650496.0,
"sglang:generation_tokens_total": 2693400.0,
"sglang:prompt_tokens_histogram_sum": 67371184.0,
"sglang:prompt_tokens_histogram_count": 10538.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21784992.0,
"sglang:realtime_tokens_total/prefill_compute": 22007200.0,
"sglang:realtime_tokens_total/decode": 2701186.0,
"sglang:realtime_tokens_total/prefill_cache": 45817248.0,
"sglang:queue_time_seconds_sum": 36386.03715084866,
"sglang:queue_time_seconds_count": 10605.0
}
},
{
"time": 144.03886085562408,
"metrics": {
"sglang:queue_time_seconds_sum": 32987.19792520255,
"sglang:queue_time_seconds_count": 10970.0,
"sglang:realtime_tokens_total/prefill_compute": 21445472.0,
"sglang:realtime_tokens_total/decode": 2799202.0,
"sglang:realtime_tokens_total/prefill_cache": 47034208.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4864.0,
"sglang:kv_evictable_tokens": 657696.0,
"sglang:prompt_tokens_histogram_sum": 68038495.0,
"sglang:prompt_tokens_histogram_count": 10903.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21185871.0,
"sglang:generation_tokens_total": 2788280.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 146.03831377532333,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 10896.0,
"sglang:kv_evictable_tokens": 582672.0,
"sglang:generation_tokens_total": 2699544.0,
"sglang:prompt_tokens_histogram_sum": 67527286.0,
"sglang:prompt_tokens_histogram_count": 10562.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21869030.0,
"sglang:realtime_tokens_total/prefill_compute": 22127584.0,
"sglang:realtime_tokens_total/decode": 2702757.0,
"sglang:realtime_tokens_total/prefill_cache": 45904416.0,
"sglang:queue_time_seconds_sum": 36450.8948802799,
"sglang:queue_time_seconds_count": 10629.0
}
},
{
"time": 146.03820923063904,
"metrics": {
"sglang:queue_time_seconds_sum": 33102.15857915953,
"sglang:queue_time_seconds_count": 10994.0,
"sglang:realtime_tokens_total/prefill_compute": 21515216.0,
"sglang:realtime_tokens_total/decode": 2804207.0,
"sglang:realtime_tokens_total/prefill_cache": 47071712.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 53.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 2416.0,
"sglang:kv_evictable_tokens": 650704.0,
"sglang:prompt_tokens_histogram_sum": 68246849.0,
"sglang:prompt_tokens_histogram_count": 10937.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21354865.0,
"sglang:generation_tokens_total": 2796984.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 148.03765044827014,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 47.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2032.0,
"sglang:kv_evictable_tokens": 578576.0,
"sglang:generation_tokens_total": 2700056.0,
"sglang:prompt_tokens_histogram_sum": 67535682.0,
"sglang:prompt_tokens_histogram_count": 10564.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21870834.0,
"sglang:realtime_tokens_total/prefill_compute": 22151984.0,
"sglang:realtime_tokens_total/decode": 2710179.0,
"sglang:realtime_tokens_total/prefill_cache": 45905952.0,
"sglang:queue_time_seconds_sum": 36456.36408342328,
"sglang:queue_time_seconds_count": 10631.0
}
},
{
"time": 148.0404021004215,
"metrics": {
"sglang:queue_time_seconds_sum": 33292.294479009695,
"sglang:queue_time_seconds_count": 11031.0,
"sglang:realtime_tokens_total/prefill_compute": 21629616.0,
"sglang:realtime_tokens_total/decode": 2806928.0,
"sglang:realtime_tokens_total/prefill_cache": 47216976.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 663392.0,
"sglang:prompt_tokens_histogram_sum": 68416063.0,
"sglang:prompt_tokens_histogram_count": 10965.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21382879.0,
"sglang:generation_tokens_total": 2804152.0
}
}
]
},
{
"label": "score_end",
"workers": [
{
"time": 150.00687798764557,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2080.0,
"sglang:kv_evictable_tokens": 626560.0,
"sglang:generation_tokens_total": 2706456.0,
"sglang:prompt_tokens_histogram_sum": 67692678.0,
"sglang:prompt_tokens_histogram_count": 10589.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21928518.0,
"sglang:realtime_tokens_total/prefill_compute": 22206560.0,
"sglang:realtime_tokens_total/decode": 2715831.0,
"sglang:realtime_tokens_total/prefill_cache": 45958608.0,
"sglang:queue_time_seconds_sum": 36584.29360806104,
"sglang:queue_time_seconds_count": 10656.0
}
},
{
"time": 150.00721210241318,
"metrics": {
"sglang:queue_time_seconds_sum": 33301.935865178704,
"sglang:queue_time_seconds_count": 11034.0,
"sglang:realtime_tokens_total/prefill_compute": 21636624.0,
"sglang:realtime_tokens_total/decode": 2815565.0,
"sglang:realtime_tokens_total/prefill_cache": 47218512.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 6000.0,
"sglang:kv_evictable_tokens": 675296.0,
"sglang:prompt_tokens_histogram_sum": 68432455.0,
"sglang:prompt_tokens_histogram_count": 10967.0,
"sglang:uncached_prompt_tokens_histogram_sum": 21398247.0,
"sglang:generation_tokens_total": 2804664.0
}
}
]
},
{
"label": "drained",
"workers": [
{
"time": 189.5855828402564,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1040.0,
"sglang:kv_evictable_tokens": 1047536.0,
"sglang:generation_tokens_total": 2820376.0,
"sglang:prompt_tokens_histogram_sum": 70510068.0,
"sglang:prompt_tokens_histogram_count": 11034.0,
"sglang:uncached_prompt_tokens_histogram_sum": 23298132.0,
"sglang:realtime_tokens_total/prefill_compute": 23345584.0,
"sglang:realtime_tokens_total/decode": 2820300.0,
"sglang:realtime_tokens_total/prefill_cache": 47211936.0,
"sglang:queue_time_seconds_sum": 38129.90134270117,
"sglang:queue_time_seconds_count": 11037.0
}
},
{
"time": 189.58605293836445,
"metrics": {
"sglang:queue_time_seconds_sum": 34853.60219723731,
"sglang:queue_time_seconds_count": 11412.0,
"sglang:realtime_tokens_total/prefill_compute": 22719616.0,
"sglang:realtime_tokens_total/decode": 2917742.0,
"sglang:realtime_tokens_total/prefill_cache": 48587376.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 4480.0,
"sglang:kv_evictable_tokens": 1044096.0,
"sglang:prompt_tokens_histogram_sum": 71257824.0,
"sglang:prompt_tokens_histogram_count": 11409.0,
"sglang:uncached_prompt_tokens_histogram_sum": 22670448.0,
"sglang:generation_tokens_total": 2917816.0
}
}
]
}
],
"r1_dynamo_sticky": [
{
"label": "start",
"workers": [
{
"time": 0.005657692439854145,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1048576.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:generation_tokens_total": 1723352.0,
"sglang:prompt_tokens_histogram_sum": 42725458.0,
"sglang:prompt_tokens_histogram_count": 6745.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13877858.0,
"sglang:realtime_tokens_total/prefill_compute": 13907168.0,
"sglang:realtime_tokens_total/decode": 1723338.0,
"sglang:realtime_tokens_total/prefill_cache": 28847600.0,
"sglang:queue_time_seconds_sum": 24310.929400721565,
"sglang:queue_time_seconds_count": 6748.0
}
},
{
"time": 0.006360257975757122,
"metrics": {
"sglang:queue_time_seconds_sum": 19082.89318639785,
"sglang:queue_time_seconds_count": 6922.0,
"sglang:realtime_tokens_total/prefill_compute": 12814912.0,
"sglang:realtime_tokens_total/decode": 1768806.0,
"sglang:realtime_tokens_total/prefill_cache": 30672992.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 1044464.0,
"sglang:kv_evictable_tokens": 0.0,
"sglang:prompt_tokens_histogram_sum": 43458182.0,
"sglang:prompt_tokens_histogram_count": 6919.0,
"sglang:uncached_prompt_tokens_histogram_sum": 12785190.0,
"sglang:generation_tokens_total": 1768856.0
}
}
]
},
{
"label": "score_start",
"workers": [
{
"time": 30.00855605956167,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 65.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 11392.0,
"sglang:kv_evictable_tokens": 628992.0,
"sglang:generation_tokens_total": 1791192.0,
"sglang:prompt_tokens_histogram_sum": 44343946.0,
"sglang:prompt_tokens_histogram_count": 7010.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14778538.0,
"sglang:realtime_tokens_total/prefill_compute": 14875648.0,
"sglang:realtime_tokens_total/decode": 1802948.0,
"sglang:realtime_tokens_total/prefill_cache": 29892928.0,
"sglang:queue_time_seconds_sum": 25167.169267313555,
"sglang:queue_time_seconds_count": 7077.0
}
},
{
"time": 30.008664379827678,
"metrics": {
"sglang:queue_time_seconds_sum": 19896.88988619391,
"sglang:queue_time_seconds_count": 7245.0,
"sglang:realtime_tokens_total/prefill_compute": 13812368.0,
"sglang:realtime_tokens_total/decode": 1846146.0,
"sglang:realtime_tokens_total/prefill_cache": 31749488.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 54.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 3664.0,
"sglang:kv_evictable_tokens": 583088.0,
"sglang:prompt_tokens_histogram_sum": 45059349.0,
"sglang:prompt_tokens_histogram_count": 7178.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13700821.0,
"sglang:generation_tokens_total": 1835160.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 32.027194124646485,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 5376.0,
"sglang:kv_evictable_tokens": 709616.0,
"sglang:generation_tokens_total": 1805016.0,
"sglang:prompt_tokens_histogram_sum": 44710904.0,
"sglang:prompt_tokens_histogram_count": 7064.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14841064.0,
"sglang:realtime_tokens_total/prefill_compute": 14935072.0,
"sglang:realtime_tokens_total/decode": 1808517.0,
"sglang:realtime_tokens_total/prefill_cache": 30160640.0,
"sglang:queue_time_seconds_sum": 25325.81468412094,
"sglang:queue_time_seconds_count": 7131.0
}
},
{
"time": 32.02248903084546,
"metrics": {
"sglang:queue_time_seconds_sum": 20011.413356852718,
"sglang:queue_time_seconds_count": 7286.0,
"sglang:realtime_tokens_total/prefill_compute": 13855200.0,
"sglang:realtime_tokens_total/decode": 1851727.0,
"sglang:realtime_tokens_total/prefill_cache": 31953104.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 18.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 4464.0,
"sglang:kv_evictable_tokens": 628256.0,
"sglang:prompt_tokens_histogram_sum": 45346096.0,
"sglang:prompt_tokens_histogram_count": 7219.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13748560.0,
"sglang:generation_tokens_total": 1845656.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 34.02217829786241,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 72.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 6928.0,
"sglang:kv_evictable_tokens": 695648.0,
"sglang:generation_tokens_total": 1806040.0,
"sglang:prompt_tokens_histogram_sum": 44736330.0,
"sglang:prompt_tokens_histogram_count": 7068.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14844922.0,
"sglang:realtime_tokens_total/prefill_compute": 14939568.0,
"sglang:realtime_tokens_total/decode": 1818177.0,
"sglang:realtime_tokens_total/prefill_cache": 30184896.0,
"sglang:queue_time_seconds_sum": 25343.713459544815,
"sglang:queue_time_seconds_count": 7135.0
}
},
{
"time": 34.02555417921394,
"metrics": {
"sglang:queue_time_seconds_sum": 20053.610828476027,
"sglang:queue_time_seconds_count": 7305.0,
"sglang:realtime_tokens_total/prefill_compute": 13881200.0,
"sglang:realtime_tokens_total/decode": 1858747.0,
"sglang:realtime_tokens_total/prefill_cache": 32081584.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 17.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 6080.0,
"sglang:kv_evictable_tokens": 625744.0,
"sglang:prompt_tokens_histogram_sum": 45496813.0,
"sglang:prompt_tokens_histogram_count": 7238.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13775629.0,
"sglang:generation_tokens_total": 1850520.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 36.021652528084815,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 3360.0,
"sglang:kv_evictable_tokens": 736752.0,
"sglang:generation_tokens_total": 1821400.0,
"sglang:prompt_tokens_histogram_sum": 45064765.0,
"sglang:prompt_tokens_histogram_count": 7128.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14904125.0,
"sglang:realtime_tokens_total/prefill_compute": 14995744.0,
"sglang:realtime_tokens_total/decode": 1824261.0,
"sglang:realtime_tokens_total/prefill_cache": 30428912.0,
"sglang:queue_time_seconds_sum": 25519.43801706098,
"sglang:queue_time_seconds_count": 7195.0
}
},
{
"time": 36.02231667842716,
"metrics": {
"sglang:queue_time_seconds_sum": 20088.848248786293,
"sglang:queue_time_seconds_count": 7320.0,
"sglang:realtime_tokens_total/prefill_compute": 13900432.0,
"sglang:realtime_tokens_total/decode": 1866028.0,
"sglang:realtime_tokens_total/prefill_cache": 32174144.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4864.0,
"sglang:kv_evictable_tokens": 598240.0,
"sglang:prompt_tokens_histogram_sum": 45586695.0,
"sglang:prompt_tokens_histogram_count": 7253.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13791383.0,
"sglang:generation_tokens_total": 1854360.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 38.0215124161914,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 73.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 6464.0,
"sglang:kv_evictable_tokens": 728752.0,
"sglang:generation_tokens_total": 1822424.0,
"sglang:prompt_tokens_histogram_sum": 45093491.0,
"sglang:prompt_tokens_histogram_count": 7132.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14908595.0,
"sglang:realtime_tokens_total/prefill_compute": 14999712.0,
"sglang:realtime_tokens_total/decode": 1834178.0,
"sglang:realtime_tokens_total/prefill_cache": 30448096.0,
"sglang:queue_time_seconds_sum": 25532.015572302975,
"sglang:queue_time_seconds_count": 7198.0
}
},
{
"time": 38.02232042234391,
"metrics": {
"sglang:queue_time_seconds_sum": 20192.33320797421,
"sglang:queue_time_seconds_count": 7369.0,
"sglang:realtime_tokens_total/prefill_compute": 13962720.0,
"sglang:realtime_tokens_total/decode": 1870779.0,
"sglang:realtime_tokens_total/prefill_cache": 32468720.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 3.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 1440.0,
"sglang:kv_evictable_tokens": 596688.0,
"sglang:prompt_tokens_histogram_sum": 45931272.0,
"sglang:prompt_tokens_histogram_count": 7302.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13849688.0,
"sglang:generation_tokens_total": 1866904.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 40.02283411286771,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 26.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 4272.0,
"sglang:kv_evictable_tokens": 696880.0,
"sglang:generation_tokens_total": 1837016.0,
"sglang:prompt_tokens_histogram_sum": 45362361.0,
"sglang:prompt_tokens_histogram_count": 7189.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14959353.0,
"sglang:realtime_tokens_total/prefill_compute": 15052176.0,
"sglang:realtime_tokens_total/decode": 1840010.0,
"sglang:realtime_tokens_total/prefill_cache": 30707984.0,
"sglang:queue_time_seconds_sum": 25709.027954271063,
"sglang:queue_time_seconds_count": 7256.0
}
},
{
"time": 40.02641086187214,
"metrics": {
"sglang:queue_time_seconds_sum": 20200.347489914857,
"sglang:queue_time_seconds_count": 7373.0,
"sglang:realtime_tokens_total/prefill_compute": 13966672.0,
"sglang:realtime_tokens_total/decode": 1878967.0,
"sglang:realtime_tokens_total/prefill_cache": 32487408.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4544.0,
"sglang:kv_evictable_tokens": 601504.0,
"sglang:prompt_tokens_histogram_sum": 45969392.0,
"sglang:prompt_tokens_histogram_count": 7306.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13855696.0,
"sglang:generation_tokens_total": 1867928.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 42.021594484336674,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 69.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2000.0,
"sglang:kv_evictable_tokens": 691184.0,
"sglang:generation_tokens_total": 1838296.0,
"sglang:prompt_tokens_histogram_sum": 45414449.0,
"sglang:prompt_tokens_histogram_count": 7194.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14968145.0,
"sglang:realtime_tokens_total/prefill_compute": 15062048.0,
"sglang:realtime_tokens_total/decode": 1849155.0,
"sglang:realtime_tokens_total/prefill_cache": 30752416.0,
"sglang:queue_time_seconds_sum": 25726.272073490545,
"sglang:queue_time_seconds_count": 7261.0
}
},
{
"time": 42.022149751894176,
"metrics": {
"sglang:queue_time_seconds_sum": 20304.55785360653,
"sglang:queue_time_seconds_count": 7414.0,
"sglang:realtime_tokens_total/prefill_compute": 14016160.0,
"sglang:realtime_tokens_total/decode": 1884495.0,
"sglang:realtime_tokens_total/prefill_cache": 32713200.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 6176.0,
"sglang:kv_evictable_tokens": 628368.0,
"sglang:prompt_tokens_histogram_sum": 46267939.0,
"sglang:prompt_tokens_histogram_count": 7347.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13907011.0,
"sglang:generation_tokens_total": 1878424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 44.02261995058507,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3536.0,
"sglang:kv_evictable_tokens": 704176.0,
"sglang:generation_tokens_total": 1850584.0,
"sglang:prompt_tokens_histogram_sum": 45647083.0,
"sglang:prompt_tokens_histogram_count": 7242.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15007179.0,
"sglang:realtime_tokens_total/prefill_compute": 15097264.0,
"sglang:realtime_tokens_total/decode": 1855828.0,
"sglang:realtime_tokens_total/prefill_cache": 30935232.0,
"sglang:queue_time_seconds_sum": 25892.971023992635,
"sglang:queue_time_seconds_count": 7308.0
}
},
{
"time": 44.02208085823804,
"metrics": {
"sglang:queue_time_seconds_sum": 20324.46942190267,
"sglang:queue_time_seconds_count": 7433.0,
"sglang:realtime_tokens_total/prefill_compute": 14041120.0,
"sglang:realtime_tokens_total/decode": 1891707.0,
"sglang:realtime_tokens_total/prefill_cache": 32824832.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 16.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 1152.0,
"sglang:kv_evictable_tokens": 629056.0,
"sglang:prompt_tokens_histogram_sum": 46399614.0,
"sglang:prompt_tokens_histogram_count": 7366.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13930894.0,
"sglang:generation_tokens_total": 1883288.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 46.022600774653256,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 7776.0,
"sglang:kv_evictable_tokens": 745024.0,
"sglang:generation_tokens_total": 1854680.0,
"sglang:prompt_tokens_histogram_sum": 45783044.0,
"sglang:prompt_tokens_histogram_count": 7258.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15030628.0,
"sglang:realtime_tokens_total/prefill_compute": 15113472.0,
"sglang:realtime_tokens_total/decode": 1865027.0,
"sglang:realtime_tokens_total/prefill_cache": 31009136.0,
"sglang:queue_time_seconds_sum": 25945.973448688164,
"sglang:queue_time_seconds_count": 7325.0
}
},
{
"time": 46.02603948954493,
"metrics": {
"sglang:queue_time_seconds_sum": 20371.791862557642,
"sglang:queue_time_seconds_count": 7454.0,
"sglang:realtime_tokens_total/prefill_compute": 14059424.0,
"sglang:realtime_tokens_total/decode": 1898924.0,
"sglang:realtime_tokens_total/prefill_cache": 32906384.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1424.0,
"sglang:kv_evictable_tokens": 616272.0,
"sglang:prompt_tokens_histogram_sum": 46526096.0,
"sglang:prompt_tokens_histogram_count": 7387.0,
"sglang:uncached_prompt_tokens_histogram_sum": 13953952.0,
"sglang:generation_tokens_total": 1888664.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 48.02306345012039,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3968.0,
"sglang:kv_evictable_tokens": 693600.0,
"sglang:generation_tokens_total": 1865944.0,
"sglang:prompt_tokens_histogram_sum": 45995712.0,
"sglang:prompt_tokens_histogram_count": 7302.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15065312.0,
"sglang:realtime_tokens_total/prefill_compute": 15159696.0,
"sglang:realtime_tokens_total/decode": 1871575.0,
"sglang:realtime_tokens_total/prefill_cache": 31235264.0,
"sglang:queue_time_seconds_sum": 26094.517871445045,
"sglang:queue_time_seconds_count": 7369.0
}
},
{
"time": 48.021960464306176,
"metrics": {
"sglang:queue_time_seconds_sum": 20459.427162292413,
"sglang:queue_time_seconds_count": 7497.0,
"sglang:realtime_tokens_total/prefill_compute": 14121712.0,
"sglang:realtime_tokens_total/decode": 1903611.0,
"sglang:realtime_tokens_total/prefill_cache": 33191776.0,
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 6.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 3584.0,
"sglang:kv_evictable_tokens": 616656.0,
"sglang:prompt_tokens_histogram_sum": 46833789.0,
"sglang:prompt_tokens_histogram_count": 7430.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14008957.0,
"sglang:generation_tokens_total": 1899672.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 50.027616801671684,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 45.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2000.0,
"sglang:kv_evictable_tokens": 689728.0,
"sglang:generation_tokens_total": 1870552.0,
"sglang:prompt_tokens_histogram_sum": 46074204.0,
"sglang:prompt_tokens_histogram_count": 7320.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15079036.0,
"sglang:realtime_tokens_total/prefill_compute": 15173984.0,
"sglang:realtime_tokens_total/decode": 1880069.0,
"sglang:realtime_tokens_total/prefill_cache": 31302752.0,
"sglang:queue_time_seconds_sum": 26143.466776013374,
"sglang:queue_time_seconds_count": 7387.0
}
},
{
"time": 50.02251013740897,
"metrics": {
"sglang:queue_time_seconds_sum": 20467.774361949414,
"sglang:queue_time_seconds_count": 7501.0,
"sglang:realtime_tokens_total/prefill_compute": 14128336.0,
"sglang:realtime_tokens_total/decode": 1911863.0,
"sglang:realtime_tokens_total/prefill_cache": 33226576.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 1600.0,
"sglang:kv_evictable_tokens": 602048.0,
"sglang:prompt_tokens_histogram_sum": 46867209.0,
"sglang:prompt_tokens_histogram_count": 7434.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14014825.0,
"sglang:generation_tokens_total": 1900696.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 52.02273667883128,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2448.0,
"sglang:kv_evictable_tokens": 707936.0,
"sglang:generation_tokens_total": 1879000.0,
"sglang:prompt_tokens_histogram_sum": 46325705.0,
"sglang:prompt_tokens_histogram_count": 7353.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15122953.0,
"sglang:realtime_tokens_total/prefill_compute": 15213936.0,
"sglang:realtime_tokens_total/decode": 1886692.0,
"sglang:realtime_tokens_total/prefill_cache": 31494832.0,
"sglang:queue_time_seconds_sum": 26266.73713793326,
"sglang:queue_time_seconds_count": 7420.0
}
},
{
"time": 52.02195905614644,
"metrics": {
"sglang:queue_time_seconds_sum": 20575.209084203467,
"sglang:queue_time_seconds_count": 7541.0,
"sglang:realtime_tokens_total/prefill_compute": 14176384.0,
"sglang:realtime_tokens_total/decode": 1917203.0,
"sglang:realtime_tokens_total/prefill_cache": 33448256.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 22.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 9632.0,
"sglang:kv_evictable_tokens": 620544.0,
"sglang:prompt_tokens_histogram_sum": 47189105.0,
"sglang:prompt_tokens_histogram_count": 7475.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14070833.0,
"sglang:generation_tokens_total": 1911192.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 54.02242355700582,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 3888.0,
"sglang:kv_evictable_tokens": 685472.0,
"sglang:generation_tokens_total": 1886936.0,
"sglang:prompt_tokens_histogram_sum": 46444817.0,
"sglang:prompt_tokens_histogram_count": 7384.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15142065.0,
"sglang:realtime_tokens_total/prefill_compute": 15236304.0,
"sglang:realtime_tokens_total/decode": 1894405.0,
"sglang:realtime_tokens_total/prefill_cache": 31615392.0,
"sglang:queue_time_seconds_sum": 26352.92946966458,
"sglang:queue_time_seconds_count": 7451.0
}
},
{
"time": 54.022726375609636,
"metrics": {
"sglang:queue_time_seconds_sum": 20612.15773706138,
"sglang:queue_time_seconds_count": 7561.0,
"sglang:realtime_tokens_total/prefill_compute": 14198496.0,
"sglang:realtime_tokens_total/decode": 1924795.0,
"sglang:realtime_tokens_total/prefill_cache": 33547024.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 2624.0,
"sglang:kv_evictable_tokens": 628608.0,
"sglang:prompt_tokens_histogram_sum": 47281050.0,
"sglang:prompt_tokens_histogram_count": 7494.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14089274.0,
"sglang:generation_tokens_total": 1916056.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 56.02331790700555,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 7264.0,
"sglang:kv_evictable_tokens": 750512.0,
"sglang:generation_tokens_total": 1892056.0,
"sglang:prompt_tokens_histogram_sum": 46624862.0,
"sglang:prompt_tokens_histogram_count": 7404.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15172926.0,
"sglang:realtime_tokens_total/prefill_compute": 15256560.0,
"sglang:realtime_tokens_total/decode": 1902641.0,
"sglang:realtime_tokens_total/prefill_cache": 31695392.0,
"sglang:queue_time_seconds_sum": 26437.90651666466,
"sglang:queue_time_seconds_count": 7471.0
}
},
{
"time": 56.02319141011685,
"metrics": {
"sglang:queue_time_seconds_sum": 20661.819301310927,
"sglang:queue_time_seconds_count": 7582.0,
"sglang:realtime_tokens_total/prefill_compute": 14227968.0,
"sglang:realtime_tokens_total/decode": 1931878.0,
"sglang:realtime_tokens_total/prefill_cache": 33686800.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 2304.0,
"sglang:kv_evictable_tokens": 606208.0,
"sglang:prompt_tokens_histogram_sum": 47431782.0,
"sglang:prompt_tokens_histogram_count": 7515.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14116086.0,
"sglang:generation_tokens_total": 1921432.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 58.022203960455954,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 6864.0,
"sglang:kv_evictable_tokens": 693568.0,
"sglang:generation_tokens_total": 1903320.0,
"sglang:prompt_tokens_histogram_sum": 46819507.0,
"sglang:prompt_tokens_histogram_count": 7448.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15204115.0,
"sglang:realtime_tokens_total/prefill_compute": 15301504.0,
"sglang:realtime_tokens_total/decode": 1908928.0,
"sglang:realtime_tokens_total/prefill_cache": 31914592.0,
"sglang:queue_time_seconds_sum": 26558.31403274089,
"sglang:queue_time_seconds_count": 7515.0
}
},
{
"time": 58.02255218755454,
"metrics": {
"sglang:queue_time_seconds_sum": 20747.72073614411,
"sglang:queue_time_seconds_count": 7625.0,
"sglang:realtime_tokens_total/prefill_compute": 14275552.0,
"sglang:realtime_tokens_total/decode": 1937464.0,
"sglang:realtime_tokens_total/prefill_cache": 33922880.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 3.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 8288.0,
"sglang:kv_evictable_tokens": 605152.0,
"sglang:prompt_tokens_histogram_sum": 47712828.0,
"sglang:prompt_tokens_histogram_count": 7558.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14165804.0,
"sglang:generation_tokens_total": 1932440.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 60.027062178589404,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 68.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 4880.0,
"sglang:kv_evictable_tokens": 680608.0,
"sglang:generation_tokens_total": 1905880.0,
"sglang:prompt_tokens_histogram_sum": 46876592.0,
"sglang:prompt_tokens_histogram_count": 7458.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15214720.0,
"sglang:realtime_tokens_total/prefill_compute": 15313936.0,
"sglang:realtime_tokens_total/decode": 1917750.0,
"sglang:realtime_tokens_total/prefill_cache": 31967792.0,
"sglang:queue_time_seconds_sum": 26607.2989449054,
"sglang:queue_time_seconds_count": 7525.0
}
},
{
"time": 60.02240607794374,
"metrics": {
"sglang:queue_time_seconds_sum": 20763.312271649018,
"sglang:queue_time_seconds_count": 7633.0,
"sglang:realtime_tokens_total/prefill_compute": 14286048.0,
"sglang:realtime_tokens_total/decode": 1945329.0,
"sglang:realtime_tokens_total/prefill_cache": 33971888.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 4192.0,
"sglang:kv_evictable_tokens": 583312.0,
"sglang:prompt_tokens_histogram_sum": 47758089.0,
"sglang:prompt_tokens_histogram_count": 7566.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14173865.0,
"sglang:generation_tokens_total": 1934488.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 62.02420618291944,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 4704.0,
"sglang:kv_evictable_tokens": 670960.0,
"sglang:generation_tokens_total": 1919704.0,
"sglang:prompt_tokens_histogram_sum": 47183643.0,
"sglang:prompt_tokens_histogram_count": 7512.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15269051.0,
"sglang:realtime_tokens_total/prefill_compute": 15372000.0,
"sglang:realtime_tokens_total/decode": 1923200.0,
"sglang:realtime_tokens_total/prefill_cache": 32237088.0,
"sglang:queue_time_seconds_sum": 26782.30915222224,
"sglang:queue_time_seconds_count": 7579.0
}
},
{
"time": 62.02320118248463,
"metrics": {
"sglang:queue_time_seconds_sum": 20858.481459295377,
"sglang:queue_time_seconds_count": 7671.0,
"sglang:realtime_tokens_total/prefill_compute": 14336704.0,
"sglang:realtime_tokens_total/decode": 1950531.0,
"sglang:realtime_tokens_total/prefill_cache": 34229456.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 13.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 4384.0,
"sglang:kv_evictable_tokens": 601232.0,
"sglang:prompt_tokens_histogram_sum": 48074893.0,
"sglang:prompt_tokens_histogram_count": 7604.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14226237.0,
"sglang:generation_tokens_total": 1944216.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 64.02205565478653,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 79.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 5216.0,
"sglang:kv_evictable_tokens": 667040.0,
"sglang:generation_tokens_total": 1920728.0,
"sglang:prompt_tokens_histogram_sum": 47204114.0,
"sglang:prompt_tokens_histogram_count": 7516.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15273266.0,
"sglang:realtime_tokens_total/prefill_compute": 15374320.0,
"sglang:realtime_tokens_total/decode": 1932477.0,
"sglang:realtime_tokens_total/prefill_cache": 32248512.0,
"sglang:queue_time_seconds_sum": 26795.91453507077,
"sglang:queue_time_seconds_count": 7582.0
}
},
{
"time": 64.02783464360982,
"metrics": {
"sglang:queue_time_seconds_sum": 20875.40580234304,
"sglang:queue_time_seconds_count": 7689.0,
"sglang:realtime_tokens_total/prefill_compute": 14358656.0,
"sglang:realtime_tokens_total/decode": 1957343.0,
"sglang:realtime_tokens_total/prefill_cache": 34339376.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 18.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 2464.0,
"sglang:kv_evictable_tokens": 560272.0,
"sglang:prompt_tokens_histogram_sum": 48165443.0,
"sglang:prompt_tokens_histogram_count": 7622.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14242563.0,
"sglang:generation_tokens_total": 1948824.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 66.02331696730107,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 37.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 3424.0,
"sglang:kv_evictable_tokens": 723136.0,
"sglang:generation_tokens_total": 1935320.0,
"sglang:prompt_tokens_histogram_sum": 47568934.0,
"sglang:prompt_tokens_histogram_count": 7573.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15337846.0,
"sglang:realtime_tokens_total/prefill_compute": 15430512.0,
"sglang:realtime_tokens_total/decode": 1938309.0,
"sglang:realtime_tokens_total/prefill_cache": 32496240.0,
"sglang:queue_time_seconds_sum": 26999.987895655446,
"sglang:queue_time_seconds_count": 7638.0
}
},
{
"time": 66.02232020813972,
"metrics": {
"sglang:queue_time_seconds_sum": 20906.75212469697,
"sglang:queue_time_seconds_count": 7704.0,
"sglang:realtime_tokens_total/prefill_compute": 14383840.0,
"sglang:realtime_tokens_total/decode": 1963984.0,
"sglang:realtime_tokens_total/prefill_cache": 34463040.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.48,
"sglang:kv_available_tokens": 1712.0,
"sglang:kv_evictable_tokens": 542752.0,
"sglang:prompt_tokens_histogram_sum": 48301143.0,
"sglang:prompt_tokens_histogram_count": 7637.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14266279.0,
"sglang:generation_tokens_total": 1952664.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 68.02624873165041,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 82.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 5936.0,
"sglang:kv_evictable_tokens": 681392.0,
"sglang:generation_tokens_total": 1936600.0,
"sglang:prompt_tokens_histogram_sum": 47587005.0,
"sglang:prompt_tokens_histogram_count": 7578.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15340909.0,
"sglang:realtime_tokens_total/prefill_compute": 15441168.0,
"sglang:realtime_tokens_total/decode": 1947198.0,
"sglang:realtime_tokens_total/prefill_cache": 32551632.0,
"sglang:queue_time_seconds_sum": 27024.2417890355,
"sglang:queue_time_seconds_count": 7645.0
}
},
{
"time": 68.02764875907451,
"metrics": {
"sglang:queue_time_seconds_sum": 20992.54800198786,
"sglang:queue_time_seconds_count": 7753.0,
"sglang:realtime_tokens_total/prefill_compute": 14440512.0,
"sglang:realtime_tokens_total/decode": 1968579.0,
"sglang:realtime_tokens_total/prefill_cache": 34732736.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 5408.0,
"sglang:kv_evictable_tokens": 585312.0,
"sglang:prompt_tokens_histogram_sum": 48664776.0,
"sglang:prompt_tokens_histogram_count": 7686.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14325400.0,
"sglang:generation_tokens_total": 1965208.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 70.02387919742614,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.27,
"sglang:kv_available_tokens": 4016.0,
"sglang:kv_evictable_tokens": 758240.0,
"sglang:generation_tokens_total": 1948632.0,
"sglang:prompt_tokens_histogram_sum": 47851830.0,
"sglang:prompt_tokens_histogram_count": 7625.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15391510.0,
"sglang:realtime_tokens_total/prefill_compute": 15482096.0,
"sglang:realtime_tokens_total/decode": 1953935.0,
"sglang:realtime_tokens_total/prefill_cache": 32708048.0,
"sglang:queue_time_seconds_sum": 27211.62720699422,
"sglang:queue_time_seconds_count": 7692.0
}
},
{
"time": 70.02862520236522,
"metrics": {
"sglang:queue_time_seconds_sum": 20996.96713713836,
"sglang:queue_time_seconds_count": 7756.0,
"sglang:realtime_tokens_total/prefill_compute": 14445760.0,
"sglang:realtime_tokens_total/decode": 1976640.0,
"sglang:realtime_tokens_total/prefill_cache": 34758128.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 38.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 1712.0,
"sglang:kv_evictable_tokens": 578064.0,
"sglang:prompt_tokens_histogram_sum": 48691332.0,
"sglang:prompt_tokens_histogram_count": 7689.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14330116.0,
"sglang:generation_tokens_total": 1965976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 72.02336499653757,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 3328.0,
"sglang:kv_evictable_tokens": 714880.0,
"sglang:generation_tokens_total": 1952472.0,
"sglang:prompt_tokens_histogram_sum": 47956316.0,
"sglang:prompt_tokens_histogram_count": 7640.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15407740.0,
"sglang:realtime_tokens_total/prefill_compute": 15507024.0,
"sglang:realtime_tokens_total/decode": 1962304.0,
"sglang:realtime_tokens_total/prefill_cache": 32829056.0,
"sglang:queue_time_seconds_sum": 27259.94753706362,
"sglang:queue_time_seconds_count": 7707.0
}
},
{
"time": 72.02381309587508,
"metrics": {
"sglang:queue_time_seconds_sum": 21083.88980471436,
"sglang:queue_time_seconds_count": 7793.0,
"sglang:realtime_tokens_total/prefill_compute": 14487056.0,
"sglang:realtime_tokens_total/decode": 1982555.0,
"sglang:realtime_tokens_total/prefill_cache": 34963872.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 6.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 3568.0,
"sglang:kv_evictable_tokens": 614816.0,
"sglang:prompt_tokens_histogram_sum": 48973610.0,
"sglang:prompt_tokens_histogram_count": 7726.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14375978.0,
"sglang:generation_tokens_total": 1975448.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 74.02341698203236,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 8288.0,
"sglang:kv_evictable_tokens": 668928.0,
"sglang:generation_tokens_total": 1962456.0,
"sglang:prompt_tokens_histogram_sum": 48122183.0,
"sglang:prompt_tokens_histogram_count": 7679.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15443559.0,
"sglang:realtime_tokens_total/prefill_compute": 15546560.0,
"sglang:realtime_tokens_total/decode": 1969369.0,
"sglang:realtime_tokens_total/prefill_cache": 32995056.0,
"sglang:queue_time_seconds_sum": 27434.910639484413,
"sglang:queue_time_seconds_count": 7746.0
}
},
{
"time": 74.02244196739048,
"metrics": {
"sglang:queue_time_seconds_sum": 21089.05578204803,
"sglang:queue_time_seconds_count": 7817.0,
"sglang:realtime_tokens_total/prefill_compute": 14523648.0,
"sglang:realtime_tokens_total/decode": 1988379.0,
"sglang:realtime_tokens_total/prefill_cache": 35134640.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 3.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 3376.0,
"sglang:kv_evictable_tokens": 574864.0,
"sglang:prompt_tokens_histogram_sum": 49139730.0,
"sglang:prompt_tokens_histogram_count": 7750.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14406994.0,
"sglang:generation_tokens_total": 1981592.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 76.0234137577936,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 66.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 4320.0,
"sglang:kv_evictable_tokens": 728944.0,
"sglang:generation_tokens_total": 1968856.0,
"sglang:prompt_tokens_histogram_sum": 48302789.0,
"sglang:prompt_tokens_histogram_count": 7704.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15473733.0,
"sglang:realtime_tokens_total/prefill_compute": 15566208.0,
"sglang:realtime_tokens_total/decode": 1977728.0,
"sglang:realtime_tokens_total/prefill_cache": 33098080.0,
"sglang:queue_time_seconds_sum": 27514.181709463708,
"sglang:queue_time_seconds_count": 7771.0
}
},
{
"time": 76.02229550946504,
"metrics": {
"sglang:queue_time_seconds_sum": 21111.76780631952,
"sglang:queue_time_seconds_count": 7830.0,
"sglang:realtime_tokens_total/prefill_compute": 14537456.0,
"sglang:realtime_tokens_total/decode": 1995663.0,
"sglang:realtime_tokens_total/prefill_cache": 35200720.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3872.0,
"sglang:kv_evictable_tokens": 597792.0,
"sglang:prompt_tokens_histogram_sum": 49264496.0,
"sglang:prompt_tokens_histogram_count": 7763.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14428016.0,
"sglang:generation_tokens_total": 1984920.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 78.02379007916898,
"metrics": {
"sglang:num_running_reqs": 56.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 9472.0,
"sglang:kv_evictable_tokens": 659680.0,
"sglang:generation_tokens_total": 1977304.0,
"sglang:prompt_tokens_histogram_sum": 48456799.0,
"sglang:prompt_tokens_histogram_count": 7737.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15504143.0,
"sglang:realtime_tokens_total/prefill_compute": 15602656.0,
"sglang:realtime_tokens_total/decode": 1984991.0,
"sglang:realtime_tokens_total/prefill_cache": 33278560.0,
"sglang:queue_time_seconds_sum": 27674.250259983353,
"sglang:queue_time_seconds_count": 7804.0
}
},
{
"time": 78.0269282637164,
"metrics": {
"sglang:queue_time_seconds_sum": 21180.941001648083,
"sglang:queue_time_seconds_count": 7873.0,
"sglang:realtime_tokens_total/prefill_compute": 14592640.0,
"sglang:realtime_tokens_total/decode": 2000675.0,
"sglang:realtime_tokens_total/prefill_cache": 35464688.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 1.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 2816.0,
"sglang:kv_evictable_tokens": 595040.0,
"sglang:prompt_tokens_histogram_sum": 49557229.0,
"sglang:prompt_tokens_histogram_count": 7806.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14478333.0,
"sglang:generation_tokens_total": 1995928.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 80.02246823441237,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 5936.0,
"sglang:kv_evictable_tokens": 673088.0,
"sglang:generation_tokens_total": 1985240.0,
"sglang:prompt_tokens_histogram_sum": 48630749.0,
"sglang:prompt_tokens_histogram_count": 7768.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15532669.0,
"sglang:realtime_tokens_total/prefill_compute": 15633888.0,
"sglang:realtime_tokens_total/decode": 1992384.0,
"sglang:realtime_tokens_total/prefill_cache": 33417024.0,
"sglang:queue_time_seconds_sum": 27769.949851490557,
"sglang:queue_time_seconds_count": 7835.0
}
},
{
"time": 80.02233114559203,
"metrics": {
"sglang:queue_time_seconds_sum": 21186.024431409314,
"sglang:queue_time_seconds_count": 7884.0,
"sglang:realtime_tokens_total/prefill_compute": 14600080.0,
"sglang:realtime_tokens_total/decode": 2008984.0,
"sglang:realtime_tokens_total/prefill_cache": 35487472.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 33.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 4176.0,
"sglang:kv_evictable_tokens": 632944.0,
"sglang:prompt_tokens_histogram_sum": 49631835.0,
"sglang:prompt_tokens_histogram_count": 7817.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14491195.0,
"sglang:generation_tokens_total": 1998744.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 82.02262754365802,
"metrics": {
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 72.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 2480.0,
"sglang:kv_evictable_tokens": 720256.0,
"sglang:generation_tokens_total": 1989848.0,
"sglang:prompt_tokens_histogram_sum": 48795541.0,
"sglang:prompt_tokens_histogram_count": 7786.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15560165.0,
"sglang:realtime_tokens_total/prefill_compute": 15645008.0,
"sglang:realtime_tokens_total/decode": 2000558.0,
"sglang:realtime_tokens_total/prefill_cache": 33480464.0,
"sglang:queue_time_seconds_sum": 27866.834541103803,
"sglang:queue_time_seconds_count": 7853.0
}
},
{
"time": 82.02360009495169,
"metrics": {
"sglang:queue_time_seconds_sum": 21252.408904029988,
"sglang:queue_time_seconds_count": 7915.0,
"sglang:realtime_tokens_total/prefill_compute": 14641952.0,
"sglang:realtime_tokens_total/decode": 2014777.0,
"sglang:realtime_tokens_total/prefill_cache": 35701280.0,
"sglang:num_running_reqs": 61.0,
"sglang:num_queue_reqs": 19.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 4768.0,
"sglang:kv_evictable_tokens": 617968.0,
"sglang:prompt_tokens_histogram_sum": 49870131.0,
"sglang:prompt_tokens_histogram_count": 7849.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14530499.0,
"sglang:generation_tokens_total": 2006936.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 84.02337313536555,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 1824.0,
"sglang:kv_evictable_tokens": 642016.0,
"sglang:generation_tokens_total": 2001624.0,
"sglang:prompt_tokens_histogram_sum": 49017097.0,
"sglang:prompt_tokens_histogram_count": 7832.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15600073.0,
"sglang:realtime_tokens_total/prefill_compute": 15706256.0,
"sglang:realtime_tokens_total/decode": 2006080.0,
"sglang:realtime_tokens_total/prefill_cache": 33766992.0,
"sglang:queue_time_seconds_sum": 28032.087103607133,
"sglang:queue_time_seconds_count": 7899.0
}
},
{
"time": 84.02776233758777,
"metrics": {
"sglang:queue_time_seconds_sum": 21284.448893981054,
"sglang:queue_time_seconds_count": 7945.0,
"sglang:realtime_tokens_total/prefill_compute": 14676256.0,
"sglang:realtime_tokens_total/decode": 2021275.0,
"sglang:realtime_tokens_total/prefill_cache": 35843008.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 14.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 1216.0,
"sglang:kv_evictable_tokens": 621328.0,
"sglang:prompt_tokens_histogram_sum": 50041877.0,
"sglang:prompt_tokens_histogram_count": 7878.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14563829.0,
"sglang:generation_tokens_total": 2014360.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 86.0229602465406,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 76.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1328.0,
"sglang:kv_evictable_tokens": 650000.0,
"sglang:generation_tokens_total": 2002648.0,
"sglang:prompt_tokens_histogram_sum": 49040367.0,
"sglang:prompt_tokens_histogram_count": 7836.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15603679.0,
"sglang:realtime_tokens_total/prefill_compute": 15707216.0,
"sglang:realtime_tokens_total/decode": 2014588.0,
"sglang:realtime_tokens_total/prefill_cache": 33774592.0,
"sglang:queue_time_seconds_sum": 28053.10200497415,
"sglang:queue_time_seconds_count": 7903.0
}
},
{
"time": 86.02193654235452,
"metrics": {
"sglang:queue_time_seconds_sum": 21311.472456028685,
"sglang:queue_time_seconds_count": 7958.0,
"sglang:realtime_tokens_total/prefill_compute": 14690352.0,
"sglang:realtime_tokens_total/decode": 2028750.0,
"sglang:realtime_tokens_total/prefill_cache": 35907520.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.41,
"sglang:kv_available_tokens": 2752.0,
"sglang:kv_evictable_tokens": 620304.0,
"sglang:prompt_tokens_histogram_sum": 50125892.0,
"sglang:prompt_tokens_histogram_count": 7891.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14578324.0,
"sglang:generation_tokens_total": 2017688.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 88.0237072436139,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.39,
"sglang:kv_available_tokens": 3216.0,
"sglang:kv_evictable_tokens": 639952.0,
"sglang:generation_tokens_total": 2014424.0,
"sglang:prompt_tokens_histogram_sum": 49345316.0,
"sglang:prompt_tokens_histogram_count": 7882.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15656532.0,
"sglang:realtime_tokens_total/prefill_compute": 15761248.0,
"sglang:realtime_tokens_total/decode": 2019854.0,
"sglang:realtime_tokens_total/prefill_cache": 34040976.0,
"sglang:queue_time_seconds_sum": 28251.388409940526,
"sglang:queue_time_seconds_count": 7949.0
}
},
{
"time": 88.02341047395021,
"metrics": {
"sglang:queue_time_seconds_sum": 21403.264844186604,
"sglang:queue_time_seconds_count": 8003.0,
"sglang:realtime_tokens_total/prefill_compute": 14732704.0,
"sglang:realtime_tokens_total/decode": 2034529.0,
"sglang:realtime_tokens_total/prefill_cache": 36109968.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2288.0,
"sglang:kv_evictable_tokens": 683008.0,
"sglang:prompt_tokens_histogram_sum": 50430309.0,
"sglang:prompt_tokens_histogram_count": 7936.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14632629.0,
"sglang:generation_tokens_total": 2029208.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 90.02175795659423,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 52.0,
"sglang:token_usage": 0.38,
"sglang:kv_available_tokens": 1312.0,
"sglang:kv_evictable_tokens": 648480.0,
"sglang:generation_tokens_total": 2018008.0,
"sglang:prompt_tokens_histogram_sum": 49439130.0,
"sglang:prompt_tokens_histogram_count": 7896.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15672138.0,
"sglang:realtime_tokens_total/prefill_compute": 15777168.0,
"sglang:realtime_tokens_total/decode": 2028096.0,
"sglang:realtime_tokens_total/prefill_cache": 34109536.0,
"sglang:queue_time_seconds_sum": 28298.52993764542,
"sglang:queue_time_seconds_count": 7963.0
}
},
{
"time": 90.02716358099133,
"metrics": {
"sglang:queue_time_seconds_sum": 21417.708836517297,
"sglang:queue_time_seconds_count": 8014.0,
"sglang:realtime_tokens_total/prefill_compute": 14743088.0,
"sglang:realtime_tokens_total/decode": 2042966.0,
"sglang:realtime_tokens_total/prefill_cache": 36157712.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 2096.0,
"sglang:kv_evictable_tokens": 682128.0,
"sglang:prompt_tokens_histogram_sum": 50495524.0,
"sglang:prompt_tokens_histogram_count": 7947.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14644116.0,
"sglang:generation_tokens_total": 2032024.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 92.02340667042881,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 44.0,
"sglang:token_usage": 0.37,
"sglang:kv_available_tokens": 4352.0,
"sglang:kv_evictable_tokens": 660464.0,
"sglang:generation_tokens_total": 2026456.0,
"sglang:prompt_tokens_histogram_sum": 49669837.0,
"sglang:prompt_tokens_histogram_count": 7929.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15709357.0,
"sglang:realtime_tokens_total/prefill_compute": 15810928.0,
"sglang:realtime_tokens_total/decode": 2034395.0,
"sglang:realtime_tokens_total/prefill_cache": 34292032.0,
"sglang:queue_time_seconds_sum": 28443.511239928193,
"sglang:queue_time_seconds_count": 7995.0
}
},
{
"time": 92.02321626897901,
"metrics": {
"sglang:queue_time_seconds_sum": 21521.478869833052,
"sglang:queue_time_seconds_count": 8061.0,
"sglang:realtime_tokens_total/prefill_compute": 14789264.0,
"sglang:realtime_tokens_total/decode": 2048743.0,
"sglang:realtime_tokens_total/prefill_cache": 36392640.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 16.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 1968.0,
"sglang:kv_evictable_tokens": 690736.0,
"sglang:prompt_tokens_histogram_sum": 50799983.0,
"sglang:prompt_tokens_histogram_count": 7994.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14694479.0,
"sglang:generation_tokens_total": 2044056.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 94.02301814500242,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.4,
"sglang:kv_available_tokens": 3488.0,
"sglang:kv_evictable_tokens": 622640.0,
"sglang:generation_tokens_total": 2034392.0,
"sglang:prompt_tokens_histogram_sum": 49852272.0,
"sglang:prompt_tokens_histogram_count": 7960.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15742736.0,
"sglang:realtime_tokens_total/prefill_compute": 15851344.0,
"sglang:realtime_tokens_total/decode": 2040887.0,
"sglang:realtime_tokens_total/prefill_cache": 34475616.0,
"sglang:queue_time_seconds_sum": 28547.7727550501,
"sglang:queue_time_seconds_count": 8027.0
}
},
{
"time": 94.02328342664987,
"metrics": {
"sglang:queue_time_seconds_sum": 21538.201198610477,
"sglang:queue_time_seconds_count": 8075.0,
"sglang:realtime_tokens_total/prefill_compute": 14808672.0,
"sglang:realtime_tokens_total/decode": 2056665.0,
"sglang:realtime_tokens_total/prefill_cache": 36478080.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.36,
"sglang:kv_available_tokens": 1952.0,
"sglang:kv_evictable_tokens": 666624.0,
"sglang:prompt_tokens_histogram_sum": 50859004.0,
"sglang:prompt_tokens_histogram_count": 8008.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14707004.0,
"sglang:generation_tokens_total": 2047640.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 96.02329161390662,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 4208.0,
"sglang:kv_evictable_tokens": 571280.0,
"sglang:generation_tokens_total": 2036952.0,
"sglang:prompt_tokens_histogram_sum": 49886152.0,
"sglang:prompt_tokens_histogram_count": 7970.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15746792.0,
"sglang:realtime_tokens_total/prefill_compute": 15864784.0,
"sglang:realtime_tokens_total/decode": 2048813.0,
"sglang:realtime_tokens_total/prefill_cache": 34538976.0,
"sglang:queue_time_seconds_sum": 28602.36121027544,
"sglang:queue_time_seconds_count": 8037.0
}
},
{
"time": 96.02415235713124,
"metrics": {
"sglang:queue_time_seconds_sum": 21593.92973984126,
"sglang:queue_time_seconds_count": 8099.0,
"sglang:realtime_tokens_total/prefill_compute": 14836464.0,
"sglang:realtime_tokens_total/decode": 2063489.0,
"sglang:realtime_tokens_total/prefill_cache": 36621472.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 34.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1904.0,
"sglang:kv_evictable_tokens": 680688.0,
"sglang:prompt_tokens_histogram_sum": 51053443.0,
"sglang:prompt_tokens_histogram_count": 8032.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14739459.0,
"sglang:generation_tokens_total": 2053784.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 98.02364174835384,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.42,
"sglang:kv_available_tokens": 2560.0,
"sglang:kv_evictable_tokens": 608384.0,
"sglang:generation_tokens_total": 2050776.0,
"sglang:prompt_tokens_histogram_sum": 50292205.0,
"sglang:prompt_tokens_histogram_count": 8024.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15816589.0,
"sglang:realtime_tokens_total/prefill_compute": 15929952.0,
"sglang:realtime_tokens_total/decode": 2053433.0,
"sglang:realtime_tokens_total/prefill_cache": 34851296.0,
"sglang:queue_time_seconds_sum": 28783.929436611943,
"sglang:queue_time_seconds_count": 8091.0
}
},
{
"time": 98.02925950381905,
"metrics": {
"sglang:queue_time_seconds_sum": 21676.619689053856,
"sglang:queue_time_seconds_count": 8137.0,
"sglang:realtime_tokens_total/prefill_compute": 14867360.0,
"sglang:realtime_tokens_total/decode": 2070427.0,
"sglang:realtime_tokens_total/prefill_cache": 36774640.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 24.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 1856.0,
"sglang:kv_evictable_tokens": 682288.0,
"sglang:prompt_tokens_histogram_sum": 51229990.0,
"sglang:prompt_tokens_histogram_count": 8070.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14770326.0,
"sglang:generation_tokens_total": 2063512.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 100.0220821974799,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 3312.0,
"sglang:kv_evictable_tokens": 582256.0,
"sglang:generation_tokens_total": 2051288.0,
"sglang:prompt_tokens_histogram_sum": 50300985.0,
"sglang:prompt_tokens_histogram_count": 8026.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15818009.0,
"sglang:realtime_tokens_total/prefill_compute": 15934960.0,
"sglang:realtime_tokens_total/decode": 2061941.0,
"sglang:realtime_tokens_total/prefill_cache": 34875536.0,
"sglang:queue_time_seconds_sum": 28793.816436062567,
"sglang:queue_time_seconds_count": 8093.0
}
},
{
"time": 100.02239664737135,
"metrics": {
"sglang:queue_time_seconds_sum": 21713.72880083695,
"sglang:queue_time_seconds_count": 8152.0,
"sglang:realtime_tokens_total/prefill_compute": 14884000.0,
"sglang:realtime_tokens_total/decode": 2078476.0,
"sglang:realtime_tokens_total/prefill_cache": 36846640.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 48.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 3808.0,
"sglang:kv_evictable_tokens": 700816.0,
"sglang:prompt_tokens_histogram_sum": 51342587.0,
"sglang:prompt_tokens_histogram_count": 8085.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14789691.0,
"sglang:generation_tokens_total": 2067352.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 102.02714652754366,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.43,
"sglang:kv_available_tokens": 3056.0,
"sglang:kv_evictable_tokens": 596624.0,
"sglang:generation_tokens_total": 2060760.0,
"sglang:prompt_tokens_histogram_sum": 50582726.0,
"sglang:prompt_tokens_histogram_count": 8063.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15865638.0,
"sglang:realtime_tokens_total/prefill_compute": 15980480.0,
"sglang:realtime_tokens_total/decode": 2067664.0,
"sglang:realtime_tokens_total/prefill_cache": 35100784.0,
"sglang:queue_time_seconds_sum": 28924.592755299993,
"sglang:queue_time_seconds_count": 8129.0
}
},
{
"time": 102.02355349157006,
"metrics": {
"sglang:queue_time_seconds_sum": 21832.413898727857,
"sglang:queue_time_seconds_count": 8201.0,
"sglang:realtime_tokens_total/prefill_compute": 14928128.0,
"sglang:realtime_tokens_total/decode": 2084379.0,
"sglang:realtime_tokens_total/prefill_cache": 37078000.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 21.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 699968.0,
"sglang:prompt_tokens_histogram_sum": 51606971.0,
"sglang:prompt_tokens_histogram_count": 8134.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14832331.0,
"sglang:generation_tokens_total": 2079896.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 104.0219996329397,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 1808.0,
"sglang:kv_evictable_tokens": 557024.0,
"sglang:generation_tokens_total": 2067160.0,
"sglang:prompt_tokens_histogram_sum": 50756860.0,
"sglang:prompt_tokens_histogram_count": 8088.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15896556.0,
"sglang:realtime_tokens_total/prefill_compute": 16019872.0,
"sglang:realtime_tokens_total/decode": 2073778.0,
"sglang:realtime_tokens_total/prefill_cache": 35278800.0,
"sglang:queue_time_seconds_sum": 29004.96996915713,
"sglang:queue_time_seconds_count": 8155.0
}
},
{
"time": 104.02184547111392,
"metrics": {
"sglang:queue_time_seconds_sum": 21856.573645999655,
"sglang:queue_time_seconds_count": 8210.0,
"sglang:realtime_tokens_total/prefill_compute": 14936720.0,
"sglang:realtime_tokens_total/decode": 2093266.0,
"sglang:realtime_tokens_total/prefill_cache": 37113680.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.34,
"sglang:kv_available_tokens": 2368.0,
"sglang:kv_evictable_tokens": 685264.0,
"sglang:prompt_tokens_histogram_sum": 51644254.0,
"sglang:prompt_tokens_histogram_count": 8144.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14840270.0,
"sglang:generation_tokens_total": 2082456.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 106.02228048164397,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 55.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1856.0,
"sglang:kv_evictable_tokens": 568528.0,
"sglang:generation_tokens_total": 2069720.0,
"sglang:prompt_tokens_histogram_sum": 50830314.0,
"sglang:prompt_tokens_histogram_count": 8098.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15909546.0,
"sglang:realtime_tokens_total/prefill_compute": 16024352.0,
"sglang:realtime_tokens_total/decode": 2081453.0,
"sglang:realtime_tokens_total/prefill_cache": 35299152.0,
"sglang:queue_time_seconds_sum": 29044.479361052625,
"sglang:queue_time_seconds_count": 8165.0
}
},
{
"time": 106.0228641666472,
"metrics": {
"sglang:queue_time_seconds_sum": 21982.207000417635,
"sglang:queue_time_seconds_count": 8258.0,
"sglang:realtime_tokens_total/prefill_compute": 14982512.0,
"sglang:realtime_tokens_total/decode": 2099426.0,
"sglang:realtime_tokens_total/prefill_cache": 37338656.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 25.0,
"sglang:token_usage": 0.31,
"sglang:kv_available_tokens": 1136.0,
"sglang:kv_evictable_tokens": 725888.0,
"sglang:prompt_tokens_histogram_sum": 51950000.0,
"sglang:prompt_tokens_histogram_count": 8191.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14888272.0,
"sglang:generation_tokens_total": 2094488.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 108.0235242890194,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 10.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2624.0,
"sglang:kv_evictable_tokens": 574576.0,
"sglang:generation_tokens_total": 2082776.0,
"sglang:prompt_tokens_histogram_sum": 51239363.0,
"sglang:prompt_tokens_histogram_count": 8149.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15979987.0,
"sglang:realtime_tokens_total/prefill_compute": 16093488.0,
"sglang:realtime_tokens_total/decode": 2085691.0,
"sglang:realtime_tokens_total/prefill_cache": 35620272.0,
"sglang:queue_time_seconds_sum": 29199.938159097917,
"sglang:queue_time_seconds_count": 8214.0
}
},
{
"time": 108.02780208270997,
"metrics": {
"sglang:queue_time_seconds_sum": 22019.640613798983,
"sglang:queue_time_seconds_count": 8270.0,
"sglang:realtime_tokens_total/prefill_compute": 14989888.0,
"sglang:realtime_tokens_total/decode": 2108502.0,
"sglang:realtime_tokens_total/prefill_cache": 37375600.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 61.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2160.0,
"sglang:kv_evictable_tokens": 707856.0,
"sglang:prompt_tokens_histogram_sum": 51982476.0,
"sglang:prompt_tokens_histogram_count": 8203.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14896348.0,
"sglang:generation_tokens_total": 2097560.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 110.02275703381747,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.46,
"sglang:kv_available_tokens": 1408.0,
"sglang:kv_evictable_tokens": 560736.0,
"sglang:generation_tokens_total": 2083544.0,
"sglang:prompt_tokens_histogram_sum": 51263253.0,
"sglang:prompt_tokens_histogram_count": 8152.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15984453.0,
"sglang:realtime_tokens_total/prefill_compute": 16108208.0,
"sglang:realtime_tokens_total/decode": 2093234.0,
"sglang:realtime_tokens_total/prefill_cache": 35689840.0,
"sglang:queue_time_seconds_sum": 29206.693455890752,
"sglang:queue_time_seconds_count": 8219.0
}
},
{
"time": 110.02386709023267,
"metrics": {
"sglang:queue_time_seconds_sum": 22152.679167006165,
"sglang:queue_time_seconds_count": 8319.0,
"sglang:realtime_tokens_total/prefill_compute": 15032976.0,
"sglang:realtime_tokens_total/decode": 2115046.0,
"sglang:realtime_tokens_total/prefill_cache": 37573408.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 28.0,
"sglang:token_usage": 0.27,
"sglang:kv_available_tokens": 2000.0,
"sglang:kv_evictable_tokens": 767616.0,
"sglang:prompt_tokens_histogram_sum": 52284171.0,
"sglang:prompt_tokens_histogram_count": 8254.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14947035.0,
"sglang:generation_tokens_total": 2110616.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 112.02231097128242,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.47,
"sglang:kv_available_tokens": 2640.0,
"sglang:kv_evictable_tokens": 548864.0,
"sglang:generation_tokens_total": 2091736.0,
"sglang:prompt_tokens_histogram_sum": 51484652.0,
"sglang:prompt_tokens_histogram_count": 8184.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16023740.0,
"sglang:realtime_tokens_total/prefill_compute": 16132000.0,
"sglang:realtime_tokens_total/decode": 2099606.0,
"sglang:realtime_tokens_total/prefill_cache": 35792192.0,
"sglang:queue_time_seconds_sum": 29292.700579542667,
"sglang:queue_time_seconds_count": 8247.0
}
},
{
"time": 112.0221043927595,
"metrics": {
"sglang:queue_time_seconds_sum": 22194.731935429387,
"sglang:queue_time_seconds_count": 8333.0,
"sglang:realtime_tokens_total/prefill_compute": 15045200.0,
"sglang:realtime_tokens_total/decode": 2124055.0,
"sglang:realtime_tokens_total/prefill_cache": 37641472.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 62.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 3648.0,
"sglang:kv_evictable_tokens": 728400.0,
"sglang:prompt_tokens_histogram_sum": 52324405.0,
"sglang:prompt_tokens_histogram_count": 8266.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14953253.0,
"sglang:generation_tokens_total": 2113688.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 114.0226228730753,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 10.0,
"sglang:token_usage": 0.49,
"sglang:kv_available_tokens": 3440.0,
"sglang:kv_evictable_tokens": 535328.0,
"sglang:generation_tokens_total": 2099928.0,
"sglang:prompt_tokens_histogram_sum": 51762286.0,
"sglang:prompt_tokens_histogram_count": 8216.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16072446.0,
"sglang:realtime_tokens_total/prefill_compute": 16201936.0,
"sglang:realtime_tokens_total/decode": 2103986.0,
"sglang:realtime_tokens_total/prefill_cache": 36124384.0,
"sglang:queue_time_seconds_sum": 29383.02123996988,
"sglang:queue_time_seconds_count": 8283.0
}
},
{
"time": 114.02243428025395,
"metrics": {
"sglang:queue_time_seconds_sum": 22331.625609591603,
"sglang:queue_time_seconds_count": 8381.0,
"sglang:realtime_tokens_total/prefill_compute": 15086752.0,
"sglang:realtime_tokens_total/decode": 2130727.0,
"sglang:realtime_tokens_total/prefill_cache": 37843568.0,
"sglang:num_running_reqs": 58.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 4448.0,
"sglang:kv_evictable_tokens": 733376.0,
"sglang:prompt_tokens_histogram_sum": 52568555.0,
"sglang:prompt_tokens_histogram_count": 8314.0,
"sglang:uncached_prompt_tokens_histogram_sum": 14996939.0,
"sglang:generation_tokens_total": 2125976.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 116.03048471268266,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 50.0,
"sglang:token_usage": 0.49,
"sglang:kv_available_tokens": 1296.0,
"sglang:kv_evictable_tokens": 530384.0,
"sglang:generation_tokens_total": 2100440.0,
"sglang:prompt_tokens_histogram_sum": 51784898.0,
"sglang:prompt_tokens_histogram_count": 8218.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16076274.0,
"sglang:realtime_tokens_total/prefill_compute": 16205776.0,
"sglang:realtime_tokens_total/decode": 2111728.0,
"sglang:realtime_tokens_total/prefill_cache": 36143168.0,
"sglang:queue_time_seconds_sum": 29390.43154285848,
"sglang:queue_time_seconds_count": 8286.0
}
},
{
"time": 116.02201844099909,
"metrics": {
"sglang:queue_time_seconds_sum": 22375.042056131177,
"sglang:queue_time_seconds_count": 8396.0,
"sglang:realtime_tokens_total/prefill_compute": 15100944.0,
"sglang:realtime_tokens_total/decode": 2139544.0,
"sglang:realtime_tokens_total/prefill_cache": 37907152.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 63.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 733728.0,
"sglang:prompt_tokens_histogram_sum": 52649436.0,
"sglang:prompt_tokens_histogram_count": 8329.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15009484.0,
"sglang:generation_tokens_total": 2129816.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 118.02316074911505,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.53,
"sglang:kv_available_tokens": 2416.0,
"sglang:kv_evictable_tokens": 487008.0,
"sglang:generation_tokens_total": 2109656.0,
"sglang:prompt_tokens_histogram_sum": 52065110.0,
"sglang:prompt_tokens_histogram_count": 8254.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16125798.0,
"sglang:realtime_tokens_total/prefill_compute": 16253952.0,
"sglang:realtime_tokens_total/decode": 2116752.0,
"sglang:realtime_tokens_total/prefill_cache": 36368880.0,
"sglang:queue_time_seconds_sum": 29501.25908134319,
"sglang:queue_time_seconds_count": 8321.0
}
},
{
"time": 118.02352916728705,
"metrics": {
"sglang:queue_time_seconds_sum": 22511.650089616887,
"sglang:queue_time_seconds_count": 8439.0,
"sglang:realtime_tokens_total/prefill_compute": 15125792.0,
"sglang:realtime_tokens_total/decode": 2146798.0,
"sglang:realtime_tokens_total/prefill_cache": 38031072.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 41.0,
"sglang:token_usage": 0.24,
"sglang:kv_available_tokens": 3072.0,
"sglang:kv_evictable_tokens": 793264.0,
"sglang:prompt_tokens_histogram_sum": 52852565.0,
"sglang:prompt_tokens_histogram_count": 8372.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15043541.0,
"sglang:generation_tokens_total": 2140824.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 120.026077860035,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 16.0,
"sglang:token_usage": 0.51,
"sglang:kv_available_tokens": 1744.0,
"sglang:kv_evictable_tokens": 515296.0,
"sglang:generation_tokens_total": 2116312.0,
"sglang:prompt_tokens_histogram_sum": 52290266.0,
"sglang:prompt_tokens_histogram_count": 8280.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16165882.0,
"sglang:realtime_tokens_total/prefill_compute": 16297344.0,
"sglang:realtime_tokens_total/decode": 2122030.0,
"sglang:realtime_tokens_total/prefill_cache": 36577664.0,
"sglang:queue_time_seconds_sum": 29549.003626117483,
"sglang:queue_time_seconds_count": 8347.0
}
},
{
"time": 120.0272457730025,
"metrics": {
"sglang:queue_time_seconds_sum": 22573.36329522077,
"sglang:queue_time_seconds_count": 8460.0,
"sglang:realtime_tokens_total/prefill_compute": 15145984.0,
"sglang:realtime_tokens_total/decode": 2155865.0,
"sglang:realtime_tokens_total/prefill_cache": 38126656.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 60.0,
"sglang:token_usage": 0.25,
"sglang:kv_available_tokens": 2608.0,
"sglang:kv_evictable_tokens": 787792.0,
"sglang:prompt_tokens_histogram_sum": 52972190.0,
"sglang:prompt_tokens_histogram_count": 8393.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15065038.0,
"sglang:generation_tokens_total": 2146200.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 122.02335408888757,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 42.0,
"sglang:token_usage": 0.51,
"sglang:kv_available_tokens": 3072.0,
"sglang:kv_evictable_tokens": 511504.0,
"sglang:generation_tokens_total": 2117336.0,
"sglang:prompt_tokens_histogram_sum": 52330794.0,
"sglang:prompt_tokens_histogram_count": 8284.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16172778.0,
"sglang:realtime_tokens_total/prefill_compute": 16303520.0,
"sglang:realtime_tokens_total/decode": 2129514.0,
"sglang:realtime_tokens_total/prefill_cache": 36607360.0,
"sglang:queue_time_seconds_sum": 29558.588891919702,
"sglang:queue_time_seconds_count": 8351.0
}
},
{
"time": 122.02374017238617,
"metrics": {
"sglang:queue_time_seconds_sum": 22733.70181185566,
"sglang:queue_time_seconds_count": 8510.0,
"sglang:realtime_tokens_total/prefill_compute": 15177600.0,
"sglang:realtime_tokens_total/decode": 2163750.0,
"sglang:realtime_tokens_total/prefill_cache": 38252432.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 35.0,
"sglang:token_usage": 0.19,
"sglang:kv_available_tokens": 2592.0,
"sglang:kv_evictable_tokens": 844192.0,
"sglang:prompt_tokens_histogram_sum": 53173241.0,
"sglang:prompt_tokens_histogram_count": 8443.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15098889.0,
"sglang:generation_tokens_total": 2159000.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 124.0246642595157,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 11.0,
"sglang:token_usage": 0.58,
"sglang:kv_available_tokens": 3168.0,
"sglang:kv_evictable_tokens": 435104.0,
"sglang:generation_tokens_total": 2128088.0,
"sglang:prompt_tokens_histogram_sum": 52695852.0,
"sglang:prompt_tokens_histogram_count": 8326.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16236588.0,
"sglang:realtime_tokens_total/prefill_compute": 16364384.0,
"sglang:realtime_tokens_total/decode": 2133501.0,
"sglang:realtime_tokens_total/prefill_cache": 36907856.0,
"sglang:queue_time_seconds_sum": 29672.996054396965,
"sglang:queue_time_seconds_count": 8390.0
}
},
{
"time": 124.02364388480783,
"metrics": {
"sglang:queue_time_seconds_sum": 22792.145648987964,
"sglang:queue_time_seconds_count": 8529.0,
"sglang:realtime_tokens_total/prefill_compute": 15198096.0,
"sglang:realtime_tokens_total/decode": 2174483.0,
"sglang:realtime_tokens_total/prefill_cache": 38342288.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 68.0,
"sglang:token_usage": 0.21,
"sglang:kv_available_tokens": 2080.0,
"sglang:kv_evictable_tokens": 828288.0,
"sglang:prompt_tokens_histogram_sum": 53274453.0,
"sglang:prompt_tokens_histogram_count": 8462.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15116805.0,
"sglang:generation_tokens_total": 2163864.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 126.02298572752625,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 15.0,
"sglang:token_usage": 0.59,
"sglang:kv_available_tokens": 1264.0,
"sglang:kv_evictable_tokens": 423968.0,
"sglang:generation_tokens_total": 2132696.0,
"sglang:prompt_tokens_histogram_sum": 52838566.0,
"sglang:prompt_tokens_histogram_count": 8344.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16260902.0,
"sglang:realtime_tokens_total/prefill_compute": 16406128.0,
"sglang:realtime_tokens_total/decode": 2138853.0,
"sglang:realtime_tokens_total/prefill_cache": 37108464.0,
"sglang:queue_time_seconds_sum": 29685.988537109457,
"sglang:queue_time_seconds_count": 8411.0
}
},
{
"time": 126.0240546008572,
"metrics": {
"sglang:queue_time_seconds_sum": 22933.57418016065,
"sglang:queue_time_seconds_count": 8584.0,
"sglang:realtime_tokens_total/prefill_compute": 15228320.0,
"sglang:realtime_tokens_total/decode": 2182428.0,
"sglang:realtime_tokens_total/prefill_cache": 38481760.0,
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 32.0,
"sglang:token_usage": 0.23,
"sglang:kv_available_tokens": 3888.0,
"sglang:kv_evictable_tokens": 802304.0,
"sglang:prompt_tokens_histogram_sum": 53440265.0,
"sglang:prompt_tokens_histogram_count": 8518.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15150521.0,
"sglang:generation_tokens_total": 2178200.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 128.02304905746132,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 36.0,
"sglang:token_usage": 0.6,
"sglang:kv_available_tokens": 2208.0,
"sglang:kv_evictable_tokens": 419280.0,
"sglang:generation_tokens_total": 2133720.0,
"sglang:prompt_tokens_histogram_sum": 52874398.0,
"sglang:prompt_tokens_histogram_count": 8348.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16267038.0,
"sglang:realtime_tokens_total/prefill_compute": 16412272.0,
"sglang:realtime_tokens_total/decode": 2145569.0,
"sglang:realtime_tokens_total/prefill_cache": 37135120.0,
"sglang:queue_time_seconds_sum": 29695.597621080466,
"sglang:queue_time_seconds_count": 8415.0
}
},
{
"time": 128.0226682536304,
"metrics": {
"sglang:queue_time_seconds_sum": 22982.636670610867,
"sglang:queue_time_seconds_count": 8598.0,
"sglang:realtime_tokens_total/prefill_compute": 15249104.0,
"sglang:realtime_tokens_total/decode": 2192590.0,
"sglang:realtime_tokens_total/prefill_cache": 38583232.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 71.0,
"sglang:token_usage": 0.23,
"sglang:kv_available_tokens": 2576.0,
"sglang:kv_evictable_tokens": 808848.0,
"sglang:prompt_tokens_histogram_sum": 53546498.0,
"sglang:prompt_tokens_histogram_count": 8531.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15169042.0,
"sglang:generation_tokens_total": 2181528.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 130.02340161055326,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 6.0,
"sglang:token_usage": 0.58,
"sglang:kv_available_tokens": 2160.0,
"sglang:kv_evictable_tokens": 443024.0,
"sglang:generation_tokens_total": 2142424.0,
"sglang:prompt_tokens_histogram_sum": 53235578.0,
"sglang:prompt_tokens_histogram_count": 8382.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16327722.0,
"sglang:realtime_tokens_total/prefill_compute": 16469344.0,
"sglang:realtime_tokens_total/decode": 2149631.0,
"sglang:realtime_tokens_total/prefill_cache": 37422416.0,
"sglang:queue_time_seconds_sum": 29801.902797156945,
"sglang:queue_time_seconds_count": 8449.0
}
},
{
"time": 130.02384378947318,
"metrics": {
"sglang:queue_time_seconds_sum": 23124.37825445924,
"sglang:queue_time_seconds_count": 8649.0,
"sglang:realtime_tokens_total/prefill_compute": 15284992.0,
"sglang:realtime_tokens_total/decode": 2200283.0,
"sglang:realtime_tokens_total/prefill_cache": 38762192.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.28,
"sglang:kv_available_tokens": 2192.0,
"sglang:kv_evictable_tokens": 755696.0,
"sglang:prompt_tokens_histogram_sum": 53701970.0,
"sglang:prompt_tokens_histogram_count": 8582.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15196834.0,
"sglang:generation_tokens_total": 2194584.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 132.03074470441788,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 6.0,
"sglang:token_usage": 0.55,
"sglang:kv_available_tokens": 1856.0,
"sglang:kv_evictable_tokens": 467152.0,
"sglang:generation_tokens_total": 2149080.0,
"sglang:prompt_tokens_histogram_sum": 53477750.0,
"sglang:prompt_tokens_histogram_count": 8408.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16369286.0,
"sglang:realtime_tokens_total/prefill_compute": 16508976.0,
"sglang:realtime_tokens_total/decode": 2154584.0,
"sglang:realtime_tokens_total/prefill_cache": 37603728.0,
"sglang:queue_time_seconds_sum": 29810.239618586376,
"sglang:queue_time_seconds_count": 8474.0
}
},
{
"time": 132.02508709486574,
"metrics": {
"sglang:queue_time_seconds_sum": 23185.577414676547,
"sglang:queue_time_seconds_count": 8664.0,
"sglang:realtime_tokens_total/prefill_compute": 15296176.0,
"sglang:realtime_tokens_total/decode": 2209868.0,
"sglang:realtime_tokens_total/prefill_cache": 38814832.0,
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 81.0,
"sglang:token_usage": 0.25,
"sglang:kv_available_tokens": 2496.0,
"sglang:kv_evictable_tokens": 787760.0,
"sglang:prompt_tokens_histogram_sum": 53804168.0,
"sglang:prompt_tokens_histogram_count": 8597.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15214344.0,
"sglang:generation_tokens_total": 2198424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 134.02468417026103,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 31.0,
"sglang:token_usage": 0.59,
"sglang:kv_available_tokens": 960.0,
"sglang:kv_evictable_tokens": 430976.0,
"sglang:generation_tokens_total": 2149848.0,
"sglang:prompt_tokens_histogram_sum": 53501386.0,
"sglang:prompt_tokens_histogram_count": 8411.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16373754.0,
"sglang:realtime_tokens_total/prefill_compute": 16517680.0,
"sglang:realtime_tokens_total/decode": 2161286.0,
"sglang:realtime_tokens_total/prefill_cache": 37649936.0,
"sglang:queue_time_seconds_sum": 29818.72274698969,
"sglang:queue_time_seconds_count": 8478.0
}
},
{
"time": 134.0246615288779,
"metrics": {
"sglang:queue_time_seconds_sum": 23345.45451044105,
"sglang:queue_time_seconds_count": 8713.0,
"sglang:realtime_tokens_total/prefill_compute": 15343408.0,
"sglang:realtime_tokens_total/decode": 2216667.0,
"sglang:realtime_tokens_total/prefill_cache": 39021408.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 43.0,
"sglang:token_usage": 0.29,
"sglang:kv_available_tokens": 992.0,
"sglang:kv_evictable_tokens": 747632.0,
"sglang:prompt_tokens_histogram_sum": 54010402.0,
"sglang:prompt_tokens_histogram_count": 8646.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15248210.0,
"sglang:generation_tokens_total": 2210968.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 136.02577982470393,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 7.0,
"sglang:token_usage": 0.59,
"sglang:kv_available_tokens": 1776.0,
"sglang:kv_evictable_tokens": 423104.0,
"sglang:generation_tokens_total": 2158808.0,
"sglang:prompt_tokens_histogram_sum": 53854714.0,
"sglang:prompt_tokens_histogram_count": 8446.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16432298.0,
"sglang:realtime_tokens_total/prefill_compute": 16574736.0,
"sglang:realtime_tokens_total/decode": 2165479.0,
"sglang:realtime_tokens_total/prefill_cache": 37939056.0,
"sglang:queue_time_seconds_sum": 29908.390801230446,
"sglang:queue_time_seconds_count": 8509.0
}
},
{
"time": 136.0292771635577,
"metrics": {
"sglang:queue_time_seconds_sum": 23413.615569374524,
"sglang:queue_time_seconds_count": 8728.0,
"sglang:realtime_tokens_total/prefill_compute": 15349040.0,
"sglang:realtime_tokens_total/decode": 2225868.0,
"sglang:realtime_tokens_total/prefill_cache": 39056848.0,
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 81.0,
"sglang:token_usage": 0.27,
"sglang:kv_available_tokens": 1504.0,
"sglang:kv_evictable_tokens": 764928.0,
"sglang:prompt_tokens_histogram_sum": 54074132.0,
"sglang:prompt_tokens_histogram_count": 8661.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15259300.0,
"sglang:generation_tokens_total": 2214808.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 138.0237751910463,
"metrics": {
"sglang:num_running_reqs": 62.0,
"sglang:num_queue_reqs": 5.0,
"sglang:token_usage": 0.61,
"sglang:kv_available_tokens": 1568.0,
"sglang:kv_evictable_tokens": 412048.0,
"sglang:generation_tokens_total": 2165208.0,
"sglang:prompt_tokens_histogram_sum": 54075548.0,
"sglang:prompt_tokens_histogram_count": 8471.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16471820.0,
"sglang:realtime_tokens_total/prefill_compute": 16619856.0,
"sglang:realtime_tokens_total/decode": 2170145.0,
"sglang:realtime_tokens_total/prefill_cache": 38147664.0,
"sglang:queue_time_seconds_sum": 29913.260669469833,
"sglang:queue_time_seconds_count": 8537.0
}
},
{
"time": 138.0255957171321,
"metrics": {
"sglang:queue_time_seconds_sum": 23598.687328105792,
"sglang:queue_time_seconds_count": 8777.0,
"sglang:realtime_tokens_total/prefill_compute": 15403520.0,
"sglang:realtime_tokens_total/decode": 2232091.0,
"sglang:realtime_tokens_total/prefill_cache": 39311408.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 46.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 2384.0,
"sglang:kv_evictable_tokens": 714496.0,
"sglang:prompt_tokens_histogram_sum": 54327693.0,
"sglang:prompt_tokens_histogram_count": 8710.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15306285.0,
"sglang:generation_tokens_total": 2227352.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 140.0297676017508,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 29.0,
"sglang:token_usage": 0.61,
"sglang:kv_available_tokens": 2336.0,
"sglang:kv_evictable_tokens": 404176.0,
"sglang:generation_tokens_total": 2165976.0,
"sglang:prompt_tokens_histogram_sum": 54116702.0,
"sglang:prompt_tokens_histogram_count": 8474.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16478318.0,
"sglang:realtime_tokens_total/prefill_compute": 16626480.0,
"sglang:realtime_tokens_total/decode": 2176644.0,
"sglang:realtime_tokens_total/prefill_cache": 38183232.0,
"sglang:queue_time_seconds_sum": 29921.84178769216,
"sglang:queue_time_seconds_count": 8541.0
}
},
{
"time": 140.02226989809424,
"metrics": {
"sglang:queue_time_seconds_sum": 23657.501967457123,
"sglang:queue_time_seconds_count": 8789.0,
"sglang:realtime_tokens_total/prefill_compute": 15408768.0,
"sglang:realtime_tokens_total/decode": 2240977.0,
"sglang:realtime_tokens_total/prefill_cache": 39343120.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 86.0,
"sglang:token_usage": 0.33,
"sglang:kv_available_tokens": 2624.0,
"sglang:kv_evictable_tokens": 702688.0,
"sglang:prompt_tokens_histogram_sum": 54362223.0,
"sglang:prompt_tokens_histogram_count": 8722.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15310751.0,
"sglang:generation_tokens_total": 2230424.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 142.02256041765213,
"metrics": {
"sglang:num_running_reqs": 64.0,
"sglang:num_queue_reqs": 4.0,
"sglang:token_usage": 0.55,
"sglang:kv_available_tokens": 3824.0,
"sglang:kv_evictable_tokens": 470352.0,
"sglang:generation_tokens_total": 2173656.0,
"sglang:prompt_tokens_histogram_sum": 54450938.0,
"sglang:prompt_tokens_histogram_count": 8504.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16533338.0,
"sglang:realtime_tokens_total/prefill_compute": 16672544.0,
"sglang:realtime_tokens_total/decode": 2181414.0,
"sglang:realtime_tokens_total/prefill_cache": 38405264.0,
"sglang:queue_time_seconds_sum": 29997.17492053844,
"sglang:queue_time_seconds_count": 8571.0
}
},
{
"time": 142.0218994533643,
"metrics": {
"sglang:queue_time_seconds_sum": 23854.62943262607,
"sglang:queue_time_seconds_count": 8835.0,
"sglang:realtime_tokens_total/prefill_compute": 15452704.0,
"sglang:realtime_tokens_total/decode": 2247777.0,
"sglang:realtime_tokens_total/prefill_cache": 39538448.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 56.0,
"sglang:token_usage": 0.3,
"sglang:kv_available_tokens": 2896.0,
"sglang:kv_evictable_tokens": 732816.0,
"sglang:prompt_tokens_histogram_sum": 54623737.0,
"sglang:prompt_tokens_histogram_count": 8768.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15357513.0,
"sglang:generation_tokens_total": 2242200.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 144.02258183900267,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.55,
"sglang:kv_available_tokens": 1728.0,
"sglang:kv_evictable_tokens": 470944.0,
"sglang:generation_tokens_total": 2181336.0,
"sglang:prompt_tokens_histogram_sum": 54730080.0,
"sglang:prompt_tokens_histogram_count": 8534.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16582416.0,
"sglang:realtime_tokens_total/prefill_compute": 16721552.0,
"sglang:realtime_tokens_total/decode": 2185694.0,
"sglang:realtime_tokens_total/prefill_cache": 38641168.0,
"sglang:queue_time_seconds_sum": 29998.884351029992,
"sglang:queue_time_seconds_count": 8600.0
}
},
{
"time": 144.02232729271054,
"metrics": {
"sglang:queue_time_seconds_sum": 23920.39579453692,
"sglang:queue_time_seconds_count": 8850.0,
"sglang:realtime_tokens_total/prefill_compute": 15467600.0,
"sglang:realtime_tokens_total/decode": 2256915.0,
"sglang:realtime_tokens_total/prefill_cache": 39621456.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 90.0,
"sglang:token_usage": 0.32,
"sglang:kv_available_tokens": 1344.0,
"sglang:kv_evictable_tokens": 715328.0,
"sglang:prompt_tokens_histogram_sum": 54710215.0,
"sglang:prompt_tokens_histogram_count": 8783.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15370391.0,
"sglang:generation_tokens_total": 2246040.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 146.02407972887158,
"metrics": {
"sglang:num_running_reqs": 60.0,
"sglang:num_queue_reqs": 20.0,
"sglang:token_usage": 0.55,
"sglang:kv_available_tokens": 2256.0,
"sglang:kv_evictable_tokens": 470688.0,
"sglang:generation_tokens_total": 2182616.0,
"sglang:prompt_tokens_histogram_sum": 54788642.0,
"sglang:prompt_tokens_histogram_count": 8539.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16591442.0,
"sglang:realtime_tokens_total/prefill_compute": 16727344.0,
"sglang:realtime_tokens_total/decode": 2192534.0,
"sglang:realtime_tokens_total/prefill_cache": 38671872.0,
"sglang:queue_time_seconds_sum": 30006.610230398364,
"sglang:queue_time_seconds_count": 8606.0
}
},
{
"time": 146.02388545591384,
"metrics": {
"sglang:queue_time_seconds_sum": 24142.642443335615,
"sglang:queue_time_seconds_count": 8899.0,
"sglang:realtime_tokens_total/prefill_compute": 15506832.0,
"sglang:realtime_tokens_total/decode": 2263777.0,
"sglang:realtime_tokens_total/prefill_cache": 39779792.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 57.0,
"sglang:token_usage": 0.26,
"sglang:kv_available_tokens": 1984.0,
"sglang:kv_evictable_tokens": 770256.0,
"sglang:prompt_tokens_histogram_sum": 54953493.0,
"sglang:prompt_tokens_histogram_count": 8832.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15415045.0,
"sglang:generation_tokens_total": 2258584.0
}
}
]
},
{
"label": "sample",
"workers": [
{
"time": 148.02183223702013,
"metrics": {
"sglang:num_running_reqs": 59.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.44,
"sglang:kv_available_tokens": 144.0,
"sglang:kv_evictable_tokens": 583792.0,
"sglang:generation_tokens_total": 2191320.0,
"sglang:prompt_tokens_histogram_sum": 55106794.0,
"sglang:prompt_tokens_histogram_count": 8573.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16645146.0,
"sglang:realtime_tokens_total/prefill_compute": 16765600.0,
"sglang:realtime_tokens_total/decode": 2197498.0,
"sglang:realtime_tokens_total/prefill_cache": 38858000.0,
"sglang:queue_time_seconds_sum": 30049.866528771818,
"sglang:queue_time_seconds_count": 8636.0
}
},
{
"time": 148.20441267173737,
"metrics": {
"sglang:queue_time_seconds_sum": 24204.432506535202,
"sglang:queue_time_seconds_count": 8913.0,
"sglang:realtime_tokens_total/prefill_compute": 15518944.0,
"sglang:realtime_tokens_total/decode": 2272851.0,
"sglang:realtime_tokens_total/prefill_cache": 39836304.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 94.0,
"sglang:token_usage": 0.24,
"sglang:kv_available_tokens": 1104.0,
"sglang:kv_evictable_tokens": 794416.0,
"sglang:prompt_tokens_histogram_sum": 55051369.0,
"sglang:prompt_tokens_histogram_count": 8846.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15429913.0,
"sglang:generation_tokens_total": 2262168.0
}
}
]
},
{
"label": "score_end",
"workers": [
{
"time": 150.00597844365984,
"metrics": {
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 3.0,
"sglang:token_usage": 0.45,
"sglang:kv_available_tokens": 2368.0,
"sglang:kv_evictable_tokens": 577600.0,
"sglang:generation_tokens_total": 2197720.0,
"sglang:prompt_tokens_histogram_sum": 55336386.0,
"sglang:prompt_tokens_histogram_count": 8598.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16685826.0,
"sglang:realtime_tokens_total/prefill_compute": 16808208.0,
"sglang:realtime_tokens_total/decode": 2203048.0,
"sglang:realtime_tokens_total/prefill_cache": 39053120.0,
"sglang:queue_time_seconds_sum": 30049.998684070073,
"sglang:queue_time_seconds_count": 8665.0
}
},
{
"time": 150.00723525229841,
"metrics": {
"sglang:queue_time_seconds_sum": 24438.112159040757,
"sglang:queue_time_seconds_count": 8959.0,
"sglang:realtime_tokens_total/prefill_compute": 15574176.0,
"sglang:realtime_tokens_total/decode": 2278886.0,
"sglang:realtime_tokens_total/prefill_cache": 40087312.0,
"sglang:num_running_reqs": 63.0,
"sglang:num_queue_reqs": 59.0,
"sglang:token_usage": 0.35,
"sglang:kv_available_tokens": 976.0,
"sglang:kv_evictable_tokens": 679472.0,
"sglang:prompt_tokens_histogram_sum": 55242601.0,
"sglang:prompt_tokens_histogram_count": 8894.0,
"sglang:uncached_prompt_tokens_histogram_sum": 15467641.0,
"sglang:generation_tokens_total": 2274456.0
}
}
]
},
{
"label": "drained",
"workers": [
{
"time": 196.04930848348886,
"metrics": {
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 928.0,
"sglang:kv_evictable_tokens": 1047648.0,
"sglang:generation_tokens_total": 2326744.0,
"sglang:prompt_tokens_histogram_sum": 58092138.0,
"sglang:prompt_tokens_histogram_count": 9102.0,
"sglang:uncached_prompt_tokens_histogram_sum": 17142426.0,
"sglang:realtime_tokens_total/prefill_compute": 17181584.0,
"sglang:realtime_tokens_total/decode": 2326682.0,
"sglang:realtime_tokens_total/prefill_cache": 40949712.0,
"sglang:queue_time_seconds_sum": 30425.975305385888,
"sglang:queue_time_seconds_count": 9105.0
}
},
{
"time": 196.05067839752883,
"metrics": {
"sglang:queue_time_seconds_sum": 26917.82029299438,
"sglang:queue_time_seconds_count": 9438.0,
"sglang:realtime_tokens_total/prefill_compute": 16628000.0,
"sglang:realtime_tokens_total/decode": 2412895.0,
"sglang:realtime_tokens_total/prefill_cache": 42221392.0,
"sglang:num_running_reqs": 0.0,
"sglang:num_queue_reqs": 0.0,
"sglang:token_usage": 0.0,
"sglang:kv_available_tokens": 656.0,
"sglang:kv_evictable_tokens": 1047920.0,
"sglang:prompt_tokens_histogram_sum": 58808664.0,
"sglang:prompt_tokens_histogram_count": 9435.0,
"sglang:uncached_prompt_tokens_histogram_sum": 16587272.0,
"sglang:generation_tokens_total": 2412952.0
}
}
]
}
]
}
{
"r0_smg_sticky": {
"probe": {
"greedy_text_parity": true,
"input_output_count_parity": true
},
"protocol_probe": {
"exact_output_token_parity": true,
"output_ids": [
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000
],
"input_tokens": 1024,
"output_tokens": 16
}
},
"r0_dynamo_kv": {
"probe": {
"greedy_text_parity": true,
"input_output_count_parity": true,
"live_cache_hit": 1.0,
"after_flush_cache_hit": 0.0
},
"protocol_probe": {
"exact_output_token_parity": true,
"output_ids": [
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000
],
"input_tokens": 1024,
"output_tokens": 16
}
},
"r0_dynamo_sticky": {
"probe": {
"greedy_text_parity": true,
"input_output_count_parity": true,
"live_cache_hit": 1.0,
"after_flush_cache_hit": 0.0
},
"protocol_probe": {
"exact_output_token_parity": true,
"output_ids": [
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000
],
"input_tokens": 1024,
"output_tokens": 16
}
},
"r1_smg_sticky": {
"probe": {
"greedy_text_parity": true,
"input_output_count_parity": true
},
"protocol_probe": {
"exact_output_token_parity": true,
"output_ids": [
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000
],
"input_tokens": 1024,
"output_tokens": 16
}
},
"r1_dynamo_kv": {
"probe": {
"greedy_text_parity": true,
"input_output_count_parity": true,
"live_cache_hit": 1.0,
"after_flush_cache_hit": 0.0
},
"protocol_probe": {
"exact_output_token_parity": true,
"output_ids": [
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000
],
"input_tokens": 1024,
"output_tokens": 16
}
},
"r1_dynamo_sticky": {
"probe": {
"greedy_text_parity": true,
"input_output_count_parity": true,
"live_cache_hit": 1.0,
"after_flush_cache_hit": 0.0
},
"protocol_probe": {
"exact_output_token_parity": true,
"output_ids": [
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000,
2000
],
"input_tokens": 1024,
"output_tokens": 16
}
}
}
{
"config": {
"command": "run",
"work": "/bench",
"name": "rolling_verified",
"smg_python": "/bench/public-smg-install/bin/python",
"concurrency": 256,
"duration": 180,
"warmup": 30,
"drain": 30,
"ramp": 11,
"gap": 2,
"turns": 12,
"group_size": 8,
"context": 16384,
"output": 256,
"repeats": 2,
"cache_tokens": 1048576,
"memory_fraction": 0.8,
"stream_interval": 256
},
"source_sha256": {
"check_smg.py": "5ae4d57942c7497710630530ee44088b3546ff5a5da91e34d8f7866db23acc69",
"stream_client.py": "a9dacec0f6a356d686cec5d4440bf284c73a72109d79d53094bec9f250263091",
"serve_runtime.py": "6eb2f0e370a19dfeaaefdf007d9e2b85117a37747eb41856dc53f7f2c8272fbd",
"rolling_bench.py": "bed61b40d9a616c08cbe01e19efbeaaa7b1d0e466f7d81dd1a4067da7d5bcc29",
"check_rolling.py": "1f8685e1550ba5199da19cf9ba0c4f52332c4261a8f8ef52e053ef4c8832ec21",
"summarize.py": "7d310d868587595da931b0069c53948a47a89b68555b6ffbc2ac1b27f67c2201"
},
"versions": {
"sglang": "0.5.16",
"torch": "2.11.0+cu130",
"ai-dynamo": "1.4.2",
"ai-dynamo-runtime": "1.4.2",
"aiohttp": "3.14.3",
"orjson": "3.11.9",
"transformers": "5.12.1",
"huggingface-hub": "1.24.0",
"smg": "1.7.0"
},
"workload": {
"token_pool_sha256": "76cae9b4dcae531ab9f07f948cd0acc2d14efa3d63cbca58ebc2e4479ca80711",
"kind": "continuous causal rolling",
"revision": "rolling-v1"
},
"model": "Qwen/Qwen3-8B",
"model_revision": "b968826d9c46dd6066d109eabc6255188de91218",
"image": "nvcr.io/nvidia/ai-dynamo/sglang-runtime@sha256:3692c0c6a1ae23045f48384a09b539dcb9347ffa66ead5d0426aa90e85865012",
"smg_version": "1.7.0",
"independent_request_audit_passed": true,
"hardware": {
"gpu": "NVIDIA GB300",
"visible_gpus_used": 2,
"tensor_parallel_per_worker": 1,
"architecture": "aarch64",
"driver": "580.159.03"
},
"measurement_date": "2026-09-14"
}
We can't make this file beautiful and searchable because it's too large.
trial,session_id,turn,gpu,input_tokens,output_tokens,cached_tokens,end_s,ttft_ms,latency_ms,input_sha256,output_sha256
r0_smg_sticky,rolling-1,1,0,1151,256,0,7.517106276936829,44.44088,7458.188222,bb4e72860c14b3713595d1b0435223734fb6a8491a0e91cfba70aede58702829,291bc3a9431211ec52587e7b47a25a0332d8cd4f0796c4421fe12347b1c451f4
r0_smg_sticky,rolling-1,2,0,1532,256,1392,17.95992747321725,2966.545088,8434.639496,6314d00a1e7095f2fd64329a209ada48d62203962f1f51ba6a9e789d3b38d60e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-1,3,0,2166,256,1776,27.395858401432633,2977.757992,7435.16492,f62c489f97eef12ced1e3428e11c4e3da54933cb405704be951e46eff9cd7151,189c78c550d943c3e23fd7dbf2fae5712a4c9ed162996d148ebf2e1ebfbc9e71
r0_smg_sticky,rolling-1,4,0,3055,256,2416,36.648839408531785,2604.347741,7252.259448,4ab5c3251686ccd4df98af1233eea533a2cfccf1a2d68e521dc8cfcda98388c3,1cb1420fc7e737c802d91b83450245cd4622d6a586c5e402f519174f0111b705
r0_smg_sticky,rolling-1,5,0,4198,256,3296,46.02916871290654,2759.133966,7378.976221,d623ffd8a848ced40bb4f6a61943d0cc7fcf9b94883535f9d35851fbd016f7e0,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-1,6,0,5594,256,4448,54.78226148150861,2630.600541,6752.155049,607a9d4a2d4ac3424560ae863e17eb0ea3e58e5e5cab21e7b9d6a0f331ad1115,7a23fc2c2381a374997f6033422842395149e083f266769789f862172f2b4d55
r0_smg_sticky,rolling-1,7,0,7244,256,5840,63.956743992865086,3057.760493,7172.041325,93c60061d9f9e3d5f2bbdeb8d83e854e28fff1712b654a9ad798f38227fe4dc1,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-1,8,0,9148,256,7488,72.95515704527497,2863.818605,6994.779923,5100f17202d4e89da8da17190fe2c51b1c20ac6d4ad49f164521a9d7bccef53b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-1,9,0,11306,256,9392,82.40785687044263,3102.487199,7444.283115,45c8a0c1cd4a10bf8790d26376f9f2362aa99d52931f59dc2dc314e390c62413,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-1,10,0,13718,256,11552,91.86044994369149,2902.564442,7449.916302,1cd6a6b9eae8103168bc0a0a47379ac4e8c35d6a91b7825067e1c00fe72330ed,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-1,11,0,16384,256,13968,104.53934182226658,5658.599158,10677.267848,1a555b1a6225e41533411210dfc1086aa5139aa4afeabc546660c6c933cc7e80,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-3,3,0,2166,256,512,7.821997802704573,81.345297,7678.324157,d9ce4b0711576d124dc9abf7c87e681de0894ad9715e493d82dacce9d452a645,8fad52cd7b198404257e87b50737172528b02d1a2f6aada073468925c25a67f3
r0_smg_sticky,rolling-3,4,0,3055,256,2416,18.074604077264667,3133.350425,8251.57841,484e842883cf4e9cec2ffeb6c67180b5ef923b4ec0f653eb016caf8e54c52213,e27fee0bfac644591092b04cf99658ad89ee80a69e7bf1fd6ae8ee97067a0413
r0_smg_sticky,rolling-3,5,0,4198,256,3296,27.532099361531436,3033.738398,7456.218777,3301873d3f980b53ae044964f14ec2e0cc07113c1468635c0427c22eef3499ae,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-3,6,0,5594,256,4448,36.77767264377326,2722.487182,7242.59974,7c0c4903fbbebc2de0209fc307ae107014c5777046e1dcbd7593bceb8e591863,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-3,7,0,7244,256,5840,46.320049497298896,2964.062161,7540.011059,fd8268f89b385d4373dd540c36ec95af720f9045062533f309698fae743b69a8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-3,8,0,9148,256,7488,55.627684275619686,2727.871438,7299.39615,06dc84fdbcc0889ce5ed72be3387bbf4e9ee09d4cd9056472b50af3a290bd28c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-3,9,0,11306,256,9392,64.79198496509343,2721.979851,7163.077686,16c4f6189dd723ce7eeebef689e8c9a85e7f98cb4443d5e138d0744374ab47fd,1cb1420fc7e737c802d91b83450245cd4622d6a586c5e402f519174f0111b705
r0_smg_sticky,rolling-3,10,0,13718,256,11552,76.19248522538692,4964.212453,9397.480672,495ddcb53d6f5703a532daadb90bb2cc2ff808316482676511d8f68160f22d6d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-3,11,0,16384,256,13968,85.55142348818481,2907.936475,7357.019319,7e65bbcc3c3b82b8135bab06fc7669ba22a9d0b22c45db787bcb1c2f54a749b8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,0,1,1024,256,0,7.838894065469503,285.437391,7805.577255,697a4e27b33396b99d01920337f1087480db2caca7ac60391e6a4fb72a4b3ddb,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,1,1,1280,256,1264,17.590608770027757,3101.480887,7750.588695,3599b5523bbca23e74f434942c774a97294a03a54f0564cd237c9bba5d5391e7,1cb1420fc7e737c802d91b83450245cd4622d6a586c5e402f519174f0111b705
r0_smg_sticky,rolling-0,2,1,1536,256,1520,26.43882046174258,2754.296308,6835.344233,0766a9c7f4cfd577b0beabebaffbe06854788a6e4ea73cad88892735660360f2,c71198d8d69ef50857b15636bd2568b7a5f4c84e3a50fdd02fccb1b149e83b3f
r0_smg_sticky,rolling-0,3,1,2166,256,1792,35.23402920272201,2886.345846,6785.719191,a7823a67cf9fd57900e19b4d11116adb0de6bf33e67cf370bcec55f171bd5c7f,c37288c42ac9dc335afe36be2eb34ba1154401384c7701683ce88ef888f8020f
r0_smg_sticky,rolling-0,4,1,3055,256,2416,43.86498951539397,2574.500711,6628.574871,1be83ff106dbf8fbc2fcce2f4b5a4295d9c78e995666300c8eaf64bcd86ec6b9,167ca3c73a073c1d801aa752b8807d110e4ab12a5a76b185d25f652e0d9bab71
r0_smg_sticky,rolling-0,5,1,4198,256,3296,52.71431592758745,2902.766523,6843.46591,71610b5476685191fe2c8f01c4855750971106a740507a254e6569f9dda7c460,0832c830ba22aa63fd590ba092fa43f3658d2886d5e1c65cee9a585988806de8
r0_smg_sticky,rolling-0,6,1,5594,256,4448,62.02696705888957,2891.722167,7306.70445,f4f051a74cc440d06f8fa41775a229a81790939ffeb11f840d62d5b5e7c019d7,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,7,1,7244,256,5840,71.13169480767101,2850.831102,7100.479416,81f387454643b48e83fff3f9436996e6aa87d85e3c834368decdc328b17a0b2f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,8,1,9148,256,7488,80.65477979928255,2807.276916,7519.808985,77536fa901a126d50108bf4f969fcfdd1b66530f52a4844a9beafcbd1b9f22bd,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,9,1,11306,256,9392,90.00004514493048,2803.283931,7340.944884,3cac70cb702499e029fcba83afe631da937f5c4347ab48338f100788810c0484,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,10,1,13718,256,11552,98.63880944252014,2430.445975,6635.757571,103a54adedf0df37af8f87ae2b8ff289a307ff76624dbf9243883254f82e10f4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-0,11,1,16384,256,13968,108.14212260302156,2943.090226,7499.971457,ce2907f0c6ec6164233fcc19664064c64ee2ba9c7c7f8ad69f929741e4bd1ee4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-4,4,1,3055,256,0,7.838990481570363,195.551498,7652.049725,c4dbb6bdf67a5e7ced66ef75d778e3aecef987af28558df0dc50901e0482dfc7,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-4,5,1,4198,256,3296,17.58737527858466,3101.010708,7746.947233,af57987514ea6c5e4b5bcb9505d56cc06603dc73094781d0529defeac9d3d74c,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-4,6,1,5594,256,4448,26.4336299020797,2579.196454,6838.442715,d0152763932f09932d5fb92f254219c79ddb7f13e8940fe0976fb338adf13c3d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-4,7,1,7244,256,5840,35.22185530513525,2738.284942,6783.364713,706bcfdc83df49a6d70aace01ef49fc7f2140146b776cf7005d526d7ffdc34be,4ecb9e3c253259e720bff36849d3dd49a027509bafeada29e40c5cc60f12632b
r0_smg_sticky,rolling-4,8,1,9148,256,7488,43.862615388818085,2473.185533,6637.442926,4ebc45a5da76b989892943fd5746e723cc6e821b7527653aecec504fb450c8f4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-4,9,1,11306,256,9392,52.71530233416706,2801.775698,6848.901207,30599f9dd13d0f4418ef6d2e0d65bc004def120ddf5b34624b02cf802bc118d7,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-4,10,1,13718,256,11552,62.02427158597857,2994.890925,7299.215669,eb691e2f13176461c9832851d158bc0eed8421708d8d23ff512dd6865c1ac7da,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-4,11,1,16384,256,13968,71.13457604125142,2661.9015,7107.740452,e3f79af2e99f4ea01e5174e6a7319392d65f077f51ac30da712c08d363fe1e73,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-2,2,1,1532,256,0,7.8391013303771615,281.911865,7738.566957,d173643cfb68995fa51fb3949db57ca970771939c0327d2d4f8497dbca077664,87cda4d55928bad79e371c20d0c339e2cf3dc356323587952678425f0f0e25d7
r0_smg_sticky,rolling-2,3,1,2166,256,1776,17.587873170152307,3100.730194,7747.206242,c05bb0691282883a6a4f95fba769e00d0e17f6de258e92bbded5cfefa48e863b,64e384246c5b34521296e780689865fd036b8e51d03d40991e463a85383a8634
r0_smg_sticky,rolling-2,4,1,3055,256,2416,26.43183881882578,2693.171741,6835.677642,5fabfd49960e8bff7d3d7037446b2e2db845aabb99ec6a8228abd794516b99e0,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,5,1,4198,256,3296,35.23557769320905,2740.456187,6799.338154,603a0f17356ef6196fdbd15b2101096c5b03f4a5030954016b4a215fac3eedd9,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,6,1,5594,256,4448,43.86710434406996,2678.066911,6627.642705,1a39bf65a7b1908c7f0e961d9e6613f65516f2fa43c6db77494a0168bcb70050,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,7,1,7244,256,5840,55.13406884577125,5144.775347,9252.852525,c8072058fdbc458ec6ee7741cb49bf117f22ace214a9d29bb0059d84782fef56,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,8,1,9148,256,7488,64.46067961398512,3074.481939,7324.757201,f42e995140fa0164765f261ce94ade7044cf4face55d529ddca4db2885978617,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,9,1,11306,256,9392,73.68298849649727,2853.067979,7219.077932,2df914b8df3f9e2f8ca8d151139a7866f832872cf145f357a668a2e280e92829,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,10,1,13718,256,11552,83.1123095555231,2956.661572,7424.533298,53305abbc1caa3b5cc09bfc96144f58ef8602f7202b5c6ef6c04be504ea851d5,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-2,11,1,16384,256,13968,90.00287069845945,423.274488,4888.109973,e65781049dc645bc2929fd08ba244b2f1e26739dfda174d45be5a5fc2f5d6c62,e492ee546ccd0860c894a5f9126ccf950630e81156a047b678b1f1af9a9e9e43
r0_smg_sticky,rolling-6,6,1,5594,256,512,7.83916094712913,118.702773,7566.074448,6ec95cf7323ea6c6051aadbedd03b463d64ffade24edea6589257d11036400aa,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-6,7,1,7244,256,5840,17.58627677615732,3099.705292,7744.699668,104d76c412accc300d91989c93025e306e2fe2da4552c866e575d8d0837d55e8,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-6,8,1,9148,256,7488,26.434751988388598,2582.627067,6842.921079,67dc45fd371c12e745d163646a9ce5c5cc98cfcc867043ee976fc3d5ee202430,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-6,9,1,11306,256,9392,35.2346773352474,2886.285749,6794.553805,a9cc1a211cf2c0cd079c1a26d111a41fa52c454f7bb8dc6e750898208106a03e,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-6,10,1,13718,256,11552,43.866221266798675,2679.117286,6627.860723,a4c27158226139bdb000095f30bba051d53f06297ebd40cf446fa930db8f0d06,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-6,11,1,16384,256,13968,55.135400181636214,5167.429534,9255.9512,f10289b721a7deba314499e76d12d49205b96d1c432f51d364b120787542ce5c,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-5,5,0,4198,256,512,8.07217974588275,76.258322,7842.603017,efeb0c1af0d6d4ca51af312b6cfba10a498cc70349048b3f3a07fbdc8b6c6728,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-5,6,0,5594,256,4448,18.24324395414442,3107.703261,8169.563605,d6ea086c99bdc1357cace1d145ff4412d9905d106979e9427f8e021abfe6442b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-5,7,0,7244,256,5840,27.531634238548577,2864.752182,7286.745838,796200beb7e8b7b7ba46c52097c3bd2c58ad68a9e7576f32efbedeba73dd933b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-5,8,0,9148,256,7488,36.655966493301094,2605.070049,7121.604922,8b53ccf3f9d4c651fc9b21bfa92a49e03688568230e6e0e2312b690e2364270a,1cb1420fc7e737c802d91b83450245cd4622d6a586c5e402f519174f0111b705
r0_smg_sticky,rolling-5,9,0,11306,256,9392,46.15010996256024,2930.295651,7493.087189,41f812f363c7b117da412ced964bc3a0793c9891c39e505d8f89b58939f2c680,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-5,10,0,13718,256,11552,55.34718179516494,2695.274024,7193.918642,decabd3568df70d48e46169202f8232a2e454e45363c6b6924f437a186a50997,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-5,11,0,16384,256,13968,64.65733239799738,2864.434225,7306.83594,7e9fe3442db7efd9296b0b7689e399fc8f5174566f3234ec0f6f5910ad16564d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-7,7,0,7244,256,512,8.188372646458447,86.81253,7871.576377,d422888eb3e2acaea27305d452ac81fd101c9cd3e35e8cc2707eeb6adf01c1b4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-7,8,0,9148,256,7488,18.24362056516111,2991.122229,8053.17131,c0bc099115e360034135c7c46f726df7b0355c4c5086edf5f584565bcbadb7b1,5065c12dd4a6c8257a6389ff558b7c0bd12d840b10bf6b1452357904e27e9332
r0_smg_sticky,rolling-7,9,0,11306,256,9392,29.973969695158303,5212.392851,9728.150823,b20d4c339601765064a0bd7e10ee757ff6b00662ad29f7048e7b2e60dc92bcf1,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-7,10,0,13718,256,11552,39.4173320569098,2677.064314,7441.646429,a8fa8ca13b29a08288f8a6a7abb10dbc520f3f748434fd9afc71307bb0411ae9,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-7,11,0,16384,256,13968,48.80824385583401,2807.564341,7387.664977,5282fcfc07b9f6fbfdbda41722ad50c0cf27504896792eab0598e8b1db2a9348,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-8,8,0,9148,256,0,8.209522793069482,186.848148,7830.315901,2ffa5c6c16da3f2ce293df1b0caaca8f610ddf774acecbf68c43992991235fa8,50870a39ecdc2de68ca0660dbab201cb3705d9617e6c5a3d60c62a39c3f4ae98
r0_smg_sticky,rolling-8,9,0,11306,256,9392,20.758432273752987,5297.263315,10546.930506,8bcffdfdc172783551ae3eb8fb8bba7724ee7b21bea02c64a650687a6fb2d956,f5cf03e2dcb1697306db0a894f5c58039cea17e5a04a11afc4b812a4d731c1f2
r0_smg_sticky,rolling-8,10,0,13718,256,11552,30.174833736382425,2977.944933,7414.915384,c41d46ca09ef4522a52855ab3e2ce647bc7eb3c4dc9c57f50035ef2755f94208,7ab7a9fc1617faf177b3440df5d607a18b2ac43de3182080a2c18c6a74658bdc
r0_smg_sticky,rolling-8,11,0,16384,256,13968,39.63049735780805,2754.258994,7452.586847,2ad9d199907ff890fcbff497a3228be29cfc4e79289ad3ce684d308fa51b414e,85c21c7269f1e8858df578c1df56312b7ca28bf1af780bba05ea3d4f420653d5
r0_smg_sticky,rolling-14,2,0,1532,256,512,8.21003018785268,147.427588,7593.728825,30f9058ba057ae7ca2a9c411d85ada6f887d21197f66a1c39ac65c5ebde53732,78d3cf3500969bb0876f141a087f4114cde8a54ad078bebec399265346bc805d
r0_smg_sticky,rolling-14,3,0,2166,256,1776,18.24409628007561,2973.55553,8032.161422,73ffd8f4726b14c0801d8a23241802cf80a47a24931bd97b371cd32232790459,409518599e8651374fe48a2a9785ce5ecfd09e984b3c70ba89b102508ba9111f
r0_smg_sticky,rolling-14,4,0,3055,256,2416,27.659676301293075,2933.669114,7413.115505,a4847f6447a8cd8986a5153dfd08bd363c45d50380cc0fd862d7a5dd3efc7745,eec5803795b402de6ddadbdc908a867ea607475b5c1c2b294a4453cb57330803
r0_smg_sticky,rolling-14,5,0,4198,256,3296,36.77721366472542,2596.362892,7116.118937,0bfd601d92ab28b89ed86f12832caf8ffe582f0660437efa8af2b307b4de7762,d7267c06876d8684e4997c504def8c61e061ad3f273d584844b6d91017679f92
r0_smg_sticky,rolling-14,6,0,5594,256,4448,46.15074302256107,2808.589212,7371.940913,121f61d5719f1478bfde65d7e26fde60d850c30e381a670306919b5e9f5b2a5a,d7267c06876d8684e4997c504def8c61e061ad3f273d584844b6d91017679f92
r0_smg_sticky,rolling-14,7,0,7244,256,5840,55.346895585767925,2694.511683,7192.848843,93557fc3125136b5e2b8dbcfdd6b640702e5ac8367e193d41cb95cf9726b2c5e,d7267c06876d8684e4997c504def8c61e061ad3f273d584844b6d91017679f92
r0_smg_sticky,rolling-14,8,0,9148,256,7488,64.64562589488924,2812.415987,7296.249155,b0c1d8f860467a567b47d40a47f11c277b3ab41ea8c212a0e60780afba7faa81,8759b393bfcfab63ef0711e7797023aa275d7f4e1abfe9f79517e36a9353fbf9
r0_smg_sticky,rolling-14,9,0,11306,256,9392,73.81193930003792,2778.769765,7163.499096,45366f94a91d898c76a754240fa0307e2dd3a861db5eafbde86de4dbda9f6de1,d7267c06876d8684e4997c504def8c61e061ad3f273d584844b6d91017679f92
r0_smg_sticky,rolling-14,10,0,13718,256,11552,85.22148457728326,5007.2763,9402.33907,ab91360f6d9cdfa37d1f74348235f20299e53f9414d2df0ada95166d8d49b9cb,e825e7a8e1c0b11bc21b3d081af802ecaee0e4921fe0ae545d419d57a26f897f
r0_smg_sticky,rolling-14,11,0,16384,256,13968,95.067258708179,3048.559765,7843.070095,de95ed2de1f81afddd16c33a6bb1f41b1accaf5a6cb4f43bb2a9c727ed42b13f,d7267c06876d8684e4997c504def8c61e061ad3f273d584844b6d91017679f92
r0_smg_sticky,rolling-16,4,0,3055,256,0,8.210111372172832,100.85572,7489.035514,69bc35d3956fcb33f120784606623ee2b087ff3042537e5d91c099b3db17fa39,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-16,5,0,4198,256,3296,20.532856048084795,5082.514901,10320.623045,dd1b226952385b0ba7b0da9d1031a86d3ae7209803ef027ceea40f5308d8cb0b,a15464dd783a8028c268748320bbdd3cda49ad3bae0e9ca304fcc9dbf95690b1
r0_smg_sticky,rolling-16,6,0,5594,256,4448,30.17428246885538,3203.373734,7639.899478,803dcbf3ac0e6f0daa032c5121ecdf5e4bceebfb152c95aaca44b90c12e5c8d1,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-16,7,0,7244,256,5840,39.63190405443311,2756.319711,7456.035989,4b3bbc777eb7a59229adf250c3843be63c914eb38e5f65d3ea173978a115e079,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-16,8,0,9148,256,7488,48.9400652050972,2782.968863,7306.473153,74b16e1e6c72d63be7f2ee00a5f16e8e8e610e806828a1e880eead3fdc68d49f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-16,9,0,11306,256,9392,58.2463460881263,2720.169408,7305.186234,ea0deeffff428f20978c8ff77f39436bd63a7879ea5f80ca97c98f2fa206a2b4,a93dbc3e97f3e7916ad07db116a63e3f4505768d114e92e19e961cee59768dca
r0_smg_sticky,rolling-16,10,0,13718,256,11552,67.89405612740666,3116.211122,7644.085263,3886501c3937e134ad0f8c855f59cc6845f4a9698b3712316acf45c5bc1e5087,7193d665b35f19a49a068212c3068410ca35fae8b22b8493578f30ed005c3336
r0_smg_sticky,rolling-16,11,0,16384,256,13968,77.48230218980461,3194.096557,7584.664196,90d4e6d623dce04a4b8f7918ff469de9fc6cced328d0ee4647d01eacb5840123,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-10,10,0,13718,256,512,8.210238540545106,282.326204,7764.843342,aee1cb686aac358a2419d488d2dfa18803b9dd0a7e9c41181a21d69df97bc9bb,99c2c4d385b7385a6143ab322fa3fe9e0b5c5294429a5029634dcd081c947a34
r0_smg_sticky,rolling-10,11,0,16384,256,13968,20.834064288064837,5391.510131,10620.266858,db17bf544c46da8d7a32bc30783d6456740d16bc4bf34dd163179f0f8b163950,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-13,1,0,1151,256,512,8.210667982697487,190.320842,7637.223714,87035e1b086c4eac20072b4d11deb6cc598628bed71aec8a839b156eb6404bef,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-13,2,0,1532,256,1392,18.37900446355343,3047.575854,8164.928217,a7f1e957bc69cade4fe5ce6a6c21245cc59163e4ccabfffbd0f25d56708cb2e1,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-13,3,0,2166,256,1776,30.155458066612482,5261.38435,9775.868042,20a67cf9c31f5d8ba805156959a8a615cac739e9e98f9027ec2985eefea628ef,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-13,4,0,3055,256,2416,39.60332676023245,2679.736875,7446.558459,7b6262a3b9c4285af9d8e0dd4ffdd101a58ac64dfc472ae647fa4e9649172411,a15464dd783a8028c268748320bbdd3cda49ad3bae0e9ca304fcc9dbf95690b1
r0_smg_sticky,rolling-13,5,0,4198,256,3296,48.941124027594924,2811.907343,7336.355927,012def9575a52160bcf38168aee600fafe32163e826b149e97020b82bdf7c121,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-13,6,0,5594,256,4448,58.47239076346159,2913.950431,7529.188913,7eeb91421197ab024b7f6f2ce57c59ae194f51943b471364034b6bd1c7debeca,952b3842d038dbd4c36ea665776dd5a4dc7f80358c22479fe8d59151d8a09523
r0_smg_sticky,rolling-13,7,0,7244,256,5840,67.89446368254721,2891.694327,7420.064279,37b2933898fb1aaed09280501c692ed9643fa712ea2609eb85693450258d6da0,b2083355c91d745f02a84ecdaed3d3743710105da50620bd402705b53f20e60c
r0_smg_sticky,rolling-13,8,0,9148,256,7488,77.48302334547043,3193.405865,7584.704644,30113f5256689d5eedb47a1a7c3fc31ad4fd6fab68c91997f91f0985408aadee,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-13,9,0,11306,256,9392,87.0817303666845,3298.015784,7586.043085,4d12dc2f92efb083aa7f5f168b7870a3a0b2fab5c7c8dc1313f493fe2dd66063,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-13,10,0,13718,256,11552,99.370315477252,5594.773743,10286.20754,374ed7d40f42c607daae7fec44ea3b048e8d0aa25160bfec48d17a9660715b3e,53fe68b1448a883223130e58fce7924eedb6994971101285c5200d208e734e76
r0_smg_sticky,rolling-13,11,0,16384,256,13968,109.40923475567251,3543.767013,8036.947184,ce168b624c40f657ffe0eaf039438aa5660183b8e0ecca327eec3738ef3ad687,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-18,6,0,5594,256,512,8.238068534992635,92.138707,7449.491881,4f7efd042b48bddcc4735908942c1ccc41d2aab097ee417323326834a8315988,0bed280b8f829bca194ff6282e0d27e3811805cdb0f2d0be56c6e4fad1db51fa
r0_smg_sticky,rolling-18,7,0,7244,256,5840,20.941156429238617,5484.330602,10701.891549,3b4082678617774b674ff223589bee41163b006d3414423b5a27d997ef6affed,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-18,8,0,9148,256,7488,30.174518630839884,2795.616781,7232.238877,be86ca91f88f8ba13de984b9b67645e44b5505e58804e3e10eb6c83f29d4a7e6,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-18,9,0,11306,256,9392,39.63140286691487,2755.635578,7454.813645,9cfa12aaefa805e33288eaaa404cbc1f615ff7e30410f2943e1ff9b699892f30,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-18,10,0,13718,256,11552,48.94072924088687,2783.556643,7307.678217,31329a0481aa5eb78c472e6fe00754e68248fd1a9728f8d8052bc59fb3a13dd2,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-18,11,0,16384,256,13968,58.47169306408614,2914.358114,7528.941712,5d6214025b530380d0158f41da8c1bdb7c8be9cb1760f4f6340f6cef2cb66971,0bed280b8f829bca194ff6282e0d27e3811805cdb0f2d0be56c6e4fad1db51fa
r0_smg_sticky,rolling-11,11,1,16384,256,512,8.280859995633364,299.466437,7791.174607,03b24a7ba198d1f4cecbd49a4c798dafdbcbb9e653f6a7cbdebd58570a7f0e0e,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-12,0,1,1024,256,512,8.281555199995637,259.08411,7751.51974,8ab939e00713bbed9d8209df1565b2d11f75e5df72ef69668983f7e60886dd73,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-12,1,1,1280,256,1264,17.58883429504931,3120.520171,7306.718497,74c623ff374a21d1adae1969acdcdc552427119217a4ff467da0a709d097a34c,1cb1420fc7e737c802d91b83450245cd4622d6a586c5e402f519174f0111b705
r0_smg_sticky,rolling-12,2,1,1536,256,1520,26.433866864070296,2690.32494,6834.852549,ea470450967ec22ee6be8203c7295e2740b4f053055643c59430d666d02859b8,c71198d8d69ef50857b15636bd2568b7a5f4c84e3a50fdd02fccb1b149e83b3f
r0_smg_sticky,rolling-12,3,1,2166,256,1792,35.2358074542135,2737.761194,6796.995611,7c84b63a47a3f40919b759aab6334cd15dc0d2394548e4c5a09e718161bace7b,10f3a4a67d94746fb9717e9ee3c2b7a443d06ca022af4c00edb4e0c746340201
r0_smg_sticky,rolling-12,4,1,3055,256,2416,43.86512270011008,2677.813374,6625.392484,9c0ce183633a3838ce4bf0d3b09c74f9f731419032b37f5ea25fc59713b72f0b,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-12,5,1,4198,256,3296,52.71568246465176,2898.560257,6840.711622,b344d8f1f6417715aa9a599f1853ed532cd17215a0b0840a7bb6a9d77a1b3313,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-12,6,1,5594,256,4448,62.02983683627099,2994.457098,7304.254868,7892311896c5e3cb33dd1321161e4d44ea60244d44f496e6fabf607b4c34f6ea,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-12,7,1,7244,256,5840,71.1291892239824,2927.59045,7090.662652,d3e4538220e4983fe516a3b93274f18038fc45e2e26291acfec444f2b9abb4b4,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-12,8,1,9148,256,7488,80.65702646877617,2811.335629,7526.188576,7168de5d60fee73fb3728d765b8b3d92cf84c27af784f5784e1a3db4913f2401,a99f701b70636aee39f536909b0e32958cfc41e77927da2d576bb57a346cc6b8
r0_smg_sticky,rolling-12,9,1,11306,256,9392,89.99935499671847,2799.722854,7336.771803,260cb3d631d42ed100593e79cf35c70e4f51c4094ca7f458032e34ce79210e90,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-12,10,1,13718,256,11552,98.63951415102929,2431.559902,6637.39755,8f2e0bfc8c0e7a80decde61b97a7ee577987154a5d96da93a99aedc668d1d597,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-12,11,1,16384,256,13968,108.1428363667801,2940.969349,7498.586168,e7787274a9a89e68e310dbe6733fed6dca64aaa7b216dd6838c24f801b631a32,70d5ebe8724d60af1b49ffe53452deed8190a81bb9f4cef8687569943b0e9d1d
r0_smg_sticky,rolling-15,3,1,2166,256,512,8.281679520383477,163.540486,7622.067334,85b06a065fe50485c04b725030fceb2710a27430a21486b9e51cf11b95401a48,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,4,1,3055,256,2416,20.01035724207759,5270.873651,9727.707937,0739b7354239c87ca0192331840fb1ac242b38d0ecdb2793c6b826467f567748,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,5,1,4198,256,3296,29.046687585301697,2565.046638,7035.56091,a4f5373476e3a263800bf9b2aa2f2200b2164dcce9a9e512128d802c53cd86e4,bd54dcd32e7e87c24daf5489b994620caeeb2126f3c8d37f81048e5043432b67
r0_smg_sticky,rolling-15,6,1,5594,256,4448,37.8847541231662,2653.358281,6836.937936,623e341a699ee8054c02a64dc2bafafb9284a291ae6ca06207a39cf24ba208e0,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,7,1,7244,256,5840,46.871870113536716,2645.652249,6984.952918,ffd4901483550156e3b139dfada0df40a62967bb3ce5fad19f22d3309ff6a845,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,8,1,9148,256,7488,56.19773134030402,2967.055683,7324.275694,0e808f3a63c4650d51b1a6f794dc654fcebaeed7ae7392df0be98922f410b64e,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,9,1,11306,256,9392,65.38084667176008,2828.457109,7181.454758,e65365c35cbeb4df2b7d5dc213d67a01e2d4549f05b999fb03e5d028ce27ce6f,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,10,1,13718,256,11552,74.67546898778528,2783.946949,7292.252075,7f8475dbaf54222047d3b5618ed3c7cd1a7a7bc27bf3b51d473860551b7f9c25,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-15,11,1,16384,256,13968,83.90845310501754,2679.618825,7230.941173,963d64b75ccda83494ed8daacf7d307dad70e2b769549826f18186a488021beb,77a18f3685cc70673a5386b53ad1d1da2490ed137d6c712839c548db1257cd93
r0_smg_sticky,rolling-17,5,1,4198,256,0,8.281801762059331,94.992452,7536.4903,4d257a799a1d68cc9e84ea77e15368622d2ec2c344e9cf088d5317418060618e,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-17,6,1,5594,256,4448,20.010688668116927,5270.17851,9727.357214,2b52049ffb7f936b75cca9801bec90236e2f6bfc8ef744280bc1827c8e40e320,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-17,7,1,7244,256,5840,29.183670821599662,2735.426302,7171.726093,fda8a88b3f7c5dde422f223f834cfb290c33d671f518f477faef99d83ac80bed,acf034b4615e80fba6faad806eaa227e7d59689580f16fe211aadb46c80f8dae
r0_smg_sticky,rolling-17,8,1,9148,256,7488,38.09195670019835,2757.406595,6906.176054,a365713ae361781498c2ba6e83c702a4cc48aba9be69ed86748650f56557b19d,8cf4bfcdccf9790c6a4ca6069d6d6d0142de52e00e14fa2c9747ee06d5876bfd
r0_smg_sticky,rolling-17,9,1,11306,256,9392,47.18310247827321,2777.677824,7089.101779,6951610457910e4fe4ea7c3f9493a9cbf0ffacd4769fbd7cd99347d0ade4b857,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-17,10,1,13718,256,11552,57.24351001251489,3728.057769,8058.108206,a570cbebdd5c792fba916caef137badb1c6d1940313549eccf275fad4021911a,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-17,11,1,16384,256,13968,66.55070203822106,3014.37178,7303.414383,38eb23dae681daf80386e17d7872c490aa65f86ef44ae2ccc4f0580ca9ce16e8,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-9,9,1,11306,256,0,8.282012514770031,182.821788,7878.925638,3b388bb038511ab18b7b1bc8e68d73fd90fcf5e0033d8920e607c8ee74bab3e8,eb836707772fa95f11d8719e8d126a2247462d22ee45063e33bc86f98e3e82c2
r0_smg_sticky,rolling-9,10,1,13718,256,11552,20.194156220182776,5614.578277,9909.061716,3a441dc3c60647a371dc2b9e77eac3d2de1789d18d8511155caccfc55a942e9a,9cc7d8aa8e85e38729353cf6b4d67b2ae742ffe6f3129641c0eb9618a8ffdcba
r0_smg_sticky,rolling-9,11,1,16384,256,13968,29.195530413649976,2657.789891,6998.290026,28847cff9111096bc101cddf6274f4c09ce136c43efef0bc3ad8055c96ba2e55,9cc7d8aa8e85e38729353cf6b4d67b2ae742ffe6f3129641c0eb9618a8ffdcba
r0_smg_sticky,rolling-19,7,1,7244,256,512,8.292046272195876,86.934163,7460.116713,4fb621038bb36c9cdb34ea1498722da75346f3475585941739f638d5b3617371,bd38b79868fee1f2527408fa5ff03e659973e3963786f4d9fdc1b20f0d902d49
r0_smg_sticky,rolling-19,8,1,9148,256,7488,20.010923037305474,5383.003999,9716.860222,4ad70409f156afb8fee5f4f37492e0cf3e281acfca8953b4cb9afb91504187e1,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-19,9,1,11306,256,9392,29.183944678865373,2734.541144,7171.21297,dc276f27ffa16311c33f09845172b1d17d0b2429cf58088c7f9744e8fd3129a2,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-19,10,1,13718,256,11552,38.09228834975511,2756.611518,6905.680403,c94ded9ebe0af81e62e286c2ac7d3b6d251afa2446ace7c60857860c92f84df6,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-19,11,1,16384,256,13968,47.18249568995088,2776.041781,7086.911973,dea0d29e97b95b68c643677a0113b0b2cd9107ac81db07d3c9bc8b413ca474ee,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-23,11,1,16384,256,512,8.33195330016315,268.971626,7326.457241,b2dc17d1cdb447fb04a2edfb9b23ab72bd636694b466b55301a2063048a517d7,b84e4476c33074050b32a59522f60cc6ab7d30ddf86e374e34c5133fe22cf340
r0_smg_sticky,rolling-20,8,1,9148,256,512,8.332658391445875,198.524413,7457.87782,edf4a55eb81f91bb5f3e04c72ab3e42d34bab5cbde52377c810757d791ab3927,0c439df987fc0b4dfdf634993531ca12a8c6b0458dc9bab1d1e095cbbcd80544
r0_smg_sticky,rolling-20,9,1,11306,256,9392,20.195040673017502,5564.92863,9860.150825,c1d2feb50fee07ce81b21f0d806526a355d347b0af9d96ed5ed307dd5bd5979b,6fef31b8d37e734f35a7bfae956baf4e98f3203e490d879e5fc1c5a70aaf96dc
r0_smg_sticky,rolling-20,10,1,13718,256,11552,29.194919274188578,2655.756087,6995.672666,bebd91b9e0f1cbca815697d3f694149f00919826296863acb8138de2b0c2e322,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-20,11,1,16384,256,13968,38.262586574070156,2891.945241,7064.774175,bba41396afa727f72a3fc8d9e98ddc020adc75451fd9c0698dc5849d03ba27f8,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-24,0,1,1024,256,0,8.332949274219573,243.311053,7269.430653,6a1c8ca9f532d4d0a2bdad840fd6f7ab17b802723a73c2502bde2cb6a8c81851,e60dd8becfe37be142b3052d0a3b0c5235a7e19d1f7d6ff4d0d5401181769a05
r0_smg_sticky,rolling-24,1,1,1280,256,1264,20.194709022529423,5563.614861,9858.702336,2f508b9a63beee12b6b61e3f1c4f0263f1b169fda7ee9e155f1cb93c1723ef56,892850ea4e8cd07f57a8d5cf7b0a3619af2ec1ad1fd9c39559e2f34aa3c46649
r0_smg_sticky,rolling-24,2,1,1536,256,1520,29.18245945405215,2549.867921,6984.890456,348405c8acc1ed922bf1dac639d5cfa3fb2933670e75e0c8fff89a9fc8666f76,14c9dead8792b0437050bc32049103cdbe4a055ea4f56c24b760d94ff2afcd86
r0_smg_sticky,rolling-24,3,1,2166,256,1792,37.88460903428495,2518.113839,6701.52191,5b9485b140691216ff5f9a9a42c579476f2919de3c65ff8968cfebaf89e7c842,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,4,1,3055,256,2416,46.87167552113533,2646.560543,6985.744219,b1e53ad6d63230475e3a3084ee32e5bd9a3730097969dd036766c47be42b1eb7,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,5,1,4198,256,3296,56.03143899701536,2877.800098,7158.83974,e0e0d18bf226cbc019a07a356520f9601383fd58065a521797419b406b59df20,1c35144ebb98e2410b65ae761038ef6fa9718ff223ad720bf544b53cf2bc44d5
r0_smg_sticky,rolling-24,6,1,5594,256,4448,65.3801493877545,2994.73598,7347.096761,bc7af502108b572282b117c15b2e637c7fdd2eb8bcba267dbbec440f364f0ac6,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,7,1,7244,256,5840,74.67631491273642,2786.223476,7295.310622,22a20e3c3d727fbbd376e24778a38967d58428bbd801bc9c70347b0afe58d17d,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,8,1,9148,256,7488,84.11372488550842,2889.999437,7434.23115,b866d78f27e956ce7ab05d67889a51f9b192c49ea961e5e9304bfed54811041d,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,9,1,11306,256,9392,93.19811961613595,2835.47008,7081.579557,1703e7a6d4c091a34e01d85915512de7a8343cdb973da1a36e615debee198af4,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,10,1,13718,256,11552,101.91112718172371,2253.055868,6710.043273,a8bafea329f3b2614f1243770bbc5296edf87fd2227b0d4eccb4d2d40c671275,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-24,11,1,16384,256,13968,111.57445197552443,2934.99088,7660.807287,4b5d6ebe88728cac6a8b512426bdcb03bced4f00a064e20788b4806a06101de7,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-29,5,1,4198,256,512,8.333030170761049,55.404755,7072.238313,98b8fd6e11b8c6a6489256d9c9d85c0c44b13cb8493b7e789ce3cad1c3bb58ba,1709965e91912bfe70e1b9dd10de03e62ca4166f98d6f7b3f0f2036d10775b33
r0_smg_sticky,rolling-29,6,1,5594,256,4448,20.19390424992889,5563.259628,9857.344248,f7a842830888bf734a173b876cd8061a30647d0f327b1d4d17de95cfeb37315c,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-29,7,1,7244,256,5840,29.182833696715534,2551.647611,6987.072805,830798cb5576fd4522c44ca0017d9ee56d3c5a0f1ad6b8f0e28e162e731e78ea,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-29,8,1,9148,256,7488,38.07784634176642,2676.102739,6893.642602,c3de084f4ca23db3fcca68df138cb8c1d73ddec60907cd2182bd2801c5275c83,121ea3a4502e8279fef1ab943902db192c3c73497f04cd10507c20b10d8cc6cc
r0_smg_sticky,rolling-29,9,1,11306,256,9392,47.00540280062705,2567.628989,6924.526406,c3a58b3d5cec3ba9f9d52ac021c226825ff99d21694335169efb12be398e3154,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-29,10,1,13718,256,11552,56.21254298277199,2884.578412,7205.070902,8c5f15c6b0fe62ad1ce8dd4f00fa94d50f216f2facff8809da089710ad4d72d8,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-29,11,1,16384,256,13968,65.50012851972133,2957.936076,7285.707971,bb0dd9de2cfb61860393bb426774cacb5d389a0e742709fbe388d98f8536f6bd,ce423b98f2b23ffa29302d5417ac53ab3e52c15664db0cbaa0e29e19417cc451
r0_smg_sticky,rolling-26,2,1,1532,256,512,8.333177018910646,174.986124,7201.357789,8be45536b1a19847815f2759698ccf010e7d52dcecbfa61589216c1065b9da0a,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,3,1,2166,256,1776,20.193726104684174,5562.881897,9856.909877,3253be424d2b9e90513077703616d52d0f8d9bc520628fd81b1db569fce53c60,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,4,1,3055,256,2416,29.183496036566794,2552.248799,6988.321613,ed940d627059f6f5f20ef7ff224b9228ff063d0834caabf3edf116d106a55a77,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,5,1,4198,256,3296,38.07817847188562,2675.218638,6893.015622,8ab75fdc2dcd02beb871718fc4385083a1439b54d45baaec58ace858dfb7cdb3,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,6,1,5594,256,4448,47.00508459098637,2567.05561,6923.711457,ed0488ec032c4f8c750ad887484adb82a471acfa0a5a24cabdf21185c7f6b2c5,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,7,1,7244,256,5840,56.19809662271291,2834.284665,7191.782821,5e7c27e0ff62ce9499a682233c31d3bbfbd89eb09fde785174d513ca49c3c8a6,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,8,1,9148,256,7488,65.48682568687946,2912.597271,7286.614984,43d918b32f8746332843a72d20c712441604f63a72347e45507c63fa4a605822,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,9,1,11306,256,9392,74.78726042248309,2764.505935,7298.594994,99550087147b318a16580e9f8ac96ddd759679cb813592f9496d90053be1f088,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,10,1,13718,256,11552,84.11288686469197,2778.935911,7322.328643,2a6e523bf4d0da23863e8fb6bb4b892c3325ee5abcdf6be6970c11cc013aa814,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-26,11,1,16384,256,13968,93.01932082790881,2610.699844,6904.092714,7767d9f3b49ba685a99b2da823d4e015f13e784d2fb13867205566bfde8c625e,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-21,9,0,11306,256,512,8.730760214850307,188.710208,7812.514737,3f2dad00dd93898bbc62e8cb5ab88f7a35a38dfaf6a8184517953aa710b8439f,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-21,10,0,13718,256,11552,21.32353063672781,5608.417407,10589.692752,4fc41e64b455c6f25a3749fee914b255efa95a09f95d20b4e44be4b17e802e32,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-21,11,0,16384,256,13968,30.7120533362031,2925.301284,7386.236489,93fccb619465150906b2ca4c148434b283c3ee28ae8c3e51efccfd1dd111875d,2333b413c651c3decb833e96528d67085b30eed2ea0bc6a81362775cf5d3fbf0
r0_smg_sticky,rolling-28,4,0,3055,256,0,8.731291609816253,83.252316,7513.136653,da601bb529d91e87325d0e2549548a605793db04ba72fff5dc71d60f773c5af4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,5,0,4198,256,3296,21.324053104035556,5608.041501,10589.726448,a5bc5fabd33af4babc6e0e31e8903dffa1f8e92fd62c2661e6047acb7a352771,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,6,0,5594,256,4448,30.711502004414797,2924.816802,7385.132963,2999b3a445b0ccfa089bda13e6e1cd215d4631aeeafd95538522db80cf7b339d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,7,0,7244,256,5840,40.131343520246446,2744.820759,7417.981835,1bbb6560ebeec482a76a7e035b0c126b0ce4e7599aeeda84836f10e5fd1dbdef,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,8,0,9148,256,7488,49.46167238987982,2893.81786,7326.87779,e28852b2ffb448940bbe5b142b1994f2b3c93d83bfc644f0fb0f34b1a2f5097e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,9,0,11306,256,9392,59.3687454527244,3429.885709,7904.905319,77e48516589b1a5e56d7785b9531a769c848d90152bdcabb9c19e76987d1a2f0,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,10,0,13718,256,11552,68.4509801371023,2912.175221,7079.886939,4eccc828c03c631a00bde99e5a34f71db3b5ad258cbc048cbdfaed98b9e02ab8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-28,11,0,16384,256,13968,77.48028265684843,3040.168962,7025.026284,9b85a9df1cae5c939f972ca64b80a184c15ee6ac65197b5a7b1f38ee5c1eed4f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-25,1,0,1151,256,0,8.731426042504609,207.421363,7642.766629,1863e50949cb4c990ba5f2fed7b062b27f8b45da4bd1ac319d3c3e737a05ee41,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,2,0,1532,256,1392,21.324270544573665,5607.780732,10589.719345,0619b2d63d0e76aaddd1e59b0bb5324a8646e745859a557cbf66ae4abf498599,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,3,0,2166,256,1776,30.727375445887446,2994.42065,7400.761186,12437e6c90a29296405ed5908c1f17c73fab971af28f4fd685b87d073bf93e0d,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,4,0,3055,256,2416,40.144049068912864,2810.847018,7414.971641,2cef65e7445e72731679462606a95d0ca798bf8bfbd5021cf4d13ce742b012c1,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,5,0,4198,256,3296,50.19134183693677,3605.503645,8044.462555,6298c8b5e7783db2fdbd3b69e861c534983e88408afba64ce80ed78ed3e9e297,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,6,0,5594,256,4448,59.37071474455297,3045.136289,7169.694591,9ca54c05bf3fca6d7297e22bc6dcebf2b5f566462a54522023082bfda5b24d44,a7851e890b1aa2a04b7c9b4b39dc18992aa5ef1a13f57f561ef3be12aefe2327
r0_smg_sticky,rolling-25,7,0,7244,256,5840,68.44745614659041,2948.816692,7071.63908,632facbb6de4d4c205b3b56f644e884305bbb3c749e9e899aef09c9e01e27654,df007ed00af72d3b382922965eef7e837bc0b6d5bc27355c8ea2619e29a5d3ff
r0_smg_sticky,rolling-25,8,0,9148,256,7488,77.47773121763021,2977.702116,7027.215544,bda24585acdf79425efee92f207ae670ae1fce8b83023ffdbc585be78dc52753,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,9,0,11306,256,9392,86.45310816075653,2708.678266,6966.483814,27e135b14a23524d60c6231753f3f3dbc86b8bb03391790f7232adb645f4840a,199c87282083c2e2dcb0fe23ed15ff3f36334d99a06a84d6f03f174d9e3bd7a4
r0_smg_sticky,rolling-25,10,0,13718,256,11552,95.9733041441068,2866.060379,7518.020654,2814c164134e93d67ca67c47dfa84eff0d19bf325f0e52162243eb51eaf6858c,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-25,11,0,16384,256,13968,105.87753239180893,3106.822553,7900.900977,aeebd18572c35de521dff846bd1458fbaccdfa5c6edf164a50d20832ffff87df,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-22,10,0,13718,256,512,8.73149413894862,299.352164,7769.603915,97ec71526ee1852c52bdf9c837f5d57137863c74965c9c4d521573bcb55468dd,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-22,11,0,16384,256,13968,21.55361207295209,5891.843395,10817.692257,1941ec01cd2495751a849646f408a824cab7f8bf57ac2f6bb74973cf6250eae9,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-27,3,0,2166,256,0,8.731910269707441,120.676961,7556.534134,bdac879a3253e0bd9aa6571e205c323c8eda80431ab88677949a524f7813425a,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,4,0,3055,256,2416,21.554354958236217,5891.423008,10818.022947,c81fc2ee96c3f7d89973e1b06173f1e32c4975a98f0dc308cde937faf595a439,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,5,0,4198,256,3296,30.727149493061006,2765.150355,7171.305929,c369ff619a0ddab7a9ffd740970ebf99dce511f7c29066e4b93bc961d7a47313,e60dd8becfe37be142b3052d0a3b0c5235a7e19d1f7d6ff4d0d5401181769a05
r0_smg_sticky,rolling-27,6,0,5594,256,4448,40.14325792808086,2811.154028,7414.540758,3781a3cefc6661fb860e47cfd41813116b2c25f130cb44e439551144953b6816,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,7,0,7244,256,5840,49.46200346387923,2883.314884,7316.791392,20d564c8e29f0cc1492aeb3fe127eeb4001dbfe9e3b30407422584aba8ede921,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,8,0,9148,256,7488,59.375017683021724,3429.261577,7910.488137,7b8e0fecfd0bc565bebe5b574d94ff16af7739f49f883bb588d9071ececbdcee,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,9,0,11306,256,9392,68.9725478971377,3193.136232,7587.869848,99b3c3de7d7624150454b21fbb5fdd63753f69c3f3d02680cfd4a8126b84016b,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,10,0,13718,256,11552,78.07919687405229,2753.147402,7103.754732,21847f2dc0854f7cd52b4cb696833d557a10ec803cf0d73e0e9bf2887ce802f7,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-27,11,0,16384,256,13968,89.52915068622679,5011.594855,9446.74699,8d9c93e432ddc9d852bf2eef0b5049984eff091fc4ba39adc828657fc2c9932b,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-30,6,0,5594,256,512,9.15444424096495,73.107327,7850.256535,d4b540e021c4b23bfbaa4c7b2c057716d6922afc7403eba175771a06403cfc7f,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-30,7,0,7244,256,5840,21.577933565713465,5860.185281,10421.970545,4063d4d8bb23404929d5e0396b0d931aae0237facb92bfb7cd3eb931c7da6627,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-30,8,0,9148,256,7488,31.409507418982685,3450.100937,7828.593942,00e0525f47371f02b8ef9044922471cd6e13c137a29a83024d73a388a9d27718,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-30,9,0,11306,256,9392,40.90273639000952,2777.559359,7490.087748,6f146a2a7c3b8da6c9b8fcb2c46f14d4d1884a9494df18b9cb0091d036676d3f,c898a9c1cf7690d20418f271bdbcd87c15444d374d0d34af1f08dc3686ce22a1
r0_smg_sticky,rolling-30,10,0,13718,256,11552,50.19088116195053,2887.188827,7284.980861,2e72eefabdc50c198a39db4f7fea4d927362338e9b54d16ecf2dbbac5e303f33,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-30,11,0,16384,256,13968,59.9260609196499,3196.922527,7725.430399,ca226ef21c114fa4c0cb80b8ef14f35dfc1b665646c47409ef8725d3a03f4bd7,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-37,1,0,1151,256,512,9.361393377184868,244.674165,7756.416954,c700f4de13a6f2efa92837005a51f38cf82656405bc5b89fe402b1e6986648c7,9f13e65d240f0e6cc0f7759381a13c081035eeab39934d0bbf0a2c2a5868df84
r0_smg_sticky,rolling-37,2,0,1532,256,1392,21.57755586784333,5653.698293,10215.142306,1e5d42d9cae7c15ac7f2ab349b73e1b50fc4e3b33393aff66347bc2125c97ea4,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-37,3,0,2166,256,1776,31.41117402072996,3451.409457,7831.340167,902be3a2f323860983e948fbb83319217367d0bd5fdbaaa5f6db1315437bbdff,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-37,4,0,3055,256,2416,40.90442193578929,2881.75046,7490.280901,dfacffede147e1785fe07ae121052e793deeb91b2606071e308187c392f0bc87,96c7e5250b8929a395b0e06c8fb729c5a720f67e1a7e039fbfa6262386176407
r0_smg_sticky,rolling-37,5,0,4198,256,3296,50.190660839900374,2885.112686,7282.749776,69ee60efaf931a24763a8f1cafb528f611e86ba737bb1b38d971914d010bfa6f,e9a2476641c3ba6d10a8dddfff67145fdaddc5bcac7d57ae7698b5c56ee45778
r0_smg_sticky,rolling-37,6,0,5594,256,4448,59.36916801612824,3046.602569,7169.716446,3b534cfe4a89f5cd2dd7d9d2461820fb6d24bd62990efdf1afc8e9f1a5d87edc,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-37,7,0,7244,256,5840,68.44897317979485,2911.607121,7077.315659,56dc598712b30708bc6119fd251cdb6675eae891c84c378ef66526ce7a869106,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-37,8,0,9148,256,7488,77.47808539588004,2976.687358,7026.479093,a67f2d70d9a2f8ff6e27c179627c479ac626302df860a44202ade26880a967ab,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-37,9,0,11306,256,9392,86.45501665305346,2817.825748,6967.585549,98a853f99a817aad76258e1f05ad40b2702c22762c44429f83ad1bd7d121e80d,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-37,10,0,13718,256,11552,95.98680531419814,2920.998699,7527.831466,b556d01444308b992dc4c335ddbadb366ec9b87461940674c069df7a6c53d249,cc678e0cc6d57ced96e6bc8da883f1a880b42eacc48b30344e832e4ecc42f65d
r0_smg_sticky,rolling-37,11,0,16384,256,13968,106.34799225721508,3476.536106,8355.25047,561b7a1d54d232ad1ba4c68b077d1d1d3b13facedb90f3f2a60751e3f95e485f,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-33,9,0,11306,256,0,9.361824195832014,179.179717,7927.88024,81db3aeee538b4bfc4f4959d011a9a8c9639b064c6bb8a92994ea9a929ad3be0,5e19d40163107935b0e59baa8def09022450f3db1a62b25e263b3aabb0efbf3f
r0_smg_sticky,rolling-33,10,0,13718,256,11552,22.273107475601137,6272.171093,10908.335884,88a14957ab8cd934b48eb62405dbb16aa8954dfdc35bb29fcf16be80c48ee8c7,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-33,11,0,16384,256,13968,31.410563360899687,2788.113472,7133.44205,ddd784fd5538a82988d9cf101d5b3707b01248ced48a11355f49adf32548d31a,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-35,11,0,16384,256,512,9.362207814119756,294.695079,7841.537218,37eeb7925c91b555eb3b6be4af91b612835354a7e4d7e812eb82dbe2998c3e7f,e9a2476641c3ba6d10a8dddfff67145fdaddc5bcac7d57ae7698b5c56ee45778
r0_smg_sticky,rolling-41,5,0,4198,256,0,9.362807273864746,90.4554,7584.654177,b59fd75c37a33f10363d26dece38558fc7863c5895047857cc721e81b584f060,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-41,6,0,5594,256,4448,22.271764235571027,6271.34712,10906.122206,c481fd507932a663fc3a052ba1f1e1a8ac6470b22cb59bafce5678e160745c93,1f49931dbe47d67fe56341f2fa13b1b0eec3ae74aa814b40555f38d08015dde6
r0_smg_sticky,rolling-41,7,0,7244,256,5840,31.40992870181799,2757.315811,7136.254867,e1637b02016b6e667aed6f9d454501b6327baf8d39e41f73a7c6e7edbab97657,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-41,8,0,9148,256,7488,40.904079117812216,2776.947644,7490.807176,449b2630089588cc050344ce2b4cc19c9b29781e497038ca1b7728a482dc4a9e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-41,9,0,11306,256,9392,50.1902650622651,2999.243368,7282.761424,86bf57adffa64e26b0ea47f1601f3335bfd26c3ef83122fd2e01d31469b758b5,cc784cd74906cf28da6019ba24f6424cab9de0641ecef88e4c6b4a5bd61def7e
r0_smg_sticky,rolling-41,10,0,13718,256,11552,59.37026904616505,3047.181837,7171.242952,22ee5af38e673d7dadf15ad81048a21993e7364b22768e3b32487a63599b3fe7,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-41,11,0,16384,256,13968,68.44776517245919,2949.500056,7072.531757,16e518b5dc1f07e9091d281f366d1f6db4d4558c4890eab23506ce4742aaf48c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,2,0,1532,256,512,9.362980490550399,202.075666,7715.446881,413ce971c447e9a47cf8ed9afa5f83e1acd8c21b094e6b3b9931971d7f33fb8c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,3,0,2166,256,1776,22.275678627192974,6271.048014,10909.756404,df14910799e59d7e0116e5a2f4e4d61bf1fcf61aff333992e46240c816bb0ee3,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,4,0,3055,256,2416,31.415232125669718,2890.536945,7134.196775,c947f6f41f9eba4b35b25a4e93addda5ebbdccd03fd017eafc7b2d9b981e6b82,a15464dd783a8028c268748320bbdd3cda49ad3bae0e9ca304fcc9dbf95690b1
r0_smg_sticky,rolling-38,5,0,4198,256,3296,40.90093641076237,2967.152389,7465.735535,1c64f6c840cc543c960eb12fc97f8ace9285e40aafc5a23ecbdd9fbb0724c9d0,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,6,0,5594,256,4448,50.1885949075222,2849.313556,7285.341664,0708fd95084b3863bd084e331e6266a79c763e9fd3c98987b42c4eb4f7f935cb,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,7,0,7244,256,5840,59.375525046139956,3010.090954,7182.152746,8a46edaf7bba071ed47c9f315e445544234430ed7c9627110e60a5fa2e8e0d42,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,8,0,9148,256,7488,68.98833605647087,3245.841161,7602.536337,8397683fdd3fa5f1d7017303c0e7fe559d1e08bfa3354ecd7f391697f020da2b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,9,0,11306,256,9392,78.23382626567036,2935.703108,7243.382049,9ecb56dc4faceafa2974f9dc7f6dc9e6d93932c892c540d2959e1cde3ac7e8b8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,10,0,13718,256,11552,89.73678107373416,5195.719083,9501.259931,2ed691429dc7747f50735381264e442d4c0b6e5f71526e684712329f4bcd70b4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-38,11,0,16384,256,13968,99.84549060184509,3420.313843,8106.133717,12b102568c25c01008925ea2204fc0a021d52d9c0129e95e6b9b87718abf913f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-31,7,1,7244,256,512,9.363152908161283,98.168311,8016.009419,6bfb7a1c2e806c39bf126bb8e13bb23bb4c94b6d6d13f8e35bc8612bc0b6fb45,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-31,8,1,9148,256,7488,20.206713672727346,4675.115805,8839.622162,e56ebd364042019910340f2f0bb79ba58b841dfc98e3e1848a86b0ebd3a38c28,66e7898609d2f448adb062d7544f1bf1662e3db72ab1e9d5347ba20c501145f2
r0_smg_sticky,rolling-31,9,1,11306,256,9392,29.477584712207317,2832.836112,7268.562588,187b6ff99c65f3fabc35d20088b033bd27d3cfb4be887971863382a1f24e2a71,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-31,10,1,13718,256,11552,38.45238104369491,2814.346111,6972.830478,406cdbf75ddc9dee1a11ff068a283fd5a3a4f192be77ea8e203e691d57e0ced2,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-31,11,1,16384,256,13968,48.32292742095888,3540.959763,7865.462806,cf38bf878029f444a0ed674df9c4d749193f13b10f02f1654ac5f1aac80388eb,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-43,7,0,7244,256,512,9.363452942110598,82.550616,7500.879842,8c1acf443fbd71b395c4f9020ca78dcad3392d29c136fc8f36082a6a8a1bee28,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-43,8,0,9148,256,7488,22.2723831506446,6268.857697,10904.225843,871198902d5c70068c4b8d1bc301e3f4a784da9eef6ff4e02ef442a67c59d314,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-43,9,0,11306,256,9392,31.4085426768288,2790.1227,7133.35453,dcb6a093925a71d9d8745f7ecd1fc64528ffca6605ce0a83d4fdcd1643b5a9d4,5c64331227570be35ca2bdae464cd6b7ad787ba68b9c73e0152507ad0663822e
r0_smg_sticky,rolling-43,10,0,13718,256,11552,40.90477860998362,2779.475403,7494.101853,38323aae66e8275ba7b75242c6b21a3c5f85f587a34a3d0c29196cc2fe6fa556,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-43,11,0,16384,256,13968,50.187389683909714,2997.71811,7278.26418,5f166a21f363a371e984db7e616d9c4df4955db63907a235fbd55f6d5f3ffc16,2df950b0a8b36ac6b70add4158b5c1d2f9221ed45b9f5c17870c538ad27fee4b
r0_smg_sticky,rolling-36,0,1,1024,256,512,9.3637586068362,191.56117,7802.106353,143b18cca6f1a38c06954880aae7c3dcf896191b4fbc14f7ac57e621064fd3c6,0798583f1b894f3372c3320a1c0ae7fbeeeaa84c163eb9e360881408e6b74f61
r0_smg_sticky,rolling-36,1,1,1280,256,1264,20.206559975631535,4666.400583,8830.794044,f31a03243bd6cfb91028ac999766ec3d364766ac8bfe182a4ebf4ae67d8acd97,41e06e70f76f42917d6103cb4bb4c1f273274ae170c08a748f67c6df0b28b2a9
r0_smg_sticky,rolling-36,2,1,1536,256,1520,29.195362316444516,2647.084834,6987.355847,ca68159996462c7760b52d6ff6da037c512f79a6b7d36b344e1c2e6d75783aa6,80ac661a4ec8634fdb6655cde209020506d5afdeb824da3bd48f070dea0e7c9c
r0_smg_sticky,rolling-36,3,1,2166,256,1792,38.09156431257725,2744.933432,6893.414153,4614b26ff17d2bd00a57f947f2f43320c0c2e60a5596cb72b23d9b1376f7027e,33af26a6961e7764e5856a914d24551e6ddba30fe3a3d9dbd4c1145827585ab9
r0_smg_sticky,rolling-36,4,1,3055,256,2416,47.181906279176474,2778.974632,7089.360404,1ad5f666ebc2b1e19c598f33552991e980f875448d2222b18899d38cd31d5f53,4f2d4cad47957030c64f4a18b3142238231c1d6b294c0dde9e0c026043f4263e
r0_smg_sticky,rolling-36,5,1,4198,256,3296,56.21224867645651,2708.491736,7028.746882,f7ca864e9969eb623be6887ae3db3af8b59766fa2b419e0882417d7a64b10c5e,bf5cd02a012cadf23ffc2f148beb1d699497e6f854c75cfb066c66e702fbb425
r0_smg_sticky,rolling-36,6,1,5594,256,4448,65.48652882128954,2899.69492,7273.488152,c1c0eea747a9546390e3ad80d7501007e37fc7e8c106d1b60208b29418990043,5fff04dc450f37b45638bbc5c7e92fd6845365a8eeddbcc3fc2a256b9ef10f7b
r0_smg_sticky,rolling-36,7,1,7244,256,5840,74.67602031957358,2679.408199,7188.30904,085191ed3f49b2bdb41a340063eff11d06aa55f26c348ab4e8be922146db3600,bf5cd02a012cadf23ffc2f148beb1d699497e6f854c75cfb066c66e702fbb425
r0_smg_sticky,rolling-36,8,1,9148,256,7488,83.70775827858597,2541.765343,7029.00314,17087771ae0986454eaba864bffae3883e7930140eacb005b21d82b540b8e5ba,bf5cd02a012cadf23ffc2f148beb1d699497e6f854c75cfb066c66e702fbb425
r0_smg_sticky,rolling-36,9,1,11306,256,9392,92.80365957506001,2892.656957,7093.712751,01d7d530cd7dab0948803b5144f85f945217270b81675911f60e112049f30761,bf5cd02a012cadf23ffc2f148beb1d699497e6f854c75cfb066c66e702fbb425
r0_smg_sticky,rolling-36,10,1,13718,256,11552,101.6821815604344,2523.730161,6875.235354,c6f7843084be79d66cf923f523799ccef0a9f37645507b635d885175db9b4dec,bf5cd02a012cadf23ffc2f148beb1d699497e6f854c75cfb066c66e702fbb425
r0_smg_sticky,rolling-36,11,1,16384,256,13968,111.37058119475842,3018.450782,7685.113547,7bc4be24f58fd7df9d7b4e1748b279d6bb557eb3499337a822ac48eb1d26284d,bf5cd02a012cadf23ffc2f148beb1d699497e6f854c75cfb066c66e702fbb425
r0_smg_sticky,rolling-32,8,1,9148,256,0,9.36386363208294,191.172687,7955.435385,6930250ce44996d38ccae8b9567881d57f1b4dc2863fdf066abfda41ec80d39c,5e19d40163107935b0e59baa8def09022450f3db1a62b25e263b3aabb0efbf3f
r0_smg_sticky,rolling-32,9,1,11306,256,9392,20.205889666453004,4665.320449,8828.984753,7d8a44547748ec539fdbcaee3022bae6c58932d8f159db655e9a2d17ef3d59f2,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-32,10,1,13718,256,11552,29.194454406388104,2647.319524,6986.864196,93ab29ceb92cbb69e6adc1e9e198e94be2ae470f36e239dd3f0157a4e608f97d,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-32,11,1,16384,256,13968,38.26182896923274,2893.283169,7065.410659,809ad303fb11d075617f0f714ed65e295bf61e2be583d3ca6cca0f309c0a1875,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-34,10,1,13718,256,512,9.364187153987586,275.81938,7886.762294,fad04fec8fc99112c9007800295dfc723a8135c53c2ea506f466a12c8bf0539f,96bfa9a524fbd288f64a24a339454861f5f0645bc9b8e8794d54320805c1c527
r0_smg_sticky,rolling-34,11,1,16384,256,13968,20.52242628764361,4846.451283,9143.545074,202ac264897c61dd27acdb0ff8e74550f79df846055ff4e5b7ce9df6783bc7c9,bdb5ec7695d5d6629879ed4707c3b3690580f2aedf6566748982bebe7b215812
r0_smg_sticky,rolling-49,1,0,1151,256,0,9.390688851475716,504.024133,7270.690885,3d6b5885398072ce7eb1c0feb0c7f8ac105f02350f2280b817aa531a60c829d7,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,2,0,1532,256,1392,22.272954034619033,6245.215121,10881.110886,bfd1b73982e1548ee7dd5b889f19f89a54e8848e2d46f39c09d32b1e2b0abdff,08d43d6994a5ce79fcdfc49d4908e902c31307ae0f3d566f344f952fe04f8651
r0_smg_sticky,rolling-49,3,0,2166,256,1776,31.412381291389465,2755.394583,7136.484116,900d32bf3ae5a7b79ea9007e029e75ac1f9276c8bdaef42355887a17dc0a6c7b,e87a0e7bff79748dca953571260fb9d51b84d6e02c48fe84db6d8756695dbd3f
r0_smg_sticky,rolling-49,4,0,3055,256,2416,40.902029665187,2879.395182,7485.623689,b4fe943405d1d7a5a601fe2d584e80d7aedf34a9d50b73f4f91667e32906c273,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,5,0,4198,256,3296,50.18907007854432,2888.148833,7284.1542,b00787844ce3a7da2772513b528efc486514c0f9c4a984e62f4c62c574a43e36,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,6,0,5594,256,4448,59.37362922728062,3009.335398,7179.43721,147cac6bec4ac65a9e420afe71685c5145253a4ec9567276db1be67ab6ee7f5f,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,7,0,7244,256,5840,68.44715083297342,3053.790133,7066.592041,48f5b38411d303a6b2fe00dcadbbd104b6237ce6586ac739593a56cd03064059,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,8,0,9148,256,7488,77.47563101258129,2939.093465,7025.857329,2eef32efd35263cb09e40cf8f2b94169641681b9a8237b0e834e450bbab59b81,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,9,0,11306,256,9392,86.45790579076856,2670.471216,6974.556215,c7fd47fd4b1607034cf95c1b3d952b0c7f5b58b8803192dffba714a8dfb8b4b4,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,10,0,13718,256,11552,96.40823067072779,3166.392133,7931.186761,891dda082609c15632b9755e9df54646650a7e13b9b6421491e0e1410c342d35,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-49,11,0,16384,256,13968,106.59303368907422,3290.693436,8182.496167,513f4278599f2bd5ad031f13c6c80e862262688ec08f369e3ba535f8a6c18547,bdb5ec7695d5d6629879ed4707c3b3690580f2aedf6566748982bebe7b215812
r0_smg_sticky,rolling-46,10,0,13718,256,512,9.390858132392168,630.118215,7398.201552,2a8af111ac16d8ec704bec47342c65415abdcf6cdb02fcbf0844feedcda75b8b,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-46,11,0,16384,256,13968,22.273887800052762,6431.135616,10879.790941,90589c05fc68cd6e01f0184183a8b5cbf9aeb8fa23986b92be9c4b88fba4f146,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-52,4,0,3055,256,0,9.39126840699464,374.830032,7141.863602,d03d82751def3371fd130e6ebf23c478276e4bbfa2e7e2a2182519934c1b93ba,fc977f84b3faa50e13ad61b8ec6e6736dc699b55b35de9924313b454a0eb6aba
r0_smg_sticky,rolling-52,5,0,4198,256,3296,22.273644855245948,6242.256415,10878.979481,b798ea31332b86799aea940daaaed99c05fa380c06399f85723e0b4cf7982315,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-52,6,0,5594,256,4448,31.411396773532033,2753.590093,7133.787172,2deb8daccfc3284e3bf2cc6bcdadfef604343d84612b607d2c989ad1a1ed174b,b4a798c694269b5a2772fe7eeba8ba91d6e4bfaa925fd9b29000a57649b4a6c1
r0_smg_sticky,rolling-52,7,0,7244,256,5840,40.90314653608948,2881.183384,7488.446554,c704dd4b776a94b7c28af66c664d8571096e78e123f5dcff854b2606f61f9f96,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-52,8,0,9148,256,7488,50.18992944341153,2886.446326,7283.39298,ff233b6721898bdc74504803c4e8066a01731b5484ac3a7337931dbafc8c2a83,76632b28640fd09f92f1c2487097bd0723cd9eb9aefdfdee73c33ae46d4f428f
r0_smg_sticky,rolling-52,9,0,11306,256,9392,59.36947070527822,3049.874269,7173.2109,29777f89985055c7d69459ba6c392bd0a9c642ba02c6cdd787b1c912e6fb741a,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-52,10,0,13718,256,11552,68.44955180771649,2952.044488,7076.812071,7c3688e666b1abd1714cb147e1af1a43496a5c5e88678a13b98466d197e1cb8a,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-52,11,0,16384,256,13968,77.47712289355695,2988.051235,7023.768708,de4fb946202d1bf2238fec76ce5fd5817ded8b91eddf90f75ad0be8cc3533478,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-51,3,0,2166,256,0,9.391383511945605,417.700662,7184.909209,6a9eee40f9c6286a29ba7ad4d59e89b4f3f959d5e1164b9c695c3dbd7e1837cc,3cd11d75ae55d6ef64b81d26980ee450b0536f621ec8a5c59b62f6896ea9c018
r0_smg_sticky,rolling-51,4,0,3055,256,2416,22.27273956872523,6241.850684,10877.806833,4284428f2f669256b21c5b652ffd16a97b1a1988ca881bdfb327610a1caeed08,76632b28640fd09f92f1c2487097bd0723cd9eb9aefdfdee73c33ae46d4f428f
r0_smg_sticky,rolling-51,5,0,4198,256,3296,31.412105643190444,2755.572249,7136.450069,09dab86b5524e76dbb87385fe266fd0e5234532b11dcbbc9d9c4a7a28f5b487c,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-51,6,0,5594,256,4448,40.90722806472331,2879.936528,7491.158026,58ed591e0a66d883738eb8d8093ee43742716a6d0b8d42dd7f910a66f2d14825,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-51,7,0,7244,256,5840,50.1852563591674,3037.196303,7270.181827,34ddee9a264a68bd96b7e9338fad602568796677cf5c7e405a0df2e8f067392d,447a9f28a972bf752bc9638eae4eef899e628008b6a1e6b6747f827687a8d424
r0_smg_sticky,rolling-51,8,0,9148,256,7488,59.37299136724323,2900.618894,7185.088252,c20e37cc0fc11c7a753d0f890a62b5547e76febb7d8bc4d14b6d34f12a6d4c1c,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-51,9,0,11306,256,9392,68.44676292687654,3063.656721,7067.432878,cc94e7a12a037e4ea9bfc7e22e14fef2bb079b6e8d597ed5bec667226c1775f0,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-51,10,0,13718,256,11552,77.4763510171324,2979.062444,7027.281081,e03c1f2ce05244fbbe42091261908b49ec917d8ee85c217cc07beafe6faad344,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-51,11,0,16384,256,13968,86.45448938570917,2710.172611,6969.393368,8047eb6f6d2b937ff8f5520e975799ff4d57dae45784fc46a943e02a3de9146e,44594d8278620287f7764abdea5e56de8c2746fdc94bd008b8e5ea9cb01077a3
r0_smg_sticky,rolling-44,8,0,9148,256,512,9.391444792039692,192.706392,7485.064737,fca1a73244fcb5843775007221f27bbb94e05e3473b07de83ba1334a1093ee90,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-44,9,0,11306,256,9392,22.275292929261923,6429.384117,10879.338715,d43a2f2a5c3cedd89ba3ce7ac51fe1ec6936fc49ee64b3f76ce784430e2900a0,cf81c5545ca44a360fcd10eb6f194e10ec476546c1aaad8778b9f681baad1239
r0_smg_sticky,rolling-44,10,0,13718,256,11552,31.41319441795349,2891.113524,7132.614077,97cf5931eb7ce1c20f9d3f2957ab150d8b3ead16a9e15926a4a65652c66b0ffc,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-44,11,0,16384,256,13968,40.90350733790547,2983.547273,7484.872389,bb8c464cd94ec12b6dc1e0081ae3064e6228a85baabb7aa87df9e93f13912f6f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,4,1,3055,256,0,9.395589393563569,50.785686,7643.200839,2ed68c5b6f7cdc911de8f611022aa19ca11abb8e25bd1b9dfe1d93e5a18f9593,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,5,1,4198,256,3296,20.522002861835063,4828.513222,9125.143779,257b7e90f98d86aa3c4d9021e602ec1492d0bf76c672b827ff928001dde98e2d,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-40,6,1,5594,256,4448,29.49093173723668,2562.109883,6967.25006,32d09496a6931af13cc48856db555dd2772f9347d79691a40d8f96483c5038e5,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,7,1,7244,256,5840,38.55172894708812,2920.550247,7059.67504,39472f0c58a8d9fe6e59f9e9c18b946892468aaf478ca4b4a9a863769c4fecab,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,8,1,9148,256,7488,48.32473140023649,3445.062921,7771.131734,1364416ee2eee54a43f755faaedb5e0f80c2c865001d175fb53f31811804cf8c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,9,1,11306,256,9392,57.24625694192946,2737.180808,6919.469511,89d73182ae5526a76467c82452e553708e54490da7d345e1eef07e934a19a633,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,10,1,13718,256,11552,66.55013048276305,3127.232501,7297.963725,0a2600e4fd2b2e01ee8473a62c9229772e851b8792a2e1891d26f2f134173de6,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-40,11,1,16384,256,13968,75.81010922789574,2990.87906,7251.80882,f6179841c468922ea3cc462b2f832509eecf143bc6b416e364d3b102cef0a388,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-39,3,1,2166,256,512,9.395865363068879,107.794386,7705.120321,61c9c25e67e5160388006d3dea87f1357ccea7b8fec795aa0be4440a0a4e0326,693485a4471184e653246940cb2bf99e7dc7c7124fcbe63b3449bbfba17c392d
r0_smg_sticky,rolling-39,4,1,3055,256,2416,20.522226287052035,4828.135844,9124.939969,9efb8e8a6cc55542fdc386e60dc6751a6f2e471df102d532bc886e986f8cf72d,fbbcfb06fb3d908f67ec140340f89f073390a4c3d231bf023b7919c1a8180a21
r0_smg_sticky,rolling-39,5,1,4198,256,3296,29.490723768249154,2561.419095,6966.451591,fc88f55053fb4f3ca72414205bf031d8b897a08d7f7d01c6ebc3d0b8e2df3f13,a93fabcf70da3b3ca8867067bfc5f652e8cdb8a488c6faf8230dba0663fdf21e
r0_smg_sticky,rolling-39,6,1,5594,256,4448,38.45284786261618,2802.491351,6961.38324,f4034f7a30dd285cdf9de5258f6f34e04acc2394a2a82926b405fe1903c34571,f0d2dbe5575ed0508f9a8708093fedefb54b31f8e50164340f0b02fd5cd9ed7f
r0_smg_sticky,rolling-39,7,1,7244,256,5840,47.329332714900374,2553.642375,6870.865309,762e3bd01fa1caf83d5faed73b2573c8e3837ac02803774e9f3e6e4bc9e83903,f0d2dbe5575ed0508f9a8708093fedefb54b31f8e50164340f0b02fd5cd9ed7f
r0_smg_sticky,rolling-39,8,1,9148,256,7488,57.24416876863688,3581.625356,7912.250228,1dc5ef6f86e825528efdf2abcdcf53a2ba598aa60982f61957fe2ac26b91b6b9,f0d2dbe5575ed0508f9a8708093fedefb54b31f8e50164340f0b02fd5cd9ed7f
r0_smg_sticky,rolling-39,9,1,11306,256,9392,66.54889703448862,2903.170558,7300.221852,933d5c0a1755089f743e313d1bbfa9bddbaac1e93c4d51b087b50c47df5edfae,030ab564ddd59bda878fbea9806c64e66cb0fa2e33f04e024c4f062d5831778e
r0_smg_sticky,rolling-39,10,1,13718,256,11552,75.80285244714469,2994.335722,7247.90374,b0edb6194a69a7ed6a08e826d76353396cdf98c218a86105bbaa67a927b8664e,f0d2dbe5575ed0508f9a8708093fedefb54b31f8e50164340f0b02fd5cd9ed7f
r0_smg_sticky,rolling-39,11,1,16384,256,13968,84.23592230398208,1915.236878,6430.486654,4869f83eb5fd44ab46707950265de3e7172c2dbbd6a1ca254b98dfe7c0a5ab94,f40b19c1790e034f47b9ce71ab7310464fd1802185ad45f39922e9dedd49a4d5
r0_smg_sticky,rolling-42,6,1,5594,256,512,9.889856282621622,69.86513,8069.60581,dcec01734a8d568d6ea6586f6a05fc756e61c695b66a896189098d002604622e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-42,7,1,7244,256,5840,20.699915499426425,4494.725105,8808.227124,220eae18d6959c9d31a0ca396c322004b57a81e296d5acd75c200f4385a66a40,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-42,8,1,9148,256,7488,29.851829492487013,2659.007114,7150.275145,9dd1091c91b128518065c6327a52a022f389b72e08bee56390854e04690273ce,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-42,9,1,11306,256,9392,39.458368338644505,3571.341806,7604.194813,ad0d226a24ef9c2bbccc94cd8114572d836c70048c80ceec32d9fdf3176a38ca,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-42,10,1,13718,256,11552,48.330463274382055,2863.64558,6866.709668,6b789242a9cf72fedb728da5fcfbfe4aa6de5567b743b76e5692caa0c32f90a8,f1b4178228804e0d0e60c0845c02e1a4144a8a1f7800779fc4c0c9985324e07b
r0_smg_sticky,rolling-42,11,1,16384,256,13968,60.04958900157362,4961.995991,9709.900051,349a55f897f4d7ced59c6659710af64f73de1f21eee48a99ee3256b524356aa2,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-50,2,1,1532,256,512,10.069001216441393,198.303994,7904.827972,b4bcae17e85cdc8a42869634d9162b9e9c466f928bf6b3972151121f00ad99ca,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,3,1,2166,256,1776,20.699517065659165,4316.878675,8629.958868,3a3e4483811b62aaab9ca8fecc618a568dac76fbdb73c7cc6a136ab7926a8478,2f6f8c3d5f2cddd18a293ef66707e913731eac66584527e1f27398d3b2cf4d12
r0_smg_sticky,rolling-50,4,1,3055,256,2416,29.851602483540773,2659.873295,7150.8099,4d49cc76bff919078d69ae742399759d0e9a7fbdb2404b772d7c947d99ca4aa2,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,5,1,4198,256,3296,39.454506332054734,3572.196596,7601.364652,2ae084ea3a696c64bc13bcd64cb6cd3431befe359644fa1a6cf8231a51f71e1e,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,6,1,5594,256,4448,48.32503252197057,2541.929792,6868.421615,c540cb053195259443571ad7adc0a6aee69579f835fa6c03a65156a4db6c8760,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,7,1,7244,256,5840,57.24300370551646,2736.402371,6915.628431,337730c2adf90b7068625c2c3d875c4c1945531fd637ec4f561af933b86de797,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,8,1,9148,256,7488,66.5492963977158,2906.033711,7303.469167,45e104e71889902ce37120ed07123233fe872a3d4039e6af2ebb2e2657b0c457,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,9,1,11306,256,9392,75.80674504674971,2942.465773,7250.77195,602e2df76020f80ba65612c8005456516a3899d24267ca9008402fe80bd59903,bdb5ec7695d5d6629879ed4707c3b3690580f2aedf6566748982bebe7b215812
r0_smg_sticky,rolling-50,10,1,13718,256,11552,85.19830129947513,2992.464639,7386.934958,9d85f54123971148b9d646bd7f76696c5bc9f419b785579aed9342312d70e8b4,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-50,11,1,16384,256,13968,93.28346928860992,1889.090094,6082.716563,f154e12daf719a1301d77f5d417506314af890a0092a127d9babf1cb27b48b63,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-47,11,1,16384,256,512,10.069182849489152,288.128159,8033.400821,b91e39aa49b9e9ca5a491bf96f4ade74ac7bad8b2f45798507d8f8841a47557b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-48,0,1,1024,256,0,10.069803909398615,267.483936,7974.777263,09e5bf9a68c0b06f61d850be6ff407c47b00aad0f19cdb5ff5259efa5194836a,bdafbe18e183576793432868258ec1cb490587a72a87b383940cd5c596620d64
r0_smg_sticky,rolling-48,1,1,1280,256,1264,20.877949194982648,4509.715372,8807.819249,aa7cf306c8d2443fcf15f47e06358285477dc150b7854b1acfd027b9a29655e5,a22ef0edb5de4eee96a82cd8ed1da86d1929abcbed42668ad949321f3c15e751
r0_smg_sticky,rolling-48,2,1,1536,256,1520,29.8520901016891,2481.214221,6972.58702,692ecacc2d09619ce195f926e6cd3f5f65ae8c3a9597e235d7146fc24ce6e92b,518cedeecd8bf653be7def6a69b647283928fd854021161086e0fc0bc4cec7de
r0_smg_sticky,rolling-48,3,1,2166,256,1792,39.45747220609337,3570.997676,7602.981301,6955a3ce9462b65c84db641cb51486290323f824a9a813726e35cd6c17625cc6,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-48,4,1,3055,256,2416,48.322028887458146,2642.808967,6860.333181,6b1bcdc69466332cddba53f7f80196debfa8a43b2d693cb84efa0555e5798019,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-48,5,1,4198,256,3296,57.24973920267075,2635.598075,6926.302768,72b62fd3581074d537c2e288ec9c33a334f6cca7b4c2c0413c85d8a982bf1492,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-48,6,1,5594,256,4448,66.54312698356807,3169.314134,7284.582524,9f728c630667cc747c3f0cbd5e67a8e8949120345b125df66cc1c99c2dc89c3c,b46ee975650388edd89a846030eb0ed09a594aee4db452f8e4dc9780b49fbf67
r0_smg_sticky,rolling-48,7,1,7244,256,5840,75.8072084095329,2722.724015,7261.142413,6ded7a5e60135d1d29d2c897d610215dd088c11b34086e309e32a77e276d562a,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-48,8,1,9148,256,7488,85.20200692303479,3130.788939,7389.907231,1f503fbe754e157fea214cad91eeab19a91a1eb99cdb4d317eb5950115ea0a0b,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-48,9,1,11306,256,9392,94.22853365074843,3002.230523,7022.791903,41d77ceea6acc0a79153dab20fc59e95c38042ce8c3bee2bbd53bafdb97eb731,33697dcc1698c18460f657f1a9a4b606ecbc472afea6ae9b2399da1447393d75
r0_smg_sticky,rolling-48,10,1,13718,256,11552,103.58864728081971,2585.978061,7356.274291,fdee815c632b6588c7354f7d83febfc4966bd1b51b7a529d7d91e2be3c8c4ed6,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-48,11,1,16384,256,13968,115.31816193740815,5128.725107,9726.591132,71223ebd4b0874a068365373bcf3305d02bee132f6d9661b53ad5ae35d7f4f46,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-53,5,1,4198,256,512,10.070038215257227,75.882799,7777.272217,8e3f4b14d57f079fa0c5dd4138b8310f7e61987ba152aa9d095838dda1c9519e,d64911b1be7d52c8643f202b5b097f7b779fba2c1efa2c3e28a0918b8617cd59
r0_smg_sticky,rolling-53,6,1,5594,256,4448,20.877112133428454,4508.101698,8805.385858,110d63079c137645da32a17625a2290ed90745db6949e9d825075395a6d16c33,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-53,7,1,7244,256,5840,29.852233558893204,2482.360915,6973.929588,47fae98607ec224e856730adb1adf7adb4edc4343f9f4d667e50a8c63ccbe2e3,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-53,8,1,9148,256,7488,39.45565974712372,3570.19188,7600.541095,a4e7b7612268c225a859bfeb783b481d02efe5ac28c366acc07689661b6e4932,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-53,9,1,11306,256,9392,48.32614513672888,2645.912059,6867.343656,9bcc0a701b5768fecc021e946f37121aefb884ad730c5b333dd2071081aecaa9,0c439df987fc0b4dfdf634993531ca12a8c6b0458dc9bab1d1e095cbbcd80544
r0_smg_sticky,rolling-53,10,1,13718,256,11552,57.247024211101234,2778.5537,6916.912983,0d8dd27bca6beffc0f3dfc5e8784f521d0ab75cb5fe75f8502e305fe0ea3e039,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-53,11,1,16384,256,13968,66.54836423229426,3126.038254,7294.956668,1de16347329d01ce27bc5e46594be0d8db0035a5d68b43edd042a80c20d4a762,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-45,9,1,11306,256,512,10.070218407548964,171.086548,8120.741994,23e573aa75640e57dffe14a53106d5273113604987f440d16e7c0c077f1592a6,76632b28640fd09f92f1c2487097bd0723cd9eb9aefdfdee73c33ae46d4f428f
r0_smg_sticky,rolling-45,10,1,13718,256,11552,20.87826494127512,4506.683834,8805.129665,cc212598f014e53937b38739e5377a48a59a74c9f20339d901dc425fef69fd26,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-45,11,1,16384,256,13968,29.96486045513302,2592.035569,7084.121364,f395c8370bfb1cf7f363514e779977d483079d0180a93fa1c5b00ada48624234,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-55,7,1,7244,256,512,10.543872435577214,95.851721,8164.173076,8273e1e5b25d08bf5f9971bbff9f3ef9b7ce1bdbf366910ed559ca64c9149f42,5e19d40163107935b0e59baa8def09022450f3db1a62b25e263b3aabb0efbf3f
r0_smg_sticky,rolling-55,8,1,9148,256,7488,20.877504425123334,4032.955437,8330.594671,16d3be8b3930022c95ac30f3d3ce15f6e75f867c148b06865fceacd479e1d586,d3fe4eec0e76553933046f6cc88e509b684b0e0618a06a304e8c51e899e6132d
r0_smg_sticky,rolling-55,9,1,11306,256,9392,29.964352100156248,2593.50073,7085.131291,03042e47bc503a55e5ccca573b17b10044a98f194ac3564e7de687c16f189429,458a9f9f9d68337cc6151245ed12b7b8c2f1c112283a224d89a46f8b97c5d98a
r0_smg_sticky,rolling-55,10,1,13718,256,11552,39.455037214793265,3459.101249,7488.675548,d858912bf20e1b5f3024e14cda1367828b11f0af95d04c84168adc7bc66def67,458a9f9f9d68337cc6151245ed12b7b8c2f1c112283a224d89a46f8b97c5d98a
r0_smg_sticky,rolling-55,11,1,16384,256,13968,48.3237461457029,2646.44195,6865.593854,17a546f8abd1e75a14e7e86dc2693ed310df08b75b1bfb4d55cfa50bcfc538a6,14686ece792120867567f56e60676c1ff645b5dd0169b6c7f27565e93be1bbbc
r0_smg_sticky,rolling-57,9,1,11306,256,0,10.591056276112795,911.681566,8126.288748,7b93ee26af5dbb072079bcaf9a8f2029182b420cc0d8bd42dff6f7cae7a6b095,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-57,10,1,13718,256,11552,20.956776876933873,4102.267893,8363.826874,e29018aa440b8e2f81a53f9a84ba3c0588af9b02530727a5be3003348e36e280,9d9f76006d6fadca35846b166f3490410d85a4018a3fded07e70eaf7c7e1927a
r0_smg_sticky,rolling-57,11,1,16384,256,13968,29.97898047696799,2573.773154,7020.045294,01af1cc5f358990da857d5b63465e99888d1d44a73773f5176a6bf4d13138096,f5f046bd27cf139d49a28764674d5279985fe21983a9db359842320f1a7da3b6
r0_smg_sticky,rolling-58,10,1,13718,256,512,10.591656983830035,872.29259,8083.375527,4899bef16d90bc5a0826ae0351d16b107fb2ae772603e6c8aefb1b15919c8f65,728e9d5ca4c497973297148d2ec57f08102afd9d1905154b2f2fc0452a1689f4
r0_smg_sticky,rolling-58,11,1,16384,256,13968,20.95606810413301,4100.809868,8361.764526,3bc0844ed962c4a31dd71b99cd82cc57abe44d22ca0247d719d054e9cfc04c69,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-65,5,0,4198,256,0,10.678197192028165,417.655414,7869.304204,c945c1eb7a633518154c121ad76ef5bf091c74b0cf4717c5d712d82efa869c3a,ba52e0c07e207f7268f31baf5dddad08b8ff909552e308f0bf1f45505b4ee08a
r0_smg_sticky,rolling-65,6,0,5594,256,4448,22.274833629839122,5145.975866,9595.600541,0b03ac5b9f1fb080948a869067ecbeaa4cb3b8d986664a34169e8742cafe8ae0,7075d8cfd55e5f794a51843b6149071b15f8e1f587683c333aa98f229c35879a
r0_smg_sticky,rolling-65,7,0,7244,256,5840,31.408956727944314,2892.653437,7129.968845,93e43407a68c4be3e31e133c77b68f464ced83d9b920bf3ac028e6220926a1d0,7075d8cfd55e5f794a51843b6149071b15f8e1f587683c333aa98f229c35879a
r0_smg_sticky,rolling-65,8,0,9148,256,7488,40.14279258064926,2128.4257,6731.474156,b7dfb26d7c7783364de1b966a01eaeac366c6c918a43dc51217c20db6c11ad7d,7075d8cfd55e5f794a51843b6149071b15f8e1f587683c333aa98f229c35879a
r0_smg_sticky,rolling-65,9,0,11306,256,9392,49.461202883161604,2884.044936,7316.769055,3412e26b94427d5da9a50a17b66a24de4e72d2a113ca48191f03837ae224fcfd,7075d8cfd55e5f794a51843b6149071b15f8e1f587683c333aa98f229c35879a
r0_smg_sticky,rolling-65,10,0,13718,256,11552,58.75199637468904,2802.943738,7289.022199,b9cb12b60e8d9b02483da95da6d83d8fb0c3006c3c8105443f0a2fbc62add09f,7075d8cfd55e5f794a51843b6149071b15f8e1f587683c333aa98f229c35879a
r0_smg_sticky,rolling-65,11,0,16384,256,13968,68.44265464600176,3529.648654,7689.06781,bec093e8366f8a491b09c5dc8e1ad6a2cffc14948a427e9b8c07cecb007dcce7,7075d8cfd55e5f794a51843b6149071b15f8e1f587683c333aa98f229c35879a
r0_smg_sticky,rolling-72,0,0,1024,256,0,10.678410985507071,344.206933,7552.035194,286a3b73530c8e9288894e21f53cd6ebde8168e91fefc1683c05370c82867195,10a4348282fcfd7f265df78a9dfe710f2bca75cdfadd97ad0f19eaa78c64987b
r0_smg_sticky,rolling-72,1,0,1280,256,1264,22.271569738164544,5145.610936,9591.880935,6a064dabf1e4f4e9a4a6dc87eb2a7ca36874fc82bbae360c47df58f3533fc3cb,0bd6f94b8f2319a14ec48a62f326c944157add7e7ef2957f1ecdb4f22f7d4a37
r0_smg_sticky,rolling-72,2,0,1536,256,1520,31.412616909481585,2758.374794,7139.722633,ff0c7c3233d8ce51439e4b5bf74447013dd6b29e614f6fc8c4a2d2a6442ede02,73576d6dac2a151c084b373f20d37bada999731672dbd84b96e953a8c9a009e7
r0_smg_sticky,rolling-72,3,0,2166,256,1792,40.90603935346007,2879.19278,7489.422432,35b590b781546b4729c0a7247a4e21e5fd91e2ac9fc73365ad41729fb5d26f1e,11256afb697921c7f9bd2e627c9f28fa3ba2fac6bc1cad4427f5854ac2316ec7
r0_smg_sticky,rolling-72,4,0,3055,256,2416,50.186385293491185,2993.833351,7273.403735,3e738086dafcae506f8f765d194913622133172e5a2ba78af62eb7a818593d60,db515a5967fd3effcd695bc39f0e4beedd9b6ddecf974958adcd972afb6683e8
r0_smg_sticky,rolling-72,5,0,4198,256,3296,59.374108142219484,2703.966301,7184.191351,48eb6a17fd57f8cdd587406268797cbe3be706f1a341cc6e508dfa9c0b2e4c0b,fa38acdaeb15562abe61c0e705442440a9bee534928ef96e16708c236c478a56
r0_smg_sticky,rolling-72,6,0,5594,256,4448,68.44393282849342,3052.661326,7062.425871,e6fac93d6cc5c5e59d3b7c05dcefb9aee2adbd3627f738c9bde4248a11d36a04,bb5351004f64326788e28b401d93404d57b317037660654c5b67f5fd00f09fb6
r0_smg_sticky,rolling-72,7,0,7244,256,5840,77.47967740520835,2942.308429,7033.22515,e6221e15a80d583c0757818b79433c35aebbd045e76bb252c02670417c6b0cf4,4f42a1a2a001be789cd942b70ee20571c75f408a134d1d2c2c6a833e02417036
r0_smg_sticky,rolling-72,8,0,9148,256,7488,86.45385302975774,2815.264773,6963.940567,ed6ede98bac59a00bd1634f4ba4684a5ab82017cf049ce3f7817a4a9df5f9a92,4f42a1a2a001be789cd942b70ee20571c75f408a134d1d2c2c6a833e02417036
r0_smg_sticky,rolling-72,9,0,11306,256,9392,95.98428654670715,2864.049711,7526.919909,3c4a2e92608a02dd071918b2fc3b080e35cb78e4e477a1c4a12f9149351d5709,4f42a1a2a001be789cd942b70ee20571c75f408a134d1d2c2c6a833e02417036
r0_smg_sticky,rolling-72,10,0,13718,256,11552,105.88178045023233,3133.598365,7895.989203,e6467d1d64e81826906065f21014b5d8b6780eca10e46ffb8b9cdf18140b5576,4f42a1a2a001be789cd942b70ee20571c75f408a134d1d2c2c6a833e02417036
r0_smg_sticky,rolling-72,11,0,16384,256,13968,115.53761035017669,3115.800465,7651.042652,06d2be47b7ad299289b17ff077dd72852d9104cbc9e7b76d68f40fd7cc69a4f6,4f42a1a2a001be789cd942b70ee20571c75f408a134d1d2c2c6a833e02417036
r0_smg_sticky,rolling-66,6,0,5594,256,480,10.678495049476624,408.888928,7826.82116,c9daa088518049eba83b1bc2f71b50c0ec0e1a149fa5429bf6c4750863281d8c,e27a29e6d44cc7dd23d0795e61126bc49ec952b310c4672c94188565faa70404
r0_smg_sticky,rolling-66,7,0,7244,256,5840,22.272035853005946,5144.969651,9591.832582,1a15edb972c69508713fce844745025096ad0217baab0f009b755228e77ead63,3f78a959ff9749db5c88e921e67d5743d1d59269a7e6132e1f151142c9dc821e
r0_smg_sticky,rolling-66,8,0,9148,256,7488,31.41170762386173,2756.702368,7137.235545,1952939d338598b241c4701c8ea02d67b1883c62af76a020c7f108dde94f3231,08e82891018cf268f1d8c3861ea927fd5ffb36224667d85748e38341fd74eca5
r0_smg_sticky,rolling-66,9,0,11306,256,9392,40.907439841888845,2880.342963,7491.856399,f39a7d8b91d033dae48bc56d7f78658c3e922b081b5aed91e2aeb5f56cef4675,a8ef031fbfea784cbe76fe15eb838d6c40a34406a7182cc7c962bff2ab4d6d7f
r0_smg_sticky,rolling-66,10,0,13718,256,11552,50.186638799495995,3036.056616,7270.455461,839979f834e09b62365aecf50356052781a3cad455128daa314fa74dc920133a,08e82891018cf268f1d8c3861ea927fd5ffb36224667d85748e38341fd74eca5
r0_smg_sticky,rolling-66,11,0,16384,256,13968,59.37240163516253,2897.338714,7181.367622,171a2fb47cd3a28d9b133fa5d0ab000cae7c91ed6e85b37eb0e447bc7c3e575c,f6c823da669f6c2c30661da619cb322a87ce909a2589ec92b88b410580ac7e1e
r0_smg_sticky,rolling-83,11,0,16384,256,512,10.678649035282433,338.635731,7095.607576,fcff84b7db6cdad35e8cb9ab943ae7abab74a68255ac88ea859bc8e032f740dc,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-68,8,0,9148,256,512,10.679276687093079,413.425692,7741.303902,e60ae7aee5a7a4b9e61d63e66ab27968b287fe9a420131183de2a927e184df28,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-68,9,0,11306,256,9392,22.2785568209365,5143.937742,9597.421353,799192389aded6f3bc0ee991b8418d3a028c26ef67943e17744e1a554079bca9,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-68,10,0,13718,256,11552,31.415514623746276,2932.028078,7127.675806,02128fc0a962c89d28d295b8fc9b0d37fe1f50313e5a6dc376e18f0b09721e88,d1929ae7d59da9a210f7f964d9926d273cd1cd8aa641754e2410fa7f62496a92
r0_smg_sticky,rolling-68,11,0,16384,256,13968,40.89917240012437,2986.721341,7462.748446,78729b1bfadd436cc8fc6c30d608e51778ef153c435a27dde2908809b044846c,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-70,10,0,13718,256,512,10.679593840613961,446.220772,7655.386034,6781fbaadefc776068bc9cca300dcaddea8415f6def7ea7c069dfc62ab73fec6,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-70,11,0,16384,256,13968,22.275874180719256,5193.229946,9593.402671,1b5ed78b47c655f9fb223b658cb486ce53918a83eac7dd01aae6f080909eff58,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-63,3,0,2166,256,512,10.679950035177171,357.933193,7957.993321,6cf373d5fd7b8f691e00cc543f22b7bdd1fa28819b3af2fcb4b8411bf48b8281,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-63,4,0,3055,256,2416,22.275083167478442,5192.79484,9592.196681,73c4d267f93a0aac12e59d319e12b9dc7c466398b578728f1affac77f6d6144b,e9a2476641c3ba6d10a8dddfff67145fdaddc5bcac7d57ae7698b5c56ee45778
r0_smg_sticky,rolling-63,5,0,4198,256,3296,31.409254744648933,2785.915858,7129.887212,036b24b1d478ed7563f7c68cd25753bb1cacc376af458693c693d721f635433b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-63,6,0,5594,256,4448,40.90578175149858,2778.297796,7493.968636,c29bbddaf7f05c1eb046510e8a6aa75816f41ecaf09c6e56bc2d9234ced3ce85,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-63,7,0,7244,256,5840,50.18482461292297,3041.250664,7273.75017,c2337dd93955278767aa426d565a27362b808c198db4972d250f439098644473,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-63,8,0,9148,256,7488,59.37594191264361,2706.837071,7188.96482,ba32c87ced511071ca9a35b2ed7575c5413d5b740e4aa5fc1c53a2bfeb7badeb,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-63,9,0,11306,256,9392,69.12571587227285,3325.226734,7738.789009,0b2b216aa7af6e54c179cec9faa9c8f924b40def06a5c983180ec6550ac4d108,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-63,10,0,13718,256,11552,78.23456348665059,2793.033277,7101.487134,fa41850ceb9507772b4b73060fceceb19006e570f4854c62086b38770733799a,b0312d45fd28884459e5df803df852c8c75688ff8873c10b6fa0fc48bd5ab554
r0_smg_sticky,rolling-63,11,0,16384,256,13968,89.73594314884394,5193.98192,9498.653002,bd2d53e27d5614f231546dd0c45ecc1d1ba48b4866d2f522bd864d4c921b7a44,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-59,11,0,16384,256,512,10.680054963566363,527.869847,8128.049495,526f8b025c52dc5877da20e5b47ad42d28fe09da3c800b46af4292cea1401143,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-79,7,0,7244,256,512,10.68059698306024,166.945051,7270.343139,e00d6f3ab855c57cfb8f2990d8baa53669160e1a1344a3fd21daf87ea4851ddd,cf81c5545ca44a360fcd10eb6f194e10ec476546c1aaad8778b9f681baad1239
r0_smg_sticky,rolling-79,8,0,9148,256,7488,22.27447330765426,5191.83301,9590.779008,622e055c4da8113a5b2715c4d327875a9429c7c55e14a7da61d3c830f9794e2a,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-79,9,0,11306,256,9392,31.408038994297385,2786.762231,7129.610891,f97ace8813511e4cf1a2813fee1e37cd31b7987356830639648e18ff4f8cfec6,3765990eebe6c9a5817abb06bc4cde37f1b5f117b81bf150b14d396c0ae7d725
r0_smg_sticky,rolling-79,10,0,13718,256,11552,40.14347005728632,2130.35272,6733.942779,a73979520d1aa2de26cc47970a23875efad2ba4d99373a74128c9245c469f7ad,0bed280b8f829bca194ff6282e0d27e3811805cdb0f2d0be56c6e4fad1db51fa
r0_smg_sticky,rolling-79,11,0,16384,256,13968,50.19209550507367,3606.166209,8045.716323,1dd4837f9adb3d6e46908548e78e4874e87ec3618397c115ff382d7c092701d9,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-81,9,0,11306,256,0,10.680850327946246,218.007251,7184.521686,dd1b152bbcfb551073b808892b4cbc98f02ea142a07fcfbd0a73cb0d275ca886,01aa1af3e459dd382414b5c8399b262a7c578714ec52d6224b0d380a0313b5fc
r0_smg_sticky,rolling-81,10,0,13718,256,11552,22.27751291077584,5190.872396,9592.666507,7ace40265793770f5ea27961fc9abaf47788da0ffd59f500dd4304f09ae07da8,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-81,11,0,16384,256,13968,31.879152974113822,3096.858749,7593.6239,15c0eac0f083bec1b6197da8962a74d896da53bb8fa1ff9ffb1f6688f04ff6df,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-74,2,0,1532,256,0,10.681183641776443,309.275681,7486.753196,3ca0542d475d7997279d2ba26d485741947e0f45f5cda6f77f0d6e148c8f1cdd,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-74,3,0,2166,256,1776,22.277165931649506,5190.437353,9592.000039,965531c07d02a08e5e87d43c4b459b8dec62942badc62c44d21b1a80eafb30d0,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-74,4,0,3055,256,2416,31.413676403462887,2887.895265,7129.857004,782790cb718d4f56372bdbb5028db376b524d390d0c8eb7280d7341dbdc24546,af45baaf5c4c2bde56c9d08bee6fbd91369bc89fb1da42cbc69ebf3569d4030c
r0_smg_sticky,rolling-74,5,0,4198,256,3296,40.90625938680023,2983.318055,7487.247122,cc651946a91c350ee48c33e6987d6d90626fc0af6357b46a84fe1841bbc7d916,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-74,6,0,5594,256,4448,50.187117682769895,3038.921626,7273.748442,37afe5464452f7bf1fbca58dcdc37f535446e05be093688b76caccd999ece950,0bed280b8f829bca194ff6282e0d27e3811805cdb0f2d0be56c6e4fad1db51fa
r0_smg_sticky,rolling-74,7,0,7244,256,5840,59.37336919270456,2896.996664,7181.790025,43d7abeae2c934ef22e5823fc4acaf8eea55debc2ae85f7cd1d85f7a6ca0c33e,b43296105edf4bba8e34fa9dbd8b5f79add09518d7d912cafc3523bc6fbb0397
r0_smg_sticky,rolling-74,8,0,9148,256,7488,68.4455238468945,3054.455193,7065.597507,6db7721cf86c1786cf0883d01c70b46fb2fb27d8a788d063ee53ff0605ecf41e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-74,9,0,11306,256,9392,77.48178029805422,2940.833219,7033.784801,efcdfd4355029133ffda9b0828a7599a760ef4e1002f140d09b560cc416e65d9,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-74,10,0,13718,256,11552,86.93113322369754,3102.79888,7436.814333,4c3056b48688af66f6ece764e63a3628815a5b7b3fa2b6cc66e12bce9f9481bf,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-74,11,0,16384,256,13968,96.69301000982523,3003.61677,7759.961395,48e0f888c7832e13b6f3ab912fd64b142f88a9f54bc6f290d7f7fed49df7d36d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-56,8,0,9148,256,0,10.681511547416449,393.017727,8242.762899,9c47f2b6a3436f58dbad0733e0e6232384eb35d361b4e057b5cc53afcf09270d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-56,9,0,11306,256,9392,22.278005361557007,5201.365772,9591.924358,a6bc58e806b27c0d1ad755cc45d2e3c32a2687224797e63435e0ead126b69dd7,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-56,10,0,13718,256,11552,31.8710623010993,3031.7956,7584.4657,19d234359229386c0cdf9e8ed730316c5e28bfa9e9f92063e390fcfeee9bfcdc,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-56,11,0,16384,256,13968,40.906513628549874,2604.871073,7032.893277,a108eb486762724ddc2fad57fb6ba8c21d1d23a30fe00628c04bd8bc9cc6790a,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-77,5,0,4198,256,512,10.68175775744021,180.19822,7358.282908,01de8b1e4e71daaa13abc8411ae5649b782ee84d62f9998a8677adfd0f95326b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-77,6,0,5594,256,4448,22.276401448063552,5188.820895,9589.82777,5c0b841b9ef5f7f6c6c5a97510e9716173065de218a15bc90f888aec80788595,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-77,7,0,7244,256,5840,31.41410568729043,2890.389488,7132.70211,4875301d5480f8cd0b88389d13b80c7594908aa757df2b34712e589206db66eb,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-77,8,0,9148,256,7488,40.900588408112526,2968.716143,7467.039927,1efdfed7de6c96f924c057fc16f008a6a003db4d3924cc946b289104119159e5,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-77,9,0,11306,256,9392,50.18947126530111,2849.646646,7286.66676,c4f82783c9dd5f43de78fe42cbf7afd28562b792dd91af74cd1d0c16d1f9bc93,bd38b79868fee1f2527408fa5ff03e659973e3963786f4d9fdc1b20f0d902d49
r0_smg_sticky,rolling-77,10,0,13718,256,11552,59.36986184399575,3007.975869,7174.553436,505e603ebeb4dc54ccb9d516de135173f0ea7bd92ece79286254b161dff9e95a,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-77,11,0,16384,256,13968,68.44847999326885,2950.866273,7074.531866,599e0e625fae4a59b48e52c49150c6da6f7f0a4d3d97090bf61b279d61f91b4a,7193d665b35f19a49a068212c3068410ca35fae8b22b8493578f30ed005c3336
r0_smg_sticky,rolling-60,0,0,1024,256,512,10.68189001455903,486.707548,8088.773928,91f65ca11586da2ea5e4f698bb03da1d82c5a3e5c77383c6f2f3a787b18b27e1,702aead42c1fe3219a21d66f86971f2c75a8a56f5b4d54c5431dd4d4cfd9c855
r0_smg_sticky,rolling-60,1,0,1280,256,1264,22.277020907960832,5188.761631,9590.196412,6f8b46322672852ef6c555982337dcc6367420a4d53ff18296f62874071045b5,49ac0e45dc40536cb0893972f6f920240754a14d4735c2045d36d8b817191bed
r0_smg_sticky,rolling-60,2,0,1536,256,1520,31.413942069746554,2887.946592,7130.367823,172f5297da09045fe94dd9fee59a5d93d871ebeba4f0cbc4d6452afd58cf1b58,94ee73b662da5daad41fb9276006036722923345571b6ae62033794fd81145e5
r0_smg_sticky,rolling-60,3,0,2166,256,1792,40.90701375994831,2983.009542,7487.790774,bca58a0b300997fcb63943842dc7ea9655ad1b06fc2e35dccdc6139c96193d53,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-60,4,0,3055,256,2416,50.18610836472362,3037.623025,7271.587051,c22457118e1b8a371e079341dd8b71b41e8b352238bfad38c66a45810e55d774,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-60,5,0,4198,256,3296,59.37386951595545,2704.184734,7184.403704,fe728d782b72bb19240116df267ad8ba551fcdebf77a6d73644f0d0b826079eb,69fc07bbe218455efdf01bba9a1c028c317c3c20714325e52d618eb90c088131
r0_smg_sticky,rolling-60,6,0,5594,256,4448,68.44361324422061,3061.836422,7062.58936,252fc03e6075249a93139162070e3d70abe6d05acda0d173b8665028ec254f57,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-60,7,0,7244,256,5840,77.47995875123888,2943.100657,7034.205476,e44e6d637e1522a7ebe67bb2ab1c238120076c699ed2ffc78b9b5ae6a5dc15c8,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-60,8,0,9148,256,7488,86.45277007855475,2820.415524,6962.203788,379fef5dba58dbe21344c0e47ee37e936e9b4d2c67cc04cecd4886831be8bdff,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-60,9,0,11306,256,9392,95.9738308666274,2823.090133,7519.592344,8b2b671c84d4510e4b42ff5de52758ffcc1fdba291208112effe5ccb8d69c0cf,97514cdceb25a34e4accb70f4822b539cd362f492ecd54d8ce2de652a5f0fce7
r0_smg_sticky,rolling-60,10,0,13718,256,11552,105.88138972781599,3105.524882,7903.459584,bf82cfe2052498eb7695a1eb55189f18a3f5a7ae0f07595074a108bddde60bc9,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-60,11,0,16384,256,13968,115.51939583849162,3021.680338,7634.211861,82df036a80a6a7e42f5b3e8879984318788fe0922e7d005ce401215ad7010dd4,5e7413e355c3333168ee349306068ce3d525e72f2983a1c648635e2d7f771c78
r0_smg_sticky,rolling-84,0,0,1024,256,512,10.681941727176309,297.508089,7057.745713,30a740de27d397d4bd968316b66f41619c513e1fe87d1c81ad0f0689b48455bf,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,1,0,1280,256,1264,22.278431699611247,5188.560286,9591.43418,a0906e35696f5b0305fedc693304fb55558c17eaca282d7190bc60fb430356a7,f5983d995e8a89002fb037ce7a1dce6608487127170a2ffafeab505b1a304014
r0_smg_sticky,rolling-84,2,0,1536,256,1520,31.414675194770098,2884.851406,7127.789343,a6a68311c3a8dd9e426be90a4fb86a92f5d8ba0362aea860bbe04823fde08fb3,cc182b53956dcdfd519886661eb915b6295fe1b07d82e66648c9465b38a708db
r0_smg_sticky,rolling-84,3,0,2166,256,1792,40.90114799607545,2968.303724,7467.124216,820a20a777d28b10a23e88a12603629d5944130e9188b18e8895a3937e52fd24,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,4,0,3055,256,2416,50.1893012477085,2848.67752,7285.767427,ae53ae85226310b8429dd037965e9cb9f7a00a8740975a1e7558399f88cecdb3,753c647fb58a367f888cff96cf18127a923a1223746a9bdd26608336e295afea
r0_smg_sticky,rolling-84,5,0,4198,256,3296,59.37575061619282,3008.9689,7181.276133,eb8c5b3ac9ec94307fec30219dfc1ebc3768bcb88bc0377de252ab2de115e808,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,6,0,5594,256,4448,68.98869794700295,3245.416007,7602.473937,111a31a6078b260f17ba9aa7f54d2d37c0ae60b105852dd8fadace7f8f59c466,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,7,0,7244,256,5840,78.23432050924748,2935.069088,7243.286561,25b02413c6c8bd3207a544f2031f4e62fa4974362e6b864e426331d543fce3e4,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,8,0,9148,256,7488,89.71428464911878,5039.761202,9478.025164,57b15b3328b97a3b0fe04c6996be24cdd6e1ee707c609edaeb594e740a545455,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,9,0,11306,256,9392,99.76660996116698,3322.872512,8050.456993,1710d0e22a59da4d2117529b9bb3f323189799b5a9895e18ad205d7ca0b55cd5,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,10,0,13718,256,11552,109.74753669276834,3526.964991,7979.339856,34b70b9610d25baf30fb7d2bd6124a10bc0ab94e12085fa4d6c793d5567ed863,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-84,11,0,16384,256,13968,118.92529065068811,2876.696508,7176.225704,c75f0e178a7f08ff281302cb306a3afc5ac8a0f611975378bdffc43a0b88003b,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-101,5,0,4198,256,512,10.682064128108323,54.994959,6326.772546,d5c1930617b6d8de26df4b6365b500e1731d7a320a8b792975546a16083c0337,f0ecfd071fecf44e9d5ba5e2e57c61d6aff188b4c9190692bba1fd5fbaf11959
r0_smg_sticky,rolling-101,6,0,5594,256,4448,22.2789675751701,5231.619589,9590.44195,962d50e3a3a6918892a761595abd7f50ebec80388bad99749378d846eb28d0e5,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-101,7,0,7244,256,5840,31.41487718001008,2887.702655,7126.490264,2a0633aaaaa12fac6571182d0a3a9e213b6520b15681248cb3a1159f131509d6,458a9f9f9d68337cc6151245ed12b7b8c2f1c112283a224d89a46f8b97c5d98a
r0_smg_sticky,rolling-101,8,0,9148,256,7488,40.90134262107313,2988.468231,7466.654613,d37de72103b2f08838c95a74f36b4fa10c138155718d9a6bb1a24b49dfc515b7,458a9f9f9d68337cc6151245ed12b7b8c2f1c112283a224d89a46f8b97c5d98a
r0_smg_sticky,rolling-101,9,0,11306,256,9392,50.18801106419414,2888.578724,7283.668214,5791df05b90f1f01f197daae7e7e2547e3c813b9d42f042cda40f707b8b385f3,f93067737bc3b64f2336a92b949a0e48b8b1a4eca321e8cda2a42229efe6fa55
r0_smg_sticky,rolling-101,10,0,13718,256,11552,59.37099935486913,3010.927343,7178.427892,5bc48bf93466fba4facbc3727300e0d9c23aa4309374523a06656791999943cc,458a9f9f9d68337cc6151245ed12b7b8c2f1c112283a224d89a46f8b97c5d98a
r0_smg_sticky,rolling-101,11,0,16384,256,13968,68.44431455992162,3057.176521,7067.217965,a6cab23d8a68e07936433adfef2fbabd1540b35c1c2b759e44ade596375a035c,f72de618e436132f8be0b71d7e424d676ba48ec7b90d3cc4d6dd695e3514d57d
r0_smg_sticky,rolling-54,6,0,5594,256,512,10.6822174731642,404.167363,8346.522893,75b6d663de686468b0cd97bca5e022bbeb043c55ff031d0ee585700f99a650cf,4f0cc45bfb957b4ed4d53825cd91860e9efa7cfcea6cccdfec3c04661fbb512e
r0_smg_sticky,rolling-54,7,0,7244,256,5840,22.276689065620303,5193.268187,9587.546124,5a67352eea0c9cdeb57c4e5d80666ce6fd409d6cab07c672532cd3db9b2fff48,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-54,8,0,9148,256,7488,31.412811406888068,2888.476772,7129.532362,4fc373d5b0cb97fc9694785f108bec4aa1e26130a9c29d8cae692dbafb2aa45b,85eee7ff35926260a0c02fe0c71b5d5b844e8c07080a72f5620748458967f75c
r0_smg_sticky,rolling-54,9,0,11306,256,9392,40.90536952577531,2878.511272,7487.987351,61213c145bcc9b379c2d3d7793d87a2e14c41aeb166ccd16cc17c6bba800eb53,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-54,10,0,13718,256,11552,50.185656073503196,2996.089396,7275.12669,0cd843064df715e515877140e5eea72065774bcef5c775758ac388a45a8140a1,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-54,11,0,16384,256,13968,59.374338222667575,2899.444007,7185.272382,2ad238f1fe069c94c4910f5fde9e5257568ac6a4cbfad43b809285b20fd126b7,34b658020f2fe453d27a6611ae1c8881bec7d39dcca0603826827c66555752af
r0_smg_sticky,rolling-90,6,0,5594,256,0,10.682402306236327,186.411826,6799.922859,3d6a1cd771ff0bc6562b8c2b21869ac5bc348fc9f8deca4688e740c3e3c6f715,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-90,7,0,7244,256,5840,22.752120128832757,5370.917303,10062.355488,bd6e4e839cbf8486d0573a29a36480cf5420926f4975130dec1437d643f329d4,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-90,8,0,9148,256,7488,32.01469792984426,2696.714322,7260.949549,3b7ad1f13d957ab168820daf6670c48fb99904e92faac72bfd721cfbe20075dd,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-90,9,0,11306,256,9392,41.37891929689795,2632.705867,7361.773845,37b17e4c672fa719b890f7ffccac1fa90fdf5948418a90ff05641d70171cb182,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-90,10,0,13718,256,11552,50.71985930297524,2756.765631,7339.02596,6453a9180f5ef0fadfaf693363e9e3570f32fd7a58e92bef407f549988e6c48f,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-90,11,0,16384,256,13968,60.08189662266523,2816.602957,7359.716647,3df5959d3f8eecd099de93a8ad6987bba072eb7a4ae6794ad1b6a7df42dd7d90,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-96,0,0,1024,256,0,10.682598914951086,209.667264,6528.295216,25394e0e632d1c7f930325081fe8b4c1b5b7cbfcf08918c5901aa8f435b1bc8f,668d460967fe5d2aa64c070381490ddbe4a23ede5e3cf7decbaeb25cd5885711
r0_smg_sticky,rolling-96,1,0,1280,256,1264,22.27735482994467,5197.407635,9587.346538,0410449c25a3992e5b23b84351281f79f2df38a36e8681e7cdb912826fb9f69d,e1cb992a7ab06b1bec5370163ec776bfca62baf8362632a835f8c6d05f5fe973
r0_smg_sticky,rolling-96,2,0,1536,256,1520,31.414484633132815,2887.639711,7130.44584,795db10d761de996cfc467d9cbc1377e2d61e3d65bab7d3e3491eeb9a7a42866,0c16e3e6d4a5c28a1bb685ad1f2fc1b1b27def4e03a973677497c1f5e789d800
r0_smg_sticky,rolling-96,3,0,2166,256,1792,40.90038277488202,2968.411852,7466.567572,9fd6cd2e53cadd2a4f5d7c3db0bceb4559df8e3c7805b04c5e0606a6f591f09c,ea200e05bfa8baccef004167d784786cf1dd5ccf14d94f18ee6733804e549c46
r0_smg_sticky,rolling-96,4,0,3055,256,2416,50.18886988610029,2850.371611,7286.882154,8f00679d026a46d0b94d3e2842fc5d03fbca459ddf12192c579a84681b261e0e,668d460967fe5d2aa64c070381490ddbe4a23ede5e3cf7decbaeb25cd5885711
r0_smg_sticky,rolling-96,5,0,4198,256,3296,59.37533938046545,3009.78324,7181.595911,754469c3bca50ed29d6d9ffb7f72161e7814888fd0df5ffb7c7225066c3db7da,668d460967fe5d2aa64c070381490ddbe4a23ede5e3cf7decbaeb25cd5885711
r0_smg_sticky,rolling-96,6,0,5594,256,4448,68.45063731819391,3095.423955,7065.442658,71deaf8e3d52a32dc60be886e947856ab81486c4160f2ab22daa0aea38512fa8,668d460967fe5d2aa64c070381490ddbe4a23ede5e3cf7decbaeb25cd5885711
r0_smg_sticky,rolling-96,7,0,7244,256,5840,77.47679783590138,2974.189903,7022.746302,c7621ed6c8a0dfe8d0d81faabea13c701d0f287aad94b9b15e548d7e5cbfe6c9,d74a2a96396e22016314ffda519338a39d5d610c3eb40c4d6602e305c16a40d2
r0_smg_sticky,rolling-96,8,0,9148,256,7488,86.45595201849937,2709.421086,6970.070236,e273caf054f4fc7da9514c19956155b887682e7d3374e707533ac458800c6f13,668d460967fe5d2aa64c070381490ddbe4a23ede5e3cf7decbaeb25cd5885711
r0_smg_sticky,rolling-96,9,0,11306,256,9392,95.9861563174054,2919.488993,7525.745789,ada65a28300b45f6a7f50f9f9b965de4b25b75fd0b77610bdfcd54841627295b,cb1f5772910c30b1d2572daec3b41cb09d39fa9a77ef19e06b019f7ae29212f0
r0_smg_sticky,rolling-96,10,0,13718,256,11552,106.33591243904084,3422.675842,8345.186025,acdab4dcbbea97f11626c7fc08e4d15d796efb7461e71e3d1b17545cbda4e79e,668d460967fe5d2aa64c070381490ddbe4a23ede5e3cf7decbaeb25cd5885711
r0_smg_sticky,rolling-96,11,0,16384,256,13968,115.78545394353569,2915.888108,7446.267065,a9e491edd1e0fd656b632803e23700a9c8706a2dd2332844ee68546441c2b427,eb7173c02f99a7f3524c52f097555fbf6382106a64caa364a8461a01c3e86f75
r0_smg_sticky,rolling-94,10,0,13718,256,512,10.682661827653646,274.633741,6627.535022,feb0e5f2cc25b897a4d34d6c6b44c0958642c922e90104b8034c643e9b491e1e,4eded64e29a9a6dbcecd780688af3b474145da4fefebec44c2c31922fdc0d6aa
r0_smg_sticky,rolling-94,11,0,16384,256,13968,22.885151404887438,5469.692818,10193.788834,09fcef90656e28f2f7a12c7779c150a14f498dad31699233149acaba68b41c41,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-88,4,0,3055,256,0,10.68301142938435,228.97471,6873.276363,591228daeafd5fbe385e1412c2a720c1c5b1642a30579b12b32d7693be6be102,c6a5ab13cb29f4f70051fbf3f2aa8e988eb80d344ca47d037b50ae3f2afd36b7
r0_smg_sticky,rolling-88,5,0,4198,256,3296,22.752482946962118,5368.748041,10060.624117,0bbed0b6cd9c0843b3e56181678428a06897aec87cb1d39f505851d387c848bb,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-88,6,0,5594,256,4448,32.028840735554695,2729.88054,7274.655552,dba5bd4e1e4dbd062ae9008b1de0b388d56b51823ed8addef5b117c2ac704398,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-88,7,0,7244,256,5840,41.52074573095888,2665.86655,7490.406055,4f8a3f577d7848052eb5c00ee2daed49617d0d7798a63721a056ba84b488207d,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-88,8,0,9148,256,7488,50.87299550138414,2685.195498,7348.950244,edbb1439d8fc465156968b73e1e41e7aa4ed08071ed88c4964926d35e5b067a5,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-88,9,0,11306,256,9392,60.09454969223589,2706.36222,7219.547951,ad51037308aee2045297c8b2c1536b28298c658da9da9a27277aca0672959bd8,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-88,10,0,13718,256,11552,69.28658878989518,2808.112056,7190.447645,8a7cf03e7ceacff60150fb4bba989e3b3a168a8d4342aee6fe38affa1abacdd3,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-88,11,0,16384,256,13968,80.66734813153744,5052.372128,9376.621698,64faf5fa5f36c82676ac33857f464924de014d0fec6a5695968617615dd057ea,e09154f72fd0b66c5b0c4f1cc0afd7d8c7b8815e0fde16853a6d3a2cba1854bb
r0_smg_sticky,rolling-86,2,0,1532,256,512,10.683094086125493,244.609973,6972.837386,2f197d0afc46799835522120bca07b17c6910c9b095a3af89d0e908b36de5f28,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-86,3,0,2166,256,1776,22.74859121069312,5326.269639,10056.144378,2a0eb7d512f50df8f1f26aa61a64fd56d141e5ab950465e8ef3d392488db59a3,0a8e796b2f73c97aa65b5397431e10fd77c495e5eac7c2d49b67bac969949b46
r0_smg_sticky,rolling-86,4,0,3055,256,2416,31.878953997045755,2632.526282,7129.20212,31474e212115ad9652994e61c524e99b6789f76555d19567e4a4dfad49a72f88,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-86,5,0,4198,256,3296,41.35875472612679,2769.480399,7478.44787,84869e8207e431f404cbc31a6436d7cf36ed2a78b94d4e3d54a4f6411ea3b8ed,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-86,6,0,5594,256,4448,50.191603533923626,2627.052967,6830.738344,e63ecb8eaac001610d898b10febee5427b0f4f38f793e18865b0743e51b74136,f6ffd0b71c12203455041d9db02bc699da06c6008bb6bbd117e57525db3af656
r0_smg_sticky,rolling-86,7,0,7244,256,5840,59.37147318199277,3044.686142,7169.986368,fe096478891be495c350534cb61148dca07669a36237fbc8b884c5cf16256f1c,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-86,8,0,9148,256,7488,68.44493853207678,3056.509285,7067.158317,4bea2d36447c0ff5cc5d8662b15cb81d15fbd2e3ba1730c94fafaf353809ab7c,daa612bfe371c1eda104facaf9072722789e9362dcc61013dd7f25e61bd1e677
r0_smg_sticky,rolling-86,9,0,11306,256,9392,77.4793098513037,2941.566728,7032.002455,40f8657afff7e1f793f43f1a47ecbffe352259e182eab9b4d9f54e941afc141c,fd6ade90904ca41f800d76e3ea05fcffb1a42ccd57257eafa9e9010abaa8fc71
r0_smg_sticky,rolling-86,10,0,13718,256,11552,86.45347958710045,2816.044713,6964.28796,357a2cbee69a841263a4f59850cc739c4f7aeba5d19bb69ec76528a0bf811b01,acf034b4615e80fba6faad806eaa227e7d59689580f16fe211aadb46c80f8dae
r0_smg_sticky,rolling-86,11,0,16384,256,13968,95.97477852087468,2864.928981,7518.324785,80b6b083194251509e957e11e882a4e74767bf0e5d872883b29422e0c79142f5,2c9170271c14892d60f0c296e4f9fc7717e6107a8b1be60d34c50dd5eae3e1b6
r0_smg_sticky,rolling-98,2,0,1532,256,0,10.683167974464595,137.873609,6457.10243,0c70efd1b14944588878f5989cf9f3aa624efc60c48ad649d2a3136ea7ccef37,99ba43c50c46762f13aecbc5c743e5e3881a59f568dfd4b1699609450b070bf5
r0_smg_sticky,rolling-98,3,0,2166,256,1776,22.752673219889402,5367.954437,10059.972177,d88e5301ce7cee876bf7b118e5562ad93eae105fc4b57f572096213ee5ba6dfd,996e31e15bd8e783778aaf64b62f63d10b0470eea88058526aba4e7270929c53
r0_smg_sticky,rolling-98,4,0,3055,256,2416,32.01546423882246,2695.980717,7260.89358,e0ede2e3996cae42c6ea5135a5b743504915ff5b861860625a3db7daeb9435f3,789d261492410dea1da5a7eb178083ef5e0d563072097bafd0ffdf2215ae9594
r0_smg_sticky,rolling-98,5,0,4198,256,3296,41.37833836488426,2632.210024,7360.697582,909edaacceadeafaad53d42cc61e3632dc768c97c05bb36c97da1122bca4fa54,78d0b5822fc571004ab04d0457a62936b124fa524399da850fbe764d1813020c
r0_smg_sticky,rolling-98,6,0,5594,256,4448,50.70289247948676,2700.667017,7323.447721,28d0bc0a03cdee86eafc06f97dc0d1dde9c3bc3f276063a9b64080a092584b0e,0659e1d02dae4eb518f2583a980b87530ba9ec6d2bc2438bfc67a433ab8b1f2a
r0_smg_sticky,rolling-98,7,0,7244,256,5840,59.94489655457437,2728.011536,7226.672602,20788f01d4580e65217f1a6d8ffb96b3cf3631334b9e0f1244949cd03c6950a0,78d0b5822fc571004ab04d0457a62936b124fa524399da850fbe764d1813020c
r0_smg_sticky,rolling-98,8,0,9148,256,7488,69.28706424869597,2957.146247,7339.92347,bb9736620ae202a42d715cc8508391f867bbe254dbb4c3d17bd97f807d702c6d,4e41aa345cb1cbf66d143a72aa09926c87b40ed57285b4992270390eda0d9b9a
r0_smg_sticky,rolling-98,9,0,11306,256,9392,80.59165237378329,4957.966431,9300.036045,1915ead555c63ce7647d4c1cb819ba9c711739c6c35e6c205f1c3238628acbdb,78d0b5822fc571004ab04d0457a62936b124fa524399da850fbe764d1813020c
r0_smg_sticky,rolling-98,10,0,13718,256,11552,90.18564829509705,3136.565358,7592.177682,92c8f6118b12bc487d9952c1aec28a4c1a522e911054b3c3e9a61bf586781f2e,9367aab2a386190309aa7eccf9615cda6c0d1aa21b7113ea92ae78d93ed4ca12
r0_smg_sticky,rolling-98,11,0,16384,256,13968,100.12851850595325,3254.652384,7939.964127,889e2059d73f4d28d0298924273758838345ad8786c4e760fa11d411e11ad2d0,78d0b5822fc571004ab04d0457a62936b124fa524399da850fbe764d1813020c
r0_smg_sticky,rolling-92,8,0,9148,256,512,10.68324202299118,279.280041,6713.36761,c12dbefbadad0676597b5b4c954a6fd6dffad80f2149d175204a6bc89985a2b2,1537499ed371c5e9070c7d64db104edcd83c968e52935e003970da5bc12ce2e6
r0_smg_sticky,rolling-92,9,0,11306,256,9392,22.885713391937315,5468.271337,10192.232184,eca3b85b81d815ac8ef928543afb3be137cc31830ed4e96458dd237e87d137bd,a8cb1caff838c07ce019cf5274cb166c99100c99af72f5850025a6787854e677
r0_smg_sticky,rolling-92,10,0,13718,256,11552,32.19210803695023,2747.871787,7305.020186,b035fe49fa2aac72d2598032215ab523ed06998489327806490af6b9eea0cc75,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-92,11,0,16384,256,13968,41.67249062471092,2753.644078,7477.333623,903048231be3654e2e2c11ffaf5b82faac83889e1e633dccec78858bfaded412,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-124,4,1,3055,256,464,11.645994652993977,364.415985,6302.572175,62afb449681617b15aedce74cdfc6cf11a65379aaa92deff80c700b8f37553d8,32ba3eb3b82ca3d8fdd8d1f6ce9ae4f2106e62161910417f558b964b69caa6ec
r0_smg_sticky,rolling-124,5,1,4198,256,3296,20.97234682738781,3095.35781,7324.895156,55a8a90ab1934c9ef6d5b9bbd815eda3932edb8f350dd34eb1d04c0002b6471b,32ba3eb3b82ca3d8fdd8d1f6ce9ae4f2106e62161910417f558b964b69caa6ec
r0_smg_sticky,rolling-124,6,1,5594,256,4448,30.94839074742049,3579.112924,7973.664492,2e713693d04c50d05aad15ab97e68c20e585eb5a3f58d7df83c63d0e91f957c5,32ba3eb3b82ca3d8fdd8d1f6ce9ae4f2106e62161910417f558b964b69caa6ec
r0_smg_sticky,rolling-124,7,1,7244,256,5840,39.46188845671713,2709.090973,6507.625589,4de98590aad103ec93995283239fbef53c74750196498e67be1bd6c71eb3f9cc,32ba3eb3b82ca3d8fdd8d1f6ce9ae4f2106e62161910417f558b964b69caa6ec
r0_smg_sticky,rolling-124,8,1,9148,256,7488,50.87081260886043,5058.71367,9401.526969,665f760df943dd92140609006d1f52c6f22e2afed991af786a27bdd6919d2b2d,10bd36f24008f96f4d1cfd4d87c2a47bb93d2a61f801833f0d9baf4e8e908127
r0_smg_sticky,rolling-124,9,1,11306,256,9392,60.30322229396552,2652.015488,7430.348726,e96037c19495db0637e04438edfe2750fc81ea891836d396f3b659822de5c9b4,32ba3eb3b82ca3d8fdd8d1f6ce9ae4f2106e62161910417f558b964b69caa6ec
r0_smg_sticky,rolling-124,10,1,13718,256,11552,69.42653294093907,2606.791979,7115.332882,14b8ef0453a05c365f54bbf229d68be2cbc4415ade99cdcac0cc8048a3b4ab29,fd915dd021d2328eb1411d5843bb683672cbc7c2018323454066791194de51c0
r0_smg_sticky,rolling-124,11,1,16384,256,13968,78.74756770674139,2728.549331,7317.73303,1d61f2e499021c9df50f16090b72d4a4b7099dcfbece447e015ea36404b3e78b,32ba3eb3b82ca3d8fdd8d1f6ce9ae4f2106e62161910417f558b964b69caa6ec
r0_smg_sticky,rolling-71,11,1,16384,256,512,11.646710145287216,905.019349,8579.101689,8a8ff613e542db3f4d6b7ec61b329b9fffc67509ead9c469acaa8c982ca1f7e6,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-75,3,1,2166,256,0,11.647625382989645,769.753691,8409.569422,e563d5b069dec215f6eb2e5dbff2d70a86c040595b32e682e0660878fdf74eb6,eccac54bfaac7bde687c0479585a8a3a5a5937572485d0ad59350bff59ebf396
r0_smg_sticky,rolling-75,4,1,3055,256,2416,20.97192362509668,3094.853327,7323.930734,745827cfb90e9e85cabd5717f72dbfb28ea9e7be91ca0c4152fede305022c6c0,174ff7760005baa8d1a724fad5dc7630f9c7b2c8e9248ef06f85cee0396ded21
r0_smg_sticky,rolling-75,5,1,4198,256,3296,29.97873365972191,2559.093001,7005.171699,8c2e8caad16aad783dc9c3aec2bced3012958dd0f95f7f006e7406e86d72d5fb,55f5b51be7d7f435937ce11cd5d1e5ddfd7ce2deb4a2126e9949c60eebc756c1
r0_smg_sticky,rolling-75,6,1,5594,256,4448,39.457135115750134,3564.174979,7477.704729,fc21605dd0641afc5103c4ecbd939d6b7d7b8b258de845c1167d28d7a419a629,35299dc49e90ba553ffe1d1685308f839d9c81ca4b4b6ad24498d3bda197ac32
r0_smg_sticky,rolling-75,7,1,7244,256,5840,48.32232552859932,2643.293802,6860.937889,a49a25b9bc4c4612400741ed396a5d42762120f1d08f757d109ddb28d712cab9,55f5b51be7d7f435937ce11cd5d1e5ddfd7ce2deb4a2126e9949c60eebc756c1
r0_smg_sticky,rolling-75,8,1,9148,256,7488,57.24258418381214,2634.837943,6918.31792,7e6d02db9bd396323d3aa1f1134e9c983a6d4883140b895891c71de54f666c44,55f5b51be7d7f435937ce11cd5d1e5ddfd7ce2deb4a2126e9949c60eebc756c1
r0_smg_sticky,rolling-75,9,1,11306,256,9392,66.54782950878143,2906.908596,7302.976333,59c500748e778f07cc6d5b57d67c3a3f4e79d26cf2048837749f94aaebb884a9,820eb6e9d35e9ceb9a678a47daa2325fb30c54a2392d4eba3c32e567c23d48fc
r0_smg_sticky,rolling-75,10,1,13718,256,11552,75.80500641278923,2945.184253,7251.797299,44a447186b0798b212b41b0dd07bdd57c4c5442809421321ad554c125f7c14c8,55f5b51be7d7f435937ce11cd5d1e5ddfd7ce2deb4a2126e9949c60eebc756c1
r0_smg_sticky,rolling-75,11,1,16384,256,13968,85.19765396788716,2996.207381,7390.005888,b86fecc9ff9db0eb524d28e6072bfc7bf9e8fe06e05d7f7075802821a7a622f0,55f5b51be7d7f435937ce11cd5d1e5ddfd7ce2deb4a2126e9949c60eebc756c1
r0_smg_sticky,rolling-80,8,1,9148,256,0,11.647770311683416,717.850686,8177.801318,a949ff1f4f1c52a1ecedb9b824caed743fa28e68284fdbb65dcf63c50b04d616,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-80,9,1,11306,256,9392,21.84796369448304,4065.810263,8198.955533,468c482ba7a241592a6cfdb4692da53f9bf411ed8d8777df8a7ec9ca3e24b208,9a26edf464f84864526bc6e810d54732d9acfbb3c887f4cb0e335ab5ae398e84
r0_smg_sticky,rolling-80,10,1,13718,256,11552,30.962339729070663,3003.430721,7108.591914,1673de514b41492cfa9cb53eb0bd46bf6f8407a0722c3caaccc7fce74ff938b4,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-80,11,1,16384,256,13968,41.958936599083245,4832.960261,8994.247812,3ed760df51654fcc4b359fd1711e65708bd1aa365ebf2966ae4131c29d7e7eed,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-64,4,1,3055,256,0,11.648124298080802,798.345738,8860.242542,9affd24dff7f06a30e7371c0abcdf84571343633e21c2e88c7554679c3274d0e,10e9b608db1b5477bab6677e435363c136aa41a0ce0c7a887861d2bdcb865ece
r0_smg_sticky,rolling-64,5,1,4198,256,3296,21.84640198852867,4065.132564,8196.781537,e7d6928a065028edaf4ebf5e1e852718ba95e357c1663538cdf2862d1c4ad148,222dabce9d0f1ff7ddc8b784609418c19f70104da5590d644d6192f47b3a0ea1
r0_smg_sticky,rolling-64,6,1,5594,256,4448,30.961876589804888,2705.237221,7113.084646,86a04b5825964a8f7a3329c98ac213535cbc136b626739cbc5ff8bc3e7fa4577,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-64,7,1,7244,256,5840,39.46015017386526,2700.150055,6496.969909,dc2322d4d2ff00b4cfcd2968fff7164ff96955e2157b42993444849a720e3b4b,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-64,8,1,9148,256,7488,48.329096995294094,2750.026486,6863.94834,d102a558c9dedad0218ce925da5136b6bd50f8359e8048b038e0b19c8fc2a242,fef78332ebf32274ae28d7b8b2ac3f0fbf472029e7b2089f08586173ab8ef567
r0_smg_sticky,rolling-64,9,1,11306,256,9392,57.24835669901222,2776.759065,6916.372148,b8572caa49d0a452787f7e06a85ded079df90d50cbe15a23571f403f6f35e541,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-64,10,1,13718,256,11552,66.54600537009537,3124.361988,7290.960707,63eadd1016c6e3fb8e5d15a0ab81110f1db4e1ee1afdaaccc1fbe616f8a89105,b87ab63bc4ac73495f47a6c05e14702a16d74d84bc3f7979a2cb5f10e5682198
r0_smg_sticky,rolling-64,11,1,16384,256,13968,75.80439664889127,2836.584422,7256.230319,c57af59d48df2965dff45e44b7f1ca7c7de20ffd1a31823d812a11fd6699a661,76632b28640fd09f92f1c2487097bd0723cd9eb9aefdfdee73c33ae46d4f428f
r0_smg_sticky,rolling-69,9,1,11306,256,512,11.648263403214514,734.570405,8667.005746,ed2657bf2b18c3a01b653b4aa3fe88008b95baecc3b11a2e252344ea3fef1670,4e1b4200109aebd0525e3036e728f31ec953ae3e58e3463fab5b6f8bdea924a4
r0_smg_sticky,rolling-69,10,1,13718,256,11552,21.847547244280577,4063.952237,8196.793729,86066b86696107fe4b245e8be02d738c101cee4306afb9882d8a3bdafe5315fc,538ef3cdf8ee7c8dcd51969d1b0fb92335e2712a343f6d4ee0ad25912685500d
r0_smg_sticky,rolling-69,11,1,16384,256,13968,30.950535369105637,2883.301348,7097.813737,e51202ffe68a922e995ff6806882e244697f7dba2a30e5267d39ea8a6434abe9,f4312eff60cae6cce0d285dfbd6093d414884cd4f5363684d02a52306b8566dd
r0_smg_sticky,rolling-62,2,1,1532,256,512,11.648634444922209,907.630342,8970.000844,e57fc3fae5a8e3400e262e60429067c9a3bbc6daafbb3b861aaba6076b304ff1,d99ee5bcfbdd846607ac81a6181f0c059bf8a5685ee216d7fc72de730caaabc9
r0_smg_sticky,rolling-62,3,1,2166,256,1776,21.846193252131343,4063.747211,8195.069526,9f18c7a61e28080fbe34193191fe96af97645440d448cb7200c695d963c397c5,bdb5ec7695d5d6629879ed4707c3b3690580f2aedf6566748982bebe7b215812
r0_smg_sticky,rolling-62,4,1,3055,256,2416,30.950235814787447,2705.660072,7101.834945,31afb3d20effd794f5f0fd24b9bf535f1751be0358301d729c2f1a374f24acdd,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-62,5,1,4198,256,3296,39.459871963597834,2703.721501,6502.452534,3e6077eb40abc59b281c7284f4f1da2c0dd82b707cb08765058278ad2d2da18d,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-62,6,1,5594,256,4448,48.32943866122514,2750.523225,6864.882137,9bbeea0dc51ebe45eaa64c1bfc1115da779b9c58227d30bbc001cce962c59d48,f51416bef49042cb1a25bb99a097bd2167d9123c47aa03aafa08839bb0a8a259
r0_smg_sticky,rolling-62,7,1,7244,256,5840,60.05980205629021,4960.495374,9727.157692,9910c21053fd2a04a08e981fdae7d0d93564d7cda6ae71b15663b26ad372dee0,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-62,8,1,9148,256,7488,69.41519866324961,2707.171537,7352.374586,c40544a4a669f827b95500c80637b3c3178e87970f2f12f46a82f05eb2254b92,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-62,9,1,11306,256,9392,78.74083614628762,2624.851098,7316.875714,3bf16b361015e6bcb1d7a5cca236b0a59ffc1034f91ad6dcfa2628a9c56a1c6c,edc599af7b6afd8f07613263a7467f6c5a189070d966138e9a5156b1a0d3a7ea
r0_smg_sticky,rolling-62,10,1,13718,256,11552,88.04070105403662,2748.745391,7296.657543,3e4fdc1cf49146c96a65c5e750e483d6bf76ddf2047b12769575909fcdf4b968,c898a9c1cf7690d20418f271bdbcd87c15444d374d0d34af1f08dc3686ce22a1
r0_smg_sticky,rolling-62,11,1,16384,256,13968,97.16351537872106,2840.080157,7112.494179,d30297ec95a8ef041292da9d3136c7bbe26d809c3b773681128ff08ec6ecd86a,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-89,5,1,4198,256,0,11.64873524568975,598.344101,7809.828768,7718067a0a5fbd33ea789e5a4586f5eab4e9348336a9e68662968b6983c4f5b4,bdb5ec7695d5d6629879ed4707c3b3690580f2aedf6566748982bebe7b215812
r0_smg_sticky,rolling-89,6,1,5594,256,4448,21.84914328623563,4063.144359,8197.547141,82940ef87058d00fcca93f773995f68f867ae5155f369670037e4a861445f056,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-89,7,1,7244,256,5840,30.94984419643879,2880.959382,7095.026104,3dda8492b7beea1a1ab44daeb4ca52ad156bfa6b423000c7a67f8ddf501c3e9c,4812862224f6607b8697988c1bb8691767f992929109159084e13560b3c50f1a
r0_smg_sticky,rolling-89,8,1,9148,256,7488,39.461033795028925,2704.253343,6503.990399,9632861f2976623e8e854704663ac7019658ae6bb6d1ca603766b6998e16385b,e9a2476641c3ba6d10a8dddfff67145fdaddc5bcac7d57ae7698b5c56ee45778
r0_smg_sticky,rolling-89,9,1,11306,256,9392,48.3301124246791,2859.46133,6862.175592,b261bc2a6fe72c5d60d12deb0a17a6d53de0bb955fbc338b68dbdf1f5a2d6b35,08d43d6994a5ce79fcdfc49d4908e902c31307ae0f3d566f344f952fe04f8651
r0_smg_sticky,rolling-89,10,1,13718,256,11552,60.059340292587876,4954.64769,9720.809942,bdd7df0c3572b0e19f1aab72f988ff3a7eb98f331e181080f511e8bf9a18664e,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-89,11,1,16384,256,13968,69.41464899573475,2707.978197,7352.560251,acd51586a2d090f6c92f63af3ee7e5c1c6628c878a6758db09c70e23b419cb65,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-73,1,1,1151,256,0,11.648902607150376,821.435511,8497.745448,4c82247e25d7eba3cf4c6d300ffad704a4404502d44fb5c969196cdbd905486a,5b1cccd5a72019d5640e0dad7649e94d7a4ae9378413b8a61934bcdd54162c3a
r0_smg_sticky,rolling-73,2,1,1532,256,1392,21.84537327848375,4062.728165,8193.49486,1f639496d0ea742e49b391e95c59587341162b91e2e801c4ebab17d07e241452,3ebb5d73c3d533d4727795cbb92c77bc620e0c15c6b16b87fffb949bcd8a4f4c
r0_smg_sticky,rolling-73,3,1,2166,256,1776,30.949611427262425,2707.684084,7103.284298,2bc39bbb70bd8e22ebf26399c7b99b7c94dc8c27307a2f1306637d50aa694603,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,4,1,3055,256,2416,39.461491013877094,2704.784675,6505.034278,c6521608191d1749af2b2edd6c9b2ba7fdaf6f9e1cac5f47f72e32f8ade5a182,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,5,1,4198,256,3296,48.32872665673494,2858.877102,6860.367165,38618b662eafd4125ad37a1a62b4bd28e511df364b584f5b6afe79f496dfdb04,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,6,1,5594,256,4448,57.249101663939655,2777.976033,6918.235391,ede779b0a164c7f91d61f469901fcd6fe573f3005b7ddcce023cafb11781360a,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,7,1,7244,256,5840,66.54344743397087,3171.725221,7287.339885,e5400625ed000c9dbd1ecc07612761c7f7392d29ae7a684a5862d512baf716f2,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,8,1,9148,256,7488,75.80842643417418,2722.046475,7261.558575,9666e2d1c9dc71325d6239c800b8f04ac1fc6b0af44180264866e78d6ce73948,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,9,1,11306,256,9392,85.19968821946532,3129.306754,7386.196937,9af8ddaa0b2328ac4755399323cb6d815421fe850d1fde4eb957403fb2ea6d63,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,10,1,13718,256,11552,94.22934626415372,2994.6019,7027.205786,2dd3dc24aa7abfb086e6fa658d921b9b5050865f9ceb674bec874d1cf3581793,3c3632d290b3e892d8a4591586f923e78e302353ffccb059a40acb1ab02b183a
r0_smg_sticky,rolling-73,11,1,16384,256,13968,103.58722090348601,2595.290822,7353.17824,c5658e824f6a0b68ef8db25cf4c441fd619b1c9941ee75867f0d72390011610d,e9a2476641c3ba6d10a8dddfff67145fdaddc5bcac7d57ae7698b5c56ee45778
r0_smg_sticky,rolling-87,3,1,2166,256,512,11.64898494258523,538.874553,7895.819053,b09cc777db4abb41147a38446c3fa5c3cae120140095537e99cacf43ccd8c074,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,4,1,3055,256,2416,21.84938335046172,4062.713796,8197.244867,b52b19eb32ddff93ed8640aa6a6757730cd00f6057db80cbb7e77d2e124800ea,74085528de2c58bc82304a73639e7e588f8145172a702c0aad96a32d97ee3c88
r0_smg_sticky,rolling-87,5,1,4198,256,3296,30.949092095717788,3001.896055,7093.86968,5ddd465010c946af009dfdad9bc5153827515f1b565fef2e89e18ba89894442b,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,6,1,5594,256,4448,39.462716973386705,2694.900039,6506.873777,926668c2f78b7ec2b109facc3bce95477360bd9a3d1a09050bc7771ef574b35f,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,7,1,7244,256,5840,50.87258993182331,5056.969243,9401.621752,29af1c0167401307c8a26209e62f16b860c0e4bbf8958479f5c937539e9a0a11,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,8,1,9148,256,7488,60.302692690864205,2650.612184,7428.471435,f620726312d6f859c74ca69736e2e91fcaf52c1db598b386a3bd19a78ce68c7b,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,9,1,11306,256,9392,69.42567562311888,2608.017396,7115.841014,ed324112f173f07238cdfda3d85307cd9b663b7d78eab35f249992b39d3a1a0c,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,10,1,13718,256,11552,78.74231737107038,2627.412969,7315.02495,c0fd61193e0caf8b0eb09db6663d2e4ac675ecaa13df638405bc7c07d34aa41e,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-87,11,1,16384,256,13968,88.0383279202506,2745.781981,7291.44535,944fbc1ce5f3db159d7262e9867d546a53cee682de8c9c11626eaf7f4b7a2f3b,3fd7c5a76b6ecf4d098a55dc12aca716e9f88d24c3a971dcb0f35d8c2fb1c5d5
r0_smg_sticky,rolling-76,4,1,3055,256,512,11.649087440222502,726.643732,8367.964976,fc358a61f87fb2c94c3833507c42146a52b3e4fc7bcc5aedaf10bbc1a0ab1d4e,efd5bfda68b8403ad1073962b67863e1b3d1ace763d944e04992e49e2fa1084a
r0_smg_sticky,rolling-76,5,1,4198,256,3296,21.846967368386686,4167.707174,8194.290833,f5be6e5e9383039f0a57b1a02f2e8f2223cf441988ab97a3653a4cd459299eba,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-76,6,1,5594,256,4448,30.963209302164614,2886.728121,7114.065868,176c73075fbbd5f61a85683150196c00f249651c10d3cfcfff746e43004836f5,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-76,7,1,7244,256,5840,41.95870955660939,4830.995992,8992.101463,7203443f8770945f9cb7cabb43b0baef8f88b6ceab120bb7f87e3a850276a784,744be9a2a88e6674e97910c48c6ac741c7ff95e6421ea01f020f5b77227b76ef
r0_smg_sticky,rolling-76,8,1,9148,256,7488,51.14094219356775,2749.307377,7179.411577,c682705ec2e5b863117803be48cc1acad3794e7e8f0c020355ce557306506221,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-76,9,1,11306,256,9392,60.300786728039384,2380.248581,7151.851537,2073b943c73173a6c5d4bd49f2976c05c6c30284d7ddab2f55d570eca35b71a4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-76,10,1,13718,256,11552,69.41319292318076,2507.085675,7109.377167,5623437c4b56dd48ba66cc591a22ecc4b9340b4ac0c036dae6156f8c03f3bc04,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-76,11,1,16384,256,13968,78.73900528624654,2632.165991,7322.510852,692b96c5b2bc1cbc23e6590174fbc981b74c5c6c7d3be4f9aeda663498ebd7ad,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-82,10,1,13718,256,512,11.64920801576227,752.966197,8110.094153,0b6f51101bc9c07bdf52e3868075297942eee1fa7776d5df1725cb7cf301686a,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-82,11,1,16384,256,13968,21.84833947289735,4166.242141,8194.055024,a447cb6bd7018d2d7d0e059f661c6eb9b8359a2cdddf96ed31b893e7a7525f00,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-61,1,1,1151,256,512,11.64967601839453,812.997636,9014.111449,995392d944a9ab7af67522e0c7d1ad584ca5a39183933d245f4a45b6a34af0fa,bda7244be67c74c1f2c2cef50cb413fc3f500956f54279e095676959c94d2896
r0_smg_sticky,rolling-61,2,1,1532,256,1392,21.84958213660866,4165.732506,8194.968405,57354d0ac5f66d4ae05359e4ed3b7ecdc50efeb581760622d7a04843da8b3c61,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,3,1,2166,256,1776,30.949373729526997,3001.815319,7093.934993,72c8f2e51aa5e07c668ded30b0c71abab78db6831d5225dd2b74a92ba30d33b8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,4,1,3055,256,2416,39.46300539094955,2705.116005,6506.861137,012a217941d1c9cd60d6c0f4ad978740f3e5a1728c2324ed877cf0d43f5e0d0e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,5,1,4198,256,3296,48.33085604570806,2860.494872,6859.56972,32a5d7617ff781213dfba7750d2937382ac0d04cc091969d2e4bd8fc05f855ad,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,6,1,5594,256,4448,60.05905725155026,4953.043585,9719.002731,3d1338b0cf1a4a6a67b422285e70c8c7012da9a35cc89043c2401849266796ab,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,7,1,7244,256,5840,69.41205310821533,2709.34787,7351.360372,17bf6d242d7a497207956927d07582fd9b94f7a029845a8c75d8078ccde19f1d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,8,1,9148,256,7488,78.74333385657519,2523.766897,7328.857899,b827d178d64a5227652e69633609cddf3699338e935e53b004053c976f056bda,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,9,1,11306,256,9392,88.03883768245578,2779.202217,7290.140863,4d785c5de2964f7054638e97af66948eace55632bb64d57ededb3fa36c6184d2,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-61,10,1,13718,256,11552,96.69446323439479,2573.106494,6653.388623,9474987cc147b9eb63b6b0f6f3188a7e2b8fda3c0527eef3eb5be0336557d24d,2784da5540fef47fcad3ea3a86fc045cf99d3b9928c85865e20ad3103eef4477
r0_smg_sticky,rolling-61,11,1,16384,256,13968,105.92122549097985,2600.806119,7222.631587,20e4648693aff42e4e9a9552816d12ea35d258801c5850b3718eac60d857e2b9,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-85,1,1,1151,256,512,11.649754547514021,624.759014,7982.424702,ce34abdea8fd98544b88caa6fe09f014609dbc0cea59b1e8cc57271774edb673,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-85,2,1,1532,256,1392,21.847399435006082,4165.624953,8192.569479,4d40498017e57a0c597634067d82872d94ea9206fb518a2c432c9a7a666b47c6,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-85,3,1,2166,256,1776,30.963070132769644,2702.550901,7111.602077,0050bb215736a89ad0dd099cc18c039d3de578a6385d6d94c5e59625db852772,0425de25eff733ecfc0227e1280912fa7f11780b5c62d6acec0133deb0bdbe4e
r0_smg_sticky,rolling-85,4,1,3055,256,2416,41.95854616351426,4831.479291,8992.448153,37aa03202c7d2212616671a5942c328dd512233db8ae39640b63077ebcde319f,ce423b98f2b23ffa29302d5417ac53ab3e52c15664db0cbaa0e29e19417cc451
r0_smg_sticky,rolling-85,5,1,4198,256,3296,51.13964961003512,2749.850389,7178.702357,eeb22bb8cdaab3cb62c585e4e30c3f2d7e1ccfaf1280f5a4ccadc01f63771f92,daf4c6f30f26e04112d8c619795abcf5f7ab2068312c80721267c7bff3540c35
r0_smg_sticky,rolling-85,6,1,5594,256,4448,60.30211460776627,2379.155518,7156.232556,c8f8b40c1361bcc2672fac2a670f596963d19e01e4be225a997ac53a655da71b,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-85,7,1,7244,256,5840,69.41169451363385,2502.270702,7103.215433,956de652c629d7332e6d21a90823e885eca5bb8246055d40932bd074313fcc08,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-85,8,1,9148,256,7488,78.74195714388043,2524.482774,7328.320424,59c7c1ac05d472f972ac1948e73f0651b3714f2855080999b504fd16d04c6ee9,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-85,9,1,11306,256,9392,88.03797041345388,2746.965668,7292.227019,35dab08176682e46f4c5a4b3e143a7eca64eb6c46f98887620b4351219a5dc3a,a474b356e59d89bc351de7bdb3ca374693d91a683b4070db0ec5dcaa98785d55
r0_smg_sticky,rolling-85,10,1,13718,256,11552,96.69404080044478,2573.921923,6653.909522,344f670eca5f7962b0084272773af0f1bda6cad955cddcaf3fd3de76ef6e57d6,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-85,11,1,16384,256,13968,105.92067572753876,2601.786958,7223.154694,28e36304487f59f0873a96152639abdd0109e9063671f45c97bdcca02e72cc96,d513ea71e87a2087b965f0bed1c299e3f64c8a248590b27a6842489eec1c8210
r0_smg_sticky,rolling-91,7,1,7244,256,96,11.649814483709633,546.920138,7724.34911,135f04814ea30c590de0ed52d22b539c026816b078e8bb276081f90151828aaa,87e8fabf42347a447c3a2f5064e405abc9943a8fb02b8f71a4932fb2e2f1299a
r0_smg_sticky,rolling-91,8,1,9148,256,7488,21.845852001570165,4320.107176,8189.189138,97e8fffc47b310ade530004c4e62821ef250f3e2582add0f11901f5e4dd8ee1e,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-91,9,1,11306,256,9392,30.94863750040531,2706.105546,7100.67097,f640b1c60a6430fbe0cdc270835a5c25d9aa478f7cf9f8f62db678f258f6e947,76632b28640fd09f92f1c2487097bd0723cd9eb9aefdfdee73c33ae46d4f428f
r0_smg_sticky,rolling-91,10,1,13718,256,11552,39.46219383366406,2708.073399,6506.890737,bf0550a59fbbd321c8dc7c02fd961b3147d06f7ff0091a2548054b8eadc60656,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-91,11,1,16384,256,13968,50.871944167651236,5057.663871,9401.564025,94477d32796c81fbb1761fa60f65212b583159f4dae9cc55585b7d787b781338,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-67,7,1,7244,256,0,11.650059637613595,725.169196,8754.262535,e76f12043e3a29345449dc65d6e3a1ed60324a594ab1c055adff59488892e62f,d9844d90c1c7603edafe32fee6aa4bb3886f34d7bf4fe3ce83d904daafc9f51d
r0_smg_sticky,rolling-67,8,1,9148,256,7488,21.851110273972154,4319.274371,8193.576813,cb736d16b4abe2dc2a0956a5b34689cbbf3e461447dcdfca6dee33d265c2848a,166a4a3afe13c476edbdc3ac601a8ee306d5093d6ab3aab77e54d546ac79ea8a
r0_smg_sticky,rolling-67,9,1,11306,256,9392,30.94595236517489,3037.039151,7086.964519,2e456fdcaa372274614890b3156c0186308ebd682c3497e4d635f6a679e67e0b,fe32b7217d1562c4b332afb476f25b8880155cbdb40f2115b69ca3b55f2d9b17
r0_smg_sticky,rolling-67,10,1,13718,256,11552,39.46052172780037,2700.139143,6509.829955,bc32e51313f1be9af5aff54508bc9d476f87026f0e61fe21d2bb1c5fe2574135,fe32b7217d1562c4b332afb476f25b8880155cbdb40f2115b69ca3b55f2d9b17
r0_smg_sticky,rolling-67,11,1,16384,256,13968,48.33102369494736,2861.119804,6864.819992,71a5c0078442eb096f4b183bfc69c27ba1084a8ad7b0edd88e9f71350a63da1a,fe32b7217d1562c4b332afb476f25b8880155cbdb40f2115b69ca3b55f2d9b17
r0_smg_sticky,rolling-78,6,1,5594,256,512,11.650295894593,640.599175,8283.077834,ec82931a21f71fd2d496cac3e21229e29408e3095d39ceaa0aea14f044f91e5f,f0ecfd071fecf44e9d5ba5e2e57c61d6aff188b4c9190692bba1fd5fbaf11959
r0_smg_sticky,rolling-78,7,1,7244,256,5840,21.845597087405622,4162.042435,8187.412103,619fa8b30424d734fbaca00ad9223563e2bf6e81ae390a9e1aeffecded42e584,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-78,8,1,9148,256,7488,30.943071194924414,2706.897903,7096.044958,7f8d8a8f901f7e27b4fe59accb044375528e11e8af445c23f6c895486d5344e0,0bed280b8f829bca194ff6282e0d27e3811805cdb0f2d0be56c6e4fad1db51fa
r0_smg_sticky,rolling-78,9,1,11306,256,9392,39.45665917638689,2598.796572,6511.715566,a3cd2155d64e925824c90cc3436e62b00865c68d2bd4247c09c49bb206805fb8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-78,10,1,13718,256,11552,48.32546625286341,2754.259728,6864.597239,a9946429306b2d8d4e4f787f941b6ff6794383e80bdac6150ceca5d22ed104f6,403ccd4c7eeaecc77d1550c960ae4e611f2a1c77b127be08b638a476bb1dc37c
r0_smg_sticky,rolling-78,11,1,16384,256,13968,57.247747735120356,2735.248316,6919.0737,c0f2fb2cd02c7d7df2fccf596d37b8a4f28eb18c7253d64d1f91292443018f5f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-102,6,1,5594,256,512,11.650533464737236,471.695712,7252.857048,50aa90c4553d2628a424fea243fd4c3c8329249d1a001f9e0b8b46500b652f35,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-102,7,1,7244,256,5840,21.849736793898046,4161.695938,8190.947293,cec65048595880e33bb9417cf5fc7ab3fb241fd84ecd87d2c307eb07c17ab9d7,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-102,8,1,9148,256,7488,30.946435536257923,3000.998898,7090.421724,2ceadba83f8a834f3f711db7c66655daaafde5b59ffcf42ae91735b6108c34e8,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-102,9,1,11306,256,9392,39.45787560008466,2699.266849,6506.258509,c95de92888c9506617d7586c4efcb8bd78a0b749237225aea1656321de5ddf3b,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-102,10,1,13718,256,11552,48.32965818140656,2752.387076,6866.850053,0adec3bb9662aecec9fc2bd014fdacb3dcb50b43a632092b0a492ef8f3d675c9,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-102,11,1,16384,256,13968,60.04900311026722,4955.414223,9711.445597,e71adcea68d8ca53ee846f9a920b2811206a63d88c10b94d79a25ab79e0186d0,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-119,11,1,16384,256,512,11.65074191428721,565.901183,6520.63261,e8718d9105039532d9912c32dfb91512ddabced67d28ac135254b6b7badb3d17,35fe9cfb481e6bf0a2cbef43fe4baa026fea38c875c056e3107c1f053ec8447b
r0_smg_sticky,rolling-93,9,1,11306,256,512,11.651425950229168,558.928276,7639.42056,85af8df7ebf6ef2890b278c0819241006a36d7bf91847b32dbc346aac083110a,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-93,10,1,13718,256,11552,21.85052818991244,4317.047157,8190.749403,80c4459c0de2136354d754d7b687f4b1fbc2c7f63d762b686271c9c1fe142539,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-93,11,1,16384,256,13968,30.945110567845404,2999.470633,7087.405641,6885382c0ca303d168607a06f837ec3907cc63d416254208479825e5f4c8ffec,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-112,4,1,3055,256,0,11.651824896223843,512.761402,6809.524549,f4442bf97163e96f371164807f9223c47620968010c336a1f19b8ae85e7c2c75,82c6b1507e3b2f3a1dbfd33d9bc03219021c879608f147b521a8723806f1cf94
r0_smg_sticky,rolling-112,5,1,4198,256,3296,21.847191945649683,4160.114904,8186.968357,267d829213c2dee6bfd6b28602b010c0c942c50730639d54b6123e9b43eb7dd3,82c6b1507e3b2f3a1dbfd33d9bc03219021c879608f147b521a8723806f1cf94
r0_smg_sticky,rolling-112,6,1,5594,256,4448,30.962796083651483,2884.698029,7111.604861,87c79ddbcb64c7b672226bc49ee7645c2386943565c5ed081836e525accf7829,82c6b1507e3b2f3a1dbfd33d9bc03219021c879608f147b521a8723806f1cf94
r0_smg_sticky,rolling-112,7,1,7244,256,5840,41.95712612289935,4831.744861,8991.343698,6aaa563538b431233cea108ed1dced0fb03db246ef912418947a5dbf93a66a96,82c6b1507e3b2f3a1dbfd33d9bc03219021c879608f147b521a8723806f1cf94
r0_smg_sticky,rolling-112,8,1,9148,256,7488,51.140044236555696,2751.636064,7181.046787,c5297e1bb11c53eb0545bfa417e126c82ed0a6293d16b2c20c493f3cd87cfb5a,ab58044fc3347d6d3d09f9c942ef1cb91f031224bba2a53171ca209c6979faad
r0_smg_sticky,rolling-112,9,1,11306,256,9392,60.311514344997704,2455.740273,7164.340478,0e6d00a74684ac9b351db718747caca2cf87cde954ff932bab059d7129d808d3,82c6b1507e3b2f3a1dbfd33d9bc03219021c879608f147b521a8723806f1cf94
r0_smg_sticky,rolling-112,10,1,13718,256,11552,69.74131361488253,2781.536215,7427.392036,5cac42c5af2cbcd69e764c638dfac75ddf414aa47d5dd49a208cf3e44378f943,e17b74ab7ad9361fd1403fcffc1a09011b2a3ffdf15f1c1e8af01b6d1f11e65d
r0_smg_sticky,rolling-112,11,1,16384,256,13968,79.08543988224119,2614.862845,7342.26966,91decdeeda34fe928bab1892fbb5f1d02dd763a6022f25bd0b42e5b78a7f4926,82c6b1507e3b2f3a1dbfd33d9bc03219021c879608f147b521a8723806f1cf94
r0_smg_sticky,rolling-100,4,1,3055,256,512,11.651960224844515,557.880974,7340.471311,286aa572427f13e109d98cc8dc9b22f909964144b58d1302872d29a1f95975e2,def40a156e3f7d1f19c3131331c9af76b53054ad451b5e615dfcc13c32f6d9f5
r0_smg_sticky,rolling-100,5,1,4198,256,3296,21.848934100940824,4159.956855,8188.384877,15988835eaf6a09ca45062b59e59eeb837c2118bc1bea7fc273cbd89a80edce1,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-100,6,1,5594,256,4448,30.96351931989193,2881.708602,7109.255118,3e79ffd098e61088234b640c99827af39767286b8677105d05b4a39703971c6e,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-100,7,1,7244,256,5840,41.95830139517784,4830.210452,8991.156049,04253cd550e3cbebf838c97c5aa0fb14dcb7dce902956334edcbd79505d0fe73,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-100,8,1,9148,256,7488,51.141286867670715,2750.227319,7180.640641,f61d915e67365ee38a82cb2f8190550f0526ec94aad49002d18aef2fbf64168e,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-100,9,1,11306,256,9392,60.31091344449669,2452.764511,7160.943017,521305ca8a2bd79b734773b73e054a993dced6b2abb9d610a8239ca341a61578,a8b2ae6518357f7f0ffd815e34ef34fee26b5efc66bbe393892a9662e786743d
r0_smg_sticky,rolling-100,10,1,13718,256,11552,69.4261031774804,2605.641957,7113.759978,ee5e6ea85ab83566d6c6f2e72c4ef3e24cc8abc000919246f7f926141067dd37,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-100,11,1,16384,256,13968,78.7470038626343,2729.613913,7318.30449,ea11dcfdf11da32bd2449643e30f1110232691028aff11da00da51a4e5c67209,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-95,11,1,16384,256,512,11.652090753428638,744.164543,7553.471843,d57486f8ea7280ef09e8f73aff1e8184d24d658d56723db45bac1f1076774c9c,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-116,8,1,9148,256,512,11.664503597654402,480.242292,6664.76645,1124aa87784b2c14ff8df5cbe0ca3c0875039164355e10310cff2508659aa9c1,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-116,9,1,11306,256,9392,21.852370377629995,4319.380675,8186.370016,c76e17b332d2d8b4421738bdce65977ac018645725aede8d069b7625eb102a80,1d531ce332c85553ce9d966e1bd4ff10e6453122ce6ad9fac0fb8487bb450df5
r0_smg_sticky,rolling-116,10,1,13718,256,11552,30.947908504866064,3032.982806,7084.841146,f9b41f45ebd614cbbf766dce00e944a662344b6bc44f4ba8cd7edce09d646d26,79773f79d887f8f66f55457bdd279281706f4133087b038da91e437b27449d4d
r0_smg_sticky,rolling-116,11,1,16384,256,13968,39.46320430468768,2697.204085,6509.503425,724d46e2e02bd43d4e6cf1e50369b1b4e6a99ea3b9a6346a991d4330e6782091,79773f79d887f8f66f55457bdd279281706f4133087b038da91e437b27449d4d
r0_smg_sticky,rolling-121,1,1,1151,256,0,11.664823760278523,481.701501,6450.54703,d60a85d33f6d057c3130fdd8f6a82fd32cf18ecab7751e477ce63755e060e2a5,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,2,1,1532,256,1392,21.851956870406866,4310.408077,8185.545244,7694fa1527b431b7dc5b4338e615eb45cc762ed6fff88ab22337d507681acf62,eee967638462d5864c8b185243580c107a12c4c65ad4acdf531ed146032a8776
r0_smg_sticky,rolling-121,3,1,2166,256,1776,30.944207745604217,2995.58453,7082.930798,338abe7e20e37000f8a18928e88d4798e728eca0386a6dab1ae05cea8421857e,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,4,1,3055,256,2416,39.47361726406962,2597.953495,6528.019539,bdf4afe8b1eaca775c4580c2472cce78ab6d8c4cdcf91c2be66434ef38352fac,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,5,1,4198,256,3296,50.87031356617808,5051.949084,9394.385997,ed6c059bc5095386ee48cb0413a0c9c9c08cf4edf12a8c1ecf1be53032e6c47c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,6,1,5594,256,4448,60.04880438838154,2430.005492,7177.132748,2637218c3e4312c856d2ea234e362d61b9f161e2592de10433c601008e8808b7,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,7,1,7244,256,5840,69.14596982020885,2506.345191,7095.969181,c9ed912a3a47b3465a843c7edbe0dcb7635a5b1878a11853e07e71f5cfe2fe52,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,8,1,9148,256,7488,78.7429712312296,2790.355469,7595.211461,860570f25edf1af856e44ecb6a42bc90d25c5dfa8af75224995f2244e461805c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,9,1,11306,256,9392,88.03916843701154,2779.847021,7291.053604,eb2bfc3ac75f7be3af16a5d95bcbde87c27e9a81f5fc0f964bd44ca86d3167bc,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-121,10,1,13718,256,11552,96.69496845360845,2579.781191,6652.950124,a9c5f98ebdb26b9dcadd2a4da0822149552845acd6cece866000bc5aeb1d888b,343b3b227b969e684a7425a1869acce3ad04d5870caa6e1a68faf588315f4c4b
r0_smg_sticky,rolling-121,11,1,16384,256,13968,105.92223026510328,2754.43925,7222.42381,21bce191f97eff58c62a2a7413ac7ba24027795303542f6089008114e4456999,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,3,1,2166,256,0,11.66490519978106,600.737332,7396.326564,443c5bbe0beb583ab5d50c83ff6068eae76713fb8679832e434e08cc3597efb4,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,4,1,3055,256,2416,21.85094163287431,4310.127979,8184.179092,c1a067d3562a666d5766f4eae0eb7405c0744bae7c13210a3249983e0060a24d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,5,1,4198,256,3296,30.94683336187154,2998.899814,7088.711345,40edaeca898e7427183ce6beb21c4e61b06369716f610f5cbf516e01df326c94,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,6,1,5594,256,4448,39.45604749303311,2591.620976,6504.043232,7e31f5250c8b34fa658ec037fd9aaf605235c0bc96baf09df9a71287fd76f26d,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,7,1,7244,256,5840,48.32428198866546,2645.262871,6864.830233,b10543ecf4a17f2d2a613d20f0c1d695bf5157a824451bdc8728dcc9c21ed493,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,8,1,9148,256,7488,57.25017334986478,2738.079278,6924.282692,ac0b56f5dfe9627722ab56e49780086393d7037def7fe2c6c2944ff94ef2867a,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,9,1,11306,256,9392,66.54273847024888,3168.160623,7283.16946,68a60156976e370e16010014671b7b6218b6cfb2f0a5cde1043bbd87611696c1,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,10,1,13718,256,11552,75.8088205801323,2723.544948,7263.438011,b35a981e5329adcaf66c5bd1f42121faa567816f94cbee735caf7dc8b832ca07,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-99,11,1,16384,256,13968,85.20152234379202,3138.75174,7386.835949,0e2559a7574ac736a27f5a956ba515698e115fb78f3b0893517216dae1ad7d58,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-105,9,1,11306,256,0,11.665012625046074,521.627377,7136.174192,da7a368490f7c76355fbd609af1cc7111e017d5698a332e658b7d65b184bbe53,835b76416c487e6b62f1576f83815f0aef391b56ec3c58b9de9df0988b1f2423
r0_smg_sticky,rolling-105,10,1,13718,256,11552,21.851543844677508,4316.752243,8183.043276,e5c365bd7fbb64aa60065c669e1d1163c564e9b06508ad9bf48fc4b7138ef277,f0ecfd071fecf44e9d5ba5e2e57c61d6aff188b4c9190692bba1fd5fbaf11959
r0_smg_sticky,rolling-105,11,1,16384,256,13968,30.94353634957224,3035.323204,7083.014318,ff045a10f7d8374144ce81650cf130a09aa5f4b8f3441ef572359015347e3c4b,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-108,0,1,1024,256,512,11.66540011484176,699.69512,7010.079406,c1e36fbf4a58f3ca213cda6cbfb65eaca302c895aa676bdda368e7f910c6e891,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,1,1,1280,256,1264,21.85040425416082,4307.952798,8181.607843,03ed3c73a98b121f2d9a78740f424710ed8a352a67943ff2f390f5fad24d0531,410339d0813ae862eb42c9d17bc7c7b17366dcca3036590c2481eb86f932c1cc
r0_smg_sticky,rolling-108,2,1,1536,256,1520,30.96214279998094,2879.512269,7105.811353,6e45efb4c96847c252dc2bf057dad8bf1d9aafbd37b7676884b520e4bdb3fb28,e8baa5dd76405be94d7c7e40464e69ba5aab6118dc3e16d4837968fd2c114361
r0_smg_sticky,rolling-108,3,1,2166,256,1792,41.958021136932075,4833.907562,8994.508134,165e9523992cee0d514a026fc9866a7dbe454cf38db147eab74076cb2d4da616,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,4,1,3055,256,2416,51.13984337169677,2750.903932,7179.985661,39605163f9aed8aab0eaa2cb403f88d864ef17e36c8a662b8904ed24493aeb3f,67f44f14babc52f009a9dd76fd31059dd151739410287a9ed52447e586fd47f0
r0_smg_sticky,rolling-108,5,1,4198,256,3296,60.30243057757616,2378.235128,7156.015915,cbc6ef4490b75fbaf77eb53506b149985f2af03a187273829fe1fcf4d192b00d,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,6,1,5594,256,4448,69.41437014564872,2501.874795,7105.377206,1bc1059c22aa8f5c69ee7c7078be6e78e7026259c2f06e59b5c58fa4b218b656,75ef8a6e06cf1793b298cb70056fd28baf3ced0e955b4812b9d6b6edb400e978
r0_smg_sticky,rolling-108,7,1,7244,256,5840,78.74050103966147,2625.945953,7317.578278,617b47327042fa11cfa94911c642c90d07d87413be3864923259d299a8b2f577,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,8,1,9148,256,7488,88.03992444183677,2636.948708,7296.985544,8db4aa11b5cd1880fda9619f38f1a9d9971f0ad683a39462dc15a57028d3e04b,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,9,1,11306,256,9392,97.16313214506954,2846.934598,7119.073802,a9d55d64860dbe147ed2ece2b9eb068d199f733152212eda1f3c0cd25df356ae,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,10,1,13718,256,11552,105.93468816485256,2390.371843,6770.065432,48a46334d7a333e2e39503fe123ddd13a557fde8b3753de36abf2f1f9e7422d2,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-108,11,1,16384,256,13968,115.61517738364637,3302.563492,7674.551275,6650521a11ba4fa81d009e034e2016de132b11205242ddd344a7db4bdc455c39,be9c7a49d55edf3ad1d8d8bdb201735625a262025047cc65572a9fa27cc2d066
r0_smg_sticky,rolling-97,1,1,1151,256,0,11.665458868257701,660.380576,7483.039862,92881128ed9301cb7257d04c85e5cdaebfdc01f3603e49dc1ba6a9b7cd4ffc68,332f6ce92cb57818d7cd8ef1fbf8def0640dee9f75b54b6e284241838772272a
r0_smg_sticky,rolling-97,2,1,1532,256,1392,21.85327051114291,4307.860061,8184.257012,f5edf68678d356679b4295dcccdcdd6af79a2d42acaedc2cae206f919e4bfbf9,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,3,1,2166,256,1776,30.9475969504565,3031.278667,7082.954318,4eeee69188ab8db0613598e3b014a7e189fd93eb5a1a5424c68a62c953de9858,bbb41ed42e41bfd6909e8ff884fc9d49c145133903e948505c85999b35d738a5
r0_smg_sticky,rolling-97,4,1,3055,256,2416,39.46171146351844,2698.495293,6509.354784,8d1209407de92345d929e37b76bbbb689e978cdbbbeda44e7db59124b77429bb,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,5,1,4198,256,3296,48.32895040139556,2858.692461,6860.251101,fb81d09aa5d59766c475a7e59619d9068339c77479bfc0363abf22be0f9e8b31,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,6,1,5594,256,4448,57.24880057387054,2777.550751,6917.578332,b450ba0045258b5cbcdfde289f15284c04f48f9f66f91698a1ed67a7490f79b8,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,7,1,7244,256,5840,66.54986932873726,3123.918176,7294.246678,a92703fc398cbd59d17f75a4280469f537b271b6c39d4df2a0ad1298ea20e598,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,8,1,9148,256,7488,75.8034238750115,2941.300294,7246.393619,5db88157018996d3aaa92123a2c97e43c2f808aaeded3a2282bbcc315f04fae6,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,9,1,11306,256,9392,84.22087594028562,1850.832868,6414.515036,fe3ce69fceb691d0dd6611ec01ac7dc19a973a25b43d9ac7b63c7c757fc6fe00,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,10,1,13718,256,11552,93.19843878597021,2728.960822,6975.392509,afddefe704b0a55ccf017c0941a84c19dbb68c65d572573e390c30563ac8c954,5f720f30d834261aca119b455099d28e949bb4d508e0fbd94e168f4a4c34f448
r0_smg_sticky,rolling-97,11,1,16384,256,13968,102.06853300798684,2464.69204,6866.4657,27942fe2bb8a76a06268080d942b17d0a25d8f747040898a59a4ee17c2ae43f6,1417049bb0ae41466338fc501577b7480ce3c34307c294c9ca685a7d03112ebe
r0_smg_sticky,rolling-107,11,1,16384,256,512,11.665544532239437,740.593514,7051.049832,a95d6431806a5bcf85699c6267fbf2baae943bbd1616615987a46a1b3c44a07a,f0ecfd071fecf44e9d5ba5e2e57c61d6aff188b4c9190692bba1fd5fbaf11959
r0_smg_sticky,rolling-111,3,1,2166,256,512,11.666038135066628,570.506651,6881.470236,543555b1c55fa1f1ca4919a3ab480432ab91695d484ae1a8f6e2f4366fce9c33,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,4,1,3055,256,2416,21.853018606081605,4307.566139,8183.743472,78b636176d700f04b89adbfa00b951d2757069e940ca39da6e636c3e6788cb65,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,5,1,4198,256,3296,33.369675163179636,5245.467548,9505.379381,8335083069e78abf61551ef0289f4f6d538cfc0f5c730bfe6341c1f91d442271,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,6,1,5594,256,4448,42.19065692462027,2559.04692,6820.184361,0609668c0ef0bd9eef992e8616e9c8507e4762d830f613462762334ea140a588,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,7,1,7244,256,5840,51.37495530303568,2716.902764,7182.488076,b625f7bdc20d3fac5c2713c1d90b4fb6578055e4ab9d54f6f1bae0ba828ad4bf,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,8,1,9148,256,7488,60.62045501451939,2395.006751,7244.078149,3e305f6d0a4ead247c0eac76dec8728883a06e619435406407487c9872435b45,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,9,1,11306,256,9392,69.7557011898607,2531.543776,7133.139007,e53637b57b2e5e8999232a13a74a86e598ef7a36fabcf16b2b26da87c6db720b,a3a6cdfbe0b16fe4f4968c00976978ddb4450ad603b2f3bd86fceec2f6e32aa7
r0_smg_sticky,rolling-111,10,1,13718,256,11552,79.10111968871206,2673.91559,7342.684991,9e4049960e7014656016c38afa3a6700c0b1e5a0b18c26af0f1021214abf7c6a,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-111,11,1,16384,256,13968,88.43651540670544,2681.106546,7332.217568,baa5bc09360edc40d08fd9b602f5e68dbb5417a62bd3d4cd977d2d216a106c70,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-115,7,1,7244,256,0,11.666145527735353,433.69564,6709.632996,7f10024d2c536e638f9446f47a6f21628f0b7412e9ad90058477dc911e08c4b0,a1cee9df3da6469e55a33407ada384967c4f38203e819ab572b89cbe2bbc3a44
r0_smg_sticky,rolling-115,8,1,9148,256,7488,21.852084168232977,4315.491788,8182.143783,9bf42ebea195ea9a576c369f99d6a84fe6dfd38b0c3c1d662259fa30cbc610a8,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-115,9,1,11306,256,9392,30.94466506037861,3033.840347,7082.562444,4fdf683a5d36d81594fceca9a63327730517c59e9e5371cfa03c01728cd85270,fd997ca5b006aeb2f452f0b6557f35c836d3e560326a77268de83b6e3d9e8435
r0_smg_sticky,rolling-115,10,1,13718,256,11552,39.473146508447826,2596.258349,6525.896134,e698dabe644395723b31620cae9c9b31497bcdafdc51a454316030d86b87f956,933a0dbcb78f443b3d7e67047362f3c4cfc2aecf220269f4d7ec04a8371d473d
r0_smg_sticky,rolling-115,11,1,16384,256,13968,50.871369764208794,5058.445476,9395.785013,d9d5c5e35e086d65b89a0d75ec868a1d7aebd29b963b8d39c178d3a6a9428d3b,fd997ca5b006aeb2f452f0b6557f35c836d3e560326a77268de83b6e3d9e8435
r0_smg_sticky,rolling-123,3,1,2166,256,0,11.666378584690392,407.389751,6365.911153,d8ab37a756cce67aadc53c32bb747103f70ada9928fd71329f23bae26993acb3,1692a5a7e6fa0bd575b03900d21886e1e0dac322059704a0487c4a070e556100
r0_smg_sticky,rolling-123,4,1,3055,256,2416,21.85278334002942,4306.64895,8182.528649,cac98f4f9bfc22365a16773e41fb5fd058a4049fa8c0be72041922e0837e1a2a,76632b28640fd09f92f1c2487097bd0723cd9eb9aefdfdee73c33ae46d4f428f
r0_smg_sticky,rolling-123,5,1,4198,256,3296,30.9444118430838,3036.543692,7080.709696,9a4d8621abb4df8a7b18e1f1306ff1133c3908eb16857d46a889ed1153f5f021,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-123,6,1,5594,256,4448,39.45633971877396,2597.699062,6510.308614,797256e8969846cf47e7b0d00f58d19c7223fe994bf897a7c95bb46dbb7878ff,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-123,7,1,7244,256,5840,48.32265509944409,2644.798388,6862.703116,9ee08edf08b31b981e66dd88214b41f33c75a53819a1b1da43618f1ca41afa07,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-123,8,1,9148,256,7488,57.245139783248305,2634.141171,6920.224171,cdc445ed289e9152ca51cd2a90c476037cd2538be3a28c92a1c7c7eb30b676e9,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-123,9,1,11306,256,9392,66.54750800319016,3012.132406,7298.001326,3495b980b8ee3ae0c4f808a4dc4d12408953dc1062f8f6ee921572767ee7b1e1,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-123,10,1,13718,256,11552,75.8062534602359,2946.408165,7254.247843,3d56f52f4c33cf1bae18069cdc0061fc80296a5fee13a0f1f214ae749a8bc302,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-123,11,1,16384,256,13968,85.19918831251562,3132.44975,7388.972538,fcc24049c8e7345976c5e80505998bb19f2000a41922c3871a8282d07a219939,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-103,7,0,7244,256,512,12.425454515963793,97.894805,7984.298601,d183d519ed9a08a578d04ca7e896c978eb93138554f131a1d660e87f0eb19bb0,f0ecfd071fecf44e9d5ba5e2e57c61d6aff188b4c9190692bba1fd5fbaf11959
r0_smg_sticky,rolling-103,8,0,9148,256,7488,22.898742623627186,3769.42647,8470.82526,898059dc22c9e3c1d45be94c869dbe86d215a9c01e3fe784035accb728055f35,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-103,9,0,11306,256,9392,32.19324506819248,2735.106717,7293.175313,6280a7c6cdd2a85530dccb0b530350886ccbe9c6a75553aebb31cfbbea0965de,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-103,10,0,13718,256,11552,41.6717094052583,2750.8375,7473.883905,7ba0345b3387fc5626a4c746b77518f54ec89df0aaea2888fb1f2e7eec420e84,222dabce9d0f1ff7ddc8b784609418c19f70104da5590d644d6192f47b3a0ea1
r0_smg_sticky,rolling-103,11,0,16384,256,13968,50.8764122268185,2591.271789,7201.449888,36a725383d32bb8b32fc32db4a94cbadae2d603ca4510fe635fbb8a422d909e9,1aa830ebb0f1905bb30c5f73bcbbd3714ac7366b1c11eec0e05718e48abed7b3
r0_smg_sticky,rolling-106,10,0,13718,256,512,12.445751438848674,286.499253,7875.229551,209ce91ba20dab4a8404d7a81b673a47cfea0f3bd80ed6bec5d899042f7f1ef0,f0ecfd071fecf44e9d5ba5e2e57c61d6aff188b4c9190692bba1fd5fbaf11959
r0_smg_sticky,rolling-106,11,0,16384,256,13968,23.022134737111628,3898.14732,8574.098658,fc80892424373a32616209cb90b07f3d1741d69ed6ccf335b4847a6f69fc0fa4,59a7e3c369a21588fd959a0a3e9b74503e0f5f6d1709627921e2a52ef31cc17c
r0_smg_sticky,rolling-104,8,0,9148,256,0,12.44625688251108,194.083937,7944.217429,fc1b0ebbdcfdd217b965f2c6c8ecce52b23e776f326843c18ed47e4798692871,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-104,9,0,11306,256,9392,23.02263333182782,3897.180274,8573.7264,4ebfacb9c66ddb4d46850ecbd9bceeced1babc95d5e4482d320df1a05ce0a527,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-104,10,0,13718,256,11552,32.28337854612619,2693.305406,7259.029249,dedb338e2245a33e2d337ed17a94a09aa8fbb79899884d1ad281e05d20585a13,081b4af5c1f4a45377a94076b72c69bf604a356ec895dba321a67227cdc108d2
r0_smg_sticky,rolling-104,11,0,16384,256,13968,41.67299258057028,2667.382975,7387.53317,3a8e3031b2c9bd61d5c2473fdf7eda1996483db6af4fc5fc10ca10f649544df9,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-110,2,0,1532,256,512,12.446504595689476,120.984962,7704.645406,0806e4f3bf1b2a1add2ad7fd364790aad6964b2526f59a7c8d45c0b8d1faeb7d,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,3,0,2166,256,1776,23.021664110012352,3896.935505,8572.446616,74f6228b84b9538a12d4961782b68106cef1760161262e11fbfd7e983d48c02f,52dfde5f1075b684f3b622b3a9d4275192d361d98a5d624464d14e0ab508d852
r0_smg_sticky,rolling-110,4,0,3055,256,2416,32.19274320919067,2612.674066,7170.336099,8bc1db5b0646ed6c68a7a4edca0757d7dcba69bb6a6a8543abfc59156b074a33,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,5,0,4198,256,3296,41.53373256139457,2535.54009,7337.758914,95e0ccf682dbeaec8a5e07da3903f486ca26bccd32e431fa5bfc0c08552e5d43,ab8929db57b53b03a94c12ca1e4829ca01111369bde2936a4d251032425f1e59
r0_smg_sticky,rolling-110,6,0,5594,256,4448,50.87339268904179,2674.861867,7338.958344,bc545a42a987e55b17b5bf7aa91a95985b7ea561c3111ad14d9e6d885fa0a26e,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,7,0,7244,256,5840,60.08265614788979,2663.27786,7207.090498,b1ef2868d3f381f69119cb1e247cf9e7aae5023ba3ffc6edc579e334ca19e4e4,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,8,0,9148,256,7488,69.28626709152013,2819.893345,7201.881443,435c1a80426db13e2ae4dbfaa922601d4657a236baba5d30829a5e3720031199,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,9,0,11306,256,9392,80.36165433004498,4741.304724,9072.135678,5f1f7ab048c73127d67884e1ab9b42555d1e9dbfc05830c5268c48e267e82cbb,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,10,0,13718,256,11552,90.04787110071629,3271.644487,7683.956483,4c5a3bc9cec1b9408972fdd90d1906076e3729117b60f7110baec131d1292566,63508c6d192c62504d251ae098383afe356d9a33bed4e254b83351f6c3cb2103
r0_smg_sticky,rolling-110,11,0,16384,256,13968,100.11454136483371,3331.431093,8064.532792,1fa3d853dddc3ea9e76b4f35f4521e3a63a033851de3e18c9133b21a1bc6bd8d,9e8935428d2e7f2ed6ae386f2acf76d479d4b5b8fbd67601b351ea4fbd856338
r0_smg_sticky,rolling-109,1,0,1151,256,512,12.446596628986299,164.45246,7748.242568,68b49dc552ca9eca59d5340b667793b2339be637d7f4e8564919b84c6fc5a024,7c081541e25f27bee2e2e76b871c06d414775ae38e48db017831cf0919453658
r0_smg_sticky,rolling-109,2,0,1532,256,1392,23.021818607114255,3896.071116,8571.704852,31e6b8db061a6f3c9d57c1e8ffb27f7518ee56f58bd8fd2f98249034edb2c34c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,3,0,2166,256,1776,32.1925752395764,2612.37416,7169.844768,217c5d20da4e44fb937716952192a802db51b2f2007629f5d30b3c8cd2a0302f,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,4,0,3055,256,2416,41.520547362044454,2500.524613,7324.920533,f59df5f4448b3054e39ecf9acc2f87bb7dfe701ea740394a2a65f3e07b2bc146,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,5,0,4198,256,3296,50.72029501758516,2614.497499,7197.070726,6175eb2913839bac925ca243f94a89e43bac34907cca446a3fe68733204851c8,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,6,0,5594,256,4448,59.945194507949054,2723.667222,7222.527233,44003a6f512b3d2929bae8bac19fdcf2fb4e69856c69b37fcca25e641416d5bd,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,7,0,7244,256,5840,69.28594062570482,2956.406818,7338.209347,2db4fedb8156e85fa9b21924ece0b37561450a7456f8b0e659337e2597075306,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,8,0,9148,256,7488,78.38272826280445,2720.084511,7094.050833,47e702cd57f0e95d2276c6cbf9067b074a6392f50dae5bebd530bcca5609f18b,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,9,0,11306,256,9392,89.73561085853726,5052.142622,9350.843973,d85094da5380201196c1f600ffc04bcbf61b6de594741cadac248d971f68984c,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-109,10,0,13718,256,11552,99.84608625341207,3422.172383,8108.616389,4f2cccb91f8c003df2d5572d1847a55abb9a76c16130e384da80ac11ffad39d3,9471545e8179a5e3f67368c98320580c172b36af004885ddbd372da0ef626ec1
r0_smg_sticky,rolling-109,11,0,16384,256,13968,109.76068435795605,3520.418263,7912.963226,ab1706e8d3ac9777cd047f691ef21c528c05b1182fbb5082963f236e85abe5d5,658407d4ca14899f2a50bc39af95f8e5767fbed115103f78ed424f1334ad4d3d
r0_smg_sticky,rolling-113,5,0,4198,256,0,12.89707461092621,68.969349,8026.21825,ed776df02420bcc1fd2987f204c8bc3583dbb40c928164e5f1293e7e8bc8f5c4,2055e8ea848f5030ac5354ced7f95c77b823be80b1d128522661ad13aa54bfbb
r0_smg_sticky,rolling-113,6,0,5594,256,4448,23.021927824243903,3447.439513,8123.332802,575b3cf941ab2b0a3fd51932ce4e96ad635b38893d6f5a4ca05726cf1ef6c160,2055e8ea848f5030ac5354ced7f95c77b823be80b1d128522661ad13aa54bfbb
r0_smg_sticky,rolling-113,7,0,7244,256,5840,32.1929236901924,2611.799948,7169.589918,623e18cc961b1026cae743f1749f68b53e1d519615a216910634ef3bba1f68b4,5e19d40163107935b0e59baa8def09022450f3db1a62b25e263b3aabb0efbf3f
r0_smg_sticky,rolling-113,8,0,9148,256,7488,41.67216294258833,2752.01866,7475.419947,a5d9ef4589e7645bbd9ab03e431156990adf71a802ee5ed376a931fcde33592c,82bb0f52c026164f40c9369d15d1d1d36f1e5d47bae7da91b9bb39df8712cd9f
r0_smg_sticky,rolling-113,9,0,11306,256,9392,50.99449624400586,2696.116109,7318.560043,4a5085b8a48a11b235418e03986738db3ed8e5cc50b1a834e8ed059838276e0e,2055e8ea848f5030ac5354ced7f95c77b823be80b1d128522661ad13aa54bfbb
r0_smg_sticky,rolling-113,10,0,13718,256,11552,60.262611421756446,2688.632864,7265.306406,ec3c9ec1b53f0c8c49c70c4c523a3c367c27d843f4a7a3caa280cc9d90d8b728,c5ec7de1975b388bde0301e881dc0c32944bc79003db9feee055c1b560d6001a
r0_smg_sticky,rolling-113,11,0,16384,256,13968,71.69509904645383,4994.426494,9430.686187,ba2cc03dee2ace70b927f07921de70b901d729af7ddec5ccb27dee762e8571d8,2055e8ea848f5030ac5354ced7f95c77b823be80b1d128522661ad13aa54bfbb
r0_smg_sticky,rolling-114,6,0,5594,256,512,12.911346250213683,90.928843,7997.279993,cf96a66bfe2097d2f78c8725a31f3e9bd0025d5ca4ac78534e89f459c1e317e2,717ccd3ecbdccb4606d5c0a527dfd310f02cc6e43f281fce86ab4b5019461ada
r0_smg_sticky,rolling-114,7,0,7244,256,5840,23.13461465574801,3506.702468,8221.84806,62ff3f4c318c1384ac41f3eda97e51400556174ac7bc36b89178f13316edc611,fa27067ab34492347d45db3c4f8a97c9fe047eca3b496405eb7baed708c710f4
r0_smg_sticky,rolling-114,8,0,9148,256,7488,34.382411235012114,4667.707764,9245.799204,b0e382500e0341b0c3ccb8e2af0f5034c06484af40cd61a8a34ceeb420c65ced,c0520ced61649b24682e00501bc5a4622b797d9c565f6e2ad3fe4e1f1f9d610f
r0_smg_sticky,rolling-114,9,0,11306,256,9392,43.87094132788479,2855.006424,7486.361165,36870060624d232a39072be9913612e0ea0befd007aae88f4ddee6b8e3afd8c8,ac90f7870b0d5ff67e7cc309888ec0031d0e86f6d5ed69a61ed482f7f4a06fb6
r0_smg_sticky,rolling-114,10,0,13718,256,11552,53.152267914265394,2676.464053,7269.707201,b51219d546f1feeb68dc81f1859205024c37babb04066de679c164befc46af52,ca0409ede68cfee21b1157292ebb92fec6d805b422ff8ca3b7b3d4c6ab15014e
r0_smg_sticky,rolling-114,11,0,16384,256,13968,62.81431103404611,3198.304583,7659.922479,1ef301b2fed484b23ba24277a51472b26416ef0059e56b03901296c83459701b,ac6ac74d25bd60d2242d35dc8d6346804583a531b5f9a2f07d55c12accdaa40b
r0_smg_sticky,rolling-125,5,0,4198,256,512,13.037873390130699,59.239082,7651.235224,90bf877ad6f22ad7ea03c3611a0c18501374c88bbc4c1ff8bd26c4133a1eaa95,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-125,6,0,5594,256,4448,25.192527283914387,5542.447954,10153.254828,539ccb47129a55d713929557498e13c7f46232378fd91038fc5db769dce10baf,494f04f73e1267fe709b810b8a33b46a9c02209436c6490b1b31c5ebbdd0eec7
r0_smg_sticky,rolling-125,7,0,7244,256,5840,34.80813543498516,3087.059616,7614.315931,0fcb49621f6fd23be805050d09ca8ab6f91645bfeb398805c0fb8bf253ef18ec,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-125,8,0,9148,256,7488,44.304428230039775,2887.960737,7495.23213,23989394ca06b6c05708e6f248b42710a266e184414fa492a504d1d707d52097,bdb5ec7695d5d6629879ed4707c3b3690580f2aedf6566748982bebe7b215812
r0_smg_sticky,rolling-125,9,0,11306,256,9392,53.775990954600275,2873.975275,7468.887201,dcc41692f5922042717b634163b01bfe91cba1855e9d40d4515aa7cf833804d2,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-125,10,0,13718,256,11552,63.27162368223071,3110.097004,7493.290102,de4023c6c242e5341d704b096afcfd059dca3f3b2a6148f1e08e6bbc7ac923bb,494f04f73e1267fe709b810b8a33b46a9c02209436c6490b1b31c5ebbdd0eec7
r0_smg_sticky,rolling-125,11,0,16384,256,13968,72.95013899821788,3388.810323,7676.087667,90e822e7f3fb6b89437076b7564e4dbe9b69ac517cd022eaf9de13403c162255,0d6879a3922ac462cb0a55f0d821d03cffbefa95c7009d856fb01967640ea7cf
r0_smg_sticky,rolling-117,9,0,11306,256,512,13.03808958362788,178.351489,7994.068773,a827ba5cb2baf67702dc60ea8817f3a91ed70c9585d3e30f2d6b304c69cbc2bc,5e19d40163107935b0e59baa8def09022450f3db1a62b25e263b3aabb0efbf3f
r0_smg_sticky,rolling-117,10,0,13718,256,11552,25.590493202209473,5959.008225,10549.996354,cde56c3f87411b96ad67a2cac64bb47ed45aa0bc8f32a9cf7f9f082e23174521,abd462ece67de4d48d7d0a08d8de86ba1c73a930b5138dce86d58cae9fc3fd92
r0_smg_sticky,rolling-117,11,0,16384,256,13968,34.808635213412344,2687.268342,7214.999316,77b125468d6eb396ded266be2bd2858e7888ae13fa353fdae82af762ab722461,60f20d4d9f2a2edb2bf1a92b6a1fb6467e160ad5e4454e43b9d6ed9ed912e0a0
r0_smg_sticky,rolling-122,2,0,1532,256,0,13.038407473824918,183.776418,7781.73778,02b0fe7b077f44f3bb5dd155538f8a71c42806d6d24f7953ec00af7e2bea53b9,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-122,3,0,2166,256,1776,25.40342399571091,5764.951137,10362.584394,55f8de628fdc3f02b45a968835f702004ef26f077a23d53a72659896800d115e,734f55ceca5bae11d98710fa6d25f2e4155c61d321a6d30144ba44051ca0c2af
r0_smg_sticky,rolling-122,4,0,3055,256,2416,34.808467340655625,2876.989725,7404.458169,3ee6238b87f159ca184376dacbe3b942d2cf2425587a0c597550e00988c3d983,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-122,5,0,4198,256,3296,44.54026810172945,3072.524648,7730.697952,4d3d2fc40e0c9e5ae970a08c5ce999a571572e1d8000ffeabcff37dfee86a8cd,f6c4239a17de464c1064e0b3610e449d95d2819e52529e81e70f6d0c74742171
r0_smg_sticky,rolling-122,6,0,5594,256,4448,53.88903964497149,2748.217003,7346.925593,f09051010402458341a7b7326468b08531d52da849f94507f83869f942d4e041,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-122,7,0,7244,256,5840,63.27232275810093,2997.668766,7381.563724,160b33b621b08a6f3cc3629ef799f33524c532ab28f114ea9638c0b0d9ae2604,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-122,8,0,9148,256,7488,72.95314151141793,3505.410714,7677.829597,9b69df6cd663e0810eb992df29c3a1ea295a439f4da8d3856cfab8df59d82895,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-122,9,0,11306,256,9392,81.94324142578989,2987.706146,6983.632271,536c4c239193dec497a3c3cb6b409df1b7596e8a6791693d833479b217faacda,ed296c21a96f901693f3b070236b026db9bd7fecb46c77aac61ff13220b017ee
r0_smg_sticky,rolling-122,10,0,13718,256,11552,91.72813985683024,3258.515703,7775.53381,953748b5f2cc67dd3dedeae08ca16a6457f3329d4941937cfedc553cc024d0c0,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-122,11,0,16384,256,13968,104.322370512411,5479.147886,10591.186747,425f32a5ef190fac83a26522c2473b3f55bdce1e312e71f7f44b2241377c4e05,c06286baffbf20a450600f6964fe206d26e70136bd77e7c4221c7d9d3a87532b
r0_smg_sticky,rolling-118,10,0,13718,256,512,13.038509969599545,311.906736,7952.62948,ca703407d667d8b567850a6e4cab8e9bb9078abd8258a0383a49bef21d4a2940,92c5a564284f2dbeb2b39938300e9a58cb01c88083ba712bc2b5e066cac24b8c
r0_smg_sticky,rolling-118,11,0,16384,256,13968,25.608918914571404,6076.245838,10566.899849,4437d3121be620d38a739b6abc46c7dff4dc169ad71cb8d0f6d42026afe51ccf,0492a8eefa569c7eb6d775fac3a6bffa36a9cee21bfe364214a3bc985d204fc7
r0_smg_sticky,rolling-120,0,0,1024,256,0,13.038827987387776,211.999118,7853.057672,c0d850bccd11896d326eb8990d49f245245f0633a1200f6c06a8791f222634bb,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-120,1,0,1280,256,1264,25.486863256432116,5842.397946,10444.284445,6021db8dce38d3096e7f8e301adf7381a4dfcd5f46dad67ae0810c2b75c227db,add5c508cc8f511688cac36c90d72cb21233bd53b29837c236b82eacffaa181c
r0_smg_sticky,rolling-120,2,0,1536,256,1520,34.807687912136316,2793.684769,7320.378328,7a7b2389999c5cad76750ca6708a409059bb81d0dc1037c1138539523714f312,f2ef1f9e3702517969548d82f1959f37b962db734693e9bd154c68ed3cc25a93
r0_smg_sticky,rolling-120,3,0,2166,256,1792,44.30398346018046,2888.609605,7495.537029,076cd4458e57a8a8579985d29affb4d9d00e230019383de665e823a9844eaf97,e78a64b37a679d432c207d84e2ed795087bfb7889deb73e54ad2621f8f140ae6
r0_smg_sticky,rolling-120,4,0,3055,256,2416,53.55319023411721,2698.191577,7247.691578,8f8cd6fdda0293e260d937cfc8d8db1a7448ecdc011688bcbe131a937f5f3cde,bd82208079b6a17eaa1144fb9bf128d6a103567a1aac389deef49b45d36a5913
r0_smg_sticky,rolling-120,5,0,4198,256,3296,62.997326070442796,2965.686427,7443.009283,e6722aee8156d8763aaa49a29fbcb66642f8a95b8127ab32d4d92f8abac80dad,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-120,6,0,5594,256,4448,72.37134045548737,2947.531724,7372.579125,b664a47dce2ac203c739c42d463111edd2845d4eec414840df3c7ae40eacd674,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-120,7,0,7244,256,5840,81.93877922277898,3308.380679,7565.329614,f173735e2dc048280d15a4d3786aaabb56dd93445c2e9cd40fc10bce35b0e20c,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-120,8,0,9148,256,7488,91.06361819896847,2751.625248,7122.06646,0472402fd805fd6e67675a05d147977fa13e18372c51ecb892cdca787e48d5e3,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-120,9,0,11306,256,9392,101.2406796971336,3323.927943,8169.662426,97c66d5c8bc276cd8d1df95053650678fcc75fdc2b68ff4519755db80acc14b8,3efe84f518e079f27a9f5d1e9184768aa017beb4fa5e9acb02932ab858d1c778
r0_smg_sticky,rolling-120,10,0,13718,256,11552,111.0289665972814,3197.186561,7786.47759,388544b379789a6bf78b65c45ecb7e2cbf040a4d63c346e8a5c9d6fa0750c8c5,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-120,11,0,16384,256,13968,120.18931296095252,2864.749972,7157.924409,425438fa0d670ce54db92d3f90d93d8e5aeb18db413c4504d19ba3aafa2ddfa2,f03289d2f4580d508623a46c7b94e92847b35d31f32eaf7a6c9cf2cf2462a9bf
r0_smg_sticky,rolling-127,7,0,7244,256,512,13.21255074441433,94.818403,7738.883856,01f1701caa397056589c0bc8ca4599a929c8fe32ffee40b22443f95081b81bce,2aa0cec05398b4ada4904c60eb710fc7212233fd44426c7c3b591fa5eed37fe9
r0_smg_sticky,rolling-127,8,0,9148,256,7488,25.609501253813505,5904.296181,10395.676469,8f11ae30ac562e7407dea23d34a4228a9a942d6ba7c4978d7367e105546d6892,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-127,9,0,11306,256,9392,35.05180226638913,2869.922257,7440.361908,4f9e32ab4a0967a6fa3e87899a5b5273e92fbe630dd176aab8ce9fde94b4aeb2,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-127,10,0,13718,256,11552,44.54042432643473,2827.138189,7485.386086,4788349cd7ec396afb69f58a35163290292c4f5bb9ab3451debdc829886e6fb7,51f9346e8772001cb4905edeba46143470bc1f56a4e1346cf4677fe80fe436e3
r0_smg_sticky,rolling-127,11,0,16384,256,13968,53.888564601540565,2746.978435,7345.231694,67124cda4ae02f3b559ae66121e4e7c2e3f994a70528274cfe52ecbffe1c8f2a,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-128,8,0,9148,256,0,15.25593185890466,2129.73889,9725.012428,080025d603add5e9d93d9fb33c203123921464c898f7a9df2e73f79624cbce2c,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-128,9,0,11306,256,9392,25.609812712296844,3859.983922,8351.611828,2753bc2b432aa0cc3d30ace569c0e345584ab2c3a5b0ceb98e80bb5ac2ec048e,14414b08f789dcb636a81d8f54ea8f8d08d1ef8bea4f800b52192f1c7b3a9aa0
r0_smg_sticky,rolling-128,10,0,13718,256,11552,35.05136172007769,2868.988524,7438.992716,77b8867c54a868020e3c74fb37ae49bf64dd0f4e18d31411b7386ca68a284cc0,79f0e8d6f06632b4d3ea926add66d1f22de6a4afdb63ed24ef087ae1d442ad9a
r0_smg_sticky,rolling-128,11,0,16384,256,13968,44.63586638215929,2931.469579,7581.862292,9362cd94f10d8720858e7536df4a857735488bea6ce988f65c5f7fb52ccc454c,79f0
View raw

(Sorry about that, but we can’t show files that are this big right now.)

View raw

(Sorry about that, but we can’t show files that are this big right now.)

View raw

(Sorry about that, but we can’t show files that are this big right now.)

View raw

(Sorry about that, but we can’t show files that are this big right now.)

View raw

(Sorry about that, but we can’t show files that are this big right now.)

View raw

(Sorry about that, but we can’t show files that are this big right now.)

View raw

(Sorry about that, but we can’t show files that are this big right now.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment