Created
June 24, 2025 04:01
-
-
Save nerdalert/9e44003e13a3ddb375e5a83faef9f2ff to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2025-06-24T03:52:30.5394764Z Current runner version: '2.325.0' | |
| 2025-06-24T03:52:30.5428738Z ##[group]Operating System | |
| 2025-06-24T03:52:30.5429883Z Ubuntu | |
| 2025-06-24T03:52:30.5430846Z 24.04.2 | |
| 2025-06-24T03:52:30.5431596Z LTS | |
| 2025-06-24T03:52:30.5432469Z ##[endgroup] | |
| 2025-06-24T03:52:30.5433460Z ##[group]Runner Image | |
| 2025-06-24T03:52:30.5434453Z Image: ubuntu-24.04 | |
| 2025-06-24T03:52:30.5435403Z Version: 20250615.1.0 | |
| 2025-06-24T03:52:30.5437208Z Included Software: https://github.com/actions/runner-images/blob/ubuntu24/20250615.1/images/ubuntu/Ubuntu2404-Readme.md | |
| 2025-06-24T03:52:30.5439679Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu24%2F20250615.1 | |
| 2025-06-24T03:52:30.5441427Z ##[endgroup] | |
| 2025-06-24T03:52:30.5442303Z ##[group]Runner Image Provisioner | |
| 2025-06-24T03:52:30.5443470Z 2.0.437.1 | |
| 2025-06-24T03:52:30.5444500Z ##[endgroup] | |
| 2025-06-24T03:52:30.5446354Z ##[group]GITHUB_TOKEN Permissions | |
| 2025-06-24T03:52:30.5449157Z Contents: read | |
| 2025-06-24T03:52:30.5449960Z Metadata: read | |
| 2025-06-24T03:52:30.5451037Z PullRequests: read | |
| 2025-06-24T03:52:30.5451948Z ##[endgroup] | |
| 2025-06-24T03:52:30.5455457Z Secret source: None | |
| 2025-06-24T03:52:30.5456932Z Prepare workflow directory | |
| 2025-06-24T03:52:30.5931589Z Prepare all required actions | |
| 2025-06-24T03:52:30.5990072Z Getting action download info | |
| 2025-06-24T03:52:30.9254478Z Download action repository 'actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683) | |
| 2025-06-24T03:52:31.0136378Z Download action repository 'azure/setup-helm@5119fcb9089d432beecbf79bb2c7915207344b78' (SHA:5119fcb9089d432beecbf79bb2c7915207344b78) | |
| 2025-06-24T03:52:31.2388219Z Download action repository 'actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55' (SHA:8d9ed9ac5c53483de85588cdf95a591a75ab9f55) | |
| 2025-06-24T03:52:31.3270782Z Download action repository 'helm/chart-testing-action@0d28d3144d3a25ea2cc349d6e59901c4ff469b3b' (SHA:0d28d3144d3a25ea2cc349d6e59901c4ff469b3b) | |
| 2025-06-24T03:52:31.5153473Z Download action repository 'helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3' (SHA:a1b0e391336a6ee6713a0583f8c6240d70863de3) | |
| 2025-06-24T03:52:31.7283262Z Getting action download info | |
| 2025-06-24T03:52:31.8289546Z Download action repository 'sigstore/cosign-installer@dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da' (SHA:dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da) | |
| 2025-06-24T03:52:32.1084840Z Complete job name: Test Latest Release | |
| 2025-06-24T03:52:32.1907249Z ##[group]Run actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 | |
| 2025-06-24T03:52:32.1908859Z with: | |
| 2025-06-24T03:52:32.1909544Z fetch-depth: 0 | |
| 2025-06-24T03:52:32.1910312Z persist-credentials: true | |
| 2025-06-24T03:52:32.1911198Z repository: llm-d/llm-d-deployer | |
| 2025-06-24T03:52:32.1912365Z token: *** | |
| 2025-06-24T03:52:32.1913256Z ssh-strict: true | |
| 2025-06-24T03:52:32.1913987Z ssh-user: git | |
| 2025-06-24T03:52:32.1914693Z clean: true | |
| 2025-06-24T03:52:32.1915447Z sparse-checkout-cone-mode: true | |
| 2025-06-24T03:52:32.1916361Z fetch-tags: false | |
| 2025-06-24T03:52:32.1917108Z show-progress: true | |
| 2025-06-24T03:52:32.1917878Z lfs: false | |
| 2025-06-24T03:52:32.1918562Z submodules: false | |
| 2025-06-24T03:52:32.1919311Z set-safe-directory: true | |
| 2025-06-24T03:52:32.1920422Z ##[endgroup] | |
| 2025-06-24T03:52:32.3779498Z Syncing repository: llm-d/llm-d-deployer | |
| 2025-06-24T03:52:32.3782365Z ##[group]Getting Git version info | |
| 2025-06-24T03:52:32.3784325Z Working directory is '/home/runner/work/llm-d-deployer/llm-d-deployer' | |
| 2025-06-24T03:52:32.3787046Z [command]/usr/bin/git version | |
| 2025-06-24T03:52:32.3823797Z git version 2.49.0 | |
| 2025-06-24T03:52:32.3851562Z ##[endgroup] | |
| 2025-06-24T03:52:32.3865346Z Temporarily overriding HOME='/home/runner/work/_temp/b3627fe2-fa99-49bd-942d-5ac50b821352' before making global git config changes | |
| 2025-06-24T03:52:32.3867913Z Adding repository directory to the temporary git global config as a safe directory | |
| 2025-06-24T03:52:32.3871493Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T03:52:32.3907536Z Deleting the contents of '/home/runner/work/llm-d-deployer/llm-d-deployer' | |
| 2025-06-24T03:52:32.3911908Z ##[group]Initializing the repository | |
| 2025-06-24T03:52:32.3917640Z [command]/usr/bin/git init /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T03:52:32.3982515Z hint: Using 'master' as the name for the initial branch. This default branch name | |
| 2025-06-24T03:52:32.3984848Z hint: is subject to change. To configure the initial branch name to use in all | |
| 2025-06-24T03:52:32.3987185Z hint: of your new repositories, which will suppress this warning, call: | |
| 2025-06-24T03:52:32.3989392Z hint: | |
| 2025-06-24T03:52:32.3990911Z hint: git config --global init.defaultBranch <name> | |
| 2025-06-24T03:52:32.3992865Z hint: | |
| 2025-06-24T03:52:32.3994927Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and | |
| 2025-06-24T03:52:32.3998020Z hint: 'development'. The just-created branch can be renamed via this command: | |
| 2025-06-24T03:52:32.4000416Z hint: | |
| 2025-06-24T03:52:32.4001665Z hint: git branch -m <name> | |
| 2025-06-24T03:52:32.4004372Z Initialized empty Git repository in /home/runner/work/llm-d-deployer/llm-d-deployer/.git/ | |
| 2025-06-24T03:52:32.4008510Z [command]/usr/bin/git remote add origin https://github.com/llm-d/llm-d-deployer | |
| 2025-06-24T03:52:32.4035067Z ##[endgroup] | |
| 2025-06-24T03:52:32.4037370Z ##[group]Disabling automatic garbage collection | |
| 2025-06-24T03:52:32.4039518Z [command]/usr/bin/git config --local gc.auto 0 | |
| 2025-06-24T03:52:32.4068947Z ##[endgroup] | |
| 2025-06-24T03:52:32.4071129Z ##[group]Setting up auth | |
| 2025-06-24T03:52:32.4076642Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand | |
| 2025-06-24T03:52:32.4109620Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" | |
| 2025-06-24T03:52:32.4382108Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader | |
| 2025-06-24T03:52:32.4411786Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" | |
| 2025-06-24T03:52:32.4640997Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** | |
| 2025-06-24T03:52:32.4675710Z ##[endgroup] | |
| 2025-06-24T03:52:32.4678329Z ##[group]Fetching the repository | |
| 2025-06-24T03:52:32.4688647Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* +f8c0258dc0c62e10396fa95a3fde8b7e4ecfcc22:refs/remotes/pull/335/merge | |
| 2025-06-24T03:52:32.8931363Z From https://github.com/llm-d/llm-d-deployer | |
| 2025-06-24T03:52:32.8933962Z * [new branch] gh-pages -> origin/gh-pages | |
| 2025-06-24T03:52:32.8937086Z * [new branch] heterogeneous-p-and-d -> origin/heterogeneous-p-and-d | |
| 2025-06-24T03:52:32.8939986Z * [new branch] main -> origin/main | |
| 2025-06-24T03:52:32.8942789Z * [new branch] mkdn-link-checker1 -> origin/mkdn-link-checker1 | |
| 2025-06-24T03:52:32.8946133Z * [new branch] onboarding-flows -> origin/onboarding-flows | |
| 2025-06-24T03:52:32.8948868Z * [new tag] llm-d-1.0.0 -> llm-d-1.0.0 | |
| 2025-06-24T03:52:32.8951231Z * [new tag] llm-d-1.0.1 -> llm-d-1.0.1 | |
| 2025-06-24T03:52:32.8953804Z * [new tag] llm-d-1.0.10 -> llm-d-1.0.10 | |
| 2025-06-24T03:52:32.8956192Z * [new tag] llm-d-1.0.11 -> llm-d-1.0.11 | |
| 2025-06-24T03:52:32.8958615Z * [new tag] llm-d-1.0.12 -> llm-d-1.0.12 | |
| 2025-06-24T03:52:32.8960983Z * [new tag] llm-d-1.0.13 -> llm-d-1.0.13 | |
| 2025-06-24T03:52:32.8963514Z * [new tag] llm-d-1.0.14 -> llm-d-1.0.14 | |
| 2025-06-24T03:52:32.8966207Z * [new tag] llm-d-1.0.15 -> llm-d-1.0.15 | |
| 2025-06-24T03:52:32.8968566Z * [new tag] llm-d-1.0.16 -> llm-d-1.0.16 | |
| 2025-06-24T03:52:32.8970982Z * [new tag] llm-d-1.0.17 -> llm-d-1.0.17 | |
| 2025-06-24T03:52:32.8973554Z * [new tag] llm-d-1.0.18 -> llm-d-1.0.18 | |
| 2025-06-24T03:52:32.8975927Z * [new tag] llm-d-1.0.19 -> llm-d-1.0.19 | |
| 2025-06-24T03:52:32.8978269Z * [new tag] llm-d-1.0.2 -> llm-d-1.0.2 | |
| 2025-06-24T03:52:32.8980614Z * [new tag] llm-d-1.0.20 -> llm-d-1.0.20 | |
| 2025-06-24T03:52:32.8982926Z * [new tag] llm-d-1.0.3 -> llm-d-1.0.3 | |
| 2025-06-24T03:52:32.8985437Z * [new tag] llm-d-1.0.4 -> llm-d-1.0.4 | |
| 2025-06-24T03:52:32.8987576Z * [new tag] llm-d-1.0.5 -> llm-d-1.0.5 | |
| 2025-06-24T03:52:32.8989380Z * [new tag] llm-d-1.0.6 -> llm-d-1.0.6 | |
| 2025-06-24T03:52:32.8991171Z * [new tag] llm-d-1.0.7 -> llm-d-1.0.7 | |
| 2025-06-24T03:52:32.8993117Z * [new tag] llm-d-1.0.8 -> llm-d-1.0.8 | |
| 2025-06-24T03:52:32.8994946Z * [new tag] llm-d-1.0.9 -> llm-d-1.0.9 | |
| 2025-06-24T03:52:32.8997012Z * [new ref] f8c0258dc0c62e10396fa95a3fde8b7e4ecfcc22 -> pull/335/merge | |
| 2025-06-24T03:52:32.9027012Z ##[endgroup] | |
| 2025-06-24T03:52:32.9029216Z ##[group]Determining the checkout info | |
| 2025-06-24T03:52:32.9031636Z ##[endgroup] | |
| 2025-06-24T03:52:32.9033341Z [command]/usr/bin/git sparse-checkout disable | |
| 2025-06-24T03:52:32.9075176Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig | |
| 2025-06-24T03:52:32.9103353Z ##[group]Checking out the ref | |
| 2025-06-24T03:52:32.9106733Z [command]/usr/bin/git checkout --progress --force refs/remotes/pull/335/merge | |
| 2025-06-24T03:52:32.9270330Z Note: switching to 'refs/remotes/pull/335/merge'. | |
| 2025-06-24T03:52:32.9271708Z | |
| 2025-06-24T03:52:32.9272825Z You are in 'detached HEAD' state. You can look around, make experimental | |
| 2025-06-24T03:52:32.9275020Z changes and commit them, and you can discard any commits you make in this | |
| 2025-06-24T03:52:32.9278024Z state without impacting any branches by switching back to a branch. | |
| 2025-06-24T03:52:32.9279871Z | |
| 2025-06-24T03:52:32.9280966Z If you want to create a new branch to retain commits you create, you may | |
| 2025-06-24T03:52:32.9283693Z do so (now or later) by using -c with the switch command. Example: | |
| 2025-06-24T03:52:32.9285231Z | |
| 2025-06-24T03:52:32.9285907Z git switch -c <new-branch-name> | |
| 2025-06-24T03:52:32.9286979Z | |
| 2025-06-24T03:52:32.9287536Z Or undo this operation with: | |
| 2025-06-24T03:52:32.9288620Z | |
| 2025-06-24T03:52:32.9289120Z git switch - | |
| 2025-06-24T03:52:32.9289792Z | |
| 2025-06-24T03:52:32.9290937Z Turn off this advice by setting config variable advice.detachedHead to false | |
| 2025-06-24T03:52:32.9292412Z | |
| 2025-06-24T03:52:32.9294047Z HEAD is now at f8c0258 Merge 5f81343f8f8b552bade516549d36e0ac9f01a411 into 4ef77d318945c21b40f75c3c1cd9453934981cc3 | |
| 2025-06-24T03:52:32.9297816Z ##[endgroup] | |
| 2025-06-24T03:52:32.9317778Z [command]/usr/bin/git log -1 --format=%H | |
| 2025-06-24T03:52:32.9339780Z f8c0258dc0c62e10396fa95a3fde8b7e4ecfcc22 | |
| 2025-06-24T03:52:32.9550878Z ##[group]Run azure/setup-helm@5119fcb9089d432beecbf79bb2c7915207344b78 | |
| 2025-06-24T03:52:32.9552093Z with: | |
| 2025-06-24T03:52:32.9552717Z version: v3.10.0 | |
| 2025-06-24T03:52:32.9553536Z ##[endgroup] | |
| 2025-06-24T03:52:33.0063909Z ##[group]Downloading v3.10.0 | |
| 2025-06-24T03:52:33.3315628Z [command]/usr/bin/unzip -o -q /home/runner/work/_temp/c5c0a71d-187e-41a7-a2a1-c0ab3f9defe6 | |
| 2025-06-24T03:52:33.6936189Z ##[endgroup] | |
| 2025-06-24T03:52:33.6938539Z Helm tool version 'v3.10.0' has been cached at /opt/hostedtoolcache/helm/3.10.0/x64/linux-amd64/helm | |
| 2025-06-24T03:52:33.7176476Z ##[group]Run actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55 | |
| 2025-06-24T03:52:33.7177767Z with: | |
| 2025-06-24T03:52:33.7178422Z python-version: 3.13 | |
| 2025-06-24T03:52:33.7179198Z check-latest: false | |
| 2025-06-24T03:52:33.7180180Z token: *** | |
| 2025-06-24T03:52:33.7180882Z update-environment: true | |
| 2025-06-24T03:52:33.7181717Z allow-prereleases: false | |
| 2025-06-24T03:52:33.7182510Z freethreaded: false | |
| 2025-06-24T03:52:33.7183395Z ##[endgroup] | |
| 2025-06-24T03:52:33.8833742Z ##[group]Installed versions | |
| 2025-06-24T03:52:33.8891560Z Successfully set up CPython (3.13.5) | |
| 2025-06-24T03:52:33.8894182Z ##[endgroup] | |
| 2025-06-24T03:52:33.9079637Z ##[group]Run helm/chart-testing-action@0d28d3144d3a25ea2cc349d6e59901c4ff469b3b | |
| 2025-06-24T03:52:33.9080968Z with: | |
| 2025-06-24T03:52:33.9081595Z version: 3.12.0 | |
| 2025-06-24T03:52:33.9082314Z yamllint_version: 1.33.0 | |
| 2025-06-24T03:52:33.9083319Z yamale_version: 4.0.4 | |
| 2025-06-24T03:52:33.9084046Z env: | |
| 2025-06-24T03:52:33.9084872Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9086293Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:33.9087667Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9088905Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9090169Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9091427Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:33.9092494Z ##[endgroup] | |
| 2025-06-24T03:52:33.9444632Z ##[group]Run sigstore/cosign-installer@dc72c7d5c4d10cd6bcb8cf6e3fd625a9e5e537da | |
| 2025-06-24T03:52:33.9445952Z with: | |
| 2025-06-24T03:52:33.9446598Z cosign-release: v2.4.1 | |
| 2025-06-24T03:52:33.9447389Z install-dir: $HOME/.cosign | |
| 2025-06-24T03:52:33.9448182Z use-sudo: false | |
| 2025-06-24T03:52:33.9448835Z env: | |
| 2025-06-24T03:52:33.9449656Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9451027Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:33.9452393Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9453753Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9455000Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9456253Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:33.9457310Z ##[endgroup] | |
| 2025-06-24T03:52:33.9536506Z ##[group]Run #!/bin/bash | |
| 2025-06-24T03:52:33.9538195Z [36;1m#!/bin/bash[0m | |
| 2025-06-24T03:52:33.9539007Z [36;1m# cosign install script[0m | |
| 2025-06-24T03:52:33.9539971Z [36;1mshopt -s expand_aliases[0m | |
| 2025-06-24T03:52:33.9540881Z [36;1mif [ -z "$NO_COLOR" ]; then[0m | |
| 2025-06-24T03:52:33.9541961Z [36;1m alias log_info="echo -e \"\033[1;32mINFO\033[0m:\""[0m | |
| 2025-06-24T03:52:33.9543396Z [36;1m alias log_error="echo -e \"\033[1;31mERROR\033[0m:\""[0m | |
| 2025-06-24T03:52:33.9544496Z [36;1melse[0m | |
| 2025-06-24T03:52:33.9545251Z [36;1m alias log_info="echo \"INFO:\""[0m | |
| 2025-06-24T03:52:33.9546292Z [36;1m alias log_error="echo \"ERROR:\""[0m | |
| 2025-06-24T03:52:33.9547230Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9547893Z [36;1mset -e[0m | |
| 2025-06-24T03:52:33.9548588Z [36;1m[0m | |
| 2025-06-24T03:52:33.9549291Z [36;1mmkdir -p $HOME/.cosign[0m | |
| 2025-06-24T03:52:33.9550136Z [36;1m[0m | |
| 2025-06-24T03:52:33.9550832Z [36;1mif [[ v2.4.1 == "main" ]]; then[0m | |
| 2025-06-24T03:52:33.9552111Z [36;1m log_info "installing cosign via 'go install' from its main version"[0m | |
| 2025-06-24T03:52:33.9553599Z [36;1m GOBIN=$(go env GOPATH)/bin[0m | |
| 2025-06-24T03:52:33.9554750Z [36;1m go install github.com/sigstore/cosign/cmd/cosign@main[0m | |
| 2025-06-24T03:52:33.9555984Z [36;1m ln -s $GOBIN/cosign $HOME/.cosign/cosign[0m | |
| 2025-06-24T03:52:33.9556960Z [36;1m exit 0[0m | |
| 2025-06-24T03:52:33.9557655Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9558318Z [36;1m[0m | |
| 2025-06-24T03:52:33.9558982Z [36;1mshaprog() {[0m | |
| 2025-06-24T03:52:33.9559735Z [36;1m case Linux in[0m | |
| 2025-06-24T03:52:33.9560529Z [36;1m Linux|linux)[0m | |
| 2025-06-24T03:52:33.9561585Z [36;1m sha256sum $1 | cut -d' ' -f1[0m | |
| 2025-06-24T03:52:33.9562507Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9563339Z [36;1m macOS|macos)[0m | |
| 2025-06-24T03:52:33.9564192Z [36;1m shasum -a256 $1 | cut -d' ' -f1[0m | |
| 2025-06-24T03:52:33.9565124Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9565866Z [36;1m Windows|windows)[0m | |
| 2025-06-24T03:52:33.9567463Z [36;1m powershell -command "(Get-FileHash $1 -Algorithm SHA256 | Select-Object -ExpandProperty Hash).ToLower()"[0m | |
| 2025-06-24T03:52:33.9569117Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9570017Z [36;1m *)[0m | |
| 2025-06-24T03:52:33.9570800Z [36;1m log_error "unsupported OS Linux"[0m | |
| 2025-06-24T03:52:33.9571825Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9572571Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9573377Z [36;1m esac[0m | |
| 2025-06-24T03:52:33.9574060Z [36;1m}[0m | |
| 2025-06-24T03:52:33.9574713Z [36;1m[0m | |
| 2025-06-24T03:52:33.9575422Z [36;1mbootstrap_version='v2.4.1'[0m | |
| 2025-06-24T03:52:33.9577025Z [36;1mbootstrap_linux_amd64_sha='8b24b946dd5809c6bd93de08033bcf6bc0ed7d336b7785787c080f574b89249b'[0m | |
| 2025-06-24T03:52:33.9579256Z [36;1mbootstrap_linux_arm_sha='541fd175fae792a154fa2fa025146e3d4691e2dd97717fa9ace35677a88489e7'[0m | |
| 2025-06-24T03:52:33.9581477Z [36;1mbootstrap_linux_arm64_sha='3b2e2e3854d0356c45fe6607047526ccd04742d20bd44afb5be91fa2a6e7cb4a'[0m | |
| 2025-06-24T03:52:33.9583808Z [36;1mbootstrap_darwin_amd64_sha='666032ca283da92b6f7953965688fd51200fdc891a86c19e05c98b898ea0af4e'[0m | |
| 2025-06-24T03:52:33.9586069Z [36;1mbootstrap_darwin_arm64_sha='13343856b69f70388c4fe0b986a31dde5958e444b41be22d785d3dc5e1a9cc62'[0m | |
| 2025-06-24T03:52:33.9588329Z [36;1mbootstrap_windows_amd64_sha='8d57f8a42a981d27290c4227271fa9f0f62ca6630eb4a21d316bd6b01405b87c'[0m | |
| 2025-06-24T03:52:33.9589987Z [36;1mcosign_executable_name=cosign[0m | |
| 2025-06-24T03:52:33.9590895Z [36;1m[0m | |
| 2025-06-24T03:52:33.9591600Z [36;1mtrap "popd >/dev/null" EXIT[0m | |
| 2025-06-24T03:52:33.9592499Z [36;1m[0m | |
| 2025-06-24T03:52:33.9593414Z [36;1mpushd $HOME/.cosign > /dev/null[0m | |
| 2025-06-24T03:52:33.9594320Z [36;1m[0m | |
| 2025-06-24T03:52:33.9594989Z [36;1mcase Linux in[0m | |
| 2025-06-24T03:52:33.9595773Z [36;1m Linux|linux)[0m | |
| 2025-06-24T03:52:33.9596566Z [36;1m case X64 in[0m | |
| 2025-06-24T03:52:33.9597345Z [36;1m X64|amd64)[0m | |
| 2025-06-24T03:52:33.9598267Z [36;1m bootstrap_filename='cosign-linux-amd64'[0m | |
| 2025-06-24T03:52:33.9599427Z [36;1m bootstrap_sha=${bootstrap_linux_amd64_sha}[0m | |
| 2025-06-24T03:52:33.9600634Z [36;1m desired_cosign_filename='cosign-linux-amd64'[0m | |
| 2025-06-24T03:52:33.9602019Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T03:52:33.9603957Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9605236Z [36;1m desired_cosign_filename='cosign_linux_amd64_0.6.0_linux_amd64'[0m | |
| 2025-06-24T03:52:33.9606865Z [36;1m desired_cosign_v060_signature='cosign_linux_amd64_0.6.0_linux_amd64.sig'[0m | |
| 2025-06-24T03:52:33.9608210Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9608918Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9609628Z [36;1m[0m | |
| 2025-06-24T03:52:33.9610292Z [36;1m ARM|arm)[0m | |
| 2025-06-24T03:52:33.9611184Z [36;1m bootstrap_filename='cosign-linux-arm'[0m | |
| 2025-06-24T03:52:33.9612326Z [36;1m bootstrap_sha=${bootstrap_linux_arm_sha}[0m | |
| 2025-06-24T03:52:33.9613637Z [36;1m desired_cosign_filename='cosign-linux-arm'[0m | |
| 2025-06-24T03:52:33.9614735Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9615879Z [36;1m log_error "linux-arm build not available at v0.6.0"[0m | |
| 2025-06-24T03:52:33.9616987Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9617762Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9618483Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9619200Z [36;1m[0m | |
| 2025-06-24T03:52:33.9619866Z [36;1m ARM64|arm64)[0m | |
| 2025-06-24T03:52:33.9620816Z [36;1m bootstrap_filename='cosign-linux-arm64'[0m | |
| 2025-06-24T03:52:33.9622159Z [36;1m bootstrap_sha=${bootstrap_linux_arm64_sha}[0m | |
| 2025-06-24T03:52:33.9623495Z [36;1m desired_cosign_filename='cosign-linux-arm64'[0m | |
| 2025-06-24T03:52:33.9624606Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9625773Z [36;1m log_error "linux-arm64 build not available at v0.6.0"[0m | |
| 2025-06-24T03:52:33.9626909Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9627674Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9628402Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9629116Z [36;1m[0m | |
| 2025-06-24T03:52:33.9629766Z [36;1m *)[0m | |
| 2025-06-24T03:52:33.9630744Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T03:52:33.9631787Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9632540Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9633388Z [36;1m esac[0m | |
| 2025-06-24T03:52:33.9634085Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9634755Z [36;1m[0m | |
| 2025-06-24T03:52:33.9635418Z [36;1m macOS|macos)[0m | |
| 2025-06-24T03:52:33.9636191Z [36;1m case X64 in[0m | |
| 2025-06-24T03:52:33.9636991Z [36;1m X64|amd64)[0m | |
| 2025-06-24T03:52:33.9637910Z [36;1m bootstrap_filename='cosign-darwin-amd64'[0m | |
| 2025-06-24T03:52:33.9639094Z [36;1m bootstrap_sha=${bootstrap_darwin_amd64_sha}[0m | |
| 2025-06-24T03:52:33.9640321Z [36;1m desired_cosign_filename='cosign-darwin-amd64'[0m | |
| 2025-06-24T03:52:33.9641702Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T03:52:33.9643103Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9644377Z [36;1m desired_cosign_filename='cosign_darwin_amd64_0.6.0_darwin_amd64'[0m | |
| 2025-06-24T03:52:33.9646040Z [36;1m desired_cosign_v060_signature='cosign_darwin_amd64_0.6.0_darwin_amd64.sig'[0m | |
| 2025-06-24T03:52:33.9647362Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9648086Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9648809Z [36;1m[0m | |
| 2025-06-24T03:52:33.9649479Z [36;1m ARM64|arm64)[0m | |
| 2025-06-24T03:52:33.9650429Z [36;1m bootstrap_filename='cosign-darwin-arm64'[0m | |
| 2025-06-24T03:52:33.9651625Z [36;1m bootstrap_sha=${bootstrap_darwin_arm64_sha}[0m | |
| 2025-06-24T03:52:33.9652845Z [36;1m desired_cosign_filename='cosign-darwin-arm64'[0m | |
| 2025-06-24T03:52:33.9654326Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T03:52:33.9655765Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9657210Z [36;1m desired_cosign_filename='cosign_darwin_arm64_0.6.0_darwin_arm64'[0m | |
| 2025-06-24T03:52:33.9659098Z [36;1m desired_cosign_v060_signature='cosign_darwin_arm64_0.6.0_darwin_arm64.sig'[0m | |
| 2025-06-24T03:52:33.9660432Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9661145Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9661858Z [36;1m[0m | |
| 2025-06-24T03:52:33.9662495Z [36;1m *)[0m | |
| 2025-06-24T03:52:33.9663460Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T03:52:33.9664481Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9665250Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9665967Z [36;1m esac[0m | |
| 2025-06-24T03:52:33.9666643Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9667323Z [36;1m[0m | |
| 2025-06-24T03:52:33.9667997Z [36;1m Windows|windows)[0m | |
| 2025-06-24T03:52:33.9668824Z [36;1m case X64 in[0m | |
| 2025-06-24T03:52:33.9669608Z [36;1m X64|amd64)[0m | |
| 2025-06-24T03:52:33.9670579Z [36;1m bootstrap_filename='cosign-windows-amd64.exe'[0m | |
| 2025-06-24T03:52:33.9671806Z [36;1m bootstrap_sha=${bootstrap_windows_amd64_sha}[0m | |
| 2025-06-24T03:52:33.9673169Z [36;1m desired_cosign_filename='cosign-windows-amd64.exe'[0m | |
| 2025-06-24T03:52:33.9674387Z [36;1m cosign_executable_name=cosign.exe[0m | |
| 2025-06-24T03:52:33.9675672Z [36;1m # v0.6.0 had different filename structures from all other releases[0m | |
| 2025-06-24T03:52:33.9676956Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9678272Z [36;1m desired_cosign_filename='cosign_windows_amd64_0.6.0_windows_amd64.exe'[0m | |
| 2025-06-24T03:52:33.9680227Z [36;1m desired_cosign_v060_signature='cosign_windows_amd64_0.6.0_windows_amd64.exe.sig'[0m | |
| 2025-06-24T03:52:33.9681612Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9682329Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9683164Z [36;1m *)[0m | |
| 2025-06-24T03:52:33.9684006Z [36;1m log_error "unsupported architecture X64"[0m | |
| 2025-06-24T03:52:33.9685031Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9685786Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9686505Z [36;1m esac[0m | |
| 2025-06-24T03:52:33.9687178Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9687851Z [36;1m *)[0m | |
| 2025-06-24T03:52:33.9688740Z [36;1m log_error "unsupported os Linux"[0m | |
| 2025-06-24T03:52:33.9689698Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9690412Z [36;1m ;;[0m | |
| 2025-06-24T03:52:33.9691082Z [36;1mesac[0m | |
| 2025-06-24T03:52:33.9691748Z [36;1m[0m | |
| 2025-06-24T03:52:33.9692386Z [36;1mSUDO=[0m | |
| 2025-06-24T03:52:33.9693427Z [36;1mif [[ "false" == "true" ]] && command -v sudo >/dev/null; then[0m | |
| 2025-06-24T03:52:33.9694546Z [36;1m SUDO=sudo[0m | |
| 2025-06-24T03:52:33.9695262Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9695904Z [36;1m[0m | |
| 2025-06-24T03:52:33.9696779Z [36;1mexpected_bootstrap_version_digest=${bootstrap_sha}[0m | |
| 2025-06-24T03:52:33.9699760Z [36;1mlog_info "Downloading bootstrap version '${bootstrap_version}' of cosign to verify version to be installed...\n https://github.com/sigstore/cosign/releases/download/${bootstrap_version}/${bootstrap_filename}"[0m | |
| 2025-06-24T03:52:33.9703779Z [36;1m$SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/${bootstrap_version}/${bootstrap_filename} -o ${cosign_executable_name}[0m | |
| 2025-06-24T03:52:33.9706093Z [36;1mshaBootstrap=$(shaprog ${cosign_executable_name});[0m | |
| 2025-06-24T03:52:33.9707519Z [36;1mif [[ $shaBootstrap != ${expected_bootstrap_version_digest} ]]; then[0m | |
| 2025-06-24T03:52:33.9708967Z [36;1m log_error "Unable to validate cosign version: 'v2.4.1'"[0m | |
| 2025-06-24T03:52:33.9710081Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9710771Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9711548Z [36;1m$SUDO chmod +x ${cosign_executable_name}[0m | |
| 2025-06-24T03:52:33.9712502Z [36;1m[0m | |
| 2025-06-24T03:52:33.9713653Z [36;1m# If the bootstrap and specified `cosign` releases are the same, we're done.[0m | |
| 2025-06-24T03:52:33.9715083Z [36;1mif [[ v2.4.1 == ${bootstrap_version} ]]; then[0m | |
| 2025-06-24T03:52:33.9716807Z [36;1m log_info "bootstrap version successfully verified and matches requested version so nothing else to do"[0m | |
| 2025-06-24T03:52:33.9718418Z [36;1m exit 0[0m | |
| 2025-06-24T03:52:33.9719105Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9719755Z [36;1m[0m | |
| 2025-06-24T03:52:33.9720584Z [36;1msemver='^v([0-9]+\.){0,2}(\*|[0-9]+)(-?r?c?)(\.[0-9]+)$'[0m | |
| 2025-06-24T03:52:33.9721672Z [36;1mif [[ v2.4.1 =~ $semver ]]; then[0m | |
| 2025-06-24T03:52:33.9722760Z [36;1m log_info "Custom cosign version 'v2.4.1' requested"[0m | |
| 2025-06-24T03:52:33.9723910Z [36;1melse[0m | |
| 2025-06-24T03:52:33.9724901Z [36;1m log_error "Unable to validate requested cosign version: 'v2.4.1'"[0m | |
| 2025-06-24T03:52:33.9726119Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9726795Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9727443Z [36;1m[0m | |
| 2025-06-24T03:52:33.9728124Z [36;1m# Download custom cosign[0m | |
| 2025-06-24T03:52:33.9730341Z [36;1mlog_info "Downloading platform-specific version 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}"[0m | |
| 2025-06-24T03:52:33.9733616Z [36;1m$SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename} -o cosign_v2.4.1[0m | |
| 2025-06-24T03:52:33.9735733Z [36;1mshaCustom=$(shaprog cosign_v2.4.1);[0m | |
| 2025-06-24T03:52:33.9758582Z [36;1m[0m | |
| 2025-06-24T03:52:33.9759399Z [36;1m# same hash means it is the same release[0m | |
| 2025-06-24T03:52:33.9760520Z [36;1mif [[ $shaCustom != $shaBootstrap ]]; then[0m | |
| 2025-06-24T03:52:33.9761654Z [36;1m if [[ v2.4.1 == 'v0.6.0' && Linux == 'Linux' ]]; then[0m | |
| 2025-06-24T03:52:33.9762917Z [36;1m # v0.6.0's linux release has a dependency on `libpcsclite1`[0m | |
| 2025-06-24T03:52:33.9764660Z [36;1m log_info "Installing libpcsclite1 package if necessary..."[0m | |
| 2025-06-24T03:52:33.9765819Z [36;1m set +e[0m | |
| 2025-06-24T03:52:33.9766602Z [36;1m sudo dpkg -s libpcsclite1[0m | |
| 2025-06-24T03:52:33.9767580Z [36;1m if [ $? -eq 0 ]; then[0m | |
| 2025-06-24T03:52:33.9768651Z [36;1m log_info "libpcsclite1 package is already installed"[0m | |
| 2025-06-24T03:52:33.9769748Z [36;1m else[0m | |
| 2025-06-24T03:52:33.9770835Z [36;1m log_info "libpcsclite1 package is not installed, installing it now."[0m | |
| 2025-06-24T03:52:33.9772331Z [36;1m sudo apt-get update -q -q[0m | |
| 2025-06-24T03:52:33.9773532Z [36;1m sudo apt-get install -yq libpcsclite1[0m | |
| 2025-06-24T03:52:33.9774521Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9775205Z [36;1m set -e[0m | |
| 2025-06-24T03:52:33.9775918Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9776579Z [36;1m[0m | |
| 2025-06-24T03:52:33.9777278Z [36;1m if [[ v2.4.1 == 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9779778Z [36;1m log_info "Downloading detached signature for platform-specific 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_v060_signature}"[0m | |
| 2025-06-24T03:52:33.9783501Z [36;1m $SUDO curl -fsL https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_v060_signature} -o ${desired_cosign_filename}.sig[0m | |
| 2025-06-24T03:52:33.9785572Z [36;1m else[0m | |
| 2025-06-24T03:52:33.9787785Z [36;1m log_info "Downloading detached signature for platform-specific 'v2.4.1' of cosign...\n https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}.sig"[0m | |
| 2025-06-24T03:52:33.9791041Z [36;1m $SUDO curl -fsLO https://github.com/sigstore/cosign/releases/download/v2.4.1/${desired_cosign_filename}.sig[0m | |
| 2025-06-24T03:52:33.9792744Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9793505Z [36;1m[0m | |
| 2025-06-24T03:52:33.9794206Z [36;1m if [[ v2.4.1 < 'v0.6.0' ]]; then[0m | |
| 2025-06-24T03:52:33.9796302Z [36;1m log_info "Downloading cosign public key 'v2.4.1' of cosign...\n https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/.github/workflows/cosign.pub"[0m | |
| 2025-06-24T03:52:33.9799204Z [36;1m RELEASE_COSIGN_PUB_KEY=https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/.github/workflows/cosign.pub[0m | |
| 2025-06-24T03:52:33.9801582Z [36;1m RELEASE_COSIGN_PUB_KEY_SHA='4aa4bd19530a4929d758a9896255aef2c82f1a3a9f4b000034c6df4307c14f9e'[0m | |
| 2025-06-24T03:52:33.9803251Z [36;1m else[0m | |
| 2025-06-24T03:52:33.9805120Z [36;1m log_info "Downloading cosign public key 'v2.4.1' of cosign...\n https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/release/release-cosign.pub"[0m | |
| 2025-06-24T03:52:33.9807989Z [36;1m RELEASE_COSIGN_PUB_KEY=https://raw.githubusercontent.com/sigstore/cosign/v2.4.1/release/release-cosign.pub[0m | |
| 2025-06-24T03:52:33.9810329Z [36;1m RELEASE_COSIGN_PUB_KEY_SHA='f4cea466e5e887a45da5031757fa1d32655d83420639dc1758749b744179f126'[0m | |
| 2025-06-24T03:52:33.9811862Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9812519Z [36;1m[0m | |
| 2025-06-24T03:52:33.9813522Z [36;1m log_info "Verifying public key matches expected value"[0m | |
| 2025-06-24T03:52:33.9814846Z [36;1m $SUDO curl -fsL $RELEASE_COSIGN_PUB_KEY -o public.key[0m | |
| 2025-06-24T03:52:33.9816034Z [36;1m sha_fetched_key=$(shaprog public.key)[0m | |
| 2025-06-24T03:52:33.9817234Z [36;1m if [[ $sha_fetched_key != $RELEASE_COSIGN_PUB_KEY_SHA ]]; then[0m | |
| 2025-06-24T03:52:33.9818715Z [36;1m log_error "Fetched public key does not match expected digest, exiting"[0m | |
| 2025-06-24T03:52:33.9819977Z [36;1m exit 1[0m | |
| 2025-06-24T03:52:33.9820691Z [36;1m fi[0m | |
| 2025-06-24T03:52:33.9821345Z [36;1m[0m | |
| 2025-06-24T03:52:33.9822437Z [36;1m log_info "Using bootstrap cosign to verify signature of desired cosign version"[0m | |
| 2025-06-24T03:52:33.9824759Z [36;1m ./cosign verify-blob --insecure-ignore-tlog --key public.key --signature ${desired_cosign_filename}.sig cosign_v2.4.1[0m | |
| 2025-06-24T03:52:33.9826497Z [36;1m[0m | |
| 2025-06-24T03:52:33.9827305Z [36;1m $SUDO rm cosign[0m | |
| 2025-06-24T03:52:33.9828254Z [36;1m $SUDO mv cosign_v2.4.1 ${cosign_executable_name}[0m | |
| 2025-06-24T03:52:33.9829377Z [36;1m $SUDO chmod +x ${cosign_executable_name}[0m | |
| 2025-06-24T03:52:33.9830440Z [36;1m log_info "Installation complete!"[0m | |
| 2025-06-24T03:52:33.9831359Z [36;1mfi[0m | |
| 2025-06-24T03:52:33.9938166Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T03:52:33.9939270Z env: | |
| 2025-06-24T03:52:33.9940117Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9941663Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:33.9943201Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9944447Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9945700Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:33.9946959Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:33.9948030Z ##[endgroup] | |
| 2025-06-24T03:52:34.0079978Z [1;32mINFO[0m: Downloading bootstrap version 'v2.4.1' of cosign to verify version to be installed... | |
| 2025-06-24T03:52:34.0082525Z https://github.com/sigstore/cosign/releases/download/v2.4.1/cosign-linux-amd64 | |
| 2025-06-24T03:52:34.6519548Z [1;32mINFO[0m: bootstrap version successfully verified and matches requested version so nothing else to do | |
| 2025-06-24T03:52:34.6569824Z ##[group]Run echo "$HOME/.cosign" >> $GITHUB_PATH | |
| 2025-06-24T03:52:34.6570257Z [36;1mecho "$HOME/.cosign" >> $GITHUB_PATH[0m | |
| 2025-06-24T03:52:34.6633834Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T03:52:34.6634253Z env: | |
| 2025-06-24T03:52:34.6634586Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6635077Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:34.6635570Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6636026Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6636496Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6636940Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:34.6637319Z ##[endgroup] | |
| 2025-06-24T03:52:34.6766884Z ##[group]Run cd $GITHUB_ACTION_PATH \ | |
| 2025-06-24T03:52:34.6767261Z [36;1mcd $GITHUB_ACTION_PATH \[0m | |
| 2025-06-24T03:52:34.6767573Z [36;1m&& ./ct.sh \[0m | |
| 2025-06-24T03:52:34.6767876Z [36;1m --version 3.12.0 \[0m | |
| 2025-06-24T03:52:34.6768203Z [36;1m --yamllint-version 1.33.0 \[0m | |
| 2025-06-24T03:52:34.6768564Z [36;1m --yamale-version 4.0.4[0m | |
| 2025-06-24T03:52:34.6829833Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T03:52:34.6830243Z env: | |
| 2025-06-24T03:52:34.6830565Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6831071Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:34.6831571Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6832030Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6832483Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:34.6833148Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:34.6833561Z ##[endgroup] | |
| 2025-06-24T03:52:34.6969561Z Installing chart-testing v3.12.0... | |
| 2025-06-24T03:52:35.6497971Z Verified OK | |
| 2025-06-24T03:52:35.7443326Z Creating virtual Python environment... | |
| 2025-06-24T03:52:38.2943409Z Activating virtual environment... | |
| 2025-06-24T03:52:38.2961573Z Installing yamllint... | |
| 2025-06-24T03:52:38.7290234Z Collecting yamllint==1.33.0 | |
| 2025-06-24T03:52:38.7758679Z Downloading yamllint-1.33.0-py3-none-any.whl.metadata (4.2 kB) | |
| 2025-06-24T03:52:38.7962178Z Collecting pathspec>=0.5.3 (from yamllint==1.33.0) | |
| 2025-06-24T03:52:38.8040157Z Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) | |
| 2025-06-24T03:52:38.8545721Z Collecting pyyaml (from yamllint==1.33.0) | |
| 2025-06-24T03:52:38.8626434Z Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB) | |
| 2025-06-24T03:52:38.8741460Z Downloading yamllint-1.33.0-py3-none-any.whl (65 kB) | |
| 2025-06-24T03:52:38.8935095Z Downloading pathspec-0.12.1-py3-none-any.whl (31 kB) | |
| 2025-06-24T03:52:38.9033539Z Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (759 kB) | |
| 2025-06-24T03:52:38.9269289Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 759.5/759.5 kB 37.2 MB/s eta 0:00:00 | |
| 2025-06-24T03:52:38.9400917Z Installing collected packages: pyyaml, pathspec, yamllint | |
| 2025-06-24T03:52:39.0445888Z | |
| 2025-06-24T03:52:39.0458254Z Successfully installed pathspec-0.12.1 pyyaml-6.0.2 yamllint-1.33.0 | |
| 2025-06-24T03:52:39.1789502Z Installing Yamale... | |
| 2025-06-24T03:52:39.6035783Z Collecting yamale==4.0.4 | |
| 2025-06-24T03:52:39.6534946Z Downloading yamale-4.0.4-py3-none-any.whl.metadata (20 kB) | |
| 2025-06-24T03:52:39.6624841Z Requirement already satisfied: pyyaml in /opt/hostedtoolcache/ct/3.12.0/amd64/venv/lib/python3.13/site-packages (from yamale==4.0.4) (6.0.2) | |
| 2025-06-24T03:52:39.6706671Z Downloading yamale-4.0.4-py3-none-any.whl (55 kB) | |
| 2025-06-24T03:52:39.6915521Z Installing collected packages: yamale | |
| 2025-06-24T03:52:39.7349156Z Successfully installed yamale-4.0.4 | |
| 2025-06-24T03:52:39.7787669Z Adding ct directory to PATH... | |
| 2025-06-24T03:52:39.7789098Z Setting CT_CONFIG_DIR... | |
| 2025-06-24T03:52:39.7789928Z Configuring environment variables for virtual environment for subsequent workflow steps... | |
| 2025-06-24T03:52:39.7812362Z Version: v3.12.0 | |
| 2025-06-24T03:52:39.7814687Z Git commit: d6991035017d7ac0e3dec3d1b5ad2e5f18674b32 | |
| 2025-06-24T03:52:39.7815482Z Date: 2025-01-13T12:22:07Z | |
| 2025-06-24T03:52:39.7815831Z License: Apache 2.0 | |
| 2025-06-24T03:52:39.7860609Z ##[group]Run changed=$(ct list-changed --target-branch "$TARGET_BRANCH") | |
| 2025-06-24T03:52:39.7861144Z [36;1mchanged=$(ct list-changed --target-branch "$TARGET_BRANCH")[0m | |
| 2025-06-24T03:52:39.7861479Z [36;1mif [[ -n "$changed" ]]; then[0m | |
| 2025-06-24T03:52:39.7861771Z [36;1m echo "changed=true" >> "$GITHUB_OUTPUT"[0m | |
| 2025-06-24T03:52:39.7862021Z [36;1mfi[0m | |
| 2025-06-24T03:52:39.7922000Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T03:52:39.7922258Z env: | |
| 2025-06-24T03:52:39.7922513Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.7923085Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:39.7923726Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.7924197Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.7924565Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.7924969Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:39.7925321Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:52:39.7925681Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:52:39.7925976Z TARGET_BRANCH: main | |
| 2025-06-24T03:52:39.7926171Z ##[endgroup] | |
| 2025-06-24T03:52:39.8416150Z ##[group]Run helm repo add ingress-nginx "https://kubernetes.github.io/ingress-nginx" | |
| 2025-06-24T03:52:39.8416762Z [36;1mhelm repo add ingress-nginx "https://kubernetes.github.io/ingress-nginx"[0m | |
| 2025-06-24T03:52:39.8417270Z [36;1mhelm repo add bitnami "https://charts.bitnami.com/bitnami"[0m | |
| 2025-06-24T03:52:39.8417629Z [36;1mhelm repo update[0m | |
| 2025-06-24T03:52:39.8475971Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T03:52:39.8476210Z env: | |
| 2025-06-24T03:52:39.8476460Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.8476904Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:39.8477286Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.8477637Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.8477976Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:39.8478320Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:39.8478868Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:52:39.8479188Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:52:39.8479462Z ##[endgroup] | |
| 2025-06-24T03:52:39.9398453Z "ingress-nginx" has been added to your repositories | |
| 2025-06-24T03:52:42.6156415Z "bitnami" has been added to your repositories | |
| 2025-06-24T03:52:42.6500292Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T03:52:42.7110447Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T03:52:45.2537595Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T03:52:45.2538386Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T03:52:45.2699116Z ##[group]Run helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3 | |
| 2025-06-24T03:52:45.2699491Z with: | |
| 2025-06-24T03:52:45.2699707Z config: helpers/kind-testing/kind-config.yaml | |
| 2025-06-24T03:52:45.2699974Z version: v0.26.0 | |
| 2025-06-24T03:52:45.2700164Z cluster_name: chart-testing | |
| 2025-06-24T03:52:45.2700387Z wait: 60s | |
| 2025-06-24T03:52:45.2700543Z verbosity: 0 | |
| 2025-06-24T03:52:45.2700718Z kubectl_version: v1.31.4 | |
| 2025-06-24T03:52:45.2700916Z registry: false | |
| 2025-06-24T03:52:45.2701104Z registry_image: registry:2 | |
| 2025-06-24T03:52:45.2701324Z registry_name: kind-registry | |
| 2025-06-24T03:52:45.2701530Z registry_port: 5000 | |
| 2025-06-24T03:52:45.2701729Z registry_enable_delete: false | |
| 2025-06-24T03:52:45.2701942Z ignore_failed_clean: false | |
| 2025-06-24T03:52:45.2702138Z env: | |
| 2025-06-24T03:52:45.2702359Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:45.2702745Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:52:45.2703393Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:45.2703742Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:45.2704072Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:52:45.2704404Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:52:45.2704731Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:52:45.2705045Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:52:45.2705303Z ##[endgroup] | |
| 2025-06-24T03:52:45.3025679Z Installing kind... | |
| 2025-06-24T03:52:45.3041484Z /opt/hostedtoolcache/kind/v0.26.0/amd64/kind/bin ~/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T03:52:45.7099592Z kind-linux-amd64: OK | |
| 2025-06-24T03:52:45.7138398Z ~/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T03:52:45.7139061Z Adding kind directory to PATH... | |
| 2025-06-24T03:52:45.7139392Z Installing kubectl... | |
| 2025-06-24T03:52:46.0815402Z Adding kubectl directory to PATH... | |
| 2025-06-24T03:52:46.0836141Z kind v0.26.0 go1.23.4 linux/amd64 | |
| 2025-06-24T03:52:46.1178982Z Client Version: v1.31.4 | |
| 2025-06-24T03:52:46.1179387Z Kustomize Version: v5.4.2 | |
| 2025-06-24T03:52:46.1195441Z Creating kind cluster... | |
| 2025-06-24T03:52:46.3921116Z Creating cluster "chart-testing" ... | |
| 2025-06-24T03:52:46.3921937Z • Ensuring node image (kindest/node:v1.30.0) 🖼 ... | |
| 2025-06-24T03:52:55.5399961Z ✓ Ensuring node image (kindest/node:v1.30.0) 🖼 | |
| 2025-06-24T03:52:55.5400428Z • Preparing nodes 📦 ... | |
| 2025-06-24T03:52:57.4187814Z ✓ Preparing nodes 📦 | |
| 2025-06-24T03:52:57.4442448Z • Writing configuration 📜 ... | |
| 2025-06-24T03:52:57.6130397Z ✓ Writing configuration 📜 | |
| 2025-06-24T03:52:57.6130920Z • Starting control-plane 🕹️ ... | |
| 2025-06-24T03:53:08.4017335Z ✓ Starting control-plane 🕹️ | |
| 2025-06-24T03:53:08.4017694Z • Installing CNI 🔌 ... | |
| 2025-06-24T03:53:08.6897049Z ✓ Installing CNI 🔌 | |
| 2025-06-24T03:53:08.6897549Z • Installing StorageClass 💾 ... | |
| 2025-06-24T03:53:08.9814454Z ✓ Installing StorageClass 💾 | |
| 2025-06-24T03:53:09.0071211Z • Waiting ≤ 1m0s for control-plane = Ready ⏳ ... | |
| 2025-06-24T03:53:26.0629216Z ✓ Waiting ≤ 1m0s for control-plane = Ready ⏳ | |
| 2025-06-24T03:53:26.0629826Z • Ready after 17s 💚 | |
| 2025-06-24T03:53:26.1858962Z Set kubectl context to "kind-chart-testing" | |
| 2025-06-24T03:53:26.1859500Z You can now use your cluster with: | |
| 2025-06-24T03:53:26.1860106Z | |
| 2025-06-24T03:53:26.1860324Z kubectl cluster-info --context kind-chart-testing | |
| 2025-06-24T03:53:26.1860680Z | |
| 2025-06-24T03:53:26.1861044Z Have a nice day! 👋 | |
| 2025-06-24T03:53:26.1958104Z ##[group]Run export defaultScProvisioner=$(kubectl get storageclass -o jsonpath='{.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=="true")].provisioner}') | |
| 2025-06-24T03:53:26.1959346Z [36;1mexport defaultScProvisioner=$(kubectl get storageclass -o jsonpath='{.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=="true")].provisioner}')[0m | |
| 2025-06-24T03:53:26.1960111Z [36;1mif [[ -z "$defaultScProvisioner" ]]; then[0m | |
| 2025-06-24T03:53:26.1960817Z [36;1m echo "No default storage class found or it has no provisioner. Exiting early because the test using the custom Storage Class will likely fail. Use a cluster that has a default storage class."[0m | |
| 2025-06-24T03:53:26.1961472Z [36;1m exit 1[0m | |
| 2025-06-24T03:53:26.1961661Z [36;1mfi[0m | |
| 2025-06-24T03:53:26.1961910Z [36;1mecho "[INFO] defaultScProvisioner=$defaultScProvisioner"[0m | |
| 2025-06-24T03:53:26.1962213Z [36;1m[0m | |
| 2025-06-24T03:53:26.1962428Z [36;1mcat <<EOF | kubectl apply -f -[0m | |
| 2025-06-24T03:53:26.1962684Z [36;1mapiVersion: storage.k8s.io/v1[0m | |
| 2025-06-24T03:53:26.1963121Z [36;1mkind: StorageClass[0m | |
| 2025-06-24T03:53:26.1963365Z [36;1mmetadata:[0m | |
| 2025-06-24T03:53:26.1963564Z [36;1m name: custom-sc[0m | |
| 2025-06-24T03:53:26.1963895Z [36;1m# same provisioner as the one used by the default storage class on the cluster[0m | |
| 2025-06-24T03:53:26.1964274Z [36;1mprovisioner: $defaultScProvisioner[0m | |
| 2025-06-24T03:53:26.1964537Z [36;1mreclaimPolicy: Delete[0m | |
| 2025-06-24T03:53:26.1964788Z [36;1mvolumeBindingMode: WaitForFirstConsumer[0m | |
| 2025-06-24T03:53:26.1965047Z [36;1mEOF[0m | |
| 2025-06-24T03:53:26.1965201Z [36;1m[0m | |
| 2025-06-24T03:53:26.1965404Z [36;1mkubectl get storageclass custom-sc -o yaml[0m | |
| 2025-06-24T03:53:26.2024789Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T03:53:26.2025022Z env: | |
| 2025-06-24T03:53:26.2025267Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.2025658Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:53:26.2026036Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.2026363Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.2026717Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.2027072Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:53:26.2027394Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:53:26.2027710Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:53:26.2027971Z ##[endgroup] | |
| 2025-06-24T03:53:26.2698965Z [INFO] defaultScProvisioner=rancher.io/local-path | |
| 2025-06-24T03:53:26.3510795Z storageclass.storage.k8s.io/custom-sc created | |
| 2025-06-24T03:53:26.4416279Z apiVersion: storage.k8s.io/v1 | |
| 2025-06-24T03:53:26.4416900Z kind: StorageClass | |
| 2025-06-24T03:53:26.4417237Z metadata: | |
| 2025-06-24T03:53:26.4417510Z annotations: | |
| 2025-06-24T03:53:26.4418089Z kubectl.kubernetes.io/last-applied-configuration: | | |
| 2025-06-24T03:53:26.4431076Z {"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"custom-sc"},"provisioner":"rancher.io/local-path","reclaimPolicy":"Delete","volumeBindingMode":"WaitForFirstConsumer"} | |
| 2025-06-24T03:53:26.4432502Z creationTimestamp: "2025-06-24T03:53:26Z" | |
| 2025-06-24T03:53:26.4433117Z name: custom-sc | |
| 2025-06-24T03:53:26.4433461Z resourceVersion: "420" | |
| 2025-06-24T03:53:26.4433874Z uid: feed3ac4-319a-4847-8581-84da58f321e9 | |
| 2025-06-24T03:53:26.4434357Z provisioner: rancher.io/local-path | |
| 2025-06-24T03:53:26.4434778Z reclaimPolicy: Delete | |
| 2025-06-24T03:53:26.4435188Z volumeBindingMode: WaitForFirstConsumer | |
| 2025-06-24T03:53:26.4505478Z ##[group]Run helm install ingress-nginx/ingress-nginx --generate-name \ | |
| 2025-06-24T03:53:26.4506510Z [36;1mhelm install ingress-nginx/ingress-nginx --generate-name \[0m | |
| 2025-06-24T03:53:26.4507664Z [36;1m --set controller.service.type='NodePort' \[0m | |
| 2025-06-24T03:53:26.4508242Z [36;1m --set controller.admissionWebhooks.enabled=false[0m | |
| 2025-06-24T03:53:26.4594767Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T03:53:26.4595401Z env: | |
| 2025-06-24T03:53:26.4596041Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.4596997Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:53:26.4597888Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.4598694Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.4599541Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:26.4600400Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:53:26.4601263Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:53:26.4602070Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:53:26.4602796Z ##[endgroup] | |
| 2025-06-24T03:53:27.6211010Z NAME: ingress-nginx-1750737206 | |
| 2025-06-24T03:53:27.6211509Z LAST DEPLOYED: Tue Jun 24 03:53:26 2025 | |
| 2025-06-24T03:53:27.6211928Z NAMESPACE: default | |
| 2025-06-24T03:53:27.6212381Z STATUS: deployed | |
| 2025-06-24T03:53:27.6212684Z REVISION: 1 | |
| 2025-06-24T03:53:27.6213213Z TEST SUITE: None | |
| 2025-06-24T03:53:27.6213510Z NOTES: | |
| 2025-06-24T03:53:27.6213868Z The ingress-nginx controller has been installed. | |
| 2025-06-24T03:53:27.6214407Z Get the application URL by running these commands: | |
| 2025-06-24T03:53:27.6215446Z export HTTP_NODE_PORT=$(kubectl get service --namespace default ingress-nginx-1750737206-controller --output jsonpath="{.spec.ports[0].nodePort}") | |
| 2025-06-24T03:53:27.6217108Z export HTTPS_NODE_PORT=$(kubectl get service --namespace default ingress-nginx-1750737206-controller --output jsonpath="{.spec.ports[1].nodePort}") | |
| 2025-06-24T03:53:27.6218601Z export NODE_IP="$(kubectl get nodes --output jsonpath="{.items[0].status.addresses[1].address}")" | |
| 2025-06-24T03:53:27.6219208Z | |
| 2025-06-24T03:53:27.6219592Z echo "Visit http://${NODE_IP}:${HTTP_NODE_PORT} to access your application via HTTP." | |
| 2025-06-24T03:53:27.6220457Z echo "Visit https://${NODE_IP}:${HTTPS_NODE_PORT} to access your application via HTTPS." | |
| 2025-06-24T03:53:27.6220971Z | |
| 2025-06-24T03:53:27.6221185Z An example Ingress that makes use of the controller: | |
| 2025-06-24T03:53:27.6221696Z apiVersion: networking.k8s.io/v1 | |
| 2025-06-24T03:53:27.6222039Z kind: Ingress | |
| 2025-06-24T03:53:27.6222295Z metadata: | |
| 2025-06-24T03:53:27.6222534Z name: example | |
| 2025-06-24T03:53:27.6222806Z namespace: foo | |
| 2025-06-24T03:53:27.6223261Z spec: | |
| 2025-06-24T03:53:27.6223523Z ingressClassName: nginx | |
| 2025-06-24T03:53:27.6223868Z rules: | |
| 2025-06-24T03:53:27.6224146Z - host: www.example.com | |
| 2025-06-24T03:53:27.6224533Z http: | |
| 2025-06-24T03:53:27.6224827Z paths: | |
| 2025-06-24T03:53:27.6225166Z - pathType: Prefix | |
| 2025-06-24T03:53:27.6225546Z backend: | |
| 2025-06-24T03:53:27.6225883Z service: | |
| 2025-06-24T03:53:27.6226238Z name: exampleService | |
| 2025-06-24T03:53:27.6226634Z port: | |
| 2025-06-24T03:53:27.6226958Z number: 80 | |
| 2025-06-24T03:53:27.6227305Z path: / | |
| 2025-06-24T03:53:27.6227794Z # This section is only required if TLS is to be enabled for the Ingress | |
| 2025-06-24T03:53:27.6228345Z tls: | |
| 2025-06-24T03:53:27.6228621Z - hosts: | |
| 2025-06-24T03:53:27.6228918Z - www.example.com | |
| 2025-06-24T03:53:27.6229274Z secretName: example-tls | |
| 2025-06-24T03:53:27.6229513Z | |
| 2025-06-24T03:53:27.6229954Z If TLS is enabled for the Ingress, a Secret containing the certificate and key must also be provided: | |
| 2025-06-24T03:53:27.6230527Z | |
| 2025-06-24T03:53:27.6230643Z apiVersion: v1 | |
| 2025-06-24T03:53:27.6231275Z kind: Secret | |
| 2025-06-24T03:53:27.6231568Z metadata: | |
| 2025-06-24T03:53:27.6231856Z name: example-tls | |
| 2025-06-24T03:53:27.6232167Z namespace: foo | |
| 2025-06-24T03:53:27.6244698Z data: | |
| 2025-06-24T03:53:27.6245004Z tls.crt: <base64 encoded cert> | |
| 2025-06-24T03:53:27.6245432Z tls.key: <base64 encoded key> | |
| 2025-06-24T03:53:27.6245833Z type: kubernetes.io/tls | |
| 2025-06-24T03:53:27.6335599Z ##[group]Run curl -L "https://github.com/operator-framework/operator-lifecycle-manager/releases/download/${OLM_VERSION}/install.sh" -o install-olm.sh | |
| 2025-06-24T03:53:27.6337900Z [36;1mcurl -L "https://github.com/operator-framework/operator-lifecycle-manager/releases/download/${OLM_VERSION}/install.sh" -o install-olm.sh[0m | |
| 2025-06-24T03:53:27.6339578Z [36;1mchmod +x install-olm.sh[0m | |
| 2025-06-24T03:53:27.6340293Z [36;1m./install-olm.sh "${OLM_VERSION}"[0m | |
| 2025-06-24T03:53:27.6439637Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T03:53:27.6439879Z env: | |
| 2025-06-24T03:53:27.6440124Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:27.6440533Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:53:27.6440946Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:27.6441285Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:27.6441644Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:27.6441981Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:53:27.6442310Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:53:27.6442612Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:53:27.6442881Z OLM_VERSION: v0.31.0 | |
| 2025-06-24T03:53:27.6443357Z ##[endgroup] | |
| 2025-06-24T03:53:27.6637722Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T03:53:27.6638488Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T03:53:27.6638860Z | |
| 2025-06-24T03:53:27.8344418Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T03:53:27.8346323Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T03:53:27.8916468Z | |
| 2025-06-24T03:53:27.8916801Z 100 1886 100 1886 0 0 8246 0 --:--:-- --:--:-- --:--:-- 8246 | |
| 2025-06-24T03:53:28.2475359Z customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com created | |
| 2025-06-24T03:53:28.4047096Z customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com created | |
| 2025-06-24T03:53:28.4175273Z customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com created | |
| 2025-06-24T03:53:28.4256217Z customresourcedefinition.apiextensions.k8s.io/olmconfigs.operators.coreos.com created | |
| 2025-06-24T03:53:28.4403984Z customresourcedefinition.apiextensions.k8s.io/operatorconditions.operators.coreos.com created | |
| 2025-06-24T03:53:28.4655757Z customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com created | |
| 2025-06-24T03:53:28.4859118Z customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com created | |
| 2025-06-24T03:53:28.5836812Z customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com created | |
| 2025-06-24T03:53:28.9134273Z customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.1307876Z customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.2380569Z customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.3443901Z customresourcedefinition.apiextensions.k8s.io/olmconfigs.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.4499636Z customresourcedefinition.apiextensions.k8s.io/operatorconditions.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.5626592Z customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.6681429Z customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com condition met | |
| 2025-06-24T03:53:29.8044659Z customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com condition met | |
| 2025-06-24T03:53:30.0974354Z namespace/olm created | |
| 2025-06-24T03:53:30.1563830Z namespace/operators created | |
| 2025-06-24T03:53:30.2118214Z serviceaccount/olm-operator-serviceaccount created | |
| 2025-06-24T03:53:30.2302752Z clusterrole.rbac.authorization.k8s.io/system:controller:operator-lifecycle-manager created | |
| 2025-06-24T03:53:30.2398911Z clusterrolebinding.rbac.authorization.k8s.io/olm-operator-binding-olm created | |
| 2025-06-24T03:53:30.2731581Z olmconfig.operators.coreos.com/cluster created | |
| 2025-06-24T03:53:30.3094549Z deployment.apps/olm-operator created | |
| 2025-06-24T03:53:30.3516020Z deployment.apps/catalog-operator created | |
| 2025-06-24T03:53:30.3698349Z clusterrole.rbac.authorization.k8s.io/aggregate-olm-edit created | |
| 2025-06-24T03:53:30.3998596Z clusterrole.rbac.authorization.k8s.io/aggregate-olm-view created | |
| 2025-06-24T03:53:30.4382022Z operatorgroup.operators.coreos.com/global-operators created | |
| 2025-06-24T03:53:30.4481995Z operatorgroup.operators.coreos.com/olm-operators created | |
| 2025-06-24T03:53:30.5204481Z clusterserviceversion.operators.coreos.com/packageserver created | |
| 2025-06-24T03:53:30.5611374Z catalogsource.operators.coreos.com/operatorhubio-catalog created | |
| 2025-06-24T03:53:30.6364333Z Waiting for deployment "olm-operator" rollout to finish: 0 of 1 updated replicas are available... | |
| 2025-06-24T03:53:34.5979344Z deployment "olm-operator" successfully rolled out | |
| 2025-06-24T03:53:34.6727582Z deployment "catalog-operator" successfully rolled out | |
| 2025-06-24T03:53:34.7250678Z Package server phase: Installing | |
| 2025-06-24T03:53:44.7757612Z Package server phase: Succeeded | |
| 2025-06-24T03:53:44.8298825Z deployment "packageserver" successfully rolled out | |
| 2025-06-24T03:53:44.8352492Z ##[group]Run ./chart-dependencies/ci-deps.sh | |
| 2025-06-24T03:53:44.8352830Z [36;1m./chart-dependencies/ci-deps.sh[0m | |
| 2025-06-24T03:53:44.8411890Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} | |
| 2025-06-24T03:53:44.8412198Z env: | |
| 2025-06-24T03:53:44.8412431Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:44.8412842Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:53:44.8413511Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:44.8413849Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:44.8414183Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:53:44.8414522Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:53:44.8414849Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:53:44.8415155Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:53:44.8415423Z ##[endgroup] | |
| 2025-06-24T03:53:44.8814548Z [32m✅ 📜 Base CRDs: Installing...[0m | |
| 2025-06-24T03:53:46.0555289Z customresourcedefinition.apiextensions.k8s.io/gatewayclasses.gateway.networking.k8s.io created | |
| 2025-06-24T03:53:46.1141498Z customresourcedefinition.apiextensions.k8s.io/gateways.gateway.networking.k8s.io created | |
| 2025-06-24T03:53:46.2363713Z customresourcedefinition.apiextensions.k8s.io/grpcroutes.gateway.networking.k8s.io created | |
| 2025-06-24T03:53:46.4532745Z customresourcedefinition.apiextensions.k8s.io/httproutes.gateway.networking.k8s.io created | |
| 2025-06-24T03:53:46.4616440Z customresourcedefinition.apiextensions.k8s.io/referencegrants.gateway.networking.k8s.io created | |
| 2025-06-24T03:53:46.4658933Z [32m✅ 🚪 GAIE CRDs: Installing...[0m | |
| 2025-06-24T03:53:47.5924678Z customresourcedefinition.apiextensions.k8s.io/inferencemodels.inference.networking.x-k8s.io created | |
| 2025-06-24T03:53:47.6284847Z customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io created | |
| 2025-06-24T03:53:47.6303969Z [32m✅ 🎒 Gateway provider is -> 'istio[0m[32m': Installing...[0m[0m | |
| 2025-06-24T03:53:47.8231978Z Release "istio-base" does not exist. Installing it now. | |
| 2025-06-24T03:53:48.5922302Z Pulled: gcr.io/istio-testing/charts/base:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T03:53:48.5924090Z Digest: sha256:d022e2d190b4acdb5abbf160e34a63b5bbd94d4c76ef8ec46bcb48c1e6e6c9c5 | |
| 2025-06-24T03:53:50.4405427Z NAME: istio-base | |
| 2025-06-24T03:53:50.4407204Z LAST DEPLOYED: Tue Jun 24 03:53:48 2025 | |
| 2025-06-24T03:53:50.4408356Z NAMESPACE: istio-system | |
| 2025-06-24T03:53:50.4409391Z STATUS: deployed | |
| 2025-06-24T03:53:50.4423665Z REVISION: 1 | |
| 2025-06-24T03:53:50.4423976Z TEST SUITE: None | |
| 2025-06-24T03:53:50.4424258Z NOTES: | |
| 2025-06-24T03:53:50.4424557Z Istio base successfully installed! | |
| 2025-06-24T03:53:50.4424837Z | |
| 2025-06-24T03:53:50.4424997Z To learn more about the release, try: | |
| 2025-06-24T03:53:50.4425460Z $ helm status istio-base -n istio-system | |
| 2025-06-24T03:53:50.4425971Z $ helm get all istio-base -n istio-system | |
| 2025-06-24T03:53:50.4877635Z Release "istiod" does not exist. Installing it now. | |
| 2025-06-24T03:53:51.2781058Z Pulled: gcr.io/istio-testing/charts/istiod:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T03:53:51.2782228Z Digest: sha256:b6a16f2823041fe7410e0fc089283902dd4795e9e1eaac2406f985fba111993a | |
| 2025-06-24T03:54:00.4539666Z NAME: istiod | |
| 2025-06-24T03:54:00.4540062Z LAST DEPLOYED: Tue Jun 24 03:53:51 2025 | |
| 2025-06-24T03:54:00.4540499Z NAMESPACE: istio-system | |
| 2025-06-24T03:54:00.4540830Z STATUS: deployed | |
| 2025-06-24T03:54:00.4541129Z REVISION: 1 | |
| 2025-06-24T03:54:00.4541399Z TEST SUITE: None | |
| 2025-06-24T03:54:00.4541681Z NOTES: | |
| 2025-06-24T03:54:00.4541986Z "istiod" successfully installed! | |
| 2025-06-24T03:54:00.4542248Z | |
| 2025-06-24T03:54:00.4542399Z To learn more about the release, try: | |
| 2025-06-24T03:54:00.4542840Z $ helm status istiod -n istio-system | |
| 2025-06-24T03:54:00.4543506Z $ helm get all istiod -n istio-system | |
| 2025-06-24T03:54:00.4543796Z | |
| 2025-06-24T03:54:00.4544315Z Next steps: | |
| 2025-06-24T03:54:00.4544850Z * Deploy a Gateway: https://istio.io/latest/docs/setup/additional-setup/gateway/ | |
| 2025-06-24T03:54:00.4545600Z * Try out our tasks to get started on common configurations: | |
| 2025-06-24T03:54:00.4546203Z * https://istio.io/latest/docs/tasks/traffic-management | |
| 2025-06-24T03:54:00.4546753Z * https://istio.io/latest/docs/tasks/security/ | |
| 2025-06-24T03:54:00.4547298Z * https://istio.io/latest/docs/tasks/policy-enforcement/ | |
| 2025-06-24T03:54:00.4548054Z * Review the list of actively supported releases, CVE publications and our hardening guide: | |
| 2025-06-24T03:54:00.4548834Z * https://istio.io/latest/docs/releases/supported-releases/ | |
| 2025-06-24T03:54:00.4549371Z * https://istio.io/latest/news/security/ | |
| 2025-06-24T03:54:00.4549898Z * https://istio.io/latest/docs/ops/best-practices/security/ | |
| 2025-06-24T03:54:00.4550272Z | |
| 2025-06-24T03:54:00.4550493Z For further documentation see https://istio.io website | |
| 2025-06-24T03:54:00.4614562Z ##[group]Run ct install \ | |
| 2025-06-24T03:54:00.4614960Z [36;1mct install \[0m | |
| 2025-06-24T03:54:00.4615163Z [36;1m --debug \[0m | |
| 2025-06-24T03:54:00.4615364Z [36;1m --config ct-install.yaml \[0m | |
| 2025-06-24T03:54:00.4615606Z [36;1m --upgrade \[0m | |
| 2025-06-24T03:54:00.4615821Z [36;1m --target-branch "$TARGET_BRANCH"[0m | |
| 2025-06-24T03:54:00.4676655Z shell: /usr/bin/bash -e {0} | |
| 2025-06-24T03:54:00.4676886Z env: | |
| 2025-06-24T03:54:00.4677122Z pythonLocation: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:54:00.4677524Z PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib/pkgconfig | |
| 2025-06-24T03:54:00.4677895Z Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:54:00.4678232Z Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:54:00.4678586Z Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.13.5/x64 | |
| 2025-06-24T03:54:00.4678943Z LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.13.5/x64/lib | |
| 2025-06-24T03:54:00.4679325Z CT_CONFIG_DIR: /opt/hostedtoolcache/ct/3.12.0/amd64/etc | |
| 2025-06-24T03:54:00.4679671Z VIRTUAL_ENV: /opt/hostedtoolcache/ct/3.12.0/amd64/venv | |
| 2025-06-24T03:54:00.4679990Z TARGET_BRANCH: main | |
| 2025-06-24T03:54:00.4680185Z ##[endgroup] | |
| 2025-06-24T03:54:00.4781468Z Installing charts... | |
| 2025-06-24T03:54:00.4785387Z >>> helm version --template {{ .Version }} | |
| 2025-06-24T03:54:00.5035014Z >>> git rev-parse --is-inside-work-tree | |
| 2025-06-24T03:54:00.5051780Z >>> git rev-parse --verify origin/main | |
| 2025-06-24T03:54:00.5066588Z >>> git merge-base origin/main HEAD | |
| 2025-06-24T03:54:00.5084887Z >>> git diff --find-renames --name-only 4ef77d318945c21b40f75c3c1cd9453934981cc3 -- charts | |
| 2025-06-24T03:54:00.5143930Z | |
| 2025-06-24T03:54:00.5144354Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:54:00.5144972Z Charts to be processed: | |
| 2025-06-24T03:54:00.5145591Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:54:00.5146449Z llm-d => (version: "1.0.21", path: "charts/llm-d") | |
| 2025-06-24T03:54:00.5146934Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:54:00.5147380Z | |
| 2025-06-24T03:54:00.5147542Z >>> git rev-parse --is-inside-work-tree | |
| 2025-06-24T03:54:00.5158561Z >>> git rev-parse --verify origin/main | |
| 2025-06-24T03:54:00.5172399Z >>> git merge-base origin/main HEAD | |
| 2025-06-24T03:54:00.5189493Z >>> git worktree add ./ct-previous-revision1049135146 4ef77d318945c21b40f75c3c1cd9453934981cc3 | |
| 2025-06-24T03:54:00.5377483Z HEAD is now at 4ef77d3 Add the ability to define envs to the vLLM containers in sample app (#301) | |
| 2025-06-24T03:54:00.5384760Z Preparing worktree (detached HEAD 4ef77d3) | |
| 2025-06-24T03:54:00.5386231Z >>> helm dependency build ct-previous-revision1049135146/charts/llm-d | |
| 2025-06-24T03:54:00.5636363Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T03:54:00.6276821Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T03:54:03.3225143Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T03:54:03.3226110Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T03:54:05.6297584Z Saving 2 charts | |
| 2025-06-24T03:54:05.6298155Z Downloading common from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T03:54:08.0756230Z Downloading redis from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T03:54:08.3709893Z Pulled: registry-1.docker.io/bitnamicharts/redis:20.13.4 | |
| 2025-06-24T03:54:08.3710772Z Digest: sha256:6a389e13237e8e639ec0d445e785aa246b57bfce711b087033a196a291d5c8d7 | |
| 2025-06-24T03:54:08.3775433Z Deleting outdated charts | |
| 2025-06-24T03:54:08.3953708Z >>> helm dependency build charts/llm-d | |
| 2025-06-24T03:54:08.4194616Z Hang tight while we grab the latest from your chart repositories... | |
| 2025-06-24T03:54:08.4795159Z ...Successfully got an update from the "ingress-nginx" chart repository | |
| 2025-06-24T03:54:11.0362353Z ...Successfully got an update from the "bitnami" chart repository | |
| 2025-06-24T03:54:11.0363371Z Update Complete. ⎈Happy Helming!⎈ | |
| 2025-06-24T03:54:13.5036322Z Saving 2 charts | |
| 2025-06-24T03:54:13.5037185Z Downloading common from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T03:54:15.8577674Z Downloading redis from repo https://charts.bitnami.com/bitnami | |
| 2025-06-24T03:54:16.1070627Z Pulled: registry-1.docker.io/bitnamicharts/redis:20.13.4 | |
| 2025-06-24T03:54:16.1071443Z Digest: sha256:6a389e13237e8e639ec0d445e785aa246b57bfce711b087033a196a291d5c8d7 | |
| 2025-06-24T03:54:16.1169885Z Deleting outdated charts | |
| 2025-06-24T03:54:16.1399609Z >>> git cat-file -e origin/main:charts/llm-d/Chart.yaml | |
| 2025-06-24T03:54:16.1419351Z >>> git show origin/main:charts/llm-d/Chart.yaml | |
| 2025-06-24T03:54:16.1445789Z Testing upgrades of chart "llm-d => (version: \"1.0.21\", path: \"charts/llm-d\")" relative to previous revision "llm-d => (version: \"1.0.20\", path: \"ct-previous-revision1049135146/charts/llm-d\")"... | |
| 2025-06-24T03:54:16.1447053Z | |
| 2025-06-24T03:54:16.1447967Z Installing chart "llm-d => (version: \"1.0.20\", path: \"ct-previous-revision1049135146/charts/llm-d\")" with values file "ct-previous-revision1049135146/charts/llm-d/ci/default-values.yaml"... | |
| 2025-06-24T03:54:16.1449055Z | |
| 2025-06-24T03:54:16.1449232Z Creating namespace "llm-d-zqbp1ruj3e"... | |
| 2025-06-24T03:54:16.1450153Z >>> kubectl --request-timeout=30s create namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:16.1891456Z namespace/llm-d-zqbp1ruj3e created | |
| 2025-06-24T03:54:16.1925889Z >>> helm install llm-d-zqbp1ruj3e ct-previous-revision1049135146/charts/llm-d --namespace llm-d-zqbp1ruj3e --wait --values ct-previous-revision1049135146/charts/llm-d/ci/default-values.yaml --timeout 500s | |
| 2025-06-24T03:54:45.9263237Z NAME: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:45.9263684Z LAST DEPLOYED: Tue Jun 24 03:54:18 2025 | |
| 2025-06-24T03:54:45.9264030Z NAMESPACE: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:45.9264260Z STATUS: deployed | |
| 2025-06-24T03:54:45.9264483Z REVISION: 1 | |
| 2025-06-24T03:54:45.9264665Z NOTES: | |
| 2025-06-24T03:54:45.9264839Z Thank you for installing llm-d. | |
| 2025-06-24T03:54:45.9264987Z | |
| 2025-06-24T03:54:45.9265087Z Your release is named `llm-d-zqbp1ruj3e`. | |
| 2025-06-24T03:54:45.9265290Z | |
| 2025-06-24T03:54:45.9265380Z To learn more about the release, try: | |
| 2025-06-24T03:54:45.9265550Z | |
| 2025-06-24T03:54:45.9265614Z ```bash | |
| 2025-06-24T03:54:45.9265801Z $ helm status llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:45.9266035Z $ helm get all llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:45.9266233Z ``` | |
| 2025-06-24T03:54:45.9266322Z | |
| 2025-06-24T03:54:45.9266326Z | |
| 2025-06-24T03:54:45.9266439Z Following presets are available to your users: | |
| 2025-06-24T03:54:45.9266628Z | |
| 2025-06-24T03:54:45.9266632Z | |
| 2025-06-24T03:54:45.9266635Z | |
| 2025-06-24T03:54:45.9266826Z | Name | Description | | |
| 2025-06-24T03:54:45.9267333Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T03:54:45.9267879Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T03:54:45.9268695Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T03:54:45.9269543Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T03:54:45.9270242Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T03:54:45.9270539Z | |
| 2025-06-24T03:54:45.9270653Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T03:54:45.9270842Z | |
| 2025-06-24T03:54:45.9271329Z ```yaml | |
| 2025-06-24T03:54:45.9271635Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T03:54:45.9271972Z kind: ModelService | |
| 2025-06-24T03:54:45.9272247Z metadata: | |
| 2025-06-24T03:54:45.9272499Z name: <name> | |
| 2025-06-24T03:54:45.9272763Z spec: | |
| 2025-06-24T03:54:45.9273237Z decoupleScaling: false | |
| 2025-06-24T03:54:45.9284760Z baseConfigMapRef: | |
| 2025-06-24T03:54:45.9285106Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T03:54:45.9285593Z routing: | |
| 2025-06-24T03:54:45.9285894Z modelName: <model_name> | |
| 2025-06-24T03:54:45.9286240Z modelArtifacts: | |
| 2025-06-24T03:54:45.9286610Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T03:54:45.9287022Z decode: | |
| 2025-06-24T03:54:45.9287306Z replicas: 1 | |
| 2025-06-24T03:54:45.9287616Z containers: | |
| 2025-06-24T03:54:45.9287897Z - name: "vllm" | |
| 2025-06-24T03:54:45.9288086Z args: | |
| 2025-06-24T03:54:45.9288245Z - "--model" | |
| 2025-06-24T03:54:45.9288432Z - <model_name> | |
| 2025-06-24T03:54:45.9288613Z prefill: | |
| 2025-06-24T03:54:45.9288786Z replicas: 1 | |
| 2025-06-24T03:54:45.9288953Z containers: | |
| 2025-06-24T03:54:45.9289124Z - name: "vllm" | |
| 2025-06-24T03:54:45.9289287Z args: | |
| 2025-06-24T03:54:45.9289449Z - "--model" | |
| 2025-06-24T03:54:45.9289615Z - <model_name> | |
| 2025-06-24T03:54:45.9289802Z ``` | |
| 2025-06-24T03:54:45.9305931Z >>> kubectl --request-timeout=30s get deployments --namespace llm-d-zqbp1ruj3e --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T03:54:45.9956571Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-zqbp1ruj3e-inference-gateway-istio --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:46.0598170Z deployment "llm-d-zqbp1ruj3e-inference-gateway-istio" successfully rolled out | |
| 2025-06-24T03:54:46.0619832Z >>> kubectl --request-timeout=30s get deployment llm-d-zqbp1ruj3e-inference-gateway-istio --namespace llm-d-zqbp1ruj3e --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T03:54:46.1221232Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-zqbp1ruj3e-modelservice --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:46.1840786Z deployment "llm-d-zqbp1ruj3e-modelservice" successfully rolled out | |
| 2025-06-24T03:54:46.1862682Z >>> kubectl --request-timeout=30s get deployment llm-d-zqbp1ruj3e-modelservice --namespace llm-d-zqbp1ruj3e --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T03:54:46.2342019Z >>> kubectl --request-timeout=30s rollout status deployment llm-d-zqbp1ruj3e-redis-master --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:54:46.2891983Z deployment "llm-d-zqbp1ruj3e-redis-master" successfully rolled out | |
| 2025-06-24T03:54:46.2912362Z >>> kubectl --request-timeout=30s get deployment llm-d-zqbp1ruj3e-redis-master --namespace llm-d-zqbp1ruj3e --output jsonpath={.status.unavailableReplicas} | |
| 2025-06-24T03:54:46.3399248Z >>> helm test llm-d-zqbp1ruj3e --namespace llm-d-zqbp1ruj3e --timeout 500s | |
| 2025-06-24T03:55:07.9536940Z NAME: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:07.9537284Z LAST DEPLOYED: Tue Jun 24 03:54:18 2025 | |
| 2025-06-24T03:55:07.9537597Z NAMESPACE: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:07.9537827Z STATUS: deployed | |
| 2025-06-24T03:55:07.9538000Z REVISION: 1 | |
| 2025-06-24T03:55:07.9538211Z TEST SUITE: llm-d-zqbp1ruj3e-test-connection | |
| 2025-06-24T03:55:07.9538495Z Last Started: Tue Jun 24 03:54:46 2025 | |
| 2025-06-24T03:55:07.9538740Z Last Completed: Tue Jun 24 03:55:07 2025 | |
| 2025-06-24T03:55:07.9538970Z Phase: Succeeded | |
| 2025-06-24T03:55:07.9539205Z TEST SUITE: llm-d-zqbp1ruj3e-vllm-sim | |
| 2025-06-24T03:55:07.9539465Z Last Started: Tue Jun 24 03:54:46 2025 | |
| 2025-06-24T03:55:07.9539710Z Last Completed: Tue Jun 24 03:54:46 2025 | |
| 2025-06-24T03:55:07.9539941Z Phase: Succeeded | |
| 2025-06-24T03:55:07.9540152Z TEST SUITE: llm-d-zqbp1ruj3e-vllm-sim | |
| 2025-06-24T03:55:07.9540397Z Last Started: Tue Jun 24 03:54:46 2025 | |
| 2025-06-24T03:55:07.9540625Z Last Completed: Tue Jun 24 03:54:46 2025 | |
| 2025-06-24T03:55:07.9540850Z Phase: Succeeded | |
| 2025-06-24T03:55:07.9541028Z NOTES: | |
| 2025-06-24T03:55:07.9541201Z Thank you for installing llm-d. | |
| 2025-06-24T03:55:07.9541724Z | |
| 2025-06-24T03:55:07.9541832Z Your release is named `llm-d-zqbp1ruj3e`. | |
| 2025-06-24T03:55:07.9542015Z | |
| 2025-06-24T03:55:07.9542104Z To learn more about the release, try: | |
| 2025-06-24T03:55:07.9542264Z | |
| 2025-06-24T03:55:07.9542333Z ```bash | |
| 2025-06-24T03:55:07.9542500Z $ helm status llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:07.9542729Z $ helm get all llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:07.9543261Z ``` | |
| 2025-06-24T03:55:07.9543426Z | |
| 2025-06-24T03:55:07.9543433Z | |
| 2025-06-24T03:55:07.9543617Z Following presets are available to your users: | |
| 2025-06-24T03:55:07.9543812Z | |
| 2025-06-24T03:55:07.9543815Z | |
| 2025-06-24T03:55:07.9543819Z | |
| 2025-06-24T03:55:07.9544027Z | Name | Description | | |
| 2025-06-24T03:55:07.9544517Z | ----------------------------------------------------------------- | ----------------------------------------------------------------------------------------------- | | |
| 2025-06-24T03:55:07.9545065Z | basic-gpu-preset | Basic gpu inference | | |
| 2025-06-24T03:55:07.9545694Z | basic-gpu-with-nixl-preset | GPU inference with NIXL P/D KV transfer and cache offloading | | |
| 2025-06-24T03:55:07.9546713Z | basic-gpu-with-nixl-and-redis-lookup-preset | GPU inference with NIXL P/D KV transfer, cache offloading and Redis lookup server | | |
| 2025-06-24T03:55:07.9547399Z | basic-sim-preset | Basic simulation | | |
| 2025-06-24T03:55:07.9547689Z | |
| 2025-06-24T03:55:07.9547803Z To provision a `ModelService`, create a new CR: | |
| 2025-06-24T03:55:07.9547989Z | |
| 2025-06-24T03:55:07.9548055Z ```yaml | |
| 2025-06-24T03:55:07.9548229Z apiVersion: llm-d.ai/v1alpha1 | |
| 2025-06-24T03:55:07.9548443Z kind: ModelService | |
| 2025-06-24T03:55:07.9548620Z metadata: | |
| 2025-06-24T03:55:07.9548773Z name: <name> | |
| 2025-06-24T03:55:07.9548935Z spec: | |
| 2025-06-24T03:55:07.9549097Z decoupleScaling: false | |
| 2025-06-24T03:55:07.9549297Z baseConfigMapRef: | |
| 2025-06-24T03:55:07.9549542Z name: basic-gpu-with-nixl-and-redis-lookup-preset | |
| 2025-06-24T03:55:07.9549827Z routing: | |
| 2025-06-24T03:55:07.9549998Z modelName: <model_name> | |
| 2025-06-24T03:55:07.9550200Z modelArtifacts: | |
| 2025-06-24T03:55:07.9550401Z uri: pvc://<pvc_name>/<path_to_model> | |
| 2025-06-24T03:55:07.9550629Z decode: | |
| 2025-06-24T03:55:07.9550781Z replicas: 1 | |
| 2025-06-24T03:55:07.9550944Z containers: | |
| 2025-06-24T03:55:07.9551112Z - name: "vllm" | |
| 2025-06-24T03:55:07.9551276Z args: | |
| 2025-06-24T03:55:07.9551432Z - "--model" | |
| 2025-06-24T03:55:07.9551612Z - <model_name> | |
| 2025-06-24T03:55:07.9551787Z prefill: | |
| 2025-06-24T03:55:07.9551949Z replicas: 1 | |
| 2025-06-24T03:55:07.9552106Z containers: | |
| 2025-06-24T03:55:07.9552279Z - name: "vllm" | |
| 2025-06-24T03:55:07.9552440Z args: | |
| 2025-06-24T03:55:07.9552606Z - "--model" | |
| 2025-06-24T03:55:07.9552769Z - <model_name> | |
| 2025-06-24T03:55:07.9553108Z ``` | |
| 2025-06-24T03:55:07.9565119Z >>> helm upgrade llm-d-zqbp1ruj3e charts/llm-d --namespace llm-d-zqbp1ruj3e --reuse-values --wait --timeout 500s | |
| 2025-06-24T03:55:08.0791528Z Error: UPGRADE FAILED: values don't meet the specifications of the schema(s) in the following chart(s): | |
| 2025-06-24T03:55:08.0792382Z llm-d: | |
| 2025-06-24T03:55:08.0792861Z - sampleApplication.decode: Additional property env is not allowed | |
| 2025-06-24T03:55:08.0793785Z - sampleApplication.prefill: Additional property env is not allowed | |
| 2025-06-24T03:55:08.0794238Z | |
| 2025-06-24T03:55:08.0794376Z ======================================================================================================================== | |
| 2025-06-24T03:55:08.0794895Z ........................................................................................................................ | |
| 2025-06-24T03:55:08.0795579Z ==> Events of namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.0795941Z ........................................................................................................................ | |
| 2025-06-24T03:55:08.0796608Z >>> kubectl --request-timeout=30s get events --output wide --namespace llm-d-zqbp1ruj3e --sort-by lastTimestamp | |
| 2025-06-24T03:55:08.1367531Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME | |
| 2025-06-24T03:55:08.1369877Z 49s Normal SuccessfulCreate replicaset/llm-d-zqbp1ruj3e-modelservice-ddcc68857 replicaset-controller Created pod: llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk 49s 1 llm-d-zqbp1ruj3e-modelservice-ddcc68857.184bde430d4f281e | |
| 2025-06-24T03:55:08.1373760Z 49s Normal Scheduled pod/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg to chart-testing-control-plane 49s 1 llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.184bde43137c3158 | |
| 2025-06-24T03:55:08.1377663Z 49s Normal ScalingReplicaSet deployment/llm-d-zqbp1ruj3e-redis-master deployment-controller Scaled up replica set llm-d-zqbp1ruj3e-redis-master-7d97d5f748 to 1 49s 1 llm-d-zqbp1ruj3e-redis-master.184bde430cfcc5b6 | |
| 2025-06-24T03:55:08.1380650Z 49s Normal SuccessfulCreate replicaset/llm-d-zqbp1ruj3e-redis-master-7d97d5f748 replicaset-controller Created pod: llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 49s 1 llm-d-zqbp1ruj3e-redis-master-7d97d5f748.184bde430d7e163e | |
| 2025-06-24T03:55:08.1384119Z 49s Normal SuccessfulCreate replicaset/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5 replicaset-controller Created pod: llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg 49s 1 llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5.184bde4312e90d75 | |
| 2025-06-24T03:55:08.1387584Z 49s Normal ScalingReplicaSet deployment/llm-d-zqbp1ruj3e-inference-gateway-istio deployment-controller Scaled up replica set llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5 to 1 49s 1 llm-d-zqbp1ruj3e-inference-gateway-istio.184bde4312863bc8 | |
| 2025-06-24T03:55:08.1391741Z 49s Normal Scheduled pod/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk to chart-testing-control-plane 49s 1 llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk.184bde430dddc888 | |
| 2025-06-24T03:55:08.1395560Z 49s Normal Scheduled pod/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 to chart-testing-control-plane 49s 1 llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278.184bde430e5c9c75 | |
| 2025-06-24T03:55:08.1398547Z 49s Normal ScalingReplicaSet deployment/llm-d-zqbp1ruj3e-modelservice deployment-controller Scaled up replica set llm-d-zqbp1ruj3e-modelservice-ddcc68857 to 1 49s 1 llm-d-zqbp1ruj3e-modelservice.184bde430cbcf6c4 | |
| 2025-06-24T03:55:08.1402234Z 48s Normal Pulling pod/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg spec.containers{istio-proxy} kubelet, chart-testing-control-plane Pulling image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" 48s 1 llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.184bde432b542fcb | |
| 2025-06-24T03:55:08.1405833Z 48s Normal Pulling pod/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk spec.containers{manager} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" 48s 1 llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk.184bde43277554b8 | |
| 2025-06-24T03:55:08.1408859Z 48s Normal Pulling pod/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 spec.containers{redis} kubelet, chart-testing-control-plane Pulling image "quay.io/sclorg/redis-7-c9s:c9s" 48s 1 llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278.184bde43271e14f3 | |
| 2025-06-24T03:55:08.1412151Z 45s Normal Pulled pod/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 spec.containers{redis} kubelet, chart-testing-control-plane Successfully pulled image "quay.io/sclorg/redis-7-c9s:c9s" in 3.326s (3.326s including waiting). Image size: 97229638 bytes. 45s 1 llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278.184bde43ed6832e9 | |
| 2025-06-24T03:55:08.1415665Z 45s Normal Created pod/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 spec.containers{redis} kubelet, chart-testing-control-plane Created container redis 45s 1 llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278.184bde43ee669930 | |
| 2025-06-24T03:55:08.1418929Z 45s Normal Started pod/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 spec.containers{redis} kubelet, chart-testing-control-plane Started container redis 45s 1 llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278.184bde43f888da88 | |
| 2025-06-24T03:55:08.1421489Z 41s Normal Created pod/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk spec.containers{manager} kubelet, chart-testing-control-plane Created container manager 41s 1 llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk.184bde44dd7fa8be | |
| 2025-06-24T03:55:08.1423944Z 41s Normal Pulled pod/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk spec.containers{manager} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 4.02s (7.341s including waiting). Image size: 115030935 bytes. 41s 1 llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk.184bde44dd04cfee | |
| 2025-06-24T03:55:08.1426596Z 41s Normal Started pod/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk spec.containers{manager} kubelet, chart-testing-control-plane Started container manager 41s 1 llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk.184bde44ebcf2a0d | |
| 2025-06-24T03:55:08.1430139Z 38s Normal Pulled pod/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg spec.containers{istio-proxy} kubelet, chart-testing-control-plane Successfully pulled image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" in 2.653s (9.929s including waiting). Image size: 107788353 bytes. 38s 1 llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.184bde457b2b9cd3 | |
| 2025-06-24T03:55:08.1433826Z 38s Normal Started pod/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg spec.containers{istio-proxy} kubelet, chart-testing-control-plane Started container istio-proxy 38s 1 llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.184bde4580cb257a | |
| 2025-06-24T03:55:08.1436318Z 38s Normal Created pod/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg spec.containers{istio-proxy} kubelet, chart-testing-control-plane Created container istio-proxy 38s 1 llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.184bde457ba371de | |
| 2025-06-24T03:55:08.1439171Z 22s Normal ScalingReplicaSet deployment/llm-d-zqbp1ruj3e-vllm-sim-epp deployment-controller Scaled up replica set llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49 to 1 22s 1 llm-d-zqbp1ruj3e-vllm-sim-epp.184bde4966973ab2 | |
| 2025-06-24T03:55:08.1441872Z 22s Normal ScalingReplicaSet deployment/llm-d-zqbp1ruj3e-vllm-sim-prefill deployment-controller Scaled up replica set llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c to 1 22s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill.184bde495b53b24e | |
| 2025-06-24T03:55:08.1445028Z 22s Normal ScalingReplicaSet deployment/llm-d-zqbp1ruj3e-vllm-sim-decode deployment-controller Scaled up replica set llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc to 1 22s 1 llm-d-zqbp1ruj3e-vllm-sim-decode.184bde495c594842 | |
| 2025-06-24T03:55:08.1447821Z 21s Normal SuccessfulCreate replicaset/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c replicaset-controller Created pod: llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq 21s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c.184bde498c7e5fb7 | |
| 2025-06-24T03:55:08.1451008Z 21s Warning FailedCreate replicaset/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c replicaset-controller Error creating: pods "llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-" is forbidden: error looking up service account llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-sa: serviceaccount "llm-d-zqbp1ruj3e-vllm-sim-sa" not found 22s 7 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c.184bde495c55a34f | |
| 2025-06-24T03:55:08.1454629Z 21s Normal Scheduled pod/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq to chart-testing-control-plane 21s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq.184bde498c3638ca | |
| 2025-06-24T03:55:08.1457181Z 21s Normal Scheduled pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs to chart-testing-control-plane 21s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4993e23958 | |
| 2025-06-24T03:55:08.1459656Z 21s Normal Scheduled pod/llm-d-zqbp1ruj3e-test-connection default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-test-connection to chart-testing-control-plane 21s 1 llm-d-zqbp1ruj3e-test-connection.184bde49676ca4d2 | |
| 2025-06-24T03:55:08.1462719Z 21s Warning FailedCreate replicaset/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc replicaset-controller Error creating: pods "llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-" is forbidden: error looking up service account llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-sa: serviceaccount "llm-d-zqbp1ruj3e-vllm-sim-sa" not found 22s 7 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc.184bde495d700ebe | |
| 2025-06-24T03:55:08.1466831Z 21s Normal SuccessfulCreate replicaset/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49 replicaset-controller Created pod: llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 21s 1 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49.184bde4973d32221 | |
| 2025-06-24T03:55:08.1470725Z 21s Warning FailedCreate replicaset/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49 replicaset-controller Error creating: pods "llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-" is forbidden: error looking up service account llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-epp-sa: serviceaccount "llm-d-zqbp1ruj3e-vllm-sim-epp-sa" not found 21s 3 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49.184bde496731e0b1 | |
| 2025-06-24T03:55:08.1475402Z 21s Normal Scheduled pod/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 to chart-testing-control-plane 21s 1 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9.184bde4979988d98 | |
| 2025-06-24T03:55:08.1478941Z 21s Normal SuccessfulCreate replicaset/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc replicaset-controller Created pod: llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs 21s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc.184bde4990e177a7 | |
| 2025-06-24T03:55:08.1481525Z 20s Normal Pulling pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" 20s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde49cb93192f | |
| 2025-06-24T03:55:08.1484381Z 20s Normal Pulling pod/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq spec.containers{vllm} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" 20s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq.184bde49d629258d | |
| 2025-06-24T03:55:08.1486353Z 20s Normal Pulling pod/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 spec.containers{epp} kubelet, chart-testing-control-plane Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" 20s 1 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9.184bde49cb49dbd1 | |
| 2025-06-24T03:55:08.1488279Z 18s Normal Pulling pod/llm-d-zqbp1ruj3e-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Pulling image "quay.io/curl/curl:latest" 18s 1 llm-d-zqbp1ruj3e-test-connection.184bde4a3d8440f0 | |
| 2025-06-24T03:55:08.1490452Z 17s Normal Started pod/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 spec.containers{epp} kubelet, chart-testing-control-plane Started container epp 17s 1 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9.184bde4a8b50d088 | |
| 2025-06-24T03:55:08.1492576Z 17s Normal Pulled pod/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 spec.containers{epp} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 3.126s (3.126s including waiting). Image size: 119587259 bytes. 17s 1 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9.184bde4a85ac2d60 | |
| 2025-06-24T03:55:08.1495021Z 17s Normal Created pod/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 spec.containers{epp} kubelet, chart-testing-control-plane Created container epp 17s 1 llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9.184bde4a862cbbe1 | |
| 2025-06-24T03:55:08.1498222Z 14s Normal Created pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Created container routing-proxy 14s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4b40d1ccde | |
| 2025-06-24T03:55:08.1501630Z 14s Normal Pulled pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" in 3.131s (6.253s including waiting). Image size: 85265962 bytes. 14s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4b405621c3 | |
| 2025-06-24T03:55:08.1505560Z 13s Normal Started pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.initContainers{routing-proxy} kubelet, chart-testing-control-plane Started container routing-proxy 13s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4b459a31fd | |
| 2025-06-24T03:55:08.1508665Z 13s Normal Started pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 13s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4b76451945 | |
| 2025-06-24T03:55:08.1512124Z 13s Normal Pulled pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.containers{vllm} kubelet, chart-testing-control-plane Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine 13s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4b6f58a768 | |
| 2025-06-24T03:55:08.1515572Z 13s Normal Pulled pod/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq spec.containers{vllm} kubelet, chart-testing-control-plane Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 550ms (6.627s including waiting). Image size: 87011014 bytes. 13s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq.184bde4b612c9649 | |
| 2025-06-24T03:55:08.1517949Z 13s Normal Created pod/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 13s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq.184bde4b619dd5f8 | |
| 2025-06-24T03:55:08.1519706Z 13s Normal Started pod/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq spec.containers{vllm} kubelet, chart-testing-control-plane Started container vllm 13s 1 llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq.184bde4b665cd3ba | |
| 2025-06-24T03:55:08.1521521Z 13s Normal Created pod/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs spec.containers{vllm} kubelet, chart-testing-control-plane Created container vllm 13s 1 llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs.184bde4b7087d666 | |
| 2025-06-24T03:55:08.1523431Z 12s Normal Created pod/llm-d-zqbp1ruj3e-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Created container curl 12s 1 llm-d-zqbp1ruj3e-test-connection.184bde4b977a3fc3 | |
| 2025-06-24T03:55:08.1525121Z 12s Normal Pulled pod/llm-d-zqbp1ruj3e-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Successfully pulled image "quay.io/curl/curl:latest" in 904ms (5.797s including waiting). Image size: 9956545 bytes. 12s 1 llm-d-zqbp1ruj3e-test-connection.184bde4b970ee443 | |
| 2025-06-24T03:55:08.1526783Z 6s Normal Started pod/llm-d-zqbp1ruj3e-test-connection spec.containers{curl} kubelet, chart-testing-control-plane Started container curl 6s 1 llm-d-zqbp1ruj3e-test-connection.184bde4d1edf0299 | |
| 2025-06-24T03:55:08.1527686Z ........................................................................................................................ | |
| 2025-06-24T03:55:08.1528018Z <== Events of namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.1528461Z ........................................................................................................................ | |
| 2025-06-24T03:55:08.1529076Z >>> kubectl --request-timeout=30s get pods --no-headers --namespace llm-d-zqbp1ruj3e --selector --output jsonpath={.items[*].metadata.name} | |
| 2025-06-24T03:55:08.2032019Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.2032785Z ==> Description of pod llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg | |
| 2025-06-24T03:55:08.2033679Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.2034428Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.2578779Z Name: llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg | |
| 2025-06-24T03:55:08.2579444Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.2579862Z Priority: 0 | |
| 2025-06-24T03:55:08.2580153Z Service Account: llm-d-zqbp1ruj3e-inference-gateway-istio | |
| 2025-06-24T03:55:08.2580506Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:08.2580801Z Start Time: Tue, 24 Jun 2025 03:54:19 +0000 | |
| 2025-06-24T03:55:08.2581119Z Labels: app.kubernetes.io/component=inference-gateway | |
| 2025-06-24T03:55:08.2581819Z app.kubernetes.io/gateway=llm-d-zqbp1ruj3e-inference-gateway | |
| 2025-06-24T03:55:08.2582190Z app.kubernetes.io/instance=llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.2582490Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T03:55:08.2582756Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T03:55:08.2583266Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T03:55:08.2583582Z gateway.istio.io/managed=istio.io-gateway-controller | |
| 2025-06-24T03:55:08.2584008Z gateway.networking.k8s.io/gateway-name=llm-d-zqbp1ruj3e-inference-gateway | |
| 2025-06-24T03:55:08.2584378Z helm.sh/chart=llm-d-1.0.20 | |
| 2025-06-24T03:55:08.2584651Z istio.io/enable-inference-extproc=true | |
| 2025-06-24T03:55:08.2584925Z pod-template-hash=794f8d99f5 | |
| 2025-06-24T03:55:08.2585284Z service.istio.io/canonical-name=llm-d-zqbp1ruj3e-inference-gateway-istio | |
| 2025-06-24T03:55:08.2585688Z service.istio.io/canonical-revision=latest | |
| 2025-06-24T03:55:08.2585966Z sidecar.istio.io/inject=false | |
| 2025-06-24T03:55:08.2586224Z Annotations: istio.io/rev: default | |
| 2025-06-24T03:55:08.2586489Z meta.helm.sh/release-name: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.2586796Z meta.helm.sh/release-namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.2587101Z networking.istio.io/service-type: ClusterIP | |
| 2025-06-24T03:55:08.2587392Z prometheus.io/path: /stats/prometheus | |
| 2025-06-24T03:55:08.2587725Z prometheus.io/port: 15020 | |
| 2025-06-24T03:55:08.2588081Z prometheus.io/scrape: true | |
| 2025-06-24T03:55:08.2588321Z Status: Running | |
| 2025-06-24T03:55:08.2588513Z IP: 10.244.0.15 | |
| 2025-06-24T03:55:08.2588710Z IPs: | |
| 2025-06-24T03:55:08.2588859Z IP: 10.244.0.15 | |
| 2025-06-24T03:55:08.2589188Z Controlled By: ReplicaSet/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5 | |
| 2025-06-24T03:55:08.2589549Z Containers: | |
| 2025-06-24T03:55:08.2589709Z istio-proxy: | |
| 2025-06-24T03:55:08.2590096Z Container ID: containerd://8840ca0e2884e8eaeaeceac5734a0136129166f0922e09d7f6ef51673becd82d | |
| 2025-06-24T03:55:08.2590864Z Image: gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d | |
| 2025-06-24T03:55:08.2591581Z Image ID: gcr.io/istio-testing/proxyv2@sha256:f8b9447198a9e52e5c928cc735536a41ad416afa2a7a674056b1e24c5789607c | |
| 2025-06-24T03:55:08.2592050Z Ports: 15020/TCP, 15021/TCP, 15090/TCP | |
| 2025-06-24T03:55:08.2592516Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T03:55:08.2592748Z Args: | |
| 2025-06-24T03:55:08.2592896Z proxy | |
| 2025-06-24T03:55:08.2593217Z router | |
| 2025-06-24T03:55:08.2593378Z --domain | |
| 2025-06-24T03:55:08.2593573Z $(POD_NAMESPACE).svc.cluster.local | |
| 2025-06-24T03:55:08.2593809Z --proxyLogLevel | |
| 2025-06-24T03:55:08.2593987Z warning | |
| 2025-06-24T03:55:08.2594164Z --proxyComponentLogLevel | |
| 2025-06-24T03:55:08.2594369Z misc:error | |
| 2025-06-24T03:55:08.2594538Z --log_output_level | |
| 2025-06-24T03:55:08.2594731Z default:info | |
| 2025-06-24T03:55:08.2594901Z State: Running | |
| 2025-06-24T03:55:08.2595116Z Started: Tue, 24 Jun 2025 03:54:30 +0000 | |
| 2025-06-24T03:55:08.2595361Z Ready: True | |
| 2025-06-24T03:55:08.2595544Z Restart Count: 0 | |
| 2025-06-24T03:55:08.2595717Z Limits: | |
| 2025-06-24T03:55:08.2595865Z cpu: 2 | |
| 2025-06-24T03:55:08.2596030Z memory: 1Gi | |
| 2025-06-24T03:55:08.2596188Z Requests: | |
| 2025-06-24T03:55:08.2596353Z cpu: 100m | |
| 2025-06-24T03:55:08.2596528Z memory: 128Mi | |
| 2025-06-24T03:55:08.2596900Z Readiness: http-get http://:15021/healthz/ready delay=0s timeout=1s period=15s #success=1 #failure=4 | |
| 2025-06-24T03:55:08.2597474Z Startup: http-get http://:15021/healthz/ready delay=1s timeout=1s period=1s #success=1 #failure=30 | |
| 2025-06-24T03:55:08.2597856Z Environment: | |
| 2025-06-24T03:55:08.2598285Z PILOT_CERT_PROVIDER: istiod | |
| 2025-06-24T03:55:08.2598815Z CA_ADDR: istiod.istio-system.svc:15012 | |
| 2025-06-24T03:55:08.2599662Z POD_NAME: llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg (v1:metadata.name) | |
| 2025-06-24T03:55:08.2600556Z POD_NAMESPACE: llm-d-zqbp1ruj3e (v1:metadata.namespace) | |
| 2025-06-24T03:55:08.2601163Z INSTANCE_IP: (v1:status.podIP) | |
| 2025-06-24T03:55:08.2601675Z SERVICE_ACCOUNT: (v1:spec.serviceAccountName) | |
| 2025-06-24T03:55:08.2602001Z HOST_IP: (v1:status.hostIP) | |
| 2025-06-24T03:55:08.2602326Z ISTIO_CPU_LIMIT: 2 (limits.cpu) | |
| 2025-06-24T03:55:08.2602774Z PROXY_CONFIG: {} | |
| 2025-06-24T03:55:08.2603339Z | |
| 2025-06-24T03:55:08.2603725Z ISTIO_META_POD_PORTS: [] | |
| 2025-06-24T03:55:08.2604089Z ISTIO_META_APP_CONTAINERS: | |
| 2025-06-24T03:55:08.2604366Z GOMEMLIMIT: 1073741824 (limits.memory) | |
| 2025-06-24T03:55:08.2604678Z GOMAXPROCS: 2 (limits.cpu) | |
| 2025-06-24T03:55:08.2605160Z ISTIO_META_CLUSTER_ID: Kubernetes | |
| 2025-06-24T03:55:08.2605641Z ISTIO_META_NODE_NAME: (v1:spec.nodeName) | |
| 2025-06-24T03:55:08.2606057Z ISTIO_META_INTERCEPTION_MODE: REDIRECT | |
| 2025-06-24T03:55:08.2606399Z ISTIO_META_WORKLOAD_NAME: llm-d-zqbp1ruj3e-inference-gateway-istio | |
| 2025-06-24T03:55:08.2607253Z ISTIO_META_OWNER: kubernetes://apis/apps/v1/namespaces/llm-d-zqbp1ruj3e/deployments/llm-d-zqbp1ruj3e-inference-gateway-istio | |
| 2025-06-24T03:55:08.2607942Z ISTIO_META_MESH_ID: cluster.local | |
| 2025-06-24T03:55:08.2608274Z TRUST_DOMAIN: cluster.local | |
| 2025-06-24T03:55:08.2608618Z Mounts: | |
| 2025-06-24T03:55:08.2608807Z /etc/istio/pod from istio-podinfo (rw) | |
| 2025-06-24T03:55:08.2609127Z /etc/istio/proxy from istio-envoy (rw) | |
| 2025-06-24T03:55:08.2609514Z /var/lib/istio/data from istio-data (rw) | |
| 2025-06-24T03:55:08.2609836Z /var/run/secrets/credential-uds from credential-socket (rw) | |
| 2025-06-24T03:55:08.2610451Z /var/run/secrets/istio from istiod-ca-cert (rw) | |
| 2025-06-24T03:55:08.2611009Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-pmw6m (ro) | |
| 2025-06-24T03:55:08.2611445Z /var/run/secrets/tokens from istio-token (rw) | |
| 2025-06-24T03:55:08.2611909Z /var/run/secrets/workload-spiffe-credentials from workload-certs (rw) | |
| 2025-06-24T03:55:08.2612554Z /var/run/secrets/workload-spiffe-uds from workload-socket (rw) | |
| 2025-06-24T03:55:08.2613097Z Conditions: | |
| 2025-06-24T03:55:08.2613335Z Type Status | |
| 2025-06-24T03:55:08.2613582Z PodReadyToStartContainers True | |
| 2025-06-24T03:55:08.2613819Z Initialized True | |
| 2025-06-24T03:55:08.2614128Z Ready True | |
| 2025-06-24T03:55:08.2614352Z ContainersReady True | |
| 2025-06-24T03:55:08.2614582Z PodScheduled True | |
| 2025-06-24T03:55:08.2614884Z Volumes: | |
| 2025-06-24T03:55:08.2615051Z workload-socket: | |
| 2025-06-24T03:55:08.2615324Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.2615739Z Medium: | |
| 2025-06-24T03:55:08.2615918Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.2616115Z credential-socket: | |
| 2025-06-24T03:55:08.2616484Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.2616800Z Medium: | |
| 2025-06-24T03:55:08.2616974Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.2617253Z workload-certs: | |
| 2025-06-24T03:55:08.2617524Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.2617822Z Medium: | |
| 2025-06-24T03:55:08.2618100Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.2618283Z istio-envoy: | |
| 2025-06-24T03:55:08.2618547Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.2619111Z Medium: Memory | |
| 2025-06-24T03:55:08.2619297Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.2619508Z istio-data: | |
| 2025-06-24T03:55:08.2619984Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.2620363Z Medium: | |
| 2025-06-24T03:55:08.2620673Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.2620933Z istio-podinfo: | |
| 2025-06-24T03:55:08.2621319Z Type: DownwardAPI (a volume populated by information about the pod) | |
| 2025-06-24T03:55:08.2621810Z Items: | |
| 2025-06-24T03:55:08.2621987Z metadata.labels -> labels | |
| 2025-06-24T03:55:08.2622277Z metadata.annotations -> annotations | |
| 2025-06-24T03:55:08.2622636Z istio-token: | |
| 2025-06-24T03:55:08.2623107Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:08.2623714Z TokenExpirationSeconds: 43200 | |
| 2025-06-24T03:55:08.2623944Z istiod-ca-cert: | |
| 2025-06-24T03:55:08.2624371Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T03:55:08.2624710Z Name: istio-ca-root-cert | |
| 2025-06-24T03:55:08.2625050Z Optional: false | |
| 2025-06-24T03:55:08.2625294Z kube-api-access-pmw6m: | |
| 2025-06-24T03:55:08.2625621Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:08.2626155Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T03:55:08.2626410Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T03:55:08.2626808Z ConfigMapOptional: <nil> | |
| 2025-06-24T03:55:08.2627041Z DownwardAPI: true | |
| 2025-06-24T03:55:08.2627266Z QoS Class: Burstable | |
| 2025-06-24T03:55:08.2627624Z Node-Selectors: <none> | |
| 2025-06-24T03:55:08.2627973Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.2628590Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.2628917Z Events: | |
| 2025-06-24T03:55:08.2629218Z Type Reason Age From Message | |
| 2025-06-24T03:55:08.2629581Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:08.2630459Z Normal Scheduled 49s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg to chart-testing-control-plane | |
| 2025-06-24T03:55:08.2631596Z Normal Pulling 48s kubelet Pulling image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" | |
| 2025-06-24T03:55:08.2633385Z Normal Pulled 38s kubelet Successfully pulled image "gcr.io/istio-testing/proxyv2:1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d" in 2.653s (9.929s including waiting). Image size: 107788353 bytes. | |
| 2025-06-24T03:55:08.2634437Z Normal Created 38s kubelet Created container istio-proxy | |
| 2025-06-24T03:55:08.2634988Z Normal Started 38s kubelet Started container istio-proxy | |
| 2025-06-24T03:55:08.2635402Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.2635994Z <== Description of pod llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg | |
| 2025-06-24T03:55:08.2636529Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.2637545Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:08.3108969Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:08.3625191Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.3626166Z ==> Logs of container llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg | |
| 2025-06-24T03:55:08.3627493Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.3628455Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg --namespace llm-d-zqbp1ruj3e --container istio-proxy | |
| 2025-06-24T03:55:08.4197631Z 2025-06-24T03:54:30.265635Z info FLAG: --concurrency="0" | |
| 2025-06-24T03:55:08.4198422Z 2025-06-24T03:54:30.265663Z info FLAG: --domain="llm-d-zqbp1ruj3e.svc.cluster.local" | |
| 2025-06-24T03:55:08.4198866Z 2025-06-24T03:54:30.265668Z info FLAG: --help="false" | |
| 2025-06-24T03:55:08.4199342Z 2025-06-24T03:54:30.265671Z info FLAG: --log_as_json="false" | |
| 2025-06-24T03:55:08.4199799Z 2025-06-24T03:54:30.265674Z info FLAG: --log_caller="" | |
| 2025-06-24T03:55:08.4200442Z 2025-06-24T03:54:30.265677Z info FLAG: --log_output_level="default:info" | |
| 2025-06-24T03:55:08.4201199Z 2025-06-24T03:54:30.265685Z info FLAG: --log_stacktrace_level="default:none" | |
| 2025-06-24T03:55:08.4201874Z 2025-06-24T03:54:30.265691Z info FLAG: --log_target="[stdout]" | |
| 2025-06-24T03:55:08.4202335Z 2025-06-24T03:54:30.265694Z info FLAG: --meshConfig="./etc/istio/config/mesh" | |
| 2025-06-24T03:55:08.4202711Z 2025-06-24T03:54:30.265697Z info FLAG: --outlierLogPath="" | |
| 2025-06-24T03:55:08.4203418Z 2025-06-24T03:54:30.265704Z info FLAG: --profiling="true" | |
| 2025-06-24T03:55:08.4204073Z 2025-06-24T03:54:30.265708Z info FLAG: --proxyComponentLogLevel="misc:error" | |
| 2025-06-24T03:55:08.4204730Z 2025-06-24T03:54:30.265711Z info FLAG: --proxyLogLevel="warning" | |
| 2025-06-24T03:55:08.4205405Z 2025-06-24T03:54:30.265714Z info FLAG: --serviceCluster="istio-proxy" | |
| 2025-06-24T03:55:08.4205984Z 2025-06-24T03:54:30.265718Z info FLAG: --stsPort="0" | |
| 2025-06-24T03:55:08.4206483Z 2025-06-24T03:54:30.265828Z info FLAG: --templateFile="" | |
| 2025-06-24T03:55:08.4207015Z 2025-06-24T03:54:30.266214Z info FLAG: --tokenManagerPlugin="" | |
| 2025-06-24T03:55:08.4207527Z 2025-06-24T03:54:30.266230Z info FLAG: --vklog="0" | |
| 2025-06-24T03:55:08.4208484Z 2025-06-24T03:54:30.266234Z info Version 1.26-alpha.9befed2f1439d883120f8de70fd70d84ca0ebc3d-9befed2f1439d883120f8de70fd70d84ca0ebc3d-Clean | |
| 2025-06-24T03:55:08.4209563Z 2025-06-24T03:54:30.266238Z info Set max file descriptors (ulimit -n) to: 1048576 | |
| 2025-06-24T03:55:08.4210933Z 2025-06-24T03:54:30.266429Z info Proxy role ips=[10.244.0.15] type=router id=llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e domain=llm-d-zqbp1ruj3e.svc.cluster.local | |
| 2025-06-24T03:55:08.4212325Z 2025-06-24T03:54:30.266476Z info Apply proxy config from env {} | |
| 2025-06-24T03:55:08.4212713Z | |
| 2025-06-24T03:55:08.4213463Z 2025-06-24T03:54:30.267211Z info cpu limit detected as 2, setting concurrency | |
| 2025-06-24T03:55:08.4214220Z 2025-06-24T03:54:30.267401Z info Effective config: binaryPath: /usr/local/bin/envoy | |
| 2025-06-24T03:55:08.4214770Z concurrency: 2 | |
| 2025-06-24T03:55:08.4215076Z configPath: ./etc/istio/proxy | |
| 2025-06-24T03:55:08.4215477Z controlPlaneAuthPolicy: MUTUAL_TLS | |
| 2025-06-24T03:55:08.4215921Z discoveryAddress: istiod.istio-system.svc:15012 | |
| 2025-06-24T03:55:08.4216340Z drainDuration: 45s | |
| 2025-06-24T03:55:08.4216634Z proxyAdminPort: 15000 | |
| 2025-06-24T03:55:08.4216952Z serviceCluster: istio-proxy | |
| 2025-06-24T03:55:08.4217282Z statNameLength: 189 | |
| 2025-06-24T03:55:08.4217572Z statusPort: 15020 | |
| 2025-06-24T03:55:08.4217873Z terminationDrainDuration: 5s | |
| 2025-06-24T03:55:08.4218257Z | |
| 2025-06-24T03:55:08.4218480Z 2025-06-24T03:54:30.267416Z info JWT policy is third-party-jwt | |
| 2025-06-24T03:55:08.4219254Z 2025-06-24T03:54:30.267419Z info using credential fetcher of JWT type in cluster.local trust domain | |
| 2025-06-24T03:55:08.4219979Z 2025-06-24T03:54:30.267519Z info platform detected is Azure | |
| 2025-06-24T03:55:08.4220524Z 2025-06-24T03:54:30.339582Z info Starting default Istio SDS Server | |
| 2025-06-24T03:55:08.4221228Z 2025-06-24T03:54:30.339611Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel | |
| 2025-06-24T03:55:08.4222231Z 2025-06-24T03:54:30.339638Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem | |
| 2025-06-24T03:55:08.4223406Z 2025-06-24T03:54:30.339649Z info Opening status port 15020 | |
| 2025-06-24T03:55:08.4224358Z 2025-06-24T03:54:30.340467Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" | |
| 2025-06-24T03:55:08.4225410Z 2025-06-24T03:54:30.342758Z info Pilot SAN: [istiod.istio-system.svc] | |
| 2025-06-24T03:55:08.4226015Z 2025-06-24T03:54:30.343632Z info Starting proxy agent | |
| 2025-06-24T03:55:08.4228059Z 2025-06-24T03:54:30.343666Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] | |
| 2025-06-24T03:55:08.4230142Z 2025-06-24T03:54:30.344287Z info sds Starting SDS grpc server | |
| 2025-06-24T03:55:08.4231199Z 2025-06-24T03:54:30.344363Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" | |
| 2025-06-24T03:55:08.4233871Z 2025-06-24T03:54:30.389973Z warning envoy main external/envoy/source/server/server.cc:874 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=19 | |
| 2025-06-24T03:55:08.4236662Z 2025-06-24T03:54:30.390284Z warning envoy main external/envoy/source/server/server.cc:970 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=19 | |
| 2025-06-24T03:55:08.4238684Z 2025-06-24T03:54:30.394970Z info xdsproxy connected to delta upstream XDS server: istiod.istio-system.svc:15012 id=1 | |
| 2025-06-24T03:55:08.4239559Z 2025-06-24T03:54:30.417667Z info ads ADS: new connection for node:1 | |
| 2025-06-24T03:55:08.4240164Z 2025-06-24T03:54:30.418648Z info ads ADS: new connection for node:2 | |
| 2025-06-24T03:55:08.4240995Z 2025-06-24T03:54:30.419712Z info cache generated new workload certificate resourceName=default latency=77.389377ms ttl=23h59m59.580289634s | |
| 2025-06-24T03:55:08.4241873Z 2025-06-24T03:54:30.420185Z info cache Root cert has changed, start rotating root cert | |
| 2025-06-24T03:55:08.4242489Z 2025-06-24T03:54:30.420216Z info cache returned workload trust anchor from cache ttl=23h59m59.579784312s | |
| 2025-06-24T03:55:08.4243313Z 2025-06-24T03:54:30.420233Z info cache returned workload certificate from cache ttl=23h59m59.5797672s | |
| 2025-06-24T03:55:08.4244163Z 2025-06-24T03:54:30.420324Z info cache returned workload trust anchor from cache ttl=23h59m59.579677106s | |
| 2025-06-24T03:55:08.4244870Z 2025-06-24T03:54:30.420589Z info cache returned workload trust anchor from cache ttl=23h59m59.579411661s | |
| 2025-06-24T03:55:08.4245510Z 2025-06-24T03:54:31.149078Z info Readiness succeeded in 885.29102ms | |
| 2025-06-24T03:55:08.4245960Z 2025-06-24T03:54:31.149424Z info Envoy proxy is ready | |
| 2025-06-24T03:55:08.4246500Z 2025-06-24T03:54:50.272661Z info xdsproxy connected to delta upstream XDS server: istiod.istio-system.svc:15012 id=5 | |
| 2025-06-24T03:55:08.4247241Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.4247896Z <== Logs of container llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg | |
| 2025-06-24T03:55:08.4248448Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.4248940Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.4249490Z ==> Description of pod llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk | |
| 2025-06-24T03:55:08.4249883Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.4251168Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.4774714Z Name: llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk | |
| 2025-06-24T03:55:08.4775472Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.4776100Z Priority: 0 | |
| 2025-06-24T03:55:08.4776575Z Service Account: llm-d-zqbp1ruj3e-llm-d-zqbp1ruj3e-modelservice | |
| 2025-06-24T03:55:08.4777212Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:08.4777747Z Start Time: Tue, 24 Jun 2025 03:54:19 +0000 | |
| 2025-06-24T03:55:08.4778327Z Labels: app.kubernetes.io/component=modelservice | |
| 2025-06-24T03:55:08.4778880Z app.kubernetes.io/instance=llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.4779396Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T03:55:08.4779870Z app.kubernetes.io/name=llm-d | |
| 2025-06-24T03:55:08.4780323Z app.kubernetes.io/version=0.1 | |
| 2025-06-24T03:55:08.4780793Z control-plane=controller-manager | |
| 2025-06-24T03:55:08.4781256Z helm.sh/chart=llm-d-1.0.20 | |
| 2025-06-24T03:55:08.4781700Z pod-template-hash=ddcc68857 | |
| 2025-06-24T03:55:08.4782123Z Annotations: <none> | |
| 2025-06-24T03:55:08.4782466Z Status: Running | |
| 2025-06-24T03:55:08.4782807Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T03:55:08.4783271Z IP: 10.244.0.14 | |
| 2025-06-24T03:55:08.4783476Z IPs: | |
| 2025-06-24T03:55:08.4783638Z IP: 10.244.0.14 | |
| 2025-06-24T03:55:08.4784153Z Controlled By: ReplicaSet/llm-d-zqbp1ruj3e-modelservice-ddcc68857 | |
| 2025-06-24T03:55:08.4784753Z Containers: | |
| 2025-06-24T03:55:08.4785048Z manager: | |
| 2025-06-24T03:55:08.4785703Z Container ID: containerd://11e41ae9cbf800be658a87ab976599d0e7013b20e01a7be67887ca9df617518b | |
| 2025-06-24T03:55:08.4786508Z Image: ghcr.io/llm-d/llm-d-model-service:0.0.10 | |
| 2025-06-24T03:55:08.4787473Z Image ID: ghcr.io/llm-d/llm-d-model-service@sha256:4d38789615184aa173eaf0c085ecd7f3dc0f3970af5e97ecb4b25fdfcf54b82e | |
| 2025-06-24T03:55:08.4788402Z Port: <none> | |
| 2025-06-24T03:55:08.4788977Z Host Port: <none> | |
| 2025-06-24T03:55:08.4789310Z Command: | |
| 2025-06-24T03:55:08.4789599Z /manager | |
| 2025-06-24T03:55:08.4789894Z Args: | |
| 2025-06-24T03:55:08.4790210Z --leader-elect=false | |
| 2025-06-24T03:55:08.4790608Z --health-probe-bind-address=:8081 | |
| 2025-06-24T03:55:08.4791074Z --epp-cluster-role | |
| 2025-06-24T03:55:08.4791543Z llm-d-zqbp1ruj3e-modelservice-endpoint-picker | |
| 2025-06-24T03:55:08.4792046Z --epp-pull-secrets | |
| 2025-06-24T03:55:08.4792389Z | |
| 2025-06-24T03:55:08.4793216Z --pd-pull-secrets | |
| 2025-06-24T03:55:08.4793595Z | |
| 2025-06-24T03:55:08.4793799Z State: Running | |
| 2025-06-24T03:55:08.4794182Z Started: Tue, 24 Jun 2025 03:54:27 +0000 | |
| 2025-06-24T03:55:08.4794611Z Ready: True | |
| 2025-06-24T03:55:08.4794967Z Restart Count: 0 | |
| 2025-06-24T03:55:08.4795247Z Limits: | |
| 2025-06-24T03:55:08.4795426Z cpu: 250m | |
| 2025-06-24T03:55:08.4795600Z memory: 250Mi | |
| 2025-06-24T03:55:08.4795775Z Requests: | |
| 2025-06-24T03:55:08.4796065Z cpu: 100m | |
| 2025-06-24T03:55:08.4796385Z memory: 100Mi | |
| 2025-06-24T03:55:08.4797017Z Liveness: http-get http://:8081/healthz delay=15s timeout=1s period=20s #success=1 #failure=3 | |
| 2025-06-24T03:55:08.4798044Z Readiness: http-get http://:8081/readyz delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T03:55:08.4798760Z Environment: <none> | |
| 2025-06-24T03:55:08.4799079Z Mounts: | |
| 2025-06-24T03:55:08.4799607Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-784fs (ro) | |
| 2025-06-24T03:55:08.4799979Z Conditions: | |
| 2025-06-24T03:55:08.4800155Z Type Status | |
| 2025-06-24T03:55:08.4800394Z PodReadyToStartContainers True | |
| 2025-06-24T03:55:08.4800632Z Initialized True | |
| 2025-06-24T03:55:08.4800930Z Ready True | |
| 2025-06-24T03:55:08.4801597Z ContainersReady True | |
| 2025-06-24T03:55:08.4802003Z PodScheduled True | |
| 2025-06-24T03:55:08.4802379Z Volumes: | |
| 2025-06-24T03:55:08.4802686Z kube-api-access-784fs: | |
| 2025-06-24T03:55:08.4803437Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:08.4804104Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T03:55:08.4804532Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T03:55:08.4804973Z ConfigMapOptional: <nil> | |
| 2025-06-24T03:55:08.4805358Z DownwardAPI: true | |
| 2025-06-24T03:55:08.4805750Z QoS Class: Burstable | |
| 2025-06-24T03:55:08.4806144Z Node-Selectors: <none> | |
| 2025-06-24T03:55:08.4806691Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.4807265Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.4807660Z Events: | |
| 2025-06-24T03:55:08.4807879Z Type Reason Age From Message | |
| 2025-06-24T03:55:08.4808182Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:08.4809096Z Normal Scheduled 49s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk to chart-testing-control-plane | |
| 2025-06-24T03:55:08.4810020Z Normal Pulling 48s kubelet Pulling image "ghcr.io/llm-d/llm-d-model-service:0.0.10" | |
| 2025-06-24T03:55:08.4810873Z Normal Pulled 41s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-model-service:0.0.10" in 4.02s (7.341s including waiting). Image size: 115030935 bytes. | |
| 2025-06-24T03:55:08.4811642Z Normal Created 41s kubelet Created container manager | |
| 2025-06-24T03:55:08.4812143Z Normal Started 41s kubelet Started container manager | |
| 2025-06-24T03:55:08.4812545Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.4813278Z <== Description of pod llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk | |
| 2025-06-24T03:55:08.4813681Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.4814528Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:08.5329645Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:08.5846321Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.5847127Z ==> Logs of container llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk | |
| 2025-06-24T03:55:08.5847802Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.5849036Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk --namespace llm-d-zqbp1ruj3e --container manager | |
| 2025-06-24T03:55:08.6370549Z {"level":"info","ts":"2025-06-24T03:54:27.858210404Z","logger":"setup","caller":"cmd/root.go:272","msg":"starting manager"} | |
| 2025-06-24T03:55:08.6371751Z {"level":"info","ts":"2025-06-24T03:54:27.858558437Z","caller":"manager/server.go:83","msg":"starting server","name":"health probe","addr":"[::]:8081"} | |
| 2025-06-24T03:55:08.6374346Z {"level":"info","ts":"2025-06-24T03:54:27.858742441Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T03:55:08.6376704Z {"level":"info","ts":"2025-06-24T03:54:27.858775667Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ConfigMap"} | |
| 2025-06-24T03:55:08.6379218Z {"level":"info","ts":"2025-06-24T03:54:27.858828407Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.RoleBinding"} | |
| 2025-06-24T03:55:08.6380986Z {"level":"info","ts":"2025-06-24T03:54:27.858878498Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Service"} | |
| 2025-06-24T03:55:08.6382613Z {"level":"info","ts":"2025-06-24T03:54:27.858845262Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.Deployment"} | |
| 2025-06-24T03:55:08.6384276Z {"level":"info","ts":"2025-06-24T03:54:27.858858952Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T03:55:08.6385961Z {"level":"info","ts":"2025-06-24T03:54:27.858918515Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha1.ModelService"} | |
| 2025-06-24T03:55:08.6387608Z {"level":"info","ts":"2025-06-24T03:54:27.858837793Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T03:55:08.6389227Z {"level":"info","ts":"2025-06-24T03:54:27.858744669Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","source":"kind source: *v1.ServiceAccount"} | |
| 2025-06-24T03:55:08.6391320Z {"level":"info","ts":"2025-06-24T03:54:27.97707152Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService"} | |
| 2025-06-24T03:55:08.6393484Z {"level":"info","ts":"2025-06-24T03:54:27.977101857Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"modelservice","controllerGroup":"llm-d.ai","controllerKind":"ModelService","worker count":1} | |
| 2025-06-24T03:55:08.6395303Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.6395902Z <== Logs of container llm-d-zqbp1ruj3e-modelservice-ddcc68857-ndpmk | |
| 2025-06-24T03:55:08.6396346Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.6396860Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.6397272Z ==> Description of pod llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 | |
| 2025-06-24T03:55:08.6397774Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.6398466Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.6923705Z Name: llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 | |
| 2025-06-24T03:55:08.6924303Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.6924681Z Priority: 0 | |
| 2025-06-24T03:55:08.6925098Z Service Account: llm-d-zqbp1ruj3e-redis-master | |
| 2025-06-24T03:55:08.6925613Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:08.6926102Z Start Time: Tue, 24 Jun 2025 03:54:19 +0000 | |
| 2025-06-24T03:55:08.6926574Z Labels: app.kubernetes.io/component=master | |
| 2025-06-24T03:55:08.6927065Z app.kubernetes.io/instance=llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.6927872Z app.kubernetes.io/managed-by=Helm | |
| 2025-06-24T03:55:08.6928307Z app.kubernetes.io/name=redis | |
| 2025-06-24T03:55:08.6928824Z app.kubernetes.io/version=7.4.3 | |
| 2025-06-24T03:55:08.6929237Z helm.sh/chart=redis-20.13.4 | |
| 2025-06-24T03:55:08.6929655Z pod-template-hash=7d97d5f748 | |
| 2025-06-24T03:55:08.6930424Z Annotations: checksum/configmap: 2a9ab4a5432825504d910f022638674ce88eaefe9f9f595ad8bc107377d104fb | |
| 2025-06-24T03:55:08.6931466Z checksum/health: aff24913d801436ea469d8d374b2ddb3ec4c43ee7ab24663d5f8ff1a1b6991a9 | |
| 2025-06-24T03:55:08.6932425Z checksum/scripts: bdec350b84a1ace7cc118db113a21c9f160bde3425b07714e1c0c1da722621cf | |
| 2025-06-24T03:55:08.6933443Z checksum/secret: 44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a | |
| 2025-06-24T03:55:08.6934223Z Status: Running | |
| 2025-06-24T03:55:08.6934537Z IP: 10.244.0.13 | |
| 2025-06-24T03:55:08.6934851Z IPs: | |
| 2025-06-24T03:55:08.6935095Z IP: 10.244.0.13 | |
| 2025-06-24T03:55:08.6935606Z Controlled By: ReplicaSet/llm-d-zqbp1ruj3e-redis-master-7d97d5f748 | |
| 2025-06-24T03:55:08.6936123Z Containers: | |
| 2025-06-24T03:55:08.6936374Z redis: | |
| 2025-06-24T03:55:08.6937008Z Container ID: containerd://6aa15991ccc96cb9e5587017e6eb643d0fff19ce56b7859ebd8865cf8097e8e2 | |
| 2025-06-24T03:55:08.6937872Z Image: quay.io/sclorg/redis-7-c9s:c9s | |
| 2025-06-24T03:55:08.6938664Z Image ID: quay.io/sclorg/redis-7-c9s@sha256:d772acab11507231a2b152850f47c8b9b859dedb6652ca624949e97cb28c5e6f | |
| 2025-06-24T03:55:08.6939416Z Port: 6379/TCP | |
| 2025-06-24T03:55:08.6939746Z Host Port: 0/TCP | |
| 2025-06-24T03:55:08.6940087Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T03:55:08.6940431Z Command: | |
| 2025-06-24T03:55:08.6940686Z /bin/bash | |
| 2025-06-24T03:55:08.6940946Z Args: | |
| 2025-06-24T03:55:08.6941187Z -ec | |
| 2025-06-24T03:55:08.6941545Z /opt/bitnami/scripts/start-scripts/start-master.sh | |
| 2025-06-24T03:55:08.6941993Z State: Running | |
| 2025-06-24T03:55:08.6942367Z Started: Tue, 24 Jun 2025 03:54:23 +0000 | |
| 2025-06-24T03:55:08.6942784Z Ready: True | |
| 2025-06-24T03:55:08.6943240Z Restart Count: 0 | |
| 2025-06-24T03:55:08.6943536Z Limits: | |
| 2025-06-24T03:55:08.6943808Z cpu: 250m | |
| 2025-06-24T03:55:08.6944098Z memory: 256Mi | |
| 2025-06-24T03:55:08.6944396Z Requests: | |
| 2025-06-24T03:55:08.6944666Z cpu: 100m | |
| 2025-06-24T03:55:08.6944944Z memory: 128Mi | |
| 2025-06-24T03:55:08.6945827Z Liveness: exec [/bin/bash -ec /health/ping_liveness_local.sh 5] delay=20s timeout=6s period=5s #success=1 #failure=5 | |
| 2025-06-24T03:55:08.6947015Z Readiness: exec [/bin/bash -ec /health/ping_readiness_local.sh 1] delay=20s timeout=2s period=5s #success=1 #failure=5 | |
| 2025-06-24T03:55:08.6947727Z Environment: | |
| 2025-06-24T03:55:08.6948008Z BITNAMI_DEBUG: false | |
| 2025-06-24T03:55:08.6948372Z REDIS_REPLICATION_MODE: master | |
| 2025-06-24T03:55:08.6948730Z ALLOW_EMPTY_PASSWORD: yes | |
| 2025-06-24T03:55:08.6949103Z REDIS_TLS_ENABLED: no | |
| 2025-06-24T03:55:08.6949559Z REDIS_PORT: 6379 | |
| 2025-06-24T03:55:08.6950092Z Mounts: | |
| 2025-06-24T03:55:08.6950401Z /data from redis-data (rw) | |
| 2025-06-24T03:55:08.6950895Z /health from health (rw) | |
| 2025-06-24T03:55:08.6951419Z /opt/bitnami/redis/etc/ from empty-dir (rw,path="app-conf-dir") | |
| 2025-06-24T03:55:08.6952030Z /opt/bitnami/redis/mounted-etc from config (rw) | |
| 2025-06-24T03:55:08.6952608Z /opt/bitnami/scripts/start-scripts from start-scripts (rw) | |
| 2025-06-24T03:55:08.6953331Z /tmp from empty-dir (rw,path="tmp-dir") | |
| 2025-06-24T03:55:08.6953756Z Conditions: | |
| 2025-06-24T03:55:08.6954059Z Type Status | |
| 2025-06-24T03:55:08.6954469Z PodReadyToStartContainers True | |
| 2025-06-24T03:55:08.6954885Z Initialized True | |
| 2025-06-24T03:55:08.6955489Z Ready True | |
| 2025-06-24T03:55:08.6955906Z ContainersReady True | |
| 2025-06-24T03:55:08.6956314Z PodScheduled True | |
| 2025-06-24T03:55:08.6956696Z Volumes: | |
| 2025-06-24T03:55:08.6956874Z start-scripts: | |
| 2025-06-24T03:55:08.6957203Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T03:55:08.6957577Z Name: llm-d-zqbp1ruj3e-redis-scripts | |
| 2025-06-24T03:55:08.6957836Z Optional: false | |
| 2025-06-24T03:55:08.6958110Z health: | |
| 2025-06-24T03:55:08.6958337Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T03:55:08.6958648Z Name: llm-d-zqbp1ruj3e-redis-health | |
| 2025-06-24T03:55:08.6958978Z Optional: false | |
| 2025-06-24T03:55:08.6959154Z config: | |
| 2025-06-24T03:55:08.6959353Z Type: ConfigMap (a volume populated by a ConfigMap) | |
| 2025-06-24T03:55:08.6959741Z Name: llm-d-zqbp1ruj3e-redis-configuration | |
| 2025-06-24T03:55:08.6960001Z Optional: false | |
| 2025-06-24T03:55:08.6960179Z empty-dir: | |
| 2025-06-24T03:55:08.6960518Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.6960831Z Medium: | |
| 2025-06-24T03:55:08.6961009Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.6961282Z redis-data: | |
| 2025-06-24T03:55:08.6961699Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:08.6962013Z Medium: | |
| 2025-06-24T03:55:08.6962327Z SizeLimit: <unset> | |
| 2025-06-24T03:55:08.6962556Z QoS Class: Burstable | |
| 2025-06-24T03:55:08.6962764Z Node-Selectors: <none> | |
| 2025-06-24T03:55:08.6963444Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.6963894Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.6964359Z Events: | |
| 2025-06-24T03:55:08.6964557Z Type Reason Age From Message | |
| 2025-06-24T03:55:08.6964941Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:08.6965790Z Normal Scheduled 49s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 to chart-testing-control-plane | |
| 2025-06-24T03:55:08.6966828Z Normal Pulling 48s kubelet Pulling image "quay.io/sclorg/redis-7-c9s:c9s" | |
| 2025-06-24T03:55:08.6967778Z Normal Pulled 45s kubelet Successfully pulled image "quay.io/sclorg/redis-7-c9s:c9s" in 3.326s (3.326s including waiting). Image size: 97229638 bytes. | |
| 2025-06-24T03:55:08.6968612Z Normal Created 45s kubelet Created container redis | |
| 2025-06-24T03:55:08.6969541Z Normal Started 45s kubelet Started container redis | |
| 2025-06-24T03:55:08.6970231Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.6970993Z <== Description of pod llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 | |
| 2025-06-24T03:55:08.6971720Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.6973420Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:08.7446058Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:08.8004413Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.8005298Z ==> Logs of container llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 | |
| 2025-06-24T03:55:08.8005916Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.8006710Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 --namespace llm-d-zqbp1ruj3e --container redis | |
| 2025-06-24T03:55:08.8517097Z 1:C 24 Jun 2025 03:54:23.709 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo | |
| 2025-06-24T03:55:08.8517943Z 1:C 24 Jun 2025 03:54:23.709 # Redis version=7.0.12, bits=64, commit=00000000, modified=0, pid=1, just started | |
| 2025-06-24T03:55:08.8518610Z 1:C 24 Jun 2025 03:54:23.709 # Configuration loaded | |
| 2025-06-24T03:55:08.8519126Z 1:M 24 Jun 2025 03:54:23.710 * monotonic clock: POSIX clock_gettime | |
| 2025-06-24T03:55:08.8519696Z 1:M 24 Jun 2025 03:54:23.710 * Running mode=standalone, port=6379. | |
| 2025-06-24T03:55:08.8520173Z 1:M 24 Jun 2025 03:54:23.710 # Server initialized | |
| 2025-06-24T03:55:08.8520811Z 1:M 24 Jun 2025 03:54:23.711 * Creating AOF base file appendonly.aof.1.base.rdb on server start | |
| 2025-06-24T03:55:08.8521580Z 1:M 24 Jun 2025 03:54:23.712 * Creating AOF incr file appendonly.aof.1.incr.aof on server start | |
| 2025-06-24T03:55:08.8522214Z 1:M 24 Jun 2025 03:54:23.712 * Ready to accept connections | |
| 2025-06-24T03:55:08.8537831Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.8539199Z <== Logs of container llm-d-zqbp1ruj3e-redis-master-7d97d5f748-kp278 | |
| 2025-06-24T03:55:08.8541261Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:08.8542042Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.8542691Z ==> Description of pod llm-d-zqbp1ruj3e-test-connection | |
| 2025-06-24T03:55:08.8543506Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.8544440Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-test-connection --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.9064585Z Name: llm-d-zqbp1ruj3e-test-connection | |
| 2025-06-24T03:55:08.9065270Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:08.9065660Z Priority: 0 | |
| 2025-06-24T03:55:08.9066027Z Service Account: default | |
| 2025-06-24T03:55:08.9066424Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:08.9066744Z Start Time: Tue, 24 Jun 2025 03:54:47 +0000 | |
| 2025-06-24T03:55:08.9067002Z Labels: <none> | |
| 2025-06-24T03:55:08.9067208Z Annotations: helm.sh/hook: test | |
| 2025-06-24T03:55:08.9067462Z helm.sh/hook-weight: 1 | |
| 2025-06-24T03:55:08.9067700Z Status: Succeeded | |
| 2025-06-24T03:55:08.9067927Z SeccompProfile: RuntimeDefault | |
| 2025-06-24T03:55:08.9068142Z IP: 10.244.0.16 | |
| 2025-06-24T03:55:08.9068333Z IPs: | |
| 2025-06-24T03:55:08.9068793Z IP: 10.244.0.16 | |
| 2025-06-24T03:55:08.9068977Z Containers: | |
| 2025-06-24T03:55:08.9069131Z curl: | |
| 2025-06-24T03:55:08.9069508Z Container ID: containerd://b09e1774aecc76eba48086a044c7cbcc77ca37b41bb0863de8dcbd4a49814b6b | |
| 2025-06-24T03:55:08.9069969Z Image: quay.io/curl/curl:latest | |
| 2025-06-24T03:55:08.9070401Z Image ID: quay.io/curl/curl@sha256:f95026f35f8e40ca1c11738a1c5710baadf4b8cafabab9738dadbf9fb99084a9 | |
| 2025-06-24T03:55:08.9070846Z Port: <none> | |
| 2025-06-24T03:55:08.9071043Z Host Port: <none> | |
| 2025-06-24T03:55:08.9071228Z Command: | |
| 2025-06-24T03:55:08.9071392Z /bin/sh | |
| 2025-06-24T03:55:08.9071550Z -c | |
| 2025-06-24T03:55:08.9071706Z Args: | |
| 2025-06-24T03:55:08.9072203Z echo -e "\e[32m🥷 Waiting for pods to come up\e[0m" | |
| 2025-06-24T03:55:08.9072469Z echo "" | |
| 2025-06-24T03:55:08.9073327Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-zqbp1ruj3e-inference-gateway-istio/v1/models | |
| 2025-06-24T03:55:08.9073924Z | |
| 2025-06-24T03:55:08.9074073Z echo "" | |
| 2025-06-24T03:55:08.9074234Z echo "" | |
| 2025-06-24T03:55:08.9074501Z echo -e "\e[32m🥷 Basic chat validation\e[0m" | |
| 2025-06-24T03:55:08.9074749Z echo "" | |
| 2025-06-24T03:55:08.9075318Z curl --connect-timeout 5 --max-time 20 --retry 20 --retry-delay 10 --retry-max-time 60 --retry-all-errors http://llm-d-zqbp1ruj3e-inference-gateway-istio/v1/chat/completions \ | |
| 2025-06-24T03:55:08.9076141Z -H 'accept: application/json' \ | |
| 2025-06-24T03:55:08.9076405Z -H 'Content-Type: application/json' \ | |
| 2025-06-24T03:55:08.9076778Z -d '{"model":"food-review","messages":[{"content":"Say hi","role":"user"}],"stream":false}' | |
| 2025-06-24T03:55:08.9077132Z | |
| 2025-06-24T03:55:08.9077300Z State: Terminated | |
| 2025-06-24T03:55:08.9077510Z Reason: Completed | |
| 2025-06-24T03:55:08.9077712Z Exit Code: 0 | |
| 2025-06-24T03:55:08.9077913Z Started: Tue, 24 Jun 2025 03:55:02 +0000 | |
| 2025-06-24T03:55:08.9078186Z Finished: Tue, 24 Jun 2025 03:55:04 +0000 | |
| 2025-06-24T03:55:08.9078425Z Ready: False | |
| 2025-06-24T03:55:08.9078615Z Restart Count: 0 | |
| 2025-06-24T03:55:08.9078782Z Limits: | |
| 2025-06-24T03:55:08.9078942Z cpu: 10m | |
| 2025-06-24T03:55:08.9079110Z memory: 20Mi | |
| 2025-06-24T03:55:08.9079278Z Requests: | |
| 2025-06-24T03:55:08.9079445Z cpu: 10m | |
| 2025-06-24T03:55:08.9079616Z memory: 20Mi | |
| 2025-06-24T03:55:08.9079944Z Liveness: exec [ls /usr/bin/curl] delay=0s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T03:55:08.9080306Z Environment: <none> | |
| 2025-06-24T03:55:08.9080495Z Mounts: | |
| 2025-06-24T03:55:08.9080792Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-9qvvf (ro) | |
| 2025-06-24T03:55:08.9081336Z Conditions: | |
| 2025-06-24T03:55:08.9081543Z Type Status | |
| 2025-06-24T03:55:08.9081787Z PodReadyToStartContainers False | |
| 2025-06-24T03:55:08.9082176Z Initialized True | |
| 2025-06-24T03:55:08.9082563Z Ready False | |
| 2025-06-24T03:55:08.9083119Z ContainersReady False | |
| 2025-06-24T03:55:08.9083537Z PodScheduled True | |
| 2025-06-24T03:55:08.9083906Z Volumes: | |
| 2025-06-24T03:55:08.9084198Z kube-api-access-9qvvf: | |
| 2025-06-24T03:55:08.9084765Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:08.9085314Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T03:55:08.9085569Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T03:55:08.9085923Z ConfigMapOptional: <nil> | |
| 2025-06-24T03:55:08.9086161Z DownwardAPI: true | |
| 2025-06-24T03:55:08.9086380Z QoS Class: Guaranteed | |
| 2025-06-24T03:55:08.9086692Z Node-Selectors: <none> | |
| 2025-06-24T03:55:08.9087046Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.9087944Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:08.9088282Z Events: | |
| 2025-06-24T03:55:08.9088574Z Type Reason Age From Message | |
| 2025-06-24T03:55:08.9088869Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:08.9089587Z Normal Scheduled 21s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-test-connection to chart-testing-control-plane | |
| 2025-06-24T03:55:08.9090410Z Normal Pulling 18s kubelet Pulling image "quay.io/curl/curl:latest" | |
| 2025-06-24T03:55:08.9091177Z Normal Pulled 12s kubelet Successfully pulled image "quay.io/curl/curl:latest" in 904ms (5.797s including waiting). Image size: 9956545 bytes. | |
| 2025-06-24T03:55:08.9092100Z Normal Created 12s kubelet Created container curl | |
| 2025-06-24T03:55:08.9092792Z Normal Started 6s kubelet Started container curl | |
| 2025-06-24T03:55:08.9093706Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.9094214Z <== Description of pod llm-d-zqbp1ruj3e-test-connection | |
| 2025-06-24T03:55:08.9094687Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:08.9095505Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-test-connection --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:08.9588219Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-test-connection --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:09.0106930Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.0607563Z ==> Logs of container llm-d-zqbp1ruj3e-test-connection | |
| 2025-06-24T03:55:09.0608345Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.0609383Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-test-connection --namespace llm-d-zqbp1ruj3e --container curl | |
| 2025-06-24T03:55:09.0610519Z [32m🥷 Waiting for pods to come up[0m | |
| 2025-06-24T03:55:09.0610810Z | |
| 2025-06-24T03:55:09.0611086Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T03:55:09.0611696Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T03:55:09.0612018Z | |
| 2025-06-24T03:55:09.0612185Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T03:55:09.0612677Z 100 237 100 237 0 0 1732 0 --:--:-- --:--:-- --:--:-- 2078 | |
| 2025-06-24T03:55:09.0614359Z {"object":"list","data":[{"id":"food-review","object":"model","created":1750737303,"owned_by":"vllm","root":"food-review","parent":null},{"id":"","object":"model","created":1750737303,"owned_by":"vllm","root":"","parent":"food-review"}]} | |
| 2025-06-24T03:55:09.0615479Z | |
| 2025-06-24T03:55:09.0615692Z [32m🥷 Basic chat validation[0m | |
| 2025-06-24T03:55:09.0615936Z | |
| 2025-06-24T03:55:09.0616230Z % Total % Received % Xferd Average Speed Time Time Time Current | |
| 2025-06-24T03:55:09.0616807Z Dload Upload Total Spent Left Speed | |
| 2025-06-24T03:55:09.0617130Z | |
| 2025-06-24T03:55:09.0617324Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 | |
| 2025-06-24T03:55:09.0617822Z 100 323 100 237 100 86 2302 835 --:--:-- --:--:-- --:--:-- 3987 | |
| 2025-06-24T03:55:09.0629418Z {"id":"chatcmpl-8e8e0fa0-e53d-4c68-84a0-da098e6f212e","created":1750737304,"model":"food-review","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"I am your AI assistant, how can I help you today?"}}]} | |
| 2025-06-24T03:55:09.0631063Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.0631964Z <== Logs of container llm-d-zqbp1ruj3e-test-connection | |
| 2025-06-24T03:55:09.0632429Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.0632865Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.0633546Z ==> Description of pod llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.0633989Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.0634613Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.1175701Z Name: llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.1176299Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.1176822Z Priority: 0 | |
| 2025-06-24T03:55:09.1177235Z Service Account: llm-d-zqbp1ruj3e-vllm-sim-sa | |
| 2025-06-24T03:55:09.1177779Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:09.1178278Z Start Time: Tue, 24 Jun 2025 03:54:47 +0000 | |
| 2025-06-24T03:55:09.1178765Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T03:55:09.1179225Z llm-d.ai/model=food-review | |
| 2025-06-24T03:55:09.1179632Z llm-d.ai/role=decode | |
| 2025-06-24T03:55:09.1180370Z pod-template-hash=6457f6f4bc | |
| 2025-06-24T03:55:09.1180793Z Annotations: <none> | |
| 2025-06-24T03:55:09.1181132Z Status: Running | |
| 2025-06-24T03:55:09.1181434Z IP: 10.244.0.18 | |
| 2025-06-24T03:55:09.1181637Z IPs: | |
| 2025-06-24T03:55:09.1181795Z IP: 10.244.0.18 | |
| 2025-06-24T03:55:09.1182119Z Controlled By: ReplicaSet/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc | |
| 2025-06-24T03:55:09.1182459Z Init Containers: | |
| 2025-06-24T03:55:09.1182640Z routing-proxy: | |
| 2025-06-24T03:55:09.1183283Z Container ID: containerd://5552524de6b39a01e98975da45468421d158b7b95d9f58c937894e8fc524dea6 | |
| 2025-06-24T03:55:09.1183769Z Image: ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6 | |
| 2025-06-24T03:55:09.1184319Z Image ID: ghcr.io/llm-d/llm-d-routing-sidecar@sha256:7f3db0d03f3b3b16ec2a0e8d0d855bb7db83ef8d670dd9027f194e772a87856b | |
| 2025-06-24T03:55:09.1185211Z Port: 8000/TCP | |
| 2025-06-24T03:55:09.1185580Z Host Port: 0/TCP | |
| 2025-06-24T03:55:09.1185940Z Args: | |
| 2025-06-24T03:55:09.1186219Z --port=8000 | |
| 2025-06-24T03:55:09.1186549Z --vllm-port=8001 | |
| 2025-06-24T03:55:09.1187001Z State: Running | |
| 2025-06-24T03:55:09.1187397Z Started: Tue, 24 Jun 2025 03:54:55 +0000 | |
| 2025-06-24T03:55:09.1187825Z Ready: True | |
| 2025-06-24T03:55:09.1188143Z Restart Count: 0 | |
| 2025-06-24T03:55:09.1188462Z Environment: <none> | |
| 2025-06-24T03:55:09.1188780Z Mounts: | |
| 2025-06-24T03:55:09.1189297Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tbqt9 (ro) | |
| 2025-06-24T03:55:09.1189919Z Containers: | |
| 2025-06-24T03:55:09.1190201Z vllm: | |
| 2025-06-24T03:55:09.1190828Z Container ID: containerd://5cec76f32e27b16df66c1ea00ce9cd9c9f2f0b86301add0500a7ba7e9756021e | |
| 2025-06-24T03:55:09.1191546Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T03:55:09.1192344Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T03:55:09.1193220Z Port: 5557/TCP | |
| 2025-06-24T03:55:09.1193578Z Host Port: 0/TCP | |
| 2025-06-24T03:55:09.1193901Z Args: | |
| 2025-06-24T03:55:09.1194185Z --model | |
| 2025-06-24T03:55:09.1194474Z food-review | |
| 2025-06-24T03:55:09.1194780Z --port | |
| 2025-06-24T03:55:09.1195064Z 8001 | |
| 2025-06-24T03:55:09.1195489Z State: Running | |
| 2025-06-24T03:55:09.1195875Z Started: Tue, 24 Jun 2025 03:54:55 +0000 | |
| 2025-06-24T03:55:09.1196310Z Ready: True | |
| 2025-06-24T03:55:09.1196647Z Restart Count: 0 | |
| 2025-06-24T03:55:09.1196950Z Environment: | |
| 2025-06-24T03:55:09.1197601Z HOME: /home | |
| 2025-06-24T03:55:09.1197927Z Mounts: | |
| 2025-06-24T03:55:09.1198209Z /home from home (rw) | |
| 2025-06-24T03:55:09.1198821Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tbqt9 (ro) | |
| 2025-06-24T03:55:09.1199468Z Conditions: | |
| 2025-06-24T03:55:09.1199643Z Type Status | |
| 2025-06-24T03:55:09.1199893Z PodReadyToStartContainers True | |
| 2025-06-24T03:55:09.1200127Z Initialized True | |
| 2025-06-24T03:55:09.1200343Z Ready True | |
| 2025-06-24T03:55:09.1200567Z ContainersReady True | |
| 2025-06-24T03:55:09.1200938Z PodScheduled True | |
| 2025-06-24T03:55:09.1201309Z Volumes: | |
| 2025-06-24T03:55:09.1201578Z home: | |
| 2025-06-24T03:55:09.1202028Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:09.1202512Z Medium: | |
| 2025-06-24T03:55:09.1202702Z SizeLimit: <unset> | |
| 2025-06-24T03:55:09.1203159Z kube-api-access-tbqt9: | |
| 2025-06-24T03:55:09.1203780Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:09.1204318Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T03:55:09.1204737Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T03:55:09.1205043Z ConfigMapOptional: <nil> | |
| 2025-06-24T03:55:09.1205276Z DownwardAPI: true | |
| 2025-06-24T03:55:09.1205683Z QoS Class: BestEffort | |
| 2025-06-24T03:55:09.1205920Z Node-Selectors: <none> | |
| 2025-06-24T03:55:09.1206252Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:09.1206672Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:09.1206973Z Events: | |
| 2025-06-24T03:55:09.1207162Z Type Reason Age From Message | |
| 2025-06-24T03:55:09.1207433Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:09.1208444Z Normal Scheduled 22s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs to chart-testing-control-plane | |
| 2025-06-24T03:55:09.1209366Z Normal Pulling 21s kubelet Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" | |
| 2025-06-24T03:55:09.1210329Z Normal Pulled 15s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:0.0.6" in 3.131s (6.253s including waiting). Image size: 85265962 bytes. | |
| 2025-06-24T03:55:09.1211090Z Normal Created 15s kubelet Created container routing-proxy | |
| 2025-06-24T03:55:09.1211606Z Normal Started 14s kubelet Started container routing-proxy | |
| 2025-06-24T03:55:09.1212157Z Normal Pulled 14s kubelet Container image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" already present on machine | |
| 2025-06-24T03:55:09.1212680Z Normal Created 14s kubelet Created container vllm | |
| 2025-06-24T03:55:09.1213254Z Normal Started 14s kubelet Started container vllm | |
| 2025-06-24T03:55:09.1213641Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.1214043Z <== Description of pod llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.1214441Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.1215270Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:09.1705995Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.1707048Z ==> Logs of init container llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.1707984Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.1709058Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs --namespace llm-d-zqbp1ruj3e --container routing-proxy | |
| 2025-06-24T03:55:09.2214700Z I0624 03:54:55.034762 1 cmd.go:51] "p/d connector validated" connector="nixl" | |
| 2025-06-24T03:55:09.2215489Z I0624 03:54:55.035780 1 proxy.go:115] "starting" logger="proxy server" addr="[::]:8000" | |
| 2025-06-24T03:55:09.2235149Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.2236011Z <== Logs of init container llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.2236698Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.2238118Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:09.2747673Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.2748652Z ==> Logs of container llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.2749432Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.2750528Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs --namespace llm-d-zqbp1ruj3e --container vllm | |
| 2025-06-24T03:55:09.3249019Z I0624 03:54:55.852947 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T03:55:09.3249622Z I0624 03:54:55.853190 1 simulator.go:135] "Server starting" port=8001 | |
| 2025-06-24T03:55:09.3250059Z I0624 03:55:04.269216 1 simulator.go:195] "chat completion request received" | |
| 2025-06-24T03:55:09.3267522Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.3269021Z <== Logs of container llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs | |
| 2025-06-24T03:55:09.3269641Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.3270230Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.3270906Z ==> Description of pod llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 | |
| 2025-06-24T03:55:09.3271342Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.3272038Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.3804774Z Name: llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 | |
| 2025-06-24T03:55:09.3805356Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.3805738Z Priority: 0 | |
| 2025-06-24T03:55:09.3806160Z Service Account: llm-d-zqbp1ruj3e-vllm-sim-epp-sa | |
| 2025-06-24T03:55:09.3806710Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:09.3807212Z Start Time: Tue, 24 Jun 2025 03:54:47 +0000 | |
| 2025-06-24T03:55:09.3807828Z Labels: app.kubernetes.io/gateway=llm-d-zqbp1ruj3e-inference-gateway | |
| 2025-06-24T03:55:09.3808502Z llm-d.ai/epp=llm-d-zqbp1ruj3e-vllm-sim-epp | |
| 2025-06-24T03:55:09.3809002Z pod-template-hash=58bcf5bb49 | |
| 2025-06-24T03:55:09.3809423Z Annotations: <none> | |
| 2025-06-24T03:55:09.3809769Z Status: Running | |
| 2025-06-24T03:55:09.3810095Z IP: 10.244.0.17 | |
| 2025-06-24T03:55:09.3810405Z IPs: | |
| 2025-06-24T03:55:09.3810667Z IP: 10.244.0.17 | |
| 2025-06-24T03:55:09.3811163Z Controlled By: ReplicaSet/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49 | |
| 2025-06-24T03:55:09.3811719Z Containers: | |
| 2025-06-24T03:55:09.3811926Z epp: | |
| 2025-06-24T03:55:09.3812593Z Container ID: containerd://19efea5a64a9ecde04941258069025e84230ec39314aaecf8416b487d7b7a885 | |
| 2025-06-24T03:55:09.3813388Z Image: ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4 | |
| 2025-06-24T03:55:09.3813973Z Image ID: ghcr.io/llm-d/llm-d-inference-scheduler@sha256:d5d2492ee51c76bc78bb9dc1219dd7fba1fd70afe466c76860a6cd40ddf0c6f5 | |
| 2025-06-24T03:55:09.3814505Z Ports: 9002/TCP, 9003/TCP, 9090/TCP | |
| 2025-06-24T03:55:09.3814771Z Host Ports: 0/TCP, 0/TCP, 0/TCP | |
| 2025-06-24T03:55:09.3814995Z Args: | |
| 2025-06-24T03:55:09.3815153Z --poolName | |
| 2025-06-24T03:55:09.3815367Z llm-d-zqbp1ruj3e-vllm-sim-inference-pool | |
| 2025-06-24T03:55:09.3815623Z --poolNamespace | |
| 2025-06-24T03:55:09.3815817Z llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.3815995Z -v | |
| 2025-06-24T03:55:09.3816149Z 4 | |
| 2025-06-24T03:55:09.3816305Z --zap-encoder | |
| 2025-06-24T03:55:09.3816468Z json | |
| 2025-06-24T03:55:09.3816621Z --grpcPort | |
| 2025-06-24T03:55:09.3816778Z 9002 | |
| 2025-06-24T03:55:09.3816936Z --grpcHealthPort | |
| 2025-06-24T03:55:09.3817108Z 9003 | |
| 2025-06-24T03:55:09.3817269Z State: Running | |
| 2025-06-24T03:55:09.3817488Z Started: Tue, 24 Jun 2025 03:54:51 +0000 | |
| 2025-06-24T03:55:09.3817733Z Ready: True | |
| 2025-06-24T03:55:09.3817916Z Restart Count: 0 | |
| 2025-06-24T03:55:09.3818091Z Requests: | |
| 2025-06-24T03:55:09.3818277Z cpu: 256m | |
| 2025-06-24T03:55:09.3818608Z memory: 128Mi | |
| 2025-06-24T03:55:09.3819064Z Liveness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T03:55:09.3819793Z Readiness: grpc <pod>:9003 envoy.service.ext_proc.v3.ExternalProcessor delay=5s timeout=1s period=10s #success=1 #failure=3 | |
| 2025-06-24T03:55:09.3820262Z Environment: | |
| 2025-06-24T03:55:09.3820468Z ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T03:55:09.3820727Z ENABLE_LOAD_AWARE_SCORER: true | |
| 2025-06-24T03:55:09.3820988Z ENABLE_PREFIX_AWARE_SCORER: true | |
| 2025-06-24T03:55:09.3821247Z ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T03:55:09.3821511Z KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3821963Z KVCACHE_INDEXER_REDIS_ADDR: llm-d-zqbp1ruj3e-redis-master.llm-d-zqbp1ruj3e.svc.cluster.local:8100 | |
| 2025-06-24T03:55:09.3822425Z LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3822682Z PD_ENABLED: false | |
| 2025-06-24T03:55:09.3823104Z PD_PROMPT_LEN_THRESHOLD: 10 | |
| 2025-06-24T03:55:09.3823405Z PREFILL_ENABLE_KVCACHE_AWARE_SCORER: false | |
| 2025-06-24T03:55:09.3823689Z PREFILL_ENABLE_LOAD_AWARE_SCORER: false | |
| 2025-06-24T03:55:09.3824097Z PREFILL_ENABLE_PREFIX_AWARE_SCORER: false | |
| 2025-06-24T03:55:09.3824603Z PREFILL_ENABLE_SESSION_AWARE_SCORER: false | |
| 2025-06-24T03:55:09.3825085Z PREFILL_KVCACHE_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3825974Z PREFILL_KVCACHE_INDEXER_REDIS_ADDR: llm-d-zqbp1ruj3e-redis-master.llm-d-zqbp1ruj3e.svc.cluster.local:8100 | |
| 2025-06-24T03:55:09.3827138Z PREFILL_LOAD_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3827618Z PREFILL_PREFIX_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3828194Z PREFILL_SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3828641Z PREFIX_AWARE_SCORER_WEIGHT: 2 | |
| 2025-06-24T03:55:09.3829083Z SESSION_AWARE_SCORER_WEIGHT: 1 | |
| 2025-06-24T03:55:09.3829502Z Mounts: | |
| 2025-06-24T03:55:09.3830032Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tn829 (ro) | |
| 2025-06-24T03:55:09.3830673Z Conditions: | |
| 2025-06-24T03:55:09.3830955Z Type Status | |
| 2025-06-24T03:55:09.3831209Z PodReadyToStartContainers True | |
| 2025-06-24T03:55:09.3831443Z Initialized True | |
| 2025-06-24T03:55:09.3831650Z Ready True | |
| 2025-06-24T03:55:09.3831868Z ContainersReady True | |
| 2025-06-24T03:55:09.3832079Z PodScheduled True | |
| 2025-06-24T03:55:09.3832444Z Volumes: | |
| 2025-06-24T03:55:09.3832618Z kube-api-access-tn829: | |
| 2025-06-24T03:55:09.3833128Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:09.3833513Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T03:55:09.3833765Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T03:55:09.3834021Z ConfigMapOptional: <nil> | |
| 2025-06-24T03:55:09.3834249Z DownwardAPI: true | |
| 2025-06-24T03:55:09.3834468Z QoS Class: Burstable | |
| 2025-06-24T03:55:09.3834691Z Node-Selectors: <none> | |
| 2025-06-24T03:55:09.3835019Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:09.3835439Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:09.3835740Z Events: | |
| 2025-06-24T03:55:09.3835931Z Type Reason Age From Message | |
| 2025-06-24T03:55:09.3836326Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:09.3837340Z Normal Scheduled 22s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 to chart-testing-control-plane | |
| 2025-06-24T03:55:09.3838151Z Normal Pulling 21s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" | |
| 2025-06-24T03:55:09.3838924Z Normal Pulled 18s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:0.0.4" in 3.126s (3.126s including waiting). Image size: 119587259 bytes. | |
| 2025-06-24T03:55:09.3839744Z Normal Created 18s kubelet Created container epp | |
| 2025-06-24T03:55:09.3840337Z Normal Started 18s kubelet Started container epp | |
| 2025-06-24T03:55:09.3840722Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.3841122Z <== Description of pod llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 | |
| 2025-06-24T03:55:09.3841521Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.3842273Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:09.4327450Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:09.4850488Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.4851361Z ==> Logs of container llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 | |
| 2025-06-24T03:55:09.4851967Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.4853129Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 --namespace llm-d-zqbp1ruj3e --container epp | |
| 2025-06-24T03:55:09.5374272Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"epp/main.go:146","msg":"Flags processed","flags":{"DestinationEndpointHintMetadataNamespace":"envoy.lb","certPath":"","destinationEndpointHintKey":"x-gateway-destination-endpoint","grpcHealthPort":9003,"grpcPort":9002,"kubeconfig":"","kvCacheUsagePercentageMetric":"vllm:gpu_cache_usage_perc","loraInfoMetric":"vllm:lora_requests_info","metricsPort":9090,"poolName":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","poolNamespace":"llm-d-zqbp1ruj3e","refreshMetricsInterval":50000000,"refreshPrometheusMetricsInterval":5000000000,"secureServing":true,"totalQueuedRequestsMetric":"vllm:num_requests_waiting","v":4,"zap-devel":true,"zap-encoder":{},"zap-log-level":{},"zap-stacktrace-level":{},"zap-time-encoding":{}}} | |
| 2025-06-24T03:55:09.5380419Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T03:55:09.5382878Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T03:55:09.5384887Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_LOAD_AWARE_SCORER","value":"true"} | |
| 2025-06-24T03:55:09.5386628Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"LOAD_AWARE_SCORER_WEIGHT","value":1} | |
| 2025-06-24T03:55:09.5388226Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"LOAD_AWARE_SCORER","weight":1} | |
| 2025-06-24T03:55:09.5389851Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_PREFIX_AWARE_SCORER","value":"true"} | |
| 2025-06-24T03:55:09.5391574Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFIX_AWARE_SCORER_WEIGHT","value":2} | |
| 2025-06-24T03:55:09.5393305Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:115","msg":"Initialized plugin","plugin":"PREFIX_AWARE_SCORER","weight":2} | |
| 2025-06-24T03:55:09.5395217Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T03:55:09.5396923Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T03:55:09.5398706Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5400463Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T03:55:09.5402160Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5403995Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T03:55:09.5410854Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5412118Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T03:55:09.5413506Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5414615Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T03:55:09.5415835Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5417043Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T03:55:09.5418033Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5419011Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T03:55:09.5419953Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5420859Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T03:55:09.5421772Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5422680Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T03:55:09.5423899Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_KVCACHE_AWARE_SCORER","value":"false"} | |
| 2025-06-24T03:55:09.5425745Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"KVCACHE_AWARE_SCORER"} | |
| 2025-06-24T03:55:09.5427512Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_LOAD_AWARE_SCORER","value":"false"} | |
| 2025-06-24T03:55:09.5428891Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"LOAD_AWARE_SCORER"} | |
| 2025-06-24T03:55:09.5429982Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_PREFIX_AWARE_SCORER","value":"false"} | |
| 2025-06-24T03:55:09.5431072Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"PREFIX_AWARE_SCORER"} | |
| 2025-06-24T03:55:09.5432157Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PREFILL_ENABLE_SESSION_AWARE_SCORER","value":"false"} | |
| 2025-06-24T03:55:09.5433428Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"SESSION_AWARE_SCORER"} | |
| 2025-06-24T03:55:09.5434522Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_KVCACHE_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5435669Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_KVCACHE_FILTER"} | |
| 2025-06-24T03:55:09.5437230Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LEAST_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5438875Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LEAST_QUEUE_FILTER"} | |
| 2025-06-24T03:55:09.5440830Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LORA_AFFINITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5442521Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LORA_AFFINITY_FILTER"} | |
| 2025-06-24T03:55:09.5444578Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_LOW_QUEUE_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5446352Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_LOW_QUEUE_FILTER"} | |
| 2025-06-24T03:55:09.5448129Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_SHEDDABLE_CAPACITY_FILTER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5449950Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_SHEDDABLE_CAPACITY_FILTER"} | |
| 2025-06-24T03:55:09.5451753Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_KVCACHE_UTILIZATION_SCORER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5453881Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_KVCACHE_UTILIZATION_SCORER"} | |
| 2025-06-24T03:55:09.5455308Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_QUEUE_SCORER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5456480Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_QUEUE_SCORER"} | |
| 2025-06-24T03:55:09.5457751Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFILL_ENABLE_GIE_PREFIX_SCORER","defaultValue":"false"} | |
| 2025-06-24T03:55:09.5458885Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"config/config.go:110","msg":"Skipping plugin creation as it is not enabled","name":"GIE_PREFIX_SCORER"} | |
| 2025-06-24T03:55:09.5459822Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_ENABLED","value":"false"} | |
| 2025-06-24T03:55:09.5460881Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:29","msg":"Successfully loaded environment variable","key":"PD_PROMPT_LEN_THRESHOLD","value":10} | |
| 2025-06-24T03:55:09.5462104Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"PREFIX_SCORER_BLOCK_SIZE","defaultValue":256} | |
| 2025-06-24T03:55:09.5463568Z {"level":"info","ts":"2025-06-24T03:54:51Z","caller":"env/env.go:18","msg":"Environment variable not set, using default value","key":"LOAD_AWARE_SCORER_QUEUE_THRESHOLD","defaultValue":128} | |
| 2025-06-24T03:55:09.5464964Z {"level":"info","ts":"2025-06-24T03:54:51Z","caller":"scorer/prefix_aware.go:154","msg":"Prefix aware scorer cleanup started"} | |
| 2025-06-24T03:55:09.5466285Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"setup","caller":"epp/main.go:224","msg":"Controller manager starting"} | |
| 2025-06-24T03:55:09.5470095Z {"level":"info","ts":"2025-06-24T03:54:51Z","caller":"manager/server.go:83","msg":"starting server","name":"metrics","addr":":9090"} | |
| 2025-06-24T03:55:09.5472335Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"controller-runtime.metrics","caller":"server/server.go:208","msg":"Starting metrics server"} | |
| 2025-06-24T03:55:09.5474685Z {"level":"info","ts":"2025-06-24T03:54:51Z","logger":"controller-runtime.metrics","caller":"server/server.go:247","msg":"Serving metrics server","bindAddress":":8080","secure":false} | |
| 2025-06-24T03:55:09.5476703Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"runnable/grpc.go:26","msg":"gRPC server starting","name":"health"} | |
| 2025-06-24T03:55:09.5478071Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"runnable/grpc.go:34","msg":"gRPC server listening","name":"health","port":9003} | |
| 2025-06-24T03:55:09.5480112Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","source":"kind source: *v1alpha2.InferenceModel"} | |
| 2025-06-24T03:55:09.5483581Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","source":"kind source: *v1alpha2.InferencePool"} | |
| 2025-06-24T03:55:09.5485065Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:204","msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"} | |
| 2025-06-24T03:55:09.5486988Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool"} | |
| 2025-06-24T03:55:09.5488489Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","worker count":1} | |
| 2025-06-24T03:55:09.5489968Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel"} | |
| 2025-06-24T03:55:09.5491446Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","worker count":1} | |
| 2025-06-24T03:55:09.5494179Z {"level":"Level(-2)","ts":"2025-06-24T03:54:52Z","caller":"controller/inferencemodel_reconciler.go:47","msg":"Reconciling InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-zqbp1ruj3e-vllm-sim","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim","reconcileID":"e31d3cc1-3ac5-4ecc-88a5-235a866a1e9c","inferenceModel":{"name":"llm-d-zqbp1ruj3e-vllm-sim","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5496956Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:239","msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"} | |
| 2025-06-24T03:55:09.5497916Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"controller/controller.go:248","msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1} | |
| 2025-06-24T03:55:09.5500238Z {"level":"Level(-2)","ts":"2025-06-24T03:54:52Z","caller":"controller/inferencepool_reconciler.go:45","msg":"Reconciling InferencePool","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","reconcileID":"8a154694-a968-402b-a506-316fc773c2ec","inferencePool":{"name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5504512Z {"level":"Level(-4)","ts":"2025-06-24T03:54:52Z","caller":"datastore/datastore.go:125","msg":"Updating inference pool endpoints","controller":"inferencepool","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferencePool","InferencePool":{"name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","reconcileID":"8a154694-a968-402b-a506-316fc773c2ec","inferencePool":{"name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool","namespace":"llm-d-zqbp1ruj3e"},"selector":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review"}} | |
| 2025-06-24T03:55:09.5509361Z {"level":"Level(-2)","ts":"2025-06-24T03:54:52Z","caller":"controller/inferencemodel_reconciler.go:70","msg":"Added/Updated InferenceModel","controller":"inferencemodel","controllerGroup":"inference.networking.x-k8s.io","controllerKind":"InferenceModel","InferenceModel":{"name":"llm-d-zqbp1ruj3e-vllm-sim","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim","reconcileID":"e31d3cc1-3ac5-4ecc-88a5-235a866a1e9c","inferenceModel":{"name":"llm-d-zqbp1ruj3e-vllm-sim","namespace":"llm-d-zqbp1ruj3e"},"poolRef":{"group":"inference.networking.x-k8s.io","kind":"InferencePool","name":"llm-d-zqbp1ruj3e-vllm-sim-inference-pool"},"modelName":"food-review"} | |
| 2025-06-24T03:55:09.5512207Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"runnable/grpc.go:19","msg":"gRPC server starting","name":"ext-proc"} | |
| 2025-06-24T03:55:09.5513116Z {"level":"info","ts":"2025-06-24T03:54:52Z","caller":"runnable/grpc.go:28","msg":"gRPC server listening","name":"ext-proc","port":9002} | |
| 2025-06-24T03:55:09.5516010Z {"level":"Level(-3)","ts":"2025-06-24T03:54:55Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","reconcileID":"1f6c2162-7f9a-4347-a451-5b89ed156f40","name":{"name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5519484Z {"level":"Level(-2)","ts":"2025-06-24T03:54:55Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","reconcileID":"1f6c2162-7f9a-4347-a451-5b89ed156f40","name":{"name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5522528Z {"level":"Level(-2)","ts":"2025-06-24T03:54:55Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq","namespace":"llm-d-zqbp1ruj3e"},"pod":"{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq Address:10.244.0.19 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:5bcdd4cd5c]}"} | |
| 2025-06-24T03:55:09.5526048Z {"level":"Level(-3)","ts":"2025-06-24T03:54:55Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","reconcileID":"19c64d4f-472c-4270-9da6-ec801b1a507f","name":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5529557Z {"level":"Level(-4)","ts":"2025-06-24T03:54:55Z","caller":"controller/pod_reconciler.go:96","msg":"Pod removed or not added","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","reconcileID":"19c64d4f-472c-4270-9da6-ec801b1a507f","name":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5532915Z {"level":"Level(-3)","ts":"2025-06-24T03:54:56Z","caller":"controller/pod_reconciler.go:51","msg":"Pod being reconciled","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","reconcileID":"db256e6c-ea4f-40b7-9145-064894855345","name":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5536541Z {"level":"Level(-2)","ts":"2025-06-24T03:54:56Z","caller":"controller/pod_reconciler.go:102","msg":"Pod already exists","controller":"pod","controllerGroup":"","controllerKind":"Pod","Pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"},"namespace":"llm-d-zqbp1ruj3e","name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","reconcileID":"db256e6c-ea4f-40b7-9145-064894855345","name":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"}} | |
| 2025-06-24T03:55:09.5539897Z {"level":"Level(-2)","ts":"2025-06-24T03:54:56Z","caller":"metrics/pod_metrics.go:92","msg":"Starting refresher","pod":{"name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs","namespace":"llm-d-zqbp1ruj3e"},"pod":"{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs Address:10.244.0.18 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:6457f6f4bc]}"} | |
| 2025-06-24T03:55:09.5542597Z {"level":"Level(-4)","ts":"2025-06-24T03:55:03Z","caller":"requestcontrol/director.go:150","msg":"LLM response assembled","x-request-id":"0f371fd0-b9b9-4a34-a671-e0b8e4d71bcc","response":{"RequestId":"","Headers":{":status":"200","content-length":"237","content-type":"application/json","date":"Tue, 24 Jun 2025 03:55:02 GMT","server":"fasthttp","x-envoy-upstream-service-time":"0"},"Body":"","IsStreaming":false,"EndOfStream":false}} | |
| 2025-06-24T03:55:09.5553789Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"requestcontrol/director.go:94","msg":"LLM request assembled","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]"} | |
| 2025-06-24T03:55:09.5578197Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","logger":"PD","caller":"pd/scheduler.go:103","msg":"Disagregated prefill/decode disabled - scheduling to decode worker only","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]"} | |
| 2025-06-24T03:55:09.5597404Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:119","msg":"Scheduling a request, Metrics: [{Pod:{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq Address:10.244.0.19 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:prefill pod-template-hash:5bcdd4cd5c]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 03:55:04.244901477 +0000 UTC m=+12.330578255}} {Pod:{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs Address:10.244.0.18 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:6457f6f4bc]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 03:55:04.248059262 +0000 UTC m=+12.333736040}}]","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]"} | |
| 2025-06-24T03:55:09.5618437Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:149","msg":"Before running filter plugins","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","pods":[{"NamespacedName":{"Namespace":"llm-d-zqbp1ruj3e","Name":"llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq"},"Address":"10.244.0.19","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"prefill","pod-template-hash":"5bcdd4cd5c"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T03:55:04.244901477Z"},{"NamespacedName":{"Namespace":"llm-d-zqbp1ruj3e","Name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs"},"Address":"10.244.0.18","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"6457f6f4bc"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T03:55:04.248059262Z"}]} | |
| 2025-06-24T03:55:09.5636998Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:152","msg":"Running filter plugin","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","plugin":"decode-filter"} | |
| 2025-06-24T03:55:09.5655853Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:156","msg":"Filter plugin result","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","plugin":"decode-filter","pods":[{"NamespacedName":{"Namespace":"llm-d-zqbp1ruj3e","Name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs"},"Address":"10.244.0.18","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"6457f6f4bc"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T03:55:04.248059262Z"}]} | |
| 2025-06-24T03:55:09.5679675Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:161","msg":"After running filter plugins","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]"} | |
| 2025-06-24T03:55:09.5698954Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:168","msg":"Before running scorer plugins","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","pods":[{"NamespacedName":{"Namespace":"llm-d-zqbp1ruj3e","Name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs"},"Address":"10.244.0.18","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"6457f6f4bc"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T03:55:04.248059262Z"}]} | |
| 2025-06-24T03:55:09.5718056Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:176","msg":"Running scorer","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","scorer":"prefix-aware-scorer"} | |
| 2025-06-24T03:55:09.5726728Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:69","msg":"Got pod scores","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","scores":null} | |
| 2025-06-24T03:55:09.5728112Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:72","msg":"No scores found for pods","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc"} | |
| 2025-06-24T03:55:09.5740977Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:183","msg":"After running scorer","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","scorer":"prefix-aware-scorer"} | |
| 2025-06-24T03:55:09.5759485Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:176","msg":"Running scorer","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","scorer":"load-aware-scorer"} | |
| 2025-06-24T03:55:09.5775240Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:183","msg":"After running scorer","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","scorer":"load-aware-scorer"} | |
| 2025-06-24T03:55:09.5793861Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:185","msg":"After running scorer plugins","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]"} | |
| 2025-06-24T03:55:09.5812176Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:199","msg":"Before running picker plugin","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","pods weighted score":"map[{Pod:{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs Address:10.244.0.18 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:6457f6f4bc]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 03:55:04.248059262 +0000 UTC m=+12.333736040}}:0.5]"} | |
| 2025-06-24T03:55:09.5839947Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"picker/max_score_picker.go:47","msg":"Selecting a pod with the max score from 1 candidates: [{Pod:{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs Address:10.244.0.18 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:6457f6f4bc]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 03:55:04.248059262 +0000 UTC m=+12.333736040}}]","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]"} | |
| 2025-06-24T03:55:09.5873682Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:203","msg":"After running picker plugin","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","result":{"TargetPod":{"Pod":{"NamespacedName":{"Namespace":"llm-d-zqbp1ruj3e","Name":"llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs"},"Address":"10.244.0.18","Labels":{"llm-d.ai/inferenceServing":"true","llm-d.ai/model":"food-review","llm-d.ai/role":"decode","pod-template-hash":"6457f6f4bc"},"ActiveModels":{},"WaitingModels":{},"MaxActiveModels":0,"RunningQueueSize":0,"WaitingQueueSize":0,"KVCacheUsagePercent":0,"KvCacheMaxTokenCapacity":0,"UpdateTime":"2025-06-24T03:55:04.248059262Z"},"Score":0.5}}} | |
| 2025-06-24T03:55:09.5897294Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"scheduling/scheduler.go:210","msg":"Running post-schedule plugin","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","request":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","plugin":"prefix-aware-scorer"} | |
| 2025-06-24T03:55:09.5914831Z {"level":"info","ts":"2025-06-24T03:55:04Z","logger":"prefix-aware-scorer","caller":"scorer/prefix_aware.go:106","msg":"PostResponse called","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","req":"TargetModel: food-review, Critical: false, PromptLength: 34, Headers: map[:authority:llm-d-zqbp1ruj3e-inference-gateway-istio :method:POST :path:/v1/chat/completions :scheme:http accept:application/json content-length:86 content-type:application/json user-agent:curl/8.14.1 x-envoy-decorator-operation:llm-d-zqbp1ruj3e-vllm-sim-inference-pool-ip-dbdc6a23.llm-d-zqbp1ruj3e.svc.cluster.local:54321/* x-envoy-external-address:10.244.0.16 x-envoy-peer-metadata:ChoKCkNMVVNURVJfSUQSDBoKS3ViZXJuZXRlcwqOAQoGTEFCRUxTEoMBKoABCk0KH3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLW5hbWUSKhoobGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3RpbwovCiNzZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1yZXZpc2lvbhIIGgZsYXRlc3QKQwoETkFNRRI7GjlsbG0tZC16cWJwMXJ1ajNlLWluZmVyZW5jZS1nYXRld2F5LWlzdGlvLTc5NGY4ZDk5ZjUtNzZja2cKHwoJTkFNRVNQQUNFEhIaEGxsbS1kLXpxYnAxcnVqM2UKdQoFT1dORVISbBpqa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2xsbS1kLXpxYnAxcnVqM2UvZGVwbG95bWVudHMvbGxtLWQtenFicDFydWozZS1pbmZlcmVuY2UtZ2F0ZXdheS1pc3Rpbwo7Cg1XT1JLTE9BRF9OQU1FEioaKGxsbS1kLXpxYnAxcnVqM2UtaW5mZXJlbmNlLWdhdGV3YXktaXN0aW8= x-envoy-peer-metadata-id:router~10.244.0.15~llm-d-zqbp1ruj3e-inference-gateway-istio-794f8d99f5-76ckg.llm-d-zqbp1ruj3e~llm-d-zqbp1ruj3e.svc.cluster.local x-forwarded-for:10.244.0.16 x-forwarded-proto:http x-request-id:7d22cffe-f328-4c78-940a-b72fbbe6f6dc]","pod":"{Pod:{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs Address:10.244.0.18 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:6457f6f4bc]} MetricsState:{ActiveModels:map[] WaitingModels:map[] MaxActiveModels:0 RunningQueueSize:0 WaitingQueueSize:0 KVCacheUsagePercent:0 KvCacheMaxTokenCapacity:0 UpdateTime:2025-06-24 03:55:04.248059262 +0000 UTC m=+12.333736040}}"} | |
| 2025-06-24T03:55:09.5929460Z {"level":"Level(-2)","ts":"2025-06-24T03:55:04Z","caller":"requestcontrol/director.go:135","msg":"Request handled","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","model":"food-review","targetModel":"food-review","endpoint":"{NamespacedName:llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-decode-6457f6f4bc-7dqqs Address:10.244.0.18 Labels:map[llm-d.ai/inferenceServing:true llm-d.ai/model:food-review llm-d.ai/role:decode pod-template-hash:6457f6f4bc]}"} | |
| 2025-06-24T03:55:09.5934149Z {"level":"Level(-4)","ts":"2025-06-24T03:55:04Z","caller":"requestcontrol/director.go:150","msg":"LLM response assembled","x-request-id":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","response":{"RequestId":"7d22cffe-f328-4c78-940a-b72fbbe6f6dc","Headers":{":status":"200","content-length":"237","content-type":"application/json","date":"Tue, 24 Jun 2025 03:55:03 GMT","server":"fasthttp","x-envoy-upstream-service-time":"0"},"Body":"","IsStreaming":false,"EndOfStream":false}} | |
| 2025-06-24T03:55:09.5936886Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.5937743Z <== Logs of container llm-d-zqbp1ruj3e-vllm-sim-epp-58bcf5bb49-kjgj9 | |
| 2025-06-24T03:55:09.5938799Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.5939646Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.5940428Z ==> Description of pod llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq | |
| 2025-06-24T03:55:09.5941146Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.5942138Z >>> kubectl --request-timeout=30s describe pod llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq --namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.6019029Z Name: llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq | |
| 2025-06-24T03:55:09.6019619Z Namespace: llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:09.6020007Z Priority: 0 | |
| 2025-06-24T03:55:09.6020387Z Service Account: llm-d-zqbp1ruj3e-vllm-sim-sa | |
| 2025-06-24T03:55:09.6020714Z Node: chart-testing-control-plane/172.18.0.2 | |
| 2025-06-24T03:55:09.6021038Z Start Time: Tue, 24 Jun 2025 03:54:47 +0000 | |
| 2025-06-24T03:55:09.6021339Z Labels: llm-d.ai/inferenceServing=true | |
| 2025-06-24T03:55:09.6021610Z llm-d.ai/model=food-review | |
| 2025-06-24T03:55:09.6021851Z llm-d.ai/role=prefill | |
| 2025-06-24T03:55:09.6022111Z pod-template-hash=5bcdd4cd5c | |
| 2025-06-24T03:55:09.6022596Z Annotations: <none> | |
| 2025-06-24T03:55:09.6022790Z Status: Running | |
| 2025-06-24T03:55:09.6023237Z IP: 10.244.0.19 | |
| 2025-06-24T03:55:09.6023464Z IPs: | |
| 2025-06-24T03:55:09.6023628Z IP: 10.244.0.19 | |
| 2025-06-24T03:55:09.6023940Z Controlled By: ReplicaSet/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c | |
| 2025-06-24T03:55:09.6024336Z Containers: | |
| 2025-06-24T03:55:09.6024589Z vllm: | |
| 2025-06-24T03:55:09.6024954Z Container ID: containerd://9fcaf408d74345973b1c91078934109d39dfb2ecc7126afbc6388f7efef73754 | |
| 2025-06-24T03:55:09.6025412Z Image: ghcr.io/llm-d/llm-d-inference-sim:0.0.4 | |
| 2025-06-24T03:55:09.6025916Z Image ID: ghcr.io/llm-d/llm-d-inference-sim@sha256:5995c4dde42888844812359c121899c1d12e647588ed58fef206c3c653315338 | |
| 2025-06-24T03:55:09.6026370Z Port: 5557/TCP | |
| 2025-06-24T03:55:09.6026564Z Host Port: 0/TCP | |
| 2025-06-24T03:55:09.6026749Z Args: | |
| 2025-06-24T03:55:09.6026898Z --model | |
| 2025-06-24T03:55:09.6027061Z food-review | |
| 2025-06-24T03:55:09.6027234Z --port | |
| 2025-06-24T03:55:09.6027389Z 8000 | |
| 2025-06-24T03:55:09.6027548Z State: Running | |
| 2025-06-24T03:55:09.6027761Z Started: Tue, 24 Jun 2025 03:54:55 +0000 | |
| 2025-06-24T03:55:09.6028010Z Ready: True | |
| 2025-06-24T03:55:09.6028192Z Restart Count: 0 | |
| 2025-06-24T03:55:09.6028373Z Environment: | |
| 2025-06-24T03:55:09.6028536Z HOME: /home | |
| 2025-06-24T03:55:09.6028701Z Mounts: | |
| 2025-06-24T03:55:09.6028858Z /home from home (rw) | |
| 2025-06-24T03:55:09.6029192Z /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-28ckv (ro) | |
| 2025-06-24T03:55:09.6029552Z Conditions: | |
| 2025-06-24T03:55:09.6029712Z Type Status | |
| 2025-06-24T03:55:09.6029950Z PodReadyToStartContainers True | |
| 2025-06-24T03:55:09.6030180Z Initialized True | |
| 2025-06-24T03:55:09.6030390Z Ready True | |
| 2025-06-24T03:55:09.6030598Z ContainersReady True | |
| 2025-06-24T03:55:09.6030817Z PodScheduled True | |
| 2025-06-24T03:55:09.6031016Z Volumes: | |
| 2025-06-24T03:55:09.6031171Z home: | |
| 2025-06-24T03:55:09.6031419Z Type: EmptyDir (a temporary directory that shares a pod's lifetime) | |
| 2025-06-24T03:55:09.6031733Z Medium: | |
| 2025-06-24T03:55:09.6031910Z SizeLimit: <unset> | |
| 2025-06-24T03:55:09.6032106Z kube-api-access-28ckv: | |
| 2025-06-24T03:55:09.6032611Z Type: Projected (a volume that contains injected data from multiple sources) | |
| 2025-06-24T03:55:09.6033148Z TokenExpirationSeconds: 3607 | |
| 2025-06-24T03:55:09.6033494Z ConfigMapName: kube-root-ca.crt | |
| 2025-06-24T03:55:09.6034094Z ConfigMapOptional: <nil> | |
| 2025-06-24T03:55:09.6034351Z DownwardAPI: true | |
| 2025-06-24T03:55:09.6034570Z QoS Class: BestEffort | |
| 2025-06-24T03:55:09.6034812Z Node-Selectors: <none> | |
| 2025-06-24T03:55:09.6035280Z Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:09.6035884Z node.kubernetes.io/unreachable:NoExecute op=Exists for 300s | |
| 2025-06-24T03:55:09.6036187Z Events: | |
| 2025-06-24T03:55:09.6036377Z Type Reason Age From Message | |
| 2025-06-24T03:55:09.6036659Z ---- ------ ---- ---- ------- | |
| 2025-06-24T03:55:09.6037343Z Normal Scheduled 22s default-scheduler Successfully assigned llm-d-zqbp1ruj3e/llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq to chart-testing-control-plane | |
| 2025-06-24T03:55:09.6038151Z Normal Pulling 21s kubelet Pulling image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" | |
| 2025-06-24T03:55:09.6038879Z Normal Pulled 14s kubelet Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:0.0.4" in 550ms (6.627s including waiting). Image size: 87011014 bytes. | |
| 2025-06-24T03:55:09.6039564Z Normal Created 14s kubelet Created container vllm | |
| 2025-06-24T03:55:09.6040249Z Normal Started 14s kubelet Started container vllm | |
| 2025-06-24T03:55:09.6041191Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.6041998Z <== Description of pod llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq | |
| 2025-06-24T03:55:09.6042760Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| 2025-06-24T03:55:09.6043939Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.initContainers[*].name} | |
| 2025-06-24T03:55:09.6539466Z >>> kubectl --request-timeout=30s get pods llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq --no-headers --namespace llm-d-zqbp1ruj3e --output jsonpath={.spec.containers[*].name} | |
| 2025-06-24T03:55:09.7047129Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.7048086Z ==> Logs of container llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq | |
| 2025-06-24T03:55:09.7048910Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.7050068Z >>> kubectl --request-timeout=30s logs llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq --namespace llm-d-zqbp1ruj3e --container vllm | |
| 2025-06-24T03:55:09.7545456Z I0624 03:54:55.586026 1 cmd.go:36] "Start vllm simulator" | |
| 2025-06-24T03:55:09.7546138Z I0624 03:54:55.586152 1 simulator.go:135] "Server starting" port=8000 | |
| 2025-06-24T03:55:09.7566895Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.7567915Z <== Logs of container llm-d-zqbp1ruj3e-vllm-sim-prefill-5bcdd4cd5c-h48xq | |
| 2025-06-24T03:55:09.7568640Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:09.7569059Z ======================================================================================================================== | |
| 2025-06-24T03:55:09.7569522Z Deleting release "llm-d-zqbp1ruj3e"... | |
| 2025-06-24T03:55:09.7569913Z >>> helm uninstall llm-d-zqbp1ruj3e --namespace llm-d-zqbp1ruj3e --timeout 500s | |
| 2025-06-24T03:55:10.2347825Z release "llm-d-zqbp1ruj3e" uninstalled | |
| 2025-06-24T03:55:10.2379103Z Deleting namespace "llm-d-zqbp1ruj3e"... | |
| 2025-06-24T03:55:10.2379577Z >>> kubectl --request-timeout=30s delete namespace llm-d-zqbp1ruj3e --timeout 180s | |
| 2025-06-24T03:55:10.3114978Z namespace "llm-d-zqbp1ruj3e" deleted | |
| 2025-06-24T03:55:48.3670061Z >>> kubectl --request-timeout=30s get namespace llm-d-zqbp1ruj3e | |
| 2025-06-24T03:55:48.4145700Z Namespace "llm-d-zqbp1ruj3e" terminated. | |
| 2025-06-24T03:55:48.4147215Z >>> git worktree remove ./ct-previous-revision1049135146 | |
| 2025-06-24T03:55:48.4330267Z | |
| 2025-06-24T03:55:48.4330666Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:48.4331680Z Error: failed installing charts: failed processing charts | |
| 2025-06-24T03:55:48.4332810Z ✖︎ llm-d => (version: "1.0.21", path: "charts/llm-d") > failed waiting for process: exit status 1 | |
| 2025-06-24T03:55:48.4334318Z ------------------------------------------------------------------------------------------------------------------------ | |
| 2025-06-24T03:55:48.4335096Z failed installing charts: failed processing charts | |
| 2025-06-24T03:55:48.4353785Z ##[error]Process completed with exit code 1. | |
| 2025-06-24T03:55:48.4417868Z Post job cleanup. | |
| 2025-06-24T03:55:48.4785645Z Error response from daemon: No such container: kind-registry | |
| 2025-06-24T03:55:48.4936017Z Deleting cluster "chart-testing" ... | |
| 2025-06-24T03:55:50.9799486Z Deleted nodes: ["chart-testing-control-plane"] | |
| 2025-06-24T03:55:50.9900152Z Post job cleanup. | |
| 2025-06-24T03:55:51.0828483Z [command]/usr/bin/git version | |
| 2025-06-24T03:55:51.0869797Z git version 2.49.0 | |
| 2025-06-24T03:55:51.0922314Z Temporarily overriding HOME='/home/runner/work/_temp/2e4b748c-9662-46f9-b40e-9333c52044d3' before making global git config changes | |
| 2025-06-24T03:55:51.0923603Z Adding repository directory to the temporary git global config as a safe directory | |
| 2025-06-24T03:55:51.0927405Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/llm-d-deployer/llm-d-deployer | |
| 2025-06-24T03:55:51.0961044Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand | |
| 2025-06-24T03:55:51.0993191Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" | |
| 2025-06-24T03:55:51.1220598Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader | |
| 2025-06-24T03:55:51.1241104Z http.https://github.com/.extraheader | |
| 2025-06-24T03:55:51.1253708Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader | |
| 2025-06-24T03:55:51.1284154Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" | |
| 2025-06-24T03:55:51.1620265Z Cleaning up orphan processes |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment