Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 19, 2021 22:12
Show Gist options
  • Save dfarrell07/1aecd60e0b8b9beb9eb9eec55166daf3 to your computer and use it in GitHub Desktop.
Save dfarrell07/1aecd60e0b8b9beb9eb9eec55166daf3 to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210717-1
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-17T12:04:45.7525575Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-17T12:04:45.7525633Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-17T12:04:52.6110748Z Current runner version: '2.278.0'
2021-07-17T12:04:52.6138669Z ##[group]Operating System
2021-07-17T12:04:52.6139505Z Ubuntu
2021-07-17T12:04:52.6139908Z 20.04.2
2021-07-17T12:04:52.6140285Z LTS
2021-07-17T12:04:52.6140645Z ##[endgroup]
2021-07-17T12:04:52.6141139Z ##[group]Virtual Environment
2021-07-17T12:04:52.6141641Z Environment: ubuntu-20.04
2021-07-17T12:04:52.6142137Z Version: 20210712.0
2021-07-17T12:04:52.6142938Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-17T12:04:52.6144072Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-17T12:04:52.6144822Z ##[endgroup]
2021-07-17T12:04:52.6146427Z ##[group]GITHUB_TOKEN Permissions
2021-07-17T12:04:52.6147518Z Actions: write
2021-07-17T12:04:52.6147982Z Checks: write
2021-07-17T12:04:52.6148398Z Contents: write
2021-07-17T12:04:52.6148860Z Deployments: write
2021-07-17T12:04:52.6149444Z Discussions: write
2021-07-17T12:04:52.6149926Z Issues: write
2021-07-17T12:04:52.6150316Z Metadata: read
2021-07-17T12:04:52.6150769Z Packages: write
2021-07-17T12:04:52.6151196Z PullRequests: write
2021-07-17T12:04:52.6151754Z RepositoryProjects: write
2021-07-17T12:04:52.6152260Z SecurityEvents: write
2021-07-17T12:04:52.6152745Z Statuses: write
2021-07-17T12:04:52.6153430Z ##[endgroup]
2021-07-17T12:04:52.6156111Z Prepare workflow directory
2021-07-17T12:04:52.6723164Z Prepare all required actions
2021-07-17T12:04:52.6732572Z Getting action download info
2021-07-17T12:04:53.1301692Z Download action repository 'actions/checkout@v2'
2021-07-17T12:04:55.2755168Z Download action repository 'submariner-io/shipyard@devel'
2021-07-17T12:04:55.8459909Z ##[group]Run actions/checkout@v2
2021-07-17T12:04:55.8460520Z with:
2021-07-17T12:04:55.8461048Z repository: submariner-io/submariner-operator
2021-07-17T12:04:55.8461949Z token: ***
2021-07-17T12:04:55.8462295Z ssh-strict: true
2021-07-17T12:04:55.8462756Z persist-credentials: true
2021-07-17T12:04:55.8463249Z clean: true
2021-07-17T12:04:55.8463577Z fetch-depth: 1
2021-07-17T12:04:55.8463965Z lfs: false
2021-07-17T12:04:55.8464297Z submodules: false
2021-07-17T12:04:55.8464679Z ##[endgroup]
2021-07-17T12:04:56.0513759Z Syncing repository: submariner-io/submariner-operator
2021-07-17T12:04:56.0514999Z ##[group]Getting Git version info
2021-07-17T12:04:56.0516286Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-17T12:04:56.0618940Z [command]/usr/bin/git version
2021-07-17T12:04:56.0759988Z git version 2.32.0
2021-07-17T12:04:56.0761105Z ##[endgroup]
2021-07-17T12:04:56.0765114Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-17T12:04:56.0768135Z ##[group]Initializing the repository
2021-07-17T12:04:56.0771733Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-17T12:04:56.0864843Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-17T12:04:56.0866131Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-17T12:04:56.0867137Z hint: of your new repositories, which will suppress this warning, call:
2021-07-17T12:04:56.0867991Z hint:
2021-07-17T12:04:56.0868963Z hint: git config --global init.defaultBranch <name>
2021-07-17T12:04:56.0869735Z hint:
2021-07-17T12:04:56.0870628Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-17T12:04:56.0871807Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-17T12:04:56.0872529Z hint:
2021-07-17T12:04:56.0873299Z hint: git branch -m <name>
2021-07-17T12:04:56.0884077Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-17T12:04:56.7756851Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-17T12:04:56.7811057Z ##[endgroup]
2021-07-17T12:04:56.7811948Z ##[group]Disabling automatic garbage collection
2021-07-17T12:04:56.7813405Z [command]/usr/bin/git config --local gc.auto 0
2021-07-17T12:04:56.7814093Z ##[endgroup]
2021-07-17T12:04:56.7816358Z ##[group]Setting up auth
2021-07-17T12:04:56.7817392Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-17T12:04:56.7819085Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-17T12:04:56.7821513Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-17T12:04:56.7824181Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-17T12:04:56.7826301Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-17T12:04:56.7827355Z ##[endgroup]
2021-07-17T12:04:56.7828024Z ##[group]Fetching the repository
2021-07-17T12:04:56.7829477Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-17T12:04:56.7830713Z remote: Enumerating objects: 486, done.
2021-07-17T12:04:56.7831408Z remote: Counting objects: 0% (1/486)
2021-07-17T12:04:56.7832055Z remote: Counting objects: 1% (5/486)
2021-07-17T12:04:56.7833070Z remote: Counting objects: 2% (10/486)
2021-07-17T12:04:56.7833721Z remote: Counting objects: 3% (15/486)
2021-07-17T12:04:56.7834499Z remote: Counting objects: 4% (20/486)
2021-07-17T12:04:56.7835283Z remote: Counting objects: 5% (25/486)
2021-07-17T12:04:56.7835938Z remote: Counting objects: 6% (30/486)
2021-07-17T12:04:56.7836530Z remote: Counting objects: 7% (35/486)
2021-07-17T12:04:56.7837385Z remote: Counting objects: 8% (39/486)
2021-07-17T12:04:56.7837997Z remote: Counting objects: 9% (44/486)
2021-07-17T12:04:56.7839230Z remote: Counting objects: 10% (49/486)
2021-07-17T12:04:56.7840184Z remote: Counting objects: 11% (54/486)
2021-07-17T12:04:56.7840783Z remote: Counting objects: 12% (59/486)
2021-07-17T12:04:56.7841418Z remote: Counting objects: 13% (64/486)
2021-07-17T12:04:56.7842009Z remote: Counting objects: 14% (69/486)
2021-07-17T12:04:56.7842757Z remote: Counting objects: 15% (73/486)
2021-07-17T12:04:56.7843397Z remote: Counting objects: 16% (78/486)
2021-07-17T12:04:56.7843994Z remote: Counting objects: 17% (83/486)
2021-07-17T12:04:56.7844638Z remote: Counting objects: 18% (88/486)
2021-07-17T12:04:56.7845104Z remote: Counting objects: 19% (93/486)
2021-07-17T12:04:56.7845612Z remote: Counting objects: 20% (98/486)
2021-07-17T12:04:56.7846250Z remote: Counting objects: 21% (103/486)
2021-07-17T12:04:56.7846857Z remote: Counting objects: 22% (107/486)
2021-07-17T12:04:56.7847504Z remote: Counting objects: 23% (112/486)
2021-07-17T12:04:56.7848163Z remote: Counting objects: 24% (117/486)
2021-07-17T12:04:56.7848835Z remote: Counting objects: 25% (122/486)
2021-07-17T12:04:56.7849476Z remote: Counting objects: 26% (127/486)
2021-07-17T12:04:56.7850072Z remote: Counting objects: 27% (132/486)
2021-07-17T12:04:56.7850717Z remote: Counting objects: 28% (137/486)
2021-07-17T12:04:56.7851475Z remote: Counting objects: 29% (141/486)
2021-07-17T12:04:56.7852243Z remote: Counting objects: 30% (146/486)
2021-07-17T12:04:56.7852919Z remote: Counting objects: 31% (151/486)
2021-07-17T12:04:56.7853519Z remote: Counting objects: 32% (156/486)
2021-07-17T12:04:56.7854202Z remote: Counting objects: 33% (161/486)
2021-07-17T12:04:56.7855175Z remote: Counting objects: 34% (166/486)
2021-07-17T12:04:56.7856358Z remote: Counting objects: 35% (171/486)
2021-07-17T12:04:56.7857080Z remote: Counting objects: 36% (175/486)
2021-07-17T12:04:56.7857910Z remote: Counting objects: 37% (180/486)
2021-07-17T12:04:56.7858613Z remote: Counting objects: 38% (185/486)
2021-07-17T12:04:56.7859331Z remote: Counting objects: 39% (190/486)
2021-07-17T12:04:56.7860322Z remote: Counting objects: 40% (195/486)
2021-07-17T12:04:56.7861138Z remote: Counting objects: 41% (200/486)
2021-07-17T12:04:56.7861723Z remote: Counting objects: 42% (205/486)
2021-07-17T12:04:56.7862382Z remote: Counting objects: 43% (209/486)
2021-07-17T12:04:56.7863207Z remote: Counting objects: 44% (214/486)
2021-07-17T12:04:56.7863824Z remote: Counting objects: 45% (219/486)
2021-07-17T12:04:56.7864465Z remote: Counting objects: 46% (224/486)
2021-07-17T12:04:56.7865041Z remote: Counting objects: 47% (229/486)
2021-07-17T12:04:56.7865693Z remote: Counting objects: 48% (234/486)
2021-07-17T12:04:56.7866345Z remote: Counting objects: 49% (239/486)
2021-07-17T12:04:56.7866935Z remote: Counting objects: 50% (243/486)
2021-07-17T12:04:56.7867580Z remote: Counting objects: 51% (248/486)
2021-07-17T12:04:56.7868207Z remote: Counting objects: 52% (253/486)
2021-07-17T12:04:56.7868790Z remote: Counting objects: 53% (258/486)
2021-07-17T12:04:56.7869468Z remote: Counting objects: 54% (263/486)
2021-07-17T12:04:56.7870070Z remote: Counting objects: 55% (268/486)
2021-07-17T12:04:56.7870814Z remote: Counting objects: 56% (273/486)
2021-07-17T12:04:56.7871498Z remote: Counting objects: 57% (278/486)
2021-07-17T12:04:56.7872086Z remote: Counting objects: 58% (282/486)
2021-07-17T12:04:56.7872868Z remote: Counting objects: 59% (287/486)
2021-07-17T12:04:56.7873463Z remote: Counting objects: 60% (292/486)
2021-07-17T12:04:56.7874114Z remote: Counting objects: 61% (297/486)
2021-07-17T12:04:56.7874756Z remote: Counting objects: 62% (302/486)
2021-07-17T12:04:56.7875340Z remote: Counting objects: 63% (307/486)
2021-07-17T12:04:56.7876002Z remote: Counting objects: 64% (312/486)
2021-07-17T12:04:56.7876590Z remote: Counting objects: 65% (316/486)
2021-07-17T12:04:56.7877622Z remote: Counting objects: 66% (321/486)
2021-07-17T12:04:56.7878428Z remote: Counting objects: 67% (326/486)
2021-07-17T12:04:56.7879189Z remote: Counting objects: 68% (331/486)
2021-07-17T12:04:56.7879827Z remote: Counting objects: 69% (336/486)
2021-07-17T12:04:56.7880644Z remote: Counting objects: 70% (341/486)
2021-07-17T12:04:56.7881313Z remote: Counting objects: 71% (346/486)
2021-07-17T12:04:56.7881955Z remote: Counting objects: 72% (350/486)
2021-07-17T12:04:56.7882617Z remote: Counting objects: 73% (355/486)
2021-07-17T12:04:56.7883229Z remote: Counting objects: 74% (360/486)
2021-07-17T12:04:56.7883853Z remote: Counting objects: 75% (365/486)
2021-07-17T12:04:56.7884430Z remote: Counting objects: 76% (370/486)
2021-07-17T12:04:56.7885094Z remote: Counting objects: 77% (375/486)
2021-07-17T12:04:56.7885757Z remote: Counting objects: 78% (380/486)
2021-07-17T12:04:56.7886353Z remote: Counting objects: 79% (384/486)
2021-07-17T12:04:56.7886976Z remote: Counting objects: 80% (389/486)
2021-07-17T12:04:56.7887629Z remote: Counting objects: 81% (394/486)
2021-07-17T12:04:56.7888304Z remote: Counting objects: 82% (399/486)
2021-07-17T12:04:56.7888979Z remote: Counting objects: 83% (404/486)
2021-07-17T12:04:56.7889574Z remote: Counting objects: 84% (409/486)
2021-07-17T12:04:56.7890206Z remote: Counting objects: 85% (414/486)
2021-07-17T12:04:56.7890828Z remote: Counting objects: 86% (418/486)
2021-07-17T12:04:56.7891793Z remote: Counting objects: 87% (423/486)
2021-07-17T12:04:56.7892481Z remote: Counting objects: 88% (428/486)
2021-07-17T12:04:56.7893122Z remote: Counting objects: 89% (433/486)
2021-07-17T12:04:56.7893785Z remote: Counting objects: 90% (438/486)
2021-07-17T12:04:56.7894452Z remote: Counting objects: 91% (443/486)
2021-07-17T12:04:56.7895210Z remote: Counting objects: 92% (448/486)
2021-07-17T12:04:56.7906527Z remote: Counting objects: 93% (452/486)
2021-07-17T12:04:56.7907302Z remote: Counting objects: 94% (457/486)
2021-07-17T12:04:56.7907844Z remote: Counting objects: 95% (462/486)
2021-07-17T12:04:56.7908366Z remote: Counting objects: 96% (467/486)
2021-07-17T12:04:56.7908810Z remote: Counting objects: 97% (472/486)
2021-07-17T12:04:56.7909322Z remote: Counting objects: 98% (477/486)
2021-07-17T12:04:56.7909758Z remote: Counting objects: 99% (482/486)
2021-07-17T12:04:56.7910269Z remote: Counting objects: 100% (486/486)
2021-07-17T12:04:56.7910744Z remote: Counting objects: 100% (486/486), done.
2021-07-17T12:04:56.7911263Z remote: Compressing objects: 0% (1/352)
2021-07-17T12:04:56.7911759Z remote: Compressing objects: 1% (4/352)
2021-07-17T12:04:56.7912269Z remote: Compressing objects: 2% (8/352)
2021-07-17T12:04:56.7912796Z remote: Compressing objects: 3% (11/352)
2021-07-17T12:04:56.7913277Z remote: Compressing objects: 4% (15/352)
2021-07-17T12:04:56.7913793Z remote: Compressing objects: 5% (18/352)
2021-07-17T12:04:56.7914285Z remote: Compressing objects: 6% (22/352)
2021-07-17T12:04:56.7914922Z remote: Compressing objects: 7% (25/352)
2021-07-17T12:04:56.7915446Z remote: Compressing objects: 8% (29/352)
2021-07-17T12:04:56.7915963Z remote: Compressing objects: 9% (32/352)
2021-07-17T12:04:56.7916439Z remote: Compressing objects: 10% (36/352)
2021-07-17T12:04:56.7917182Z remote: Compressing objects: 11% (39/352)
2021-07-17T12:04:56.7917741Z remote: Compressing objects: 12% (43/352)
2021-07-17T12:04:56.7919167Z remote: Compressing objects: 13% (46/352)
2021-07-17T12:04:56.7920217Z remote: Compressing objects: 14% (50/352)
2021-07-17T12:04:56.7920756Z remote: Compressing objects: 15% (53/352)
2021-07-17T12:04:56.7934137Z remote: Compressing objects: 16% (57/352)
2021-07-17T12:04:56.7935443Z remote: Compressing objects: 17% (60/352)
2021-07-17T12:04:56.7936714Z remote: Compressing objects: 18% (64/352)
2021-07-17T12:04:56.7937524Z remote: Compressing objects: 19% (67/352)
2021-07-17T12:04:56.7938206Z remote: Compressing objects: 20% (71/352)
2021-07-17T12:04:56.7939167Z remote: Compressing objects: 21% (74/352)
2021-07-17T12:04:56.7939880Z remote: Compressing objects: 22% (78/352)
2021-07-17T12:04:56.7957638Z remote: Compressing objects: 23% (81/352)
2021-07-17T12:04:56.7958949Z remote: Compressing objects: 24% (85/352)
2021-07-17T12:04:56.7959657Z remote: Compressing objects: 25% (88/352)
2021-07-17T12:04:56.7960743Z remote: Compressing objects: 26% (92/352)
2021-07-17T12:04:56.7961442Z remote: Compressing objects: 27% (96/352)
2021-07-17T12:04:56.7962127Z remote: Compressing objects: 28% (99/352)
2021-07-17T12:04:56.8117281Z remote: Compressing objects: 29% (103/352)
2021-07-17T12:04:56.8119395Z remote: Compressing objects: 30% (106/352)
2021-07-17T12:04:56.8119870Z remote: Compressing objects: 31% (110/352)
2021-07-17T12:04:56.8120494Z remote: Compressing objects: 32% (113/352)
2021-07-17T12:04:56.8120930Z remote: Compressing objects: 33% (117/352)
2021-07-17T12:04:56.8121359Z remote: Compressing objects: 34% (120/352)
2021-07-17T12:04:56.8121790Z remote: Compressing objects: 35% (124/352)
2021-07-17T12:04:56.8122239Z remote: Compressing objects: 36% (127/352)
2021-07-17T12:04:56.8122854Z remote: Compressing objects: 37% (131/352)
2021-07-17T12:04:56.8124525Z remote: Compressing objects: 38% (134/352)
2021-07-17T12:04:56.8125143Z remote: Compressing objects: 39% (138/352)
2021-07-17T12:04:56.8125736Z remote: Compressing objects: 40% (141/352)
2021-07-17T12:04:56.8126320Z remote: Compressing objects: 41% (145/352)
2021-07-17T12:04:56.8127078Z remote: Compressing objects: 42% (148/352)
2021-07-17T12:04:56.8128288Z remote: Compressing objects: 43% (152/352)
2021-07-17T12:04:56.8128761Z remote: Compressing objects: 44% (155/352)
2021-07-17T12:04:56.8129246Z remote: Compressing objects: 45% (159/352)
2021-07-17T12:04:56.8129718Z remote: Compressing objects: 46% (162/352)
2021-07-17T12:04:56.8130186Z remote: Compressing objects: 47% (166/352)
2021-07-17T12:04:56.8130650Z remote: Compressing objects: 48% (169/352)
2021-07-17T12:04:56.8131452Z remote: Compressing objects: 49% (173/352)
2021-07-17T12:04:56.8131880Z remote: Compressing objects: 50% (176/352)
2021-07-17T12:04:56.8132313Z remote: Compressing objects: 51% (180/352)
2021-07-17T12:04:56.8132737Z remote: Compressing objects: 52% (184/352)
2021-07-17T12:04:56.8133168Z remote: Compressing objects: 53% (187/352)
2021-07-17T12:04:56.8133601Z remote: Compressing objects: 54% (191/352)
2021-07-17T12:04:56.8137366Z remote: Compressing objects: 55% (194/352)
2021-07-17T12:04:56.8137834Z remote: Compressing objects: 56% (198/352)
2021-07-17T12:04:56.8138264Z remote: Compressing objects: 57% (201/352)
2021-07-17T12:04:56.8144013Z remote: Compressing objects: 58% (205/352)
2021-07-17T12:04:56.8147568Z remote: Compressing objects: 59% (208/352)
2021-07-17T12:04:56.8158891Z remote: Compressing objects: 60% (212/352)
2021-07-17T12:04:56.8169908Z remote: Compressing objects: 61% (215/352)
2021-07-17T12:04:56.8170586Z remote: Compressing objects: 62% (219/352)
2021-07-17T12:04:56.8175593Z remote: Compressing objects: 63% (222/352)
2021-07-17T12:04:56.8176217Z remote: Compressing objects: 64% (226/352)
2021-07-17T12:04:56.8182540Z remote: Compressing objects: 65% (229/352)
2021-07-17T12:04:56.8186224Z remote: Compressing objects: 66% (233/352)
2021-07-17T12:04:56.8200774Z remote: Compressing objects: 67% (236/352)
2021-07-17T12:04:56.8201754Z remote: Compressing objects: 68% (240/352)
2021-07-17T12:04:56.8202220Z remote: Compressing objects: 69% (243/352)
2021-07-17T12:04:56.8205315Z remote: Compressing objects: 70% (247/352)
2021-07-17T12:04:56.8211756Z remote: Compressing objects: 71% (250/352)
2021-07-17T12:04:56.8213200Z remote: Compressing objects: 72% (254/352)
2021-07-17T12:04:56.8221611Z remote: Compressing objects: 73% (257/352)
2021-07-17T12:04:56.8222285Z remote: Compressing objects: 74% (261/352)
2021-07-17T12:04:56.8222894Z remote: Compressing objects: 75% (264/352)
2021-07-17T12:04:56.8223561Z remote: Compressing objects: 76% (268/352)
2021-07-17T12:04:56.8225106Z remote: Compressing objects: 77% (272/352)
2021-07-17T12:04:56.8225942Z remote: Compressing objects: 78% (275/352)
2021-07-17T12:04:56.8226699Z remote: Compressing objects: 79% (279/352)
2021-07-17T12:04:56.8227432Z remote: Compressing objects: 80% (282/352)
2021-07-17T12:04:56.8228180Z remote: Compressing objects: 81% (286/352)
2021-07-17T12:04:56.8228737Z remote: Compressing objects: 82% (289/352)
2021-07-17T12:04:56.8229316Z remote: Compressing objects: 83% (293/352)
2021-07-17T12:04:56.8229882Z remote: Compressing objects: 84% (296/352)
2021-07-17T12:04:56.8230435Z remote: Compressing objects: 85% (300/352)
2021-07-17T12:04:56.8230996Z remote: Compressing objects: 86% (303/352)
2021-07-17T12:04:56.8231958Z remote: Compressing objects: 87% (307/352)
2021-07-17T12:04:56.8232553Z remote: Compressing objects: 88% (310/352)
2021-07-17T12:04:56.8233133Z remote: Compressing objects: 89% (314/352)
2021-07-17T12:04:56.8233706Z remote: Compressing objects: 90% (317/352)
2021-07-17T12:04:56.8234291Z remote: Compressing objects: 91% (321/352)
2021-07-17T12:04:56.8234893Z remote: Compressing objects: 92% (324/352)
2021-07-17T12:04:56.8235639Z remote: Compressing objects: 93% (328/352)
2021-07-17T12:04:56.8236195Z remote: Compressing objects: 94% (331/352)
2021-07-17T12:04:56.8236957Z remote: Compressing objects: 95% (335/352)
2021-07-17T12:04:56.8237549Z remote: Compressing objects: 96% (338/352)
2021-07-17T12:04:56.8238125Z remote: Compressing objects: 97% (342/352)
2021-07-17T12:04:56.8238936Z remote: Compressing objects: 98% (345/352)
2021-07-17T12:04:56.8239525Z remote: Compressing objects: 99% (349/352)
2021-07-17T12:04:56.8240307Z remote: Compressing objects: 100% (352/352)
2021-07-17T12:04:56.8240902Z remote: Compressing objects: 100% (352/352), done.
2021-07-17T12:04:56.8569524Z Receiving objects: 0% (1/486)
2021-07-17T12:04:56.8569931Z Receiving objects: 1% (5/486)
2021-07-17T12:04:56.8570287Z Receiving objects: 2% (10/486)
2021-07-17T12:04:56.8572453Z Receiving objects: 3% (15/486)
2021-07-17T12:04:56.8572983Z Receiving objects: 4% (20/486)
2021-07-17T12:04:56.8574647Z Receiving objects: 5% (25/486)
2021-07-17T12:04:56.8575177Z Receiving objects: 6% (30/486)
2021-07-17T12:04:56.8576901Z Receiving objects: 7% (35/486)
2021-07-17T12:04:56.8577576Z Receiving objects: 8% (39/486)
2021-07-17T12:04:56.8866279Z Receiving objects: 9% (44/486)
2021-07-17T12:04:56.8867006Z Receiving objects: 10% (49/486)
2021-07-17T12:04:56.8867436Z Receiving objects: 11% (54/486)
2021-07-17T12:04:56.8867817Z Receiving objects: 12% (59/486)
2021-07-17T12:04:56.8868169Z Receiving objects: 13% (64/486)
2021-07-17T12:04:56.8868548Z Receiving objects: 14% (69/486)
2021-07-17T12:04:56.8868909Z Receiving objects: 15% (73/486)
2021-07-17T12:04:56.8869259Z Receiving objects: 16% (78/486)
2021-07-17T12:04:56.8869628Z Receiving objects: 17% (83/486)
2021-07-17T12:04:56.8869988Z Receiving objects: 18% (88/486)
2021-07-17T12:04:56.8870362Z Receiving objects: 19% (93/486)
2021-07-17T12:04:56.8870718Z Receiving objects: 20% (98/486)
2021-07-17T12:04:56.8871092Z Receiving objects: 21% (103/486)
2021-07-17T12:04:56.8871455Z Receiving objects: 22% (107/486)
2021-07-17T12:04:56.8871832Z Receiving objects: 23% (112/486)
2021-07-17T12:04:56.8872201Z Receiving objects: 24% (117/486)
2021-07-17T12:04:56.8872570Z Receiving objects: 25% (122/486)
2021-07-17T12:04:56.8872925Z Receiving objects: 26% (127/486)
2021-07-17T12:04:56.8873766Z Receiving objects: 27% (132/486)
2021-07-17T12:04:56.8874135Z Receiving objects: 28% (137/486)
2021-07-17T12:04:56.8874483Z Receiving objects: 29% (141/486)
2021-07-17T12:04:56.8874853Z Receiving objects: 30% (146/486)
2021-07-17T12:04:56.8875207Z Receiving objects: 31% (151/486)
2021-07-17T12:04:56.8875568Z Receiving objects: 32% (156/486)
2021-07-17T12:04:56.8916074Z Receiving objects: 33% (161/486)
2021-07-17T12:04:56.8916484Z Receiving objects: 34% (166/486)
2021-07-17T12:04:56.8916847Z Receiving objects: 35% (171/486)
2021-07-17T12:04:56.8917968Z Receiving objects: 36% (175/486)
2021-07-17T12:04:56.8919406Z Receiving objects: 37% (180/486)
2021-07-17T12:04:56.8920572Z Receiving objects: 38% (185/486)
2021-07-17T12:04:56.8921235Z Receiving objects: 39% (190/486)
2021-07-17T12:04:56.8926115Z Receiving objects: 40% (195/486)
2021-07-17T12:04:56.8926745Z Receiving objects: 41% (200/486)
2021-07-17T12:04:56.8927265Z Receiving objects: 42% (205/486)
2021-07-17T12:04:56.8927763Z Receiving objects: 43% (209/486)
2021-07-17T12:04:56.8928252Z Receiving objects: 44% (214/486)
2021-07-17T12:04:56.8971084Z Receiving objects: 45% (219/486)
2021-07-17T12:04:56.8971691Z Receiving objects: 46% (224/486)
2021-07-17T12:04:56.8972057Z Receiving objects: 47% (229/486)
2021-07-17T12:04:56.8972432Z Receiving objects: 48% (234/486)
2021-07-17T12:04:56.8972869Z Receiving objects: 49% (239/486)
2021-07-17T12:04:56.8973246Z Receiving objects: 50% (243/486)
2021-07-17T12:04:56.8973602Z Receiving objects: 51% (248/486)
2021-07-17T12:04:56.8973975Z Receiving objects: 52% (253/486)
2021-07-17T12:04:56.8974333Z Receiving objects: 53% (258/486)
2021-07-17T12:04:56.8974706Z Receiving objects: 54% (263/486)
2021-07-17T12:04:56.8975064Z Receiving objects: 55% (268/486)
2021-07-17T12:04:56.8975440Z Receiving objects: 56% (273/486)
2021-07-17T12:04:56.8975819Z Receiving objects: 57% (278/486)
2021-07-17T12:04:56.8976179Z Receiving objects: 58% (282/486)
2021-07-17T12:04:56.8976550Z Receiving objects: 59% (287/486)
2021-07-17T12:04:56.8976907Z Receiving objects: 60% (292/486)
2021-07-17T12:04:56.8977279Z Receiving objects: 61% (297/486)
2021-07-17T12:04:56.8977912Z Receiving objects: 62% (302/486)
2021-07-17T12:04:56.8978440Z Receiving objects: 63% (307/486)
2021-07-17T12:04:56.8978968Z Receiving objects: 64% (312/486)
2021-07-17T12:04:56.8979446Z Receiving objects: 65% (316/486)
2021-07-17T12:04:56.9031495Z Receiving objects: 66% (321/486)
2021-07-17T12:04:56.9032080Z Receiving objects: 67% (326/486)
2021-07-17T12:04:56.9034188Z Receiving objects: 68% (331/486)
2021-07-17T12:04:56.9067497Z Receiving objects: 69% (336/486)
2021-07-17T12:04:56.9180529Z Receiving objects: 70% (341/486)
2021-07-17T12:04:56.9180958Z Receiving objects: 71% (346/486)
2021-07-17T12:04:56.9181328Z Receiving objects: 72% (350/486)
2021-07-17T12:04:56.9181851Z Receiving objects: 73% (355/486)
2021-07-17T12:04:56.9183472Z Receiving objects: 74% (360/486)
2021-07-17T12:04:56.9184152Z Receiving objects: 75% (365/486)
2021-07-17T12:04:56.9224338Z Receiving objects: 76% (370/486)
2021-07-17T12:04:56.9226877Z Receiving objects: 77% (375/486)
2021-07-17T12:04:56.9228980Z Receiving objects: 78% (380/486)
2021-07-17T12:04:56.9230846Z Receiving objects: 79% (384/486)
2021-07-17T12:04:56.9233131Z Receiving objects: 80% (389/486)
2021-07-17T12:04:56.9240939Z Receiving objects: 81% (394/486)
2021-07-17T12:04:56.9279415Z Receiving objects: 82% (399/486)
2021-07-17T12:04:56.9281596Z Receiving objects: 83% (404/486)
2021-07-17T12:04:56.9283071Z Receiving objects: 84% (409/486)
2021-07-17T12:04:56.9284930Z Receiving objects: 85% (414/486)
2021-07-17T12:04:56.9286857Z Receiving objects: 86% (418/486)
2021-07-17T12:04:56.9289945Z Receiving objects: 87% (423/486)
2021-07-17T12:04:56.9292353Z Receiving objects: 88% (428/486)
2021-07-17T12:04:56.9333846Z Receiving objects: 89% (433/486)
2021-07-17T12:04:56.9337489Z Receiving objects: 90% (438/486)
2021-07-17T12:04:56.9342452Z Receiving objects: 91% (443/486)
2021-07-17T12:04:56.9344083Z Receiving objects: 92% (448/486)
2021-07-17T12:04:56.9345586Z Receiving objects: 93% (452/486)
2021-07-17T12:04:56.9347033Z Receiving objects: 94% (457/486)
2021-07-17T12:04:56.9348605Z Receiving objects: 95% (462/486)
2021-07-17T12:04:56.9350599Z Receiving objects: 96% (467/486)
2021-07-17T12:04:56.9352480Z Receiving objects: 97% (472/486)
2021-07-17T12:04:56.9381850Z Receiving objects: 98% (477/486)
2021-07-17T12:04:56.9382872Z remote: Total 486 (delta 155), reused 305 (delta 88), pack-reused 0
2021-07-17T12:04:56.9384734Z Receiving objects: 99% (482/486)
2021-07-17T12:04:56.9385246Z Receiving objects: 100% (486/486)
2021-07-17T12:04:56.9385687Z Receiving objects: 100% (486/486), 349.04 KiB | 4.21 MiB/s, done.
2021-07-17T12:04:56.9386797Z Resolving deltas: 0% (0/155)
2021-07-17T12:04:56.9388098Z Resolving deltas: 1% (2/155)
2021-07-17T12:04:56.9389006Z Resolving deltas: 2% (4/155)
2021-07-17T12:04:56.9389865Z Resolving deltas: 3% (5/155)
2021-07-17T12:04:56.9391104Z Resolving deltas: 4% (7/155)
2021-07-17T12:04:56.9392199Z Resolving deltas: 5% (8/155)
2021-07-17T12:04:56.9393072Z Resolving deltas: 6% (10/155)
2021-07-17T12:04:56.9394128Z Resolving deltas: 7% (11/155)
2021-07-17T12:04:56.9395416Z Resolving deltas: 8% (13/155)
2021-07-17T12:04:56.9396319Z Resolving deltas: 9% (14/155)
2021-07-17T12:04:56.9396992Z Resolving deltas: 10% (16/155)
2021-07-17T12:04:56.9397341Z Resolving deltas: 11% (18/155)
2021-07-17T12:04:56.9398566Z Resolving deltas: 12% (19/155)
2021-07-17T12:04:56.9399477Z Resolving deltas: 13% (21/155)
2021-07-17T12:04:56.9400149Z Resolving deltas: 14% (22/155)
2021-07-17T12:04:56.9400726Z Resolving deltas: 15% (24/155)
2021-07-17T12:04:56.9401405Z Resolving deltas: 16% (25/155)
2021-07-17T12:04:56.9401774Z Resolving deltas: 17% (27/155)
2021-07-17T12:04:56.9402748Z Resolving deltas: 18% (28/155)
2021-07-17T12:04:56.9403828Z Resolving deltas: 19% (30/155)
2021-07-17T12:04:56.9404490Z Resolving deltas: 20% (31/155)
2021-07-17T12:04:56.9405080Z Resolving deltas: 21% (33/155)
2021-07-17T12:04:56.9405741Z Resolving deltas: 22% (35/155)
2021-07-17T12:04:56.9406331Z Resolving deltas: 23% (36/155)
2021-07-17T12:04:56.9406996Z Resolving deltas: 24% (38/155)
2021-07-17T12:04:56.9410113Z Resolving deltas: 25% (39/155)
2021-07-17T12:04:56.9411299Z Resolving deltas: 26% (41/155)
2021-07-17T12:04:56.9413606Z Resolving deltas: 27% (42/155)
2021-07-17T12:04:56.9415578Z Resolving deltas: 28% (44/155)
2021-07-17T12:04:56.9418310Z Resolving deltas: 29% (45/155)
2021-07-17T12:04:56.9419028Z Resolving deltas: 30% (47/155)
2021-07-17T12:04:56.9419403Z Resolving deltas: 31% (49/155)
2021-07-17T12:04:56.9420477Z Resolving deltas: 32% (50/155)
2021-07-17T12:04:56.9421352Z Resolving deltas: 33% (52/155)
2021-07-17T12:04:56.9422201Z Resolving deltas: 34% (53/155)
2021-07-17T12:04:56.9423021Z Resolving deltas: 35% (55/155)
2021-07-17T12:04:56.9423681Z Resolving deltas: 36% (56/155)
2021-07-17T12:04:56.9424374Z Resolving deltas: 37% (58/155)
2021-07-17T12:04:56.9424745Z Resolving deltas: 38% (59/155)
2021-07-17T12:04:56.9425601Z Resolving deltas: 39% (61/155)
2021-07-17T12:04:56.9426470Z Resolving deltas: 40% (62/155)
2021-07-17T12:04:56.9427577Z Resolving deltas: 41% (64/155)
2021-07-17T12:04:56.9428436Z Resolving deltas: 42% (66/155)
2021-07-17T12:04:56.9429101Z Resolving deltas: 43% (67/155)
2021-07-17T12:04:56.9429456Z Resolving deltas: 44% (69/155)
2021-07-17T12:04:56.9430538Z Resolving deltas: 45% (70/155)
2021-07-17T12:04:56.9431209Z Resolving deltas: 46% (72/155)
2021-07-17T12:04:56.9431562Z Resolving deltas: 47% (73/155)
2021-07-17T12:04:56.9432640Z Resolving deltas: 48% (75/155)
2021-07-17T12:04:56.9433308Z Resolving deltas: 49% (76/155)
2021-07-17T12:04:56.9433675Z Resolving deltas: 50% (78/155)
2021-07-17T12:04:56.9434522Z Resolving deltas: 51% (80/155)
2021-07-17T12:04:56.9435611Z Resolving deltas: 52% (81/155)
2021-07-17T12:04:56.9437626Z Resolving deltas: 53% (83/155)
2021-07-17T12:04:56.9439044Z Resolving deltas: 54% (84/155)
2021-07-17T12:04:56.9439749Z Resolving deltas: 55% (86/155)
2021-07-17T12:04:56.9441032Z Resolving deltas: 56% (87/155)
2021-07-17T12:04:56.9441707Z Resolving deltas: 57% (89/155)
2021-07-17T12:04:56.9442302Z Resolving deltas: 58% (90/155)
2021-07-17T12:04:56.9442957Z Resolving deltas: 59% (92/155)
2021-07-17T12:04:56.9443920Z Resolving deltas: 60% (93/155)
2021-07-17T12:04:56.9445115Z Resolving deltas: 61% (95/155)
2021-07-17T12:04:56.9446660Z Resolving deltas: 62% (97/155)
2021-07-17T12:04:56.9447959Z Resolving deltas: 63% (98/155)
2021-07-17T12:04:56.9448859Z Resolving deltas: 64% (100/155)
2021-07-17T12:04:56.9449935Z Resolving deltas: 65% (101/155)
2021-07-17T12:04:56.9450574Z Resolving deltas: 66% (103/155)
2021-07-17T12:04:56.9451798Z Resolving deltas: 67% (104/155)
2021-07-17T12:04:56.9452789Z Resolving deltas: 68% (106/155)
2021-07-17T12:04:56.9455353Z Resolving deltas: 69% (107/155)
2021-07-17T12:04:56.9456453Z Resolving deltas: 70% (109/155)
2021-07-17T12:04:56.9459144Z Resolving deltas: 71% (111/155)
2021-07-17T12:04:56.9459789Z Resolving deltas: 72% (112/155)
2021-07-17T12:04:56.9460204Z Resolving deltas: 73% (114/155)
2021-07-17T12:04:56.9460569Z Resolving deltas: 74% (115/155)
2021-07-17T12:04:56.9461283Z Resolving deltas: 75% (117/155)
2021-07-17T12:04:56.9464624Z Resolving deltas: 76% (118/155)
2021-07-17T12:04:56.9465180Z Resolving deltas: 77% (120/155)
2021-07-17T12:04:56.9465665Z Resolving deltas: 78% (121/155)
2021-07-17T12:04:56.9466187Z Resolving deltas: 79% (123/155)
2021-07-17T12:04:56.9466655Z Resolving deltas: 80% (124/155)
2021-07-17T12:04:56.9468075Z Resolving deltas: 81% (126/155)
2021-07-17T12:04:56.9469344Z Resolving deltas: 82% (128/155)
2021-07-17T12:04:56.9470955Z Resolving deltas: 83% (129/155)
2021-07-17T12:04:56.9472229Z Resolving deltas: 84% (131/155)
2021-07-17T12:04:56.9473866Z Resolving deltas: 85% (132/155)
2021-07-17T12:04:56.9474632Z Resolving deltas: 86% (134/155)
2021-07-17T12:04:56.9476183Z Resolving deltas: 87% (135/155)
2021-07-17T12:04:56.9477119Z Resolving deltas: 88% (137/155)
2021-07-17T12:04:56.9479159Z Resolving deltas: 89% (138/155)
2021-07-17T12:04:56.9480460Z Resolving deltas: 90% (140/155)
2021-07-17T12:04:56.9481707Z Resolving deltas: 91% (142/155)
2021-07-17T12:04:56.9483261Z Resolving deltas: 92% (143/155)
2021-07-17T12:04:56.9484181Z Resolving deltas: 93% (145/155)
2021-07-17T12:04:56.9485696Z Resolving deltas: 94% (146/155)
2021-07-17T12:04:56.9486926Z Resolving deltas: 95% (148/155)
2021-07-17T12:04:56.9488111Z Resolving deltas: 96% (149/155)
2021-07-17T12:04:56.9488969Z Resolving deltas: 97% (151/155)
2021-07-17T12:04:56.9492485Z Resolving deltas: 98% (152/155)
2021-07-17T12:04:56.9493314Z Resolving deltas: 99% (154/155)
2021-07-17T12:04:56.9493667Z Resolving deltas: 100% (155/155)
2021-07-17T12:04:56.9494214Z Resolving deltas: 100% (155/155), done.
2021-07-17T12:04:56.9597683Z From https://github.com/submariner-io/submariner-operator
2021-07-17T12:04:56.9598895Z * [new ref] 0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-17T12:04:56.9615812Z ##[endgroup]
2021-07-17T12:04:56.9616299Z ##[group]Determining the checkout info
2021-07-17T12:04:56.9617114Z ##[endgroup]
2021-07-17T12:04:56.9622432Z ##[group]Checking out the ref
2021-07-17T12:04:56.9623396Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-17T12:04:56.9833494Z Switched to a new branch 'devel'
2021-07-17T12:04:56.9837418Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-17T12:04:56.9840669Z ##[endgroup]
2021-07-17T12:04:56.9873519Z [command]/usr/bin/git log -1 --format='%H'
2021-07-17T12:04:56.9894391Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-17T12:04:57.0053935Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-17T12:04:57.0054500Z ##[endgroup]
2021-07-17T12:04:57.0227216Z ##[group]Reclaiming free space
2021-07-17T12:05:07.8690403Z Filesystem Size Used Avail Use% Mounted on
2021-07-17T12:05:07.8719915Z /dev/root 84G 42G 43G 50% /
2021-07-17T12:05:07.8720592Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-17T12:05:07.8721194Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-17T12:05:07.8721959Z tmpfs 696M 1.1M 695M 1% /run
2021-07-17T12:05:07.8722430Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-17T12:05:07.8722906Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-17T12:05:07.8723431Z /dev/loop0 56M 56M 0 100% /snap/core18/2074
2021-07-17T12:05:07.8724101Z /dev/loop2 33M 33M 0 100% /snap/snapd/12159
2021-07-17T12:05:07.8724575Z /dev/loop3 68M 68M 0 100% /snap/lxd/20326
2021-07-17T12:05:07.8725213Z /dev/loop1 56M 56M 0 100% /snap/core18/2066
2021-07-17T12:05:07.8725730Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-17T12:05:07.8726217Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-17T12:05:07.8726673Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-17T12:05:07.8727855Z ##[endgroup]
2021-07-17T12:05:07.8861447Z ##[group]Disable swap
2021-07-17T12:05:07.9129929Z ##[endgroup]
2021-07-17T12:05:07.9228957Z ##[group]Report available RAM
2021-07-17T12:05:07.9379001Z total used free shared buff/cache available
2021-07-17T12:05:07.9379950Z Mem: 6.8Gi 489Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-17T12:05:07.9380614Z Swap: 0B 0B 0B
2021-07-17T12:05:07.9382196Z ##[endgroup]
2021-07-17T12:05:07.9521554Z Downloading Makefile.dapper
2021-07-17T12:05:08.0019603Z Downloading dapper
2021-07-17T12:05:08.2425793Z .dapper.tmp version v0.5.6
2021-07-17T12:05:08.2454959Z Downloading Dockerfile.dapper
2021-07-17T12:05:08.2830105Z docker network create -d bridge kind
2021-07-17T12:05:08.6162504Z 241ee5d87ece834db69a5485fc38aa23cc0c47460d885fb87139c45b3654dcb4
2021-07-17T12:05:08.6205651Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-17T12:05:08.8294113Z Sending build context to Docker daemon 7.517MB
2021-07-17T12:05:08.8296820Z
2021-07-17T12:05:08.8394172Z Step 1/8 : ARG BASE_BRANCH
2021-07-17T12:05:08.8395749Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-17T12:05:10.2288979Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-17T12:05:10.2289710Z b1495d80d526: Pulling fs layer
2021-07-17T12:05:10.2290463Z fb3037ce215d: Pulling fs layer
2021-07-17T12:05:10.2290934Z 95344349df1d: Pulling fs layer
2021-07-17T12:05:10.2291394Z a3e11b0fdbf6: Pulling fs layer
2021-07-17T12:05:10.2291847Z b2d0ef6cbe4f: Pulling fs layer
2021-07-17T12:05:10.2292270Z fa188fe30729: Pulling fs layer
2021-07-17T12:05:10.2292695Z 05ca4b0545ef: Pulling fs layer
2021-07-17T12:05:10.2293156Z b17ce80b21da: Pulling fs layer
2021-07-17T12:05:10.2296435Z a3e11b0fdbf6: Waiting
2021-07-17T12:05:10.2296838Z b2d0ef6cbe4f: Waiting
2021-07-17T12:05:10.2297231Z fa188fe30729: Waiting
2021-07-17T12:05:10.2297591Z 05ca4b0545ef: Waiting
2021-07-17T12:05:10.2297971Z b17ce80b21da: Waiting
2021-07-17T12:05:11.2779878Z b1495d80d526: Verifying Checksum
2021-07-17T12:05:11.2781490Z b1495d80d526: Download complete
2021-07-17T12:05:11.2782351Z 95344349df1d: Verifying Checksum
2021-07-17T12:05:11.2782947Z 95344349df1d: Download complete
2021-07-17T12:05:11.4623521Z a3e11b0fdbf6: Verifying Checksum
2021-07-17T12:05:11.4624013Z a3e11b0fdbf6: Download complete
2021-07-17T12:05:11.4741514Z b2d0ef6cbe4f: Verifying Checksum
2021-07-17T12:05:11.4741982Z b2d0ef6cbe4f: Download complete
2021-07-17T12:05:11.8431710Z fa188fe30729: Verifying Checksum
2021-07-17T12:05:11.8453545Z fa188fe30729: Download complete
2021-07-17T12:05:11.8799549Z 05ca4b0545ef: Verifying Checksum
2021-07-17T12:05:11.8800342Z 05ca4b0545ef: Download complete
2021-07-17T12:05:12.2268314Z b17ce80b21da: Verifying Checksum
2021-07-17T12:05:12.2272711Z b17ce80b21da: Download complete
2021-07-17T12:05:13.3507906Z fb3037ce215d: Verifying Checksum
2021-07-17T12:05:13.3508481Z fb3037ce215d: Download complete
2021-07-17T12:05:14.2160165Z b1495d80d526: Pull complete
2021-07-17T12:05:24.6680906Z fb3037ce215d: Pull complete
2021-07-17T12:05:26.1276320Z 95344349df1d: Pull complete
2021-07-17T12:05:26.1901965Z a3e11b0fdbf6: Pull complete
2021-07-17T12:05:26.2524706Z b2d0ef6cbe4f: Pull complete
2021-07-17T12:05:26.4076723Z fa188fe30729: Pull complete
2021-07-17T12:05:26.4794923Z 05ca4b0545ef: Pull complete
2021-07-17T12:05:26.5525813Z b17ce80b21da: Pull complete
2021-07-17T12:05:26.5572003Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-17T12:05:26.5603850Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-17T12:05:26.5619425Z ---> 92b726655a41
2021-07-17T12:05:26.5624483Z Step 3/8 : ARG PROJECT
2021-07-17T12:05:26.5818241Z ---> Running in 841ce1dc518f
2021-07-17T12:05:27.4754885Z Removing intermediate container 841ce1dc518f
2021-07-17T12:05:27.4755893Z ---> 1acf8c1c92a6
2021-07-17T12:05:27.4757100Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-17T12:05:27.4970523Z ---> Running in e2903c7651c6
2021-07-17T12:05:28.3577960Z Removing intermediate container e2903c7651c6
2021-07-17T12:05:28.3644311Z ---> aaf64828bf8f
2021-07-17T12:05:28.3644976Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-17T12:05:28.3780922Z ---> Running in 0dee541c8cbb
2021-07-17T12:05:29.2935671Z Removing intermediate container 0dee541c8cbb
2021-07-17T12:05:29.2936841Z ---> 1ddea9d4d046
2021-07-17T12:05:29.2937255Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-17T12:05:29.3104651Z ---> Running in f4910f8c44ff
2021-07-17T12:05:30.1338118Z Removing intermediate container f4910f8c44ff
2021-07-17T12:05:30.1339212Z ---> a1d2eb1c2aff
2021-07-17T12:05:30.1339640Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-17T12:05:30.1491369Z ---> Running in 0da0d30c0b8d
2021-07-17T12:05:31.0489922Z Removing intermediate container 0da0d30c0b8d
2021-07-17T12:05:31.0490924Z ---> 2475049f0c87
2021-07-17T12:05:31.0491219Z Step 8/8 : CMD ["sh"]
2021-07-17T12:05:31.0768981Z ---> Running in 0041ed9dfa60
2021-07-17T12:05:32.0474739Z Removing intermediate container 0041ed9dfa60
2021-07-17T12:05:32.0475800Z ---> 480b37ac2fb1
2021-07-17T12:05:32.0610835Z Successfully built 480b37ac2fb1
2021-07-17T12:05:32.0648718Z Successfully tagged submariner-operator:devel
2021-07-17T12:05:32.5145302Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-17T12:05:32.5168699Z [submariner-operator]$ mkdir -p bin dist output
2021-07-17T12:05:32.5175408Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-17T12:05:32.5176050Z GNU Make 4.3
2021-07-17T12:05:32.5176601Z Built for x86_64-redhat-linux-gnu
2021-07-17T12:05:32.5177220Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-17T12:05:32.5177825Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-17T12:05:32.5178470Z This is free software: you are free to change and redistribute it.
2021-07-17T12:05:32.5179033Z There is NO WARRANTY, to the extent permitted by law.
2021-07-17T12:05:32.5179464Z Reading makefiles...
2021-07-17T12:05:32.6049962Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-17T12:05:32.6052023Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-17T12:05:32.7703108Z Updating makefiles....
2021-07-17T12:05:32.7711791Z Updating goal targets....
2021-07-17T12:05:32.7712755Z File 'upgrade-e2e' does not exist.
2021-07-17T12:05:32.7717643Z File 'deploy-latest' does not exist.
2021-07-17T12:05:32.7718240Z Must remake target 'deploy-latest'.
2021-07-17T12:05:32.7719310Z curl -L get.submariner.io | VERSION=latest bash
2021-07-17T12:05:32.7822637Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-17T12:05:32.7829931Z Dload Upload Total Spent Left Speed
2021-07-17T12:05:32.7830274Z
2021-07-17T12:05:32.8227926Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-17T12:05:32.8228579Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-17T12:05:32.9807938Z
2021-07-17T12:05:32.9809019Z 100 4155 0 4155 0 0 20775 0 --:--:-- --:--:-- --:--:-- 20775
2021-07-17T12:05:33.1587632Z Installing subctl version latest
2021-07-17T12:05:33.1589196Z OS detected: linux
2021-07-17T12:05:33.1594279Z Architecture detected: amd64
2021-07-17T12:05:33.1596046Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-17T12:05:33.1596868Z
2021-07-17T12:05:33.1597358Z Downloading...
2021-07-17T12:05:34.4117030Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-17T12:05:34.4430492Z This provides subctl version: v0.9.1
2021-07-17T12:05:34.4444329Z
2021-07-17T12:05:34.4444981Z please update your path (and consider adding it to ~/.profile):
2021-07-17T12:05:34.4445823Z export PATH=$PATH:/root/.local/bin
2021-07-17T12:05:34.4446621Z
2021-07-17T12:05:34.4520590Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-17T12:05:34.4552253Z GNU Make 4.3
2021-07-17T12:05:34.4553011Z Built for x86_64-redhat-linux-gnu
2021-07-17T12:05:34.4553656Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-17T12:05:34.4554292Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-17T12:05:34.4554923Z This is free software: you are free to change and redistribute it.
2021-07-17T12:05:34.4555488Z There is NO WARRANTY, to the extent permitted by law.
2021-07-17T12:05:34.4555920Z Reading makefiles...
2021-07-17T12:05:34.4556712Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-17T12:05:34.5441433Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-17T12:05:34.5442312Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-17T12:05:34.7025242Z Updating makefiles....
2021-07-17T12:05:34.7034595Z Updating goal targets....
2021-07-17T12:05:34.7035573Z File 'clusters' does not exist.
2021-07-17T12:05:34.7036126Z Must remake target 'clusters'.
2021-07-17T12:05:34.7037129Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:05:34.7062525Z Downloading shflags 1.0.3
2021-07-17T12:05:34.7124018Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-17T12:05:34.7124638Z Dload Upload Total Spent Left Speed
2021-07-17T12:05:34.7124946Z
2021-07-17T12:05:34.7437442Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-17T12:05:34.7439519Z 100 31091 100 31091 0 0 979k 0 --:--:-- --:--:-- --:--:-- 979k
2021-07-17T12:05:34.8011530Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-17T12:05:34.8031935Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T12:05:34.8042523Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:05:34.8052304Z [submariner-operator]$ script_name=utils
2021-07-17T12:05:34.8061890Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T12:05:34.8077685Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T12:05:34.8097963Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:05:34.8107478Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:05:34.8119048Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T12:05:34.8136804Z [submariner-operator]$ broker=cluster1
2021-07-17T12:05:34.8146627Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T12:05:34.8156504Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T12:05:34.8166851Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T12:05:34.8176314Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T12:05:34.8186866Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T12:05:34.8197123Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T12:05:34.8207207Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T12:05:34.8217256Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T12:05:34.8226632Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T12:05:34.8236291Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T12:05:34.8246475Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T12:05:34.8257142Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:05:34.8267029Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:05:34.8276826Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:05:34.8290090Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T12:05:34.8308976Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T12:05:34.8320277Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T12:05:34.8346865Z [submariner-operator]$ cat <<EOM
2021-07-17T12:05:34.8348130Z Cluster settings::
2021-07-17T12:05:34.8348715Z broker - ${broker@Q}
2021-07-17T12:05:34.8349232Z clusters - ${clusters[*]@Q}
2021-07-17T12:05:34.8349802Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-17T12:05:34.8350491Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-17T12:05:34.8351249Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-17T12:05:34.8351779Z EOM
2021-07-17T12:05:34.8369068Z [submariner-operator]$ typeset -p cluster_cni
2021-07-17T12:05:34.8380987Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T12:05:34.8408170Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-17T12:05:34.8419170Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T12:05:34.8442560Z [submariner-operator]$ typeset -p cluster_subm
2021-07-17T12:05:34.8453827Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T12:05:34.8470937Z Cluster settings::
2021-07-17T12:05:34.8471661Z broker - 'cluster1'
2021-07-17T12:05:34.8472188Z clusters - 'cluster1' 'cluster2'
2021-07-17T12:05:34.8472775Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-17T12:05:34.8473762Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-17T12:05:34.8474753Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-17T12:05:34.8491504Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-17T12:05:34.8508692Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-17T12:05:34.8528186Z [submariner-operator]$ run_local_registry
2021-07-17T12:05:34.8537742Z [submariner-operator]$ run_local_registry
2021-07-17T12:05:34.8547316Z [submariner-operator]$ registry_running
2021-07-17T12:05:34.8556906Z [submariner-operator]$ registry_running
2021-07-17T12:05:34.8566680Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-17T12:05:34.8577888Z [submariner-operator]$ grep kind-registry
2021-07-17T12:05:35.0653237Z [submariner-operator]$ return 0
2021-07-17T12:05:35.0656568Z Deploying local registry kind-registry to serve images centrally.
2021-07-17T12:05:35.0667708Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-17T12:05:35.0676747Z [submariner-operator]$ selinuxenabled
2021-07-17T12:05:35.0696189Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-17T12:05:35.2797774Z Unable to find image 'registry:2' locally
2021-07-17T12:05:36.5984413Z 2: Pulling from library/registry
2021-07-17T12:05:36.9421993Z ddad3d7c1e96: Already exists
2021-07-17T12:05:36.9448175Z 6eda6749503f: Pulling fs layer
2021-07-17T12:05:36.9448620Z 363ab70c2143: Pulling fs layer
2021-07-17T12:05:36.9451906Z 5b94580856e6: Pulling fs layer
2021-07-17T12:05:36.9452270Z 12008541203a: Pulling fs layer
2021-07-17T12:05:36.9452571Z 12008541203a: Waiting
2021-07-17T12:05:37.2894513Z 5b94580856e6: Download complete
2021-07-17T12:05:37.3440462Z 6eda6749503f: Verifying Checksum
2021-07-17T12:05:37.3441985Z 6eda6749503f: Download complete
2021-07-17T12:05:37.3597476Z 363ab70c2143: Verifying Checksum
2021-07-17T12:05:37.3597878Z 363ab70c2143: Download complete
2021-07-17T12:05:37.7213843Z 12008541203a: Verifying Checksum
2021-07-17T12:05:37.7214500Z 12008541203a: Download complete
2021-07-17T12:05:37.7292642Z 6eda6749503f: Pull complete
2021-07-17T12:05:38.0089768Z 363ab70c2143: Pull complete
2021-07-17T12:05:38.0720590Z 5b94580856e6: Pull complete
2021-07-17T12:05:38.1292883Z 12008541203a: Pull complete
2021-07-17T12:05:38.1349167Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-17T12:05:38.1368491Z Status: Downloaded newer image for registry:2
2021-07-17T12:05:38.1623254Z fef8e063a9241919db0a75eb1ee372243f042a7209d5ee6548ae8ebc3e6a2e6c
2021-07-17T12:05:38.5051586Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-17T12:05:38.8242461Z [submariner-operator]$ declare_cidrs
2021-07-17T12:05:38.8250819Z [submariner-operator]$ declare_cidrs
2021-07-17T12:05:38.8264960Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T12:05:38.8268174Z [submariner-operator]$ i=1
2021-07-17T12:05:38.8272124Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:05:38.8284269Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:05:38.8296381Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T12:05:38.8297319Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T12:05:38.8305977Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T12:05:38.8319623Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:05:38.8336397Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:05:38.8342363Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T12:05:38.8354455Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T12:05:38.8364251Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T12:05:38.8380348Z [submariner-operator]$ [cluster2] wait 289
2021-07-17T12:05:38.8381412Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-17T12:05:38.8389996Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-17T12:05:38.8401776Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-17T12:05:38.8412406Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-17T12:05:38.8422384Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:05:38.8435353Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:05:38.8451547Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:05:38.8454388Z [submariner-operator]$ [cluster1] pids[cluster1]=298
2021-07-17T12:05:38.8464181Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-17T12:05:38.8477436Z [submariner-operator]$ [cluster2] pids[cluster2]=301
2021-07-17T12:05:38.8482402Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:05:38.8497274Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:05:38.8514699Z [submariner-operator]$ [cluster2] wait 301
2021-07-17T12:05:38.8528856Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-17T12:05:38.8543527Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:07:31.7730845Z [submariner-operator]$ [cluster2] with_retries
2021-07-17T12:07:31.7732036Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T12:07:31.7733202Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-17T12:07:31.7733919Z [submariner-operator]$ [cluster2] wait 323
2021-07-17T12:07:31.7734621Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-17T12:07:31.7735823Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:07:31.7737576Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:07:31.7739111Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-17T12:07:31.7740131Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-17T12:07:31.7741069Z [cluster2] No kind clusters found.
2021-07-17T12:07:31.7742146Z [cluster2] Creating KIND cluster...
2021-07-17T12:07:31.7742966Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-17T12:07:31.7744527Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-17T12:07:31.7745631Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-17T12:07:31.7746390Z [submariner-operator]$ [cluster2] nodes=
2021-07-17T12:07:31.7747043Z [cluster2] - role: control-plane
2021-07-17T12:07:31.7747832Z [submariner-operator]$ [cluster2] nodes=
2021-07-17T12:07:31.7748618Z [cluster2] - role: control-plane
2021-07-17T12:07:31.7749319Z [cluster2] - role: worker
2021-07-17T12:07:31.7749935Z [submariner-operator]$ [cluster2] nodes=
2021-07-17T12:07:31.7750552Z [cluster2] - role: control-plane
2021-07-17T12:07:31.7751075Z [cluster2] - role: worker
2021-07-17T12:07:31.7752052Z [cluster2] - role: worker
2021-07-17T12:07:31.7752712Z [cluster2] 
2021-07-17T12:07:31.7753149Z [cluster2] 
2021-07-17T12:07:31.7753796Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-17T12:07:31.7755029Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-17T12:07:31.7756296Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-17T12:07:31.7757089Z [submariner-operator]$ [cluster2] kind version
2021-07-17T12:07:31.7757579Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-17T12:07:31.7758675Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-17T12:07:31.7759600Z [cluster2] ---
2021-07-17T12:07:31.7759966Z [cluster2] kind: Cluster
2021-07-17T12:07:31.7760565Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-17T12:07:31.7760994Z [cluster2] networking:
2021-07-17T12:07:31.7761612Z [cluster2] disableDefaultCNI: true
2021-07-17T12:07:31.7762236Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-17T12:07:31.7762849Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-17T12:07:31.7763383Z [cluster2] containerdConfigPatches:
2021-07-17T12:07:31.7764021Z [cluster2] - |-
2021-07-17T12:07:31.7764668Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-17T12:07:31.7765935Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-17T12:07:31.7766495Z [cluster2] kubeadmConfigPatches:
2021-07-17T12:07:31.7767013Z [cluster2] - |
2021-07-17T12:07:31.7767436Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-17T12:07:31.7767949Z [cluster2] kind: ClusterConfiguration
2021-07-17T12:07:31.7768398Z [cluster2] metadata:
2021-07-17T12:07:31.7768738Z [cluster2] name: config
2021-07-17T12:07:31.7769105Z [cluster2] networking:
2021-07-17T12:07:31.7769468Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-17T12:07:31.7769878Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-17T12:07:31.7770318Z [cluster2] dnsDomain: cluster2.local
2021-07-17T12:07:31.7770715Z [cluster2] nodes:
2021-07-17T12:07:31.7771207Z [cluster2] - role: control-plane
2021-07-17T12:07:31.7771708Z [cluster2] - role: worker
2021-07-17T12:07:31.7772309Z [cluster2] - role: worker
2021-07-17T12:07:31.7773352Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-17T12:07:31.7774226Z [cluster2] Creating cluster "cluster2" ...
2021-07-17T12:07:31.7776098Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-17T12:07:31.7776907Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-17T12:07:31.7777582Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-17T12:07:31.7778316Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-17T12:07:31.7778860Z [cluster2] • Writing configuration 📜 ...
2021-07-17T12:07:31.7779430Z [cluster2] ✓ Writing configuration 📜
2021-07-17T12:07:31.7780011Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-17T12:07:31.7780608Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-17T12:07:31.7781208Z [cluster2] • Installing StorageClass 💾 ...
2021-07-17T12:07:31.7782000Z [cluster2] ✓ Installing StorageClass 💾
2021-07-17T12:07:31.7782959Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-17T12:07:31.7783598Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-17T12:07:31.7784244Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-17T12:07:31.7784768Z [cluster2] You can now use your cluster with:
2021-07-17T12:07:31.7785171Z [cluster2]
2021-07-17T12:07:31.7786086Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-17T12:07:31.7787380Z [cluster2]
2021-07-17T12:07:31.7788112Z [cluster2] Have a nice day! 👋
2021-07-17T12:07:31.7788972Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-17T12:07:31.7789976Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-17T12:07:31.7791286Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-17T12:07:31.7792329Z [submariner-operator]$ [cluster2] head -n 1
2021-07-17T12:07:32.8156278Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\[submariner-operator]$ [cluster1] with_retries
2021-07-17T12:07:32.8157557Z [submariner-operator]$ [cluster1] iteration=1
2021-07-17T12:07:32.8158584Z [submariner-operator]$ [cluster1] wait 315
2021-07-17T12:07:32.8159399Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-17T12:07:32.8160188Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-17T12:07:32.8161757Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:07:32.8163403Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:07:32.8164550Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-17T12:07:32.8165339Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-17T12:07:32.8165987Z [cluster1] No kind clusters found.
2021-07-17T12:07:32.8166454Z [cluster1] Creating KIND cluster...
2021-07-17T12:07:32.8167193Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-17T12:07:32.8168230Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-17T12:07:32.8168974Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-17T12:07:32.8169666Z [submariner-operator]$ [cluster1] nodes=
2021-07-17T12:07:32.8170341Z [cluster1] - role: control-plane
2021-07-17T12:07:32.8170950Z [submariner-operator]$ [cluster1] nodes=
2021-07-17T12:07:32.8171551Z [cluster1] - role: control-plane
2021-07-17T12:07:32.8172049Z [cluster1] - role: worker
2021-07-17T12:07:32.8172627Z [submariner-operator]$ [cluster1] nodes=
2021-07-17T12:07:32.8173209Z [cluster1] - role: control-plane
2021-07-17T12:07:32.8173713Z [cluster1] - role: worker
2021-07-17T12:07:32.8174173Z [cluster1] - role: worker
2021-07-17T12:07:32.8174797Z [cluster1] 
2021-07-17T12:07:32.8175190Z [cluster1] 
2021-07-17T12:07:32.8175788Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-17T12:07:32.8177022Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-17T12:07:32.8178115Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-17T12:07:32.8178895Z [submariner-operator]$ [cluster1] kind version
2021-07-17T12:07:32.8179397Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-17T12:07:32.8180239Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-17T12:07:32.8180940Z [cluster1] ---
2021-07-17T12:07:32.8181437Z [cluster1] kind: Cluster
2021-07-17T12:07:32.8182023Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-17T12:07:32.8182469Z [cluster1] networking:
2021-07-17T12:07:32.8182888Z [cluster1] disableDefaultCNI: true
2021-07-17T12:07:32.8183336Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-17T12:07:32.8183728Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-17T12:07:32.8186041Z [cluster1] containerdConfigPatches:
2021-07-17T12:07:32.8187310Z [cluster1] - |-
2021-07-17T12:07:32.8188332Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-17T12:07:32.8189776Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-17T12:07:32.8190993Z [cluster1] kubeadmConfigPatches:
2021-07-17T12:07:32.8192138Z [cluster1] - |
2021-07-17T12:07:32.8192615Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-17T12:07:32.8193463Z [cluster1] kind: ClusterConfiguration
2021-07-17T12:07:32.8193966Z [cluster1] metadata:
2021-07-17T12:07:32.8194382Z [cluster1] name: config
2021-07-17T12:07:32.8194983Z [cluster1] networking:
2021-07-17T12:07:32.8195447Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-17T12:07:32.8195949Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-17T12:07:32.8196670Z [cluster1] dnsDomain: cluster1.local
2021-07-17T12:07:32.8197146Z [cluster1] nodes:
2021-07-17T12:07:32.8197897Z [cluster1] - role: control-plane
2021-07-17T12:07:32.8198776Z [cluster1] - role: worker
2021-07-17T12:07:32.8199279Z [cluster1] - role: worker
2021-07-17T12:07:32.8200582Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-17T12:07:32.8201663Z [cluster1] Creating cluster "cluster1" ...
2021-07-17T12:07:32.8202635Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-17T12:07:32.8203599Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-17T12:07:32.8204274Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-17T12:07:32.8204895Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-17T12:07:32.8205883Z [cluster1] • Writing configuration 📜 ...
2021-07-17T12:07:32.8206588Z [cluster1] ✓ Writing configuration 📜
2021-07-17T12:07:32.8208189Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-17T12:07:32.8208967Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-17T12:07:32.8209896Z [cluster1] • Installing StorageClass 💾 ...
2021-07-17T12:07:32.8210989Z [cluster1] ✓ Installing StorageClass 💾
2021-07-17T12:07:32.8211643Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-17T12:07:32.8212384Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-17T12:07:32.8213050Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-17T12:07:32.8213597Z [cluster1] You can now use your cluster with:
2021-07-17T12:07:32.8214165Z [cluster1]
2021-07-17T12:07:32.8214777Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-17T12:07:32.8215257Z [cluster1]
2021-07-17T12:07:32.8216093Z [cluster1] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-17T12:07:32.8217074Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-17T12:07:32.8217872Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-17T12:07:32.8219236Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-17T12:07:32.8220370Z [submariner-operator]$ [cluster1] head -n 1
2021-07-17T12:08:09.3100439Z [3/\/172.18.0.5:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:08:09.3102042Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:08:09.3103886Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:08:09.3105958Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:08:09.3107972Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:08:09.3109796Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:08:09.3111033Z [submariner-operator]$ [cluster2] wait 1612
2021-07-17T12:08:09.3111962Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-17T12:08:09.3112963Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-17T12:08:09.3113870Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-17T12:08:09.3114728Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-17T12:08:09.3115617Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-17T12:08:09.3116516Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-17T12:08:09.3117412Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-17T12:08:09.3118088Z [cluster2] Applying weave network...
2021-07-17T12:08:09.3120272Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-17T12:08:09.3122025Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-17T12:08:09.3123539Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-17T12:08:09.3124600Z [cluster2] serviceaccount/weave-net created
2021-07-17T12:08:09.3125676Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:09.3127153Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:09.3128393Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:09.3129486Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:09.3130590Z [cluster2] daemonset.apps/weave-net created
2021-07-17T12:08:09.3131269Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-17T12:08:09.3132264Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T12:08:09.3133498Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T12:08:09.3136548Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T12:08:09.3137967Z [cluster2] pod/weave-net-f82x8 condition met
2021-07-17T12:08:09.3139460Z [cluster2] pod/weave-net-p8b78 condition met
2021-07-17T12:08:09.3140566Z [cluster2] pod/weave-net-pcqqr condition met
2021-07-17T12:08:09.3141488Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-17T12:08:09.3142573Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T12:08:09.3143627Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T12:08:09.3148053Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T12:08:09.3149118Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T12:08:09.3150419Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T12:08:09.3151108Z [cluster2] deployment "coredns" successfully rolled out
2021-07-17T12:08:09.3151925Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:08:09.3152641Z [submariner-operator]$ [cluster2] wait 298
2021-07-17T12:08:14.0602603Z 6m[submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:08:14.0604440Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:08:14.0606514Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:08:14.0608347Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:08:14.0610397Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:08:14.0612162Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:08:14.0613465Z [submariner-operator]$ [cluster1] wait 1642
2021-07-17T12:08:14.0614304Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-17T12:08:14.0615419Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-17T12:08:14.0616478Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-17T12:08:14.0617222Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-17T12:08:14.0617991Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-17T12:08:14.0618786Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-17T12:08:14.0619564Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-17T12:08:14.0620110Z [cluster1] Applying weave network...
2021-07-17T12:08:14.0621228Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-17T12:08:14.0622660Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-17T12:08:14.0624214Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-17T12:08:14.0625338Z [cluster1] serviceaccount/weave-net created
2021-07-17T12:08:14.0626276Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:14.0627580Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:14.0628761Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:14.0629837Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T12:08:14.0630935Z [cluster1] daemonset.apps/weave-net created
2021-07-17T12:08:14.0631637Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-17T12:08:14.0632622Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T12:08:14.0634179Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T12:08:14.0635542Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T12:08:14.0636541Z [cluster1] pod/weave-net-8lvbj condition met
2021-07-17T12:08:14.0637234Z [cluster1] pod/weave-net-ghfkf condition met
2021-07-17T12:08:14.0637908Z [cluster1] pod/weave-net-mhqmm condition met
2021-07-17T12:08:14.0639172Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-17T12:08:14.0640147Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T12:08:14.0641270Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T12:08:14.0642487Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T12:08:14.0643446Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T12:08:14.0644291Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T12:08:14.0645000Z [cluster1] deployment "coredns" successfully rolled out
2021-07-17T12:08:14.0645744Z [submariner-operator]$ [cluster1] return 0
2021-07-17T12:08:14.0677927Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-17T12:08:14.0690665Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-17T12:08:14.0715066Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-17T12:08:14.0715704Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-17T12:08:14.0716099Z
2021-07-17T12:08:14.0716835Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-17T12:08:14.0717304Z
2021-07-17T12:08:14.0717853Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-17T12:08:14.0718204Z
2021-07-17T12:08:14.0719089Z To clean everthing up, just run: make clean-clusters
2021-07-17T12:08:14.0743181Z EOM
2021-07-17T12:08:14.0761079Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-17T12:08:14.0761523Z
2021-07-17T12:08:14.0762358Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-17T12:08:14.0762827Z
2021-07-17T12:08:14.0763388Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-17T12:08:14.0763754Z
2021-07-17T12:08:14.0764277Z To clean everthing up, just run: make clean-clusters
2021-07-17T12:08:14.0768285Z Successfully remade target file 'clusters'.
2021-07-17T12:08:14.0769096Z File 'bin/subctl' does not exist.
2021-07-17T12:08:14.0769805Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-17T12:08:14.0780607Z File 'generate-embeddedyamls' does not exist.
2021-07-17T12:08:14.0781316Z File 'generate' does not exist.
2021-07-17T12:08:14.0782144Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-17T12:08:14.0782967Z File 'vendor/modules.txt' does not exist.
2021-07-17T12:08:14.0783558Z Must remake target 'vendor/modules.txt'.
2021-07-17T12:08:14.0783951Z go mod download
2021-07-17T12:09:09.1001225Z go mod vendor
2021-07-17T12:09:13.9232378Z go mod tidy
2021-07-17T12:09:14.5739419Z Successfully remade target file 'vendor/modules.txt'.
2021-07-17T12:09:14.5740800Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-17T12:09:14.5741887Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-17T12:09:14.5779698Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-17T12:09:32.2593537Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-17T12:09:32.2594479Z Must remake target 'generate'.
2021-07-17T12:09:32.2633378Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-17T12:09:42.3535034Z Successfully remade target file 'generate'.
2021-07-17T12:09:42.3535913Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-17T12:09:42.3542269Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-17T12:09:42.3549380Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-17T12:09:42.3550744Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-17T12:09:44.3630342Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-17T12:09:44.3634346Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-17T12:09:44.3635239Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-17T12:09:44.3636726Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-17T12:09:45.5669850Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-17T12:09:45.5750897Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-17T12:09:45.5751630Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-17T12:09:46.1266781Z Generating yamls.go
2021-07-17T12:09:46.1268598Z deploy/crds/submariner.io_brokers.yaml
2021-07-17T12:09:46.1271328Z deploy/crds/submariner.io_submariners.yaml
2021-07-17T12:09:46.1299017Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-17T12:09:46.1299903Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-17T12:09:46.1301841Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-17T12:09:46.1305416Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-17T12:09:46.1306139Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-17T12:09:46.1306925Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-17T12:09:46.1310913Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-17T12:09:46.1314421Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-17T12:09:46.1322078Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-17T12:09:46.1331968Z config/broker/broker-admin/service_account.yaml
2021-07-17T12:09:46.1334663Z config/broker/broker-admin/role.yaml
2021-07-17T12:09:46.1339771Z config/broker/broker-admin/role_binding.yaml
2021-07-17T12:09:46.1343504Z config/broker/broker-client/service_account.yaml
2021-07-17T12:09:46.1350003Z config/broker/broker-client/role.yaml
2021-07-17T12:09:46.1355986Z config/broker/broker-client/role_binding.yaml
2021-07-17T12:09:46.1361388Z config/rbac/submariner-operator/service_account.yaml
2021-07-17T12:09:46.1365103Z config/rbac/submariner-operator/role.yaml
2021-07-17T12:09:46.1371748Z config/rbac/submariner-operator/role_binding.yaml
2021-07-17T12:09:46.1376769Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-17T12:09:46.1378901Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-17T12:09:46.1384537Z config/rbac/submariner-gateway/service_account.yaml
2021-07-17T12:09:46.1390378Z config/rbac/submariner-gateway/role.yaml
2021-07-17T12:09:46.1395639Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-17T12:09:46.1400573Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-17T12:09:46.1405107Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-17T12:09:46.1409499Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-17T12:09:46.1413091Z config/rbac/submariner-route-agent/role.yaml
2021-07-17T12:09:46.1416845Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-17T12:09:46.1420523Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-17T12:09:46.1426420Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-17T12:09:46.1432874Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-17T12:09:46.1435472Z config/rbac/submariner-globalnet/role.yaml
2021-07-17T12:09:46.1442787Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-17T12:09:46.1448375Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-17T12:09:46.1452190Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-17T12:09:46.1456244Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-17T12:09:46.1459857Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-17T12:09:46.1465996Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-17T12:09:46.1467296Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-17T12:09:46.1470653Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-17T12:09:46.1473497Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-17T12:09:46.1476247Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-17T12:09:46.1480539Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-17T12:09:46.1484158Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-17T12:09:46.1488378Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-17T12:09:46.1491685Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-17T12:09:46.1516484Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-17T12:09:46.1517384Z Must remake target 'generate-embeddedyamls'.
2021-07-17T12:09:46.1518660Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-17T12:09:46.1706418Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-17T12:09:46.1707181Z mkdir -p bin
2021-07-17T12:09:46.1727672Z target=bin/subctl-latest-linux-amd64; \
2021-07-17T12:09:46.1728286Z target=${target%.exe}; \
2021-07-17T12:09:46.1728998Z components=($(echo ${target//-/ })); \
2021-07-17T12:09:46.1729550Z GOOS=${components[-2]}; \
2021-07-17T12:09:46.1730114Z GOARCH=${components[-1]}; \
2021-07-17T12:09:46.1730489Z export GOARCH GOOS; \
2021-07-17T12:09:46.1730942Z /opt/shipyard/scripts/compile.sh \
2021-07-17T12:09:46.1732272Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-17T12:09:46.1734123Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-17T12:09:46.1736142Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-17T12:09:46.2305830Z [submariner-operator]$ mkdir -p bin
2021-07-17T12:09:46.2321411Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-17T12:09:46.2335393Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-17T12:09:46.2348353Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-17T12:11:28.2943098Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-17T12:11:28.2944388Z Must remake target 'bin/subctl'.
2021-07-17T12:11:28.2945329Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-17T12:11:28.2972044Z Successfully remade target file 'bin/subctl'.
2021-07-17T12:11:28.2973551Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-17T12:11:28.2975723Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-17T12:11:28.2976339Z Must remake target 'deploy'.
2021-07-17T12:11:28.2977987Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:11:28.3987317Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T12:11:28.3989094Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-17T12:11:28.3997302Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:11:28.4002811Z [submariner-operator]$ script_name=utils
2021-07-17T12:11:28.4004060Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:11:28.4014021Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-17T12:11:28.4037466Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:11:28.4049784Z [submariner-operator]$ script_name=deploy_funcs
2021-07-17T12:11:28.4062503Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:11:28.4079597Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T12:11:28.4120361Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:11:28.4135388Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:11:28.4154201Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:11:28.4179068Z [submariner-operator]$ broker=cluster1
2021-07-17T12:11:28.4209200Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T12:11:28.4231962Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T12:11:28.4241654Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T12:11:28.4255577Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T12:11:28.4266429Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T12:11:28.4277051Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T12:11:28.4288560Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T12:11:28.4301629Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T12:11:28.4314045Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T12:11:28.4324905Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T12:11:28.4338220Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T12:11:28.4344823Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:11:28.4353818Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:11:28.4366147Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:11:28.4374195Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:11:28.4393135Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T12:11:28.4402457Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T12:11:28.4430358Z [submariner-operator]$ declare_cidrs
2021-07-17T12:11:28.4439157Z [submariner-operator]$ declare_cidrs
2021-07-17T12:11:28.4451989Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T12:11:28.4462915Z [submariner-operator]$ i=1
2021-07-17T12:11:28.4478969Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:11:28.4493531Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:11:28.4506208Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T12:11:28.4518294Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T12:11:28.4528666Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T12:11:28.4541775Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:11:28.4560889Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:11:28.4571166Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T12:11:28.4581969Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T12:11:28.4601120Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T12:11:28.4623322Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-17T12:11:28.4633578Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-17T12:11:28.4647384Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-17T12:11:28.4664031Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-17T12:11:28.4681682Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-17T12:11:28.4739967Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-17T12:11:28.4769712Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-17T12:11:28.8290028Z Installing subctl version latest
2021-07-17T12:11:28.8292343Z OS detected: linux
2021-07-17T12:11:28.8292785Z Architecture detected: amd64
2021-07-17T12:11:28.8295349Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-17T12:11:28.8296070Z
2021-07-17T12:11:28.8296378Z Downloading...
2021-07-17T12:11:30.0535465Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-17T12:11:30.1046878Z This provides subctl version: v0.9.1
2021-07-17T12:11:30.1077249Z
2021-07-17T12:11:30.1077918Z please update your path (and consider adding it to ~/.profile):
2021-07-17T12:11:30.1078902Z export PATH=$PATH:/go/bin
2021-07-17T12:11:30.1079286Z
2021-07-17T12:11:30.1200098Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-17T12:11:30.1211399Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-17T12:11:30.1217844Z Will deploy submariner using operator
2021-07-17T12:11:30.1229523Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-17T12:11:30.1243436Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:11:30.1254981Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-17T12:11:30.1265275Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-17T12:11:30.1284613Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-17T12:11:30.1294089Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-17T12:11:30.1306350Z 
2021-07-17T12:11:30.1319677Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-17T12:11:30.2841162Z subctl version: v0.9.1
2021-07-17T12:11:30.2869708Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-17T12:11:30.2882999Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-17T12:11:30.2894272Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-17T12:11:30.2909198Z [submariner-operator]$ [cluster2] grep -q function
2021-07-17T12:11:30.2935137Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:11:30.2946805Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-17T12:11:30.2957502Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-17T12:11:30.2974199Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T12:11:30.3017277Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-17T12:11:30.3030159Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-17T12:11:30.3045122Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:11:30.3063002Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:11:30.3083905Z [submariner-operator]$ [cluster1] pids[cluster1]=6307
2021-07-17T12:11:30.3087621Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:11:30.3100211Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-17T12:11:30.3109238Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:11:30.3120223Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:11:30.3126330Z [submariner-operator]$ [cluster2] pids[cluster2]=6310
2021-07-17T12:11:30.3129017Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-17T12:11:30.3154389Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:11:30.3201382Z [submariner-operator]$ [cluster2] wait 6310
2021-07-17T12:11:30.6592788Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-17T12:11:30.6593836Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-17T12:11:30.6594707Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-17T12:11:30.6595815Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T12:11:30.6597483Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T12:11:30.6601498Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T12:11:30.6603298Z [cluster1] node/cluster1-worker labeled
2021-07-17T12:11:30.6829366Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-17T12:11:30.6830624Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-17T12:11:30.6832061Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-17T12:11:30.6833620Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T12:11:30.6835237Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T12:11:30.6836848Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T12:11:30.6838034Z [cluster2] node/cluster2-worker labeled
2021-07-17T12:11:30.6877536Z [submariner-operator]$ [cluster2] wait 6307
2021-07-17T12:11:30.6897489Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-17T12:11:30.6915782Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-17T12:11:30.6935386Z [submariner-operator]$ [cluster1] setup_broker
2021-07-17T12:11:30.6948729Z [submariner-operator]$ [cluster1] setup_broker
2021-07-17T12:11:30.6953815Z Installing broker...
2021-07-17T12:11:30.6963892Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-17T12:11:30.6981871Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-17T12:11:30.6993723Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:11:30.7541011Z • Setting up broker RBAC ...
2021-07-17T12:11:30.8456388Z ✓ Setting up broker RBAC
2021-07-17T12:11:30.8457409Z • Deploying the Submariner operator ...
2021-07-17T12:11:41.3460273Z ✓ Deploying the Submariner operator
2021-07-17T12:11:41.3461108Z ✓ Created operator CRDs
2021-07-17T12:11:41.3461803Z ✓ Created operator namespace: submariner-operator
2021-07-17T12:11:41.3462506Z ✓ Created operator service account and role
2021-07-17T12:11:41.3463185Z ✓ Created lighthouse service account and role
2021-07-17T12:11:41.3463840Z ✓ Created Lighthouse service accounts and roles
2021-07-17T12:11:41.3464461Z ✓ Deployed the operator successfully
2021-07-17T12:11:41.3465027Z • Deploying the broker ...
2021-07-17T12:11:41.4025442Z ✓ Deploying the broker
2021-07-17T12:11:41.4026828Z ✓ The broker has been deployed
2021-07-17T12:11:41.4027563Z • Creating broker-info.subm file ...
2021-07-17T12:11:41.4218317Z ✓ Creating broker-info.subm file
2021-07-17T12:11:41.4220362Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-17T12:11:41.4269537Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-17T12:11:41.4282176Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-17T12:11:41.4295660Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-17T12:11:41.4308073Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-17T12:11:41.4325296Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T12:11:41.4361743Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-17T12:11:41.4375116Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-17T12:11:41.4388537Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:11:41.4408010Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:11:41.4455214Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:11:41.4456596Z [submariner-operator]$ [cluster1] pids[cluster1]=6371
2021-07-17T12:11:41.4474203Z [submariner-operator]$ [cluster2] pids[cluster2]=6374
2021-07-17T12:11:41.4482267Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:11:41.4492743Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-17T12:11:41.4501698Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-17T12:11:41.4534650Z [submariner-operator]$ [cluster2] wait 6374
2021-07-17T12:11:41.4552672Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:11:41.4566671Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:11:52.4140512Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-17T12:11:52.4144038Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-17T12:11:52.4145674Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-17T12:11:52.4147903Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-17T12:11:52.4150519Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-17T12:11:52.4151502Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-17T12:11:52.4152241Z [cluster2] - cluster2-worker
2021-07-17T12:11:52.4153000Z [cluster2] • Discovering network details ...
2021-07-17T12:11:52.4153616Z [cluster2] Discovered network details:
2021-07-17T12:11:52.4154416Z [cluster2] Network plugin: weave-net
2021-07-17T12:11:52.4154983Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-17T12:11:52.4155469Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-17T12:11:52.4156394Z [cluster2] ✓ Discovering network details
2021-07-17T12:11:52.4157205Z [cluster2] • Discovering multi cluster details ...
2021-07-17T12:11:52.4158028Z [cluster2] • Validating Globalnet configurations ...
2021-07-17T12:11:52.4159041Z [cluster2] ✓ Validating Globalnet configurations
2021-07-17T12:11:52.4159883Z [cluster2] ✓ Discovering multi cluster details
2021-07-17T12:11:52.4160697Z [cluster2] • Deploying the Submariner operator ...
2021-07-17T12:11:52.4161501Z [cluster2] ✓ Deploying the Submariner operator
2021-07-17T12:11:52.4162253Z [cluster2] ✓ Created operator CRDs
2021-07-17T12:11:52.4163101Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-17T12:11:52.4163985Z [cluster2] ✓ Created operator service account and role
2021-07-17T12:11:52.4164851Z [cluster2] ✓ Created lighthouse service account and role
2021-07-17T12:11:52.4165748Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-17T12:11:52.4166593Z [cluster2] ✓ Deployed the operator successfully
2021-07-17T12:11:52.4167358Z [cluster2] • Creating SA for cluster ...
2021-07-17T12:11:52.4168043Z [cluster2] ✓ Creating SA for cluster
2021-07-17T12:11:52.4168740Z [cluster2] • Deploying Submariner ...
2021-07-17T12:11:52.4169455Z [cluster2] ✓ Deploying Submariner
2021-07-17T12:11:52.4170221Z [cluster2] ✓ Submariner is up and running
2021-07-17T12:11:52.4201383Z [submariner-operator]$ [cluster2] wait 6371
2021-07-17T12:11:52.7344176Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-17T12:11:52.7345005Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-17T12:11:52.7345848Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-17T12:11:52.7348178Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-17T12:11:52.7350440Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-17T12:11:52.7351262Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-17T12:11:52.7351915Z [cluster1] - cluster1-worker
2021-07-17T12:11:52.7352509Z [cluster1] • Discovering network details ...
2021-07-17T12:11:52.7352991Z [cluster1] Discovered network details:
2021-07-17T12:11:52.7353588Z [cluster1] Network plugin: weave-net
2021-07-17T12:11:52.7354203Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-17T12:11:52.7354634Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-17T12:11:52.7355249Z [cluster1] ✓ Discovering network details
2021-07-17T12:11:52.7355919Z [cluster1] • Discovering multi cluster details ...
2021-07-17T12:11:52.7356610Z [cluster1] • Validating Globalnet configurations ...
2021-07-17T12:11:52.7357334Z [cluster1] ✓ Validating Globalnet configurations
2021-07-17T12:11:52.7358134Z [cluster1] ✓ Discovering multi cluster details
2021-07-17T12:11:52.7358959Z [cluster1] • Deploying the Submariner operator ...
2021-07-17T12:11:52.7359596Z [cluster1] ✓ Deploying the Submariner operator
2021-07-17T12:11:52.7360661Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-17T12:11:52.7361336Z [cluster1] • Creating SA for cluster ...
2021-07-17T12:11:52.7361881Z [cluster1] ✓ Creating SA for cluster
2021-07-17T12:11:52.7362431Z [cluster1] • Deploying Submariner ...
2021-07-17T12:11:52.7362975Z [cluster1] ✓ Deploying Submariner
2021-07-17T12:11:52.7363539Z [cluster1] ✓ Submariner is up and running
2021-07-17T12:11:52.7393073Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-17T12:11:52.7402429Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-17T12:11:52.7412160Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-17T12:11:52.7422978Z [submariner-operator]$ [cluster2] with_retries
2021-07-17T12:11:52.7434428Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T12:11:52.7457016Z [submariner-operator]$ [cluster2] wait 6413
2021-07-17T12:11:52.7468851Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:11:52.7479415Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:11:52.7488438Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:11:52.7500253Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:11:52.7519227Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:11:52.9030590Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:11:52.9042575Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:11:53.0237371Z • Showing Connections ...
2021-07-17T12:11:53.0355809Z ✗ Showing Connections
2021-07-17T12:11:53.0356486Z ✗ There are no gateways detected
2021-07-17T12:11:53.0580871Z • Showing Connections ...
2021-07-17T12:11:53.0657260Z ✗ Showing Connections
2021-07-17T12:11:53.0657809Z ✗ There are no gateways detected
2021-07-17T12:11:53.0691109Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:11:53.0703808Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:11:59.0758840Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:11:59.0796867Z [submariner-operator]$ [cluster2] wait 6439
2021-07-17T12:11:59.0808420Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:11:59.0854721Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:11:59.0874747Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:11:59.0879880Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:11:59.0892654Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:11:59.5579665Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:11:59.5591348Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:11:59.6205453Z • Showing Connections ...
2021-07-17T12:11:59.6247835Z ✗ Showing Connections
2021-07-17T12:11:59.6248639Z ✗ There are no gateways detected
2021-07-17T12:11:59.6436207Z • Showing Connections ...
2021-07-17T12:11:59.6462988Z ✗ Showing Connections
2021-07-17T12:11:59.6463578Z ✗ There are no gateways detected
2021-07-17T12:11:59.6497054Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:11:59.6551686Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:05.6577552Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:05.6611090Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:05.6613974Z [submariner-operator]$ [cluster2] wait 6466
2021-07-17T12:12:05.6628614Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:05.6651342Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:05.6663503Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:05.6680924Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:05.7908709Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:05.7984124Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:05.9029021Z • Showing Connections ...
2021-07-17T12:12:05.9115264Z ✗ Showing Connections
2021-07-17T12:12:05.9115835Z ✗ There are no gateways detected
2021-07-17T12:12:05.9325974Z • Showing Connections ...
2021-07-17T12:12:05.9433644Z ✗ Showing Connections
2021-07-17T12:12:05.9434173Z ✗ There are no gateways detected
2021-07-17T12:12:05.9453549Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:12:05.9466840Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:11.9505223Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:11.9559832Z [submariner-operator]$ [cluster2] wait 6493
2021-07-17T12:12:11.9642631Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:11.9672723Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:11.9775543Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:11.9788181Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:12.0023535Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:12.2755071Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:12.2789199Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:12.4193637Z • Showing Connections ...
2021-07-17T12:12:12.4635879Z ✗ Showing Connections
2021-07-17T12:12:12.4638601Z ✗ There are no gateways detected
2021-07-17T12:12:12.4897587Z • Showing Connections ...
2021-07-17T12:12:12.5066542Z ✗ Showing Connections
2021-07-17T12:12:12.5067082Z ✗ There are no gateways detected
2021-07-17T12:12:12.5088290Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:12:12.5098565Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:18.5120974Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:18.5154070Z [submariner-operator]$ [cluster2] wait 6521
2021-07-17T12:12:18.5187481Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:18.5231579Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:18.5242365Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:18.5332266Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:18.5356630Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:19.3955092Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:19.3992210Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:19.5719331Z • Showing Connections ...
2021-07-17T12:12:19.5937644Z ✗ Showing Connections
2021-07-17T12:12:19.5938174Z ✗ No connections found
2021-07-17T12:12:19.6410615Z • Showing Connections ...
2021-07-17T12:12:19.6529824Z ✗ Showing Connections
2021-07-17T12:12:19.6530550Z ✗ There are no gateways detected
2021-07-17T12:12:20.3843407Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:20.3844009Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:12:25.6668275Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:25.6740057Z [submariner-operator]$ [cluster2] wait 6547
2021-07-17T12:12:25.6746714Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:25.6766425Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:25.6776853Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:25.6793058Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:25.6819412Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:25.9853352Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:25.9869468Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:26.1629293Z • Showing Connections ...
2021-07-17T12:12:26.1679364Z ✗ Showing Connections
2021-07-17T12:12:26.1679860Z ✗ No connections found
2021-07-17T12:12:26.1810725Z • Showing Connections ...
2021-07-17T12:12:26.1827809Z ✗ Showing Connections
2021-07-17T12:12:26.1828469Z ✗ There are no gateways detected
2021-07-17T12:12:26.1852163Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:12:26.1864421Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:32.1887994Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:32.1915972Z [submariner-operator]$ [cluster2] wait 6573
2021-07-17T12:12:32.1928153Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:32.1938554Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:32.1963752Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:32.1971487Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:32.2007532Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:32.2726881Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:32.2748976Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:32.3276392Z • Showing Connections ...
2021-07-17T12:12:32.3295042Z ✗ Showing Connections
2021-07-17T12:12:32.3295944Z ✗ There are no gateways detected
2021-07-17T12:12:32.3329711Z • Showing Connections ...
2021-07-17T12:12:32.3354148Z ✗ Showing Connections
2021-07-17T12:12:32.3354666Z ✗ No connections found
2021-07-17T12:12:32.3376227Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:12:32.3387882Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:38.3412215Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:38.3443663Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:38.3444442Z [submariner-operator]$ [cluster2] wait 6600
2021-07-17T12:12:38.3453692Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:38.3464374Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:38.3473850Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:38.3488440Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:38.4232678Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:38.4246918Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:38.4677551Z • Showing Connections ...
2021-07-17T12:12:38.4704434Z ✗ Showing Connections
2021-07-17T12:12:38.4704940Z ✗ No connections found
2021-07-17T12:12:38.4799570Z • Showing Connections ...
2021-07-17T12:12:38.4819664Z ✗ Showing Connections
2021-07-17T12:12:38.4820205Z ✗ No connections found
2021-07-17T12:12:38.4837850Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:12:38.4847431Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:12:44.4868650Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:12:44.4901723Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:44.4905462Z [submariner-operator]$ [cluster2] wait 6626
2021-07-17T12:12:44.4913862Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:12:44.4924907Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:12:44.4936340Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:44.4947457Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:12:44.5713600Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:12:44.5728658Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:12:44.6178020Z • Showing Connections ...
2021-07-17T12:12:44.6229190Z ✓ Showing Connections
2021-07-17T12:12:44.6315725Z • Showing Connections ...
2021-07-17T12:12:44.6343451Z ✓ Showing Connections
2021-07-17T12:12:44.6359684Z cluster2-worker cluster2 172.18.0.9 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 139.651µs
2021-07-17T12:12:44.6360759Z cluster1-worker cluster1 172.18.0.8 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 192.351µs
2021-07-17T12:12:44.6375036Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:12:44.6388920Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:12:44.6407182Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-17T12:12:44.6418130Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-17T12:12:44.6428986Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-17T12:12:44.6439356Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-17T12:12:44.6450540Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-17T12:12:44.6461095Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-17T12:12:44.6471646Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-17T12:12:44.6485142Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-17T12:12:44.8900379Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-17T12:12:44.8953993Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-17T12:12:46.5249102Z latest: Pulling from submariner/nettest
2021-07-17T12:12:46.5279509Z df20fa9351a1: Pulling fs layer
2021-07-17T12:12:46.5280014Z 741138c6c583: Pulling fs layer
2021-07-17T12:12:46.5280419Z d34ea735672c: Pulling fs layer
2021-07-17T12:12:46.5280932Z c91acd455ec9: Pulling fs layer
2021-07-17T12:12:46.5292394Z c91acd455ec9: Waiting
2021-07-17T12:12:46.9037383Z 741138c6c583: Verifying Checksum
2021-07-17T12:12:46.9038042Z 741138c6c583: Download complete
2021-07-17T12:12:46.9399247Z df20fa9351a1: Verifying Checksum
2021-07-17T12:12:46.9412798Z df20fa9351a1: Download complete
2021-07-17T12:12:47.0128579Z d34ea735672c: Verifying Checksum
2021-07-17T12:12:47.0129507Z d34ea735672c: Download complete
2021-07-17T12:12:47.2510711Z c91acd455ec9: Verifying Checksum
2021-07-17T12:12:47.2511527Z c91acd455ec9: Download complete
2021-07-17T12:12:47.8918205Z df20fa9351a1: Pull complete
2021-07-17T12:12:47.8919176Z 741138c6c583: Pull complete
2021-07-17T12:12:47.8919811Z d34ea735672c: Pull complete
2021-07-17T12:12:47.9508158Z c91acd455ec9: Pull complete
2021-07-17T12:12:47.9556612Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-17T12:12:47.9587585Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-17T12:12:47.9641917Z quay.io/submariner/nettest:latest
2021-07-17T12:12:47.9705647Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-17T12:12:48.2076811Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-17T12:12:48.4480500Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-17T12:12:48.6961403Z The push refers to repository [localhost:5000/nettest]
2021-07-17T12:12:48.7285091Z 7497bfb0ae54: Preparing
2021-07-17T12:12:48.7285595Z 17de069c349e: Preparing
2021-07-17T12:12:48.7295891Z b85398c91342: Preparing
2021-07-17T12:12:48.7299669Z 50644c29ef5a: Preparing
2021-07-17T12:12:49.2829679Z 7497bfb0ae54: Pushed
2021-07-17T12:12:49.2840999Z b85398c91342: Pushed
2021-07-17T12:12:49.3114538Z 50644c29ef5a: Pushed
2021-07-17T12:12:50.0837614Z 17de069c349e: Pushed
2021-07-17T12:12:50.1017488Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-17T12:12:50.1077133Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:12:50.1093323Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:12:50.1101222Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-17T12:12:50.1114819Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-17T12:12:50.1133303Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:12:50.1145587Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:12:50.1173103Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:12:50.5104405Z deployment.apps/netshoot created
2021-07-17T12:12:50.5183343Z Waiting for netshoot pods to be ready.
2021-07-17T12:12:50.5194624Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-17T12:12:50.5215899Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-17T12:12:50.5264056Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-17T12:12:50.8137258Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-17T12:12:52.2513879Z deployment "netshoot" successfully rolled out
2021-07-17T12:12:52.2565680Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:12:52.2576444Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:12:52.2592058Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:12:52.2604883Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-17T12:12:52.2625205Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-17T12:12:52.2640953Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-17T12:12:52.2720360Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:12:52.2721780Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:12:52.2723201Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:12:52.8818160Z deployment.apps/nginx-demo created
2021-07-17T12:12:52.9189079Z service/nginx-demo created
2021-07-17T12:12:52.9901003Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-17T12:12:52.9978326Z Waiting for nginx-demo pods to be ready.
2021-07-17T12:12:53.0003961Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-17T12:12:53.0015098Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-17T12:12:53.0027126Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-17T12:12:53.5130141Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T12:12:59.8261701Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T12:13:00.3647611Z deployment "nginx-demo" successfully rolled out
2021-07-17T12:13:00.3691053Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-17T12:13:00.3720857Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-17T12:13:00.3733360Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-17T12:13:00.3767285Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-17T12:13:00.3785403Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-17T12:13:00.6798134Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-17T12:13:00.6814111Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-17T12:13:00.6825060Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-17T12:13:00.6840320Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-17T12:13:00.6855285Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-17T12:13:00.6873433Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-17T12:13:00.6908803Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T12:13:00.6926802Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-17T12:13:00.6956162Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T12:13:00.6971737Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T12:13:00.9366512Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-5d4k2 100.1.152.26
2021-07-17T12:13:00.9376572Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-5d4k2 100.1.152.26
2021-07-17T12:13:00.9388651Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T12:13:00.9409906Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-5d4k2 100.1.152.26
2021-07-17T12:13:00.9414361Z [submariner-operator]$ [cluster2] wait 6776
2021-07-17T12:13:00.9422236Z [submariner-operator]$ [cluster2] test_connection
2021-07-17T12:13:00.9427774Z Attempting connectivity between clusters - netshoot-57677568b8-5d4k2 --> 100.1.152.26
2021-07-17T12:13:00.9436897Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-17T12:13:00.9447681Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-17T12:13:00.9463027Z [submariner-operator]$ [cluster2] date +%s
2021-07-17T12:13:00.9489677Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-5d4k2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.152.26
2021-07-17T12:13:00.9502442Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-5d4k2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.152.26
2021-07-17T12:13:00.9514587Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-5d4k2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.152.26
2021-07-17T12:13:01.3042224Z Connection test was successful!
2021-07-17T12:13:01.3057303Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:13:01.3067972Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:13:01.3078164Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:13:01.3089627Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:13:01.3101363Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:13:01.3112611Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:13:01.5359271Z deployment.apps "netshoot" deleted
2021-07-17T12:13:01.5459769Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:13:01.5472544Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:13:01.5484388Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:13:01.5494818Z [submariner-operator]$ [cluster1] remove_resource
2021-07-17T12:13:01.5505554Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:13:01.5515497Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:13:01.5543230Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:13:01.7934292Z deployment.apps "nginx-demo" deleted
2021-07-17T12:13:01.8453139Z service "nginx-demo" deleted
2021-07-17T12:13:01.8567031Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-17T12:13:01.8851665Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-17T12:13:01.8862614Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-17T12:13:01.8886504Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-17T12:13:01.8899939Z [submariner-operator]$ [cluster2] grep -q function
2021-07-17T12:13:01.8980355Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:13:01.9013072Z Successfully remade target file 'deploy'.
2021-07-17T12:13:01.9073563Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-17T12:13:01.9125072Z Successfully remade target file 'deploy-latest'.
2021-07-17T12:13:01.9128177Z File 'clusters' does not exist.
2021-07-17T12:13:01.9130880Z Must remake target 'clusters'.
2021-07-17T12:13:01.9134658Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:13:02.0223137Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-17T12:13:02.0246380Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T12:13:02.0261084Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:13:02.0276839Z [submariner-operator]$ script_name=utils
2021-07-17T12:13:02.0290620Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T12:13:02.0311998Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T12:13:02.0328531Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:13:02.0341987Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:13:02.0354274Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T12:13:02.0378153Z [submariner-operator]$ broker=cluster1
2021-07-17T12:13:02.0389539Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T12:13:02.0400207Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T12:13:02.0413261Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T12:13:02.0425444Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T12:13:02.0442896Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T12:13:02.0454467Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T12:13:02.0511944Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T12:13:02.0523035Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T12:13:02.0556044Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T12:13:02.0582897Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T12:13:02.0595874Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T12:13:02.0608178Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:13:02.0624508Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:13:02.0635663Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:13:02.0646901Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T12:13:02.0667626Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T12:13:02.0688486Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T12:13:02.0738737Z [submariner-operator]$ cat <<EOM
2021-07-17T12:13:02.0741078Z Cluster settings::
2021-07-17T12:13:02.0741709Z broker - ${broker@Q}
2021-07-17T12:13:02.0742183Z clusters - ${clusters[*]@Q}
2021-07-17T12:13:02.0742910Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-17T12:13:02.0743826Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-17T12:13:02.0744695Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-17T12:13:02.0745243Z EOM
2021-07-17T12:13:02.0755163Z [submariner-operator]$ typeset -p cluster_cni
2021-07-17T12:13:02.0768513Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T12:13:02.0796909Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-17T12:13:02.0809750Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T12:13:02.0832359Z [submariner-operator]$ typeset -p cluster_subm
2021-07-17T12:13:02.0843933Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T12:13:02.0869233Z Cluster settings::
2021-07-17T12:13:02.0869841Z broker - 'cluster1'
2021-07-17T12:13:02.0870512Z clusters - 'cluster1' 'cluster2'
2021-07-17T12:13:02.0871073Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-17T12:13:02.0873679Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-17T12:13:02.0875590Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-17T12:13:02.0902596Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-17T12:13:02.0921223Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-17T12:13:02.0947116Z [submariner-operator]$ run_local_registry
2021-07-17T12:13:02.0957171Z [submariner-operator]$ run_local_registry
2021-07-17T12:13:02.0968061Z [submariner-operator]$ registry_running
2021-07-17T12:13:02.0982226Z [submariner-operator]$ registry_running
2021-07-17T12:13:02.0993613Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-17T12:13:02.1006254Z [submariner-operator]$ grep kind-registry
2021-07-17T12:13:02.3562355Z fef8e063a924 registry:2 "/entrypoint.sh /etc…" 7 minutes ago Up 7 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-17T12:13:02.3575347Z [submariner-operator]$ return 0
2021-07-17T12:13:02.3578682Z Local registry kind-registry already running.
2021-07-17T12:13:02.3588412Z [submariner-operator]$ declare_cidrs
2021-07-17T12:13:02.3600554Z [submariner-operator]$ declare_cidrs
2021-07-17T12:13:02.3617629Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T12:13:02.3626535Z [submariner-operator]$ i=1
2021-07-17T12:13:02.3642408Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:13:02.3651833Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:13:02.3662679Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T12:13:02.3672787Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T12:13:02.3683827Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T12:13:02.3695186Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:13:02.3709301Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:13:02.3721799Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T12:13:02.3732080Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T12:13:02.3742968Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T12:13:02.3757052Z [submariner-operator]$ [cluster2] wait 6986
2021-07-17T12:13:02.3757995Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-17T12:13:02.3768220Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-17T12:13:02.3779120Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-17T12:13:02.3789932Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-17T12:13:02.3804120Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:13:02.3846855Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:13:02.3862551Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:13:02.3867097Z [submariner-operator]$ [cluster1] pids[cluster1]=6995
2021-07-17T12:13:02.3877573Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-17T12:13:02.3887557Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:13:02.3894078Z [submariner-operator]$ [cluster2] pids[cluster2]=6999
2021-07-17T12:13:02.3902693Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:13:02.3947276Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-17T12:13:02.3985307Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:13:02.4021199Z [submariner-operator]$ [cluster2] wait 6999
2021-07-17T12:13:08.6775430Z [submariner-operator]$ [cluster1] with_retries
2021-07-17T12:13:08.6776311Z [submariner-operator]$ [cluster1] iteration=1
2021-07-17T12:13:08.6777078Z [submariner-operator]$ [cluster1] wait 7014
2021-07-17T12:13:08.6778054Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-17T12:13:08.6778865Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-17T12:13:08.6780203Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6781871Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6783023Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-17T12:13:08.6783859Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-17T12:13:08.6784520Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-17T12:13:08.6785425Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-17T12:13:08.6786262Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-17T12:13:08.6787009Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-17T12:13:08.6787813Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-17T12:13:08.6789312Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-17T12:13:08.6790686Z [submariner-operator]$ [cluster1] head -n 1
2021-07-17T12:13:08.6792070Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6794455Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6796717Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6799556Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6802283Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6804728Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T12:13:08.6806110Z [submariner-operator]$ [cluster1] return
2021-07-17T12:13:08.6806845Z [submariner-operator]$ [cluster1] return 0
2021-07-17T12:13:08.6946626Z [submariner-operator]$ [cluster2] with_retries
2021-07-17T12:13:08.6947523Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T12:13:08.6948295Z [submariner-operator]$ [cluster2] wait 7018
2021-07-17T12:13:08.6949251Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-17T12:13:08.6950256Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-17T12:13:08.6951951Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6953834Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6955176Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-17T12:13:08.6956170Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-17T12:13:08.6956884Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-17T12:13:08.6957825Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-17T12:13:08.6961679Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-17T12:13:08.6962503Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-17T12:13:08.6963676Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-17T12:13:08.6964943Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-17T12:13:08.6966071Z [submariner-operator]$ [cluster2] head -n 1
2021-07-17T12:13:08.6969029Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.5:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6971500Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6973760Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6976073Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6979130Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6983494Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T12:13:08.6985032Z [submariner-operator]$ [cluster2] return
2021-07-17T12:13:08.6985789Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:13:08.7009365Z [submariner-operator]$ [cluster2] wait 6995
2021-07-17T12:13:08.7023003Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-17T12:13:08.7037945Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-17T12:13:08.7051917Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-17T12:13:08.7052600Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-17T12:13:08.7053025Z
2021-07-17T12:13:08.7053796Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-17T12:13:08.7063539Z
2021-07-17T12:13:08.7066745Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-17T12:13:08.7067114Z
2021-07-17T12:13:08.7067655Z To clean everthing up, just run: make clean-clusters
2021-07-17T12:13:08.7069450Z EOM
2021-07-17T12:13:08.7070189Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-17T12:13:08.7070888Z
2021-07-17T12:13:08.7072180Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-17T12:13:08.7072668Z
2021-07-17T12:13:08.7073246Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-17T12:13:08.7073618Z
2021-07-17T12:13:08.7074162Z To clean everthing up, just run: make clean-clusters
2021-07-17T12:13:08.7074840Z Successfully remade target file 'clusters'.
2021-07-17T12:13:08.7075486Z File 'preload-images' does not exist.
2021-07-17T12:13:08.7076173Z File 'images' does not exist.
2021-07-17T12:13:08.7077028Z File 'package/.image.submariner-operator' does not exist.
2021-07-17T12:13:08.7123982Z find: 'bin/submariner-operator': No such file or directory
2021-07-17T12:13:09.0079074Z File 'bin/submariner-operator' does not exist.
2021-07-17T12:13:09.0085133Z File 'generate-embeddedyamls' does not exist.
2021-07-17T12:13:09.0085898Z File 'generate' does not exist.
2021-07-17T12:13:09.0086482Z Must remake target 'generate'.
2021-07-17T12:13:09.0108534Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-17T12:13:12.5070688Z Successfully remade target file 'generate'.
2021-07-17T12:13:12.5156985Z Must remake target 'generate-embeddedyamls'.
2021-07-17T12:13:12.5159085Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-17T12:13:12.5161695Z Must remake target 'bin/submariner-operator'.
2021-07-17T12:13:12.5164070Z /opt/shipyard/scripts/compile.sh \
2021-07-17T12:13:12.5165091Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-17T12:13:12.5165970Z bin/submariner-operator main.go
2021-07-17T12:13:12.5607379Z [submariner-operator]$ mkdir -p bin
2021-07-17T12:13:12.5618195Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-17T12:13:12.5627450Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-17T12:13:12.5636214Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-17T12:13:28.0108137Z [submariner-operator]$ upx bin/submariner-operator
2021-07-17T12:13:34.5418249Z Ultimate Packer for eXecutables
2021-07-17T12:13:34.5419665Z Copyright (C) 1996 - 2020
2021-07-17T12:13:34.5420140Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-17T12:13:34.5420481Z
2021-07-17T12:13:34.5420831Z File size Ratio Format Name
2021-07-17T12:13:34.5421395Z -------------------- ------ ----------- -----------
2021-07-17T12:13:34.5424652Z 34459648 -> 9933112 28.83% linux/amd64 submariner-operator
2021-07-17T12:13:34.5424985Z
2021-07-17T12:13:34.5425247Z Packed 1 file.
2021-07-17T12:13:34.5425977Z Successfully remade target file 'bin/submariner-operator'.
2021-07-17T12:13:34.5427051Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-17T12:13:34.5428213Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-17T12:13:34.5429251Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-17T12:13:34.5430043Z File 'FORCE_IMAGE' does not exist.
2021-07-17T12:13:34.5430575Z Must remake target 'FORCE_IMAGE'.
2021-07-17T12:13:34.5431152Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-17T12:13:34.5437554Z Must remake target 'package/.image.submariner-operator'.
2021-07-17T12:13:34.5439367Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-17T12:13:34.5828140Z flags:WARN flag short name (h) already defined
2021-07-17T12:13:34.6400764Z [submariner-operator]$ set -e
2021-07-17T12:13:34.6411560Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:34.6419357Z [submariner-operator]$ cache_flag=
2021-07-17T12:13:34.6430606Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:34.6444445Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:34.8876808Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:36.4765724Z devel: Pulling from submariner/submariner-operator
2021-07-17T12:13:36.4766557Z 9aabc6bb514c: Pulling fs layer
2021-07-17T12:13:36.9220337Z 9aabc6bb514c: Verifying Checksum
2021-07-17T12:13:36.9221693Z 9aabc6bb514c: Download complete
2021-07-17T12:13:37.1061311Z 9aabc6bb514c: Pull complete
2021-07-17T12:13:37.1108883Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-17T12:13:37.1127127Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:37.1136082Z quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:37.1172740Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-17T12:13:37.1197661Z [submariner-operator]$ cut -f2 -d 
2021-07-17T12:13:37.1204308Z [submariner-operator]$ grep -v scratch
2021-07-17T12:13:37.1223856Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-17T12:13:37.1240956Z 
2021-07-17T12:13:37.8190127Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-17T12:13:38.4612554Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-17T12:13:38.4673192Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-17T12:13:39.1262208Z buildx_builder
2021-07-17T12:13:39.1329911Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-17T12:13:39.7964181Z #1 [internal] booting buildkit
2021-07-17T12:13:39.7965370Z #1 sha256:61cac9fe7ba2b06f73ededf8fc6ad546d72fc33ee9e09bf23c337ea0e6f38a47
2021-07-17T12:13:39.9469048Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-17T12:13:44.8770707Z #1 pulling image moby/buildkit:buildx-stable-1 5.1s done
2021-07-17T12:13:45.0298652Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-17T12:13:45.4495426Z #1 creating container buildx_buildkit_buildx_builder0 0.6s done
2021-07-17T12:13:45.5996072Z #1 DONE 5.7s
2021-07-17T12:13:45.7003188Z
2021-07-17T12:13:45.7004880Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-17T12:13:45.7006031Z #2 sha256:b0506e2ecfb911de5df1730c41fccb1ae977fd74dce335d1b98e78e92f9c3295
2021-07-17T12:13:45.7011065Z #2 transferring dockerfile: 230B done
2021-07-17T12:13:45.7011495Z #2 DONE 0.0s
2021-07-17T12:13:45.7011693Z
2021-07-17T12:13:45.7012025Z #3 [internal] load .dockerignore
2021-07-17T12:13:45.7012875Z #3 sha256:8b09db7d904a8dd1e1bca2db7aa6a92e55410e5904a411b320fa437d021719eb
2021-07-17T12:13:45.7017055Z #3 transferring context: 2B done
2021-07-17T12:13:45.8521407Z #3 DONE 0.0s
2021-07-17T12:13:45.8521683Z
2021-07-17T12:13:45.8522076Z #4 [internal] load build context
2021-07-17T12:13:45.8522854Z #4 sha256:f1510f605bd69c8e32a48d88f59b406914e9b69ab6d9db08004e7c0ed722f37a
2021-07-17T12:13:45.8523534Z #4 DONE 0.0s
2021-07-17T12:13:45.8523715Z
2021-07-17T12:13:45.8524954Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:45.8525942Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-17T12:13:46.9037312Z #6 DONE 1.0s
2021-07-17T12:13:46.9053942Z
2021-07-17T12:13:46.9054533Z #4 [internal] load build context
2021-07-17T12:13:46.9055509Z #4 sha256:f1510f605bd69c8e32a48d88f59b406914e9b69ab6d9db08004e7c0ed722f37a
2021-07-17T12:13:47.2543039Z #4 transferring context: 9.94MB 0.3s done
2021-07-17T12:13:47.2543487Z #4 DONE 0.3s
2021-07-17T12:13:47.2543675Z
2021-07-17T12:13:47.2544962Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-17T12:13:47.2546046Z #5 sha256:c2a993c677ad95052fa6088f5ce9d7de917ab8489360a9494c758b176aa0fb11
2021-07-17T12:13:47.2546706Z #5 CACHED
2021-07-17T12:13:47.2546903Z
2021-07-17T12:13:47.2547472Z #7 exporting to oci image format
2021-07-17T12:13:47.2548297Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-17T12:13:47.2553824Z #7 exporting layers done
2021-07-17T12:13:47.2554772Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-17T12:13:47.2556274Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-17T12:13:47.4056166Z #7 ...
2021-07-17T12:13:47.4056487Z
2021-07-17T12:13:47.4058100Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-17T12:13:47.4059185Z #5 sha256:c2a993c677ad95052fa6088f5ce9d7de917ab8489360a9494c758b176aa0fb11
2021-07-17T12:13:47.4060342Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 0B / 9.62MB 0.2s
2021-07-17T12:13:47.4061093Z #5 CACHED
2021-07-17T12:13:47.5560479Z
2021-07-17T12:13:47.5561721Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-17T12:13:47.5562594Z #5 sha256:c2a993c677ad95052fa6088f5ce9d7de917ab8489360a9494c758b176aa0fb11
2021-07-17T12:13:47.5563247Z #5 CACHED
2021-07-17T12:13:47.5563434Z
2021-07-17T12:13:47.5563738Z #7 exporting to oci image format
2021-07-17T12:13:47.5564603Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-17T12:13:47.7063964Z #7 ...
2021-07-17T12:13:47.7064344Z
2021-07-17T12:13:47.7066175Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-17T12:13:47.7067286Z #5 sha256:c2a993c677ad95052fa6088f5ce9d7de917ab8489360a9494c758b176aa0fb11
2021-07-17T12:13:47.7068738Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.4s done
2021-07-17T12:13:47.7069541Z #5 CACHED
2021-07-17T12:13:47.7069727Z
2021-07-17T12:13:47.7070065Z #7 exporting to oci image format
2021-07-17T12:13:47.7070896Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-17T12:13:47.7071641Z #7 sending tarball
2021-07-17T12:13:47.8578259Z #7 sending tarball 0.3s done
2021-07-17T12:13:47.8578974Z #7 DONE 0.7s
2021-07-17T12:13:47.8579231Z
2021-07-17T12:13:47.8579622Z #9 exporting cache
2021-07-17T12:13:47.8580779Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-17T12:13:47.8581822Z #9 preparing build cache for export done
2021-07-17T12:13:47.8582305Z #9 DONE 0.0s
2021-07-17T12:13:47.8582761Z
2021-07-17T12:13:47.8583071Z #8 importing to docker
2021-07-17T12:13:47.8584219Z #8 sha256:4646ca003c25be64325a39ab32b1e6527589addaeff1fbdb91c758682121d556
2021-07-17T12:13:47.8585038Z #8 DONE 0.0s
2021-07-17T12:13:47.8669730Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-17T12:13:48.1113089Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-17T12:13:48.1115573Z File 'build' does not exist.
2021-07-17T12:13:48.1120258Z File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-17T12:13:48.1337666Z Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-17T12:13:48.1341155Z mkdir -p bin
2021-07-17T12:13:48.1370237Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-17T12:13:48.1371015Z target=${target%.exe}; \
2021-07-17T12:13:48.1371545Z components=($(echo ${target//-/ })); \
2021-07-17T12:13:48.1372038Z GOOS=${components[-2]}; \
2021-07-17T12:13:48.1372498Z GOARCH=${components[-1]}; \
2021-07-17T12:13:48.1372854Z export GOARCH GOOS; \
2021-07-17T12:13:48.1373235Z /opt/shipyard/scripts/compile.sh \
2021-07-17T12:13:48.1374135Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-17T12:13:48.1375550Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-17T12:13:48.1376874Z --noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-17T12:13:48.1824220Z [submariner-operator]$ mkdir -p bin
2021-07-17T12:13:48.1840761Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-17T12:13:48.1853713Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-17T12:13:48.1866148Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-17T12:13:51.3875686Z Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-17T12:13:51.3877499Z Prerequisite 'bin/subctl-devel-0105e4d-linux-amd64' is newer than target 'bin/subctl'.
2021-07-17T12:13:51.3879263Z Must remake target 'bin/subctl'.
2021-07-17T12:13:51.3881491Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-17T12:13:51.3923507Z Successfully remade target file 'bin/subctl'.
2021-07-17T12:13:51.3924807Z Must remake target 'build'.
2021-07-17T12:13:51.3925463Z Successfully remade target file 'build'.
2021-07-17T12:13:51.3929370Z Must remake target 'images'.
2021-07-17T12:13:51.3933396Z Successfully remade target file 'images'.
2021-07-17T12:13:51.3934178Z Must remake target 'preload-images'.
2021-07-17T12:13:51.3934677Z set -e;\
2021-07-17T12:13:51.3935044Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-17T12:13:51.3935520Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-17T12:13:51.3936764Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-17T12:13:51.3937889Z import_image quay.io/submariner/${image};\
2021-07-17T12:13:51.3938260Z done
2021-07-17T12:13:51.3978950Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-17T12:13:51.3987757Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-17T12:13:51.4001557Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-17T12:13:51.6403407Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-17T12:13:51.8807390Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-17T12:13:51.8857727Z f9269f9cee12: Preparing
2021-07-17T12:13:52.3985041Z f9269f9cee12: Pushed
2021-07-17T12:13:52.4183355Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-17T12:13:52.4270805Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-17T12:13:52.4290888Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-17T12:13:52.4305001Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-17T12:13:52.6371925Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-17T12:13:52.6401313Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-17T12:13:54.2082910Z devel: Pulling from submariner/submariner-gateway
2021-07-17T12:13:54.2083506Z 8c741e919b67: Pulling fs layer
2021-07-17T12:13:54.2083880Z 13495efbbac4: Pulling fs layer
2021-07-17T12:13:54.2084246Z 6df6df193f2d: Pulling fs layer
2021-07-17T12:13:54.2084635Z 3afbe9ee7387: Pulling fs layer
2021-07-17T12:13:54.2085122Z 3afbe9ee7387: Waiting
2021-07-17T12:13:54.5769775Z 13495efbbac4: Verifying Checksum
2021-07-17T12:13:54.5773548Z 13495efbbac4: Download complete
2021-07-17T12:13:54.7575710Z 6df6df193f2d: Verifying Checksum
2021-07-17T12:13:54.7576276Z 6df6df193f2d: Download complete
2021-07-17T12:13:55.0414599Z 3afbe9ee7387: Verifying Checksum
2021-07-17T12:13:55.0420081Z 3afbe9ee7387: Download complete
2021-07-17T12:13:55.1026526Z 8c741e919b67: Verifying Checksum
2021-07-17T12:13:55.1027390Z 8c741e919b67: Download complete
2021-07-17T12:13:58.0461619Z 8c741e919b67: Pull complete
2021-07-17T12:13:59.0794643Z 13495efbbac4: Pull complete
2021-07-17T12:14:00.3708864Z 6df6df193f2d: Pull complete
2021-07-17T12:14:00.5379450Z 3afbe9ee7387: Pull complete
2021-07-17T12:14:00.5435231Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-17T12:14:00.5618224Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-17T12:14:00.5642910Z quay.io/submariner/submariner-gateway:devel
2021-07-17T12:14:00.5720924Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-17T12:14:00.7794398Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-17T12:14:00.9975910Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-17T12:14:01.2164703Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-17T12:14:01.2210900Z 71972a942ed4: Preparing
2021-07-17T12:14:01.2234049Z 3c7f2d60eacb: Preparing
2021-07-17T12:14:01.2234474Z 00c5f6897675: Preparing
2021-07-17T12:14:01.2235047Z b3b62c837788: Preparing
2021-07-17T12:14:02.1704987Z 00c5f6897675: Pushed
2021-07-17T12:14:03.0474152Z 71972a942ed4: Pushed
2021-07-17T12:14:04.9101574Z 3c7f2d60eacb: Pushed
2021-07-17T12:14:12.0600032Z b3b62c837788: Pushed
2021-07-17T12:14:12.0784186Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-17T12:14:12.0849276Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-17T12:14:12.0852975Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-17T12:14:12.0864188Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-17T12:14:12.3006962Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-17T12:14:12.3027509Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-17T12:14:13.8610208Z devel: Pulling from submariner/submariner-route-agent
2021-07-17T12:14:13.8610990Z 8c741e919b67: Already exists
2021-07-17T12:14:13.8625128Z 13495efbbac4: Already exists
2021-07-17T12:14:13.8643151Z 70cc6422093d: Pulling fs layer
2021-07-17T12:14:13.8647097Z 7ba74d821748: Pulling fs layer
2021-07-17T12:14:13.8652324Z 62b0802bcf90: Pulling fs layer
2021-07-17T12:14:13.8652720Z 3e9c83283ee4: Pulling fs layer
2021-07-17T12:14:13.8653083Z 3e9c83283ee4: Waiting
2021-07-17T12:14:14.2046223Z 62b0802bcf90: Verifying Checksum
2021-07-17T12:14:14.2048679Z 62b0802bcf90: Download complete
2021-07-17T12:14:14.3520993Z 7ba74d821748: Verifying Checksum
2021-07-17T12:14:14.3521582Z 7ba74d821748: Download complete
2021-07-17T12:14:14.4109317Z 70cc6422093d: Verifying Checksum
2021-07-17T12:14:14.4109803Z 70cc6422093d: Download complete
2021-07-17T12:14:14.5525462Z 3e9c83283ee4: Verifying Checksum
2021-07-17T12:14:14.5535440Z 3e9c83283ee4: Download complete
2021-07-17T12:14:15.9806574Z 70cc6422093d: Pull complete
2021-07-17T12:14:16.1554727Z 7ba74d821748: Pull complete
2021-07-17T12:14:16.2648824Z 62b0802bcf90: Pull complete
2021-07-17T12:14:16.3643053Z 3e9c83283ee4: Pull complete
2021-07-17T12:14:16.3714026Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-17T12:14:16.3741033Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-17T12:14:16.3770611Z quay.io/submariner/submariner-route-agent:devel
2021-07-17T12:14:16.3840415Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-17T12:14:16.6053896Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-17T12:14:16.8302594Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-17T12:14:17.0644853Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-17T12:14:17.0730314Z 1d810a4c0610: Preparing
2021-07-17T12:14:17.0730902Z 7a86b74623fc: Preparing
2021-07-17T12:14:17.0731394Z 26de773c4486: Preparing
2021-07-17T12:14:17.0731862Z 6931e591f8e2: Preparing
2021-07-17T12:14:17.0732243Z 00c5f6897675: Preparing
2021-07-17T12:14:17.0732707Z b3b62c837788: Preparing
2021-07-17T12:14:17.0733158Z b3b62c837788: Waiting
2021-07-17T12:14:17.6345660Z 00c5f6897675: Mounted from submariner-gateway
2021-07-17T12:14:17.6346156Z 7a86b74623fc: Pushed
2021-07-17T12:14:17.6567700Z 1d810a4c0610: Pushed
2021-07-17T12:14:17.6676172Z b3b62c837788: Mounted from submariner-gateway
2021-07-17T12:14:17.6677835Z 26de773c4486: Pushed
2021-07-17T12:14:20.9706233Z 6931e591f8e2: Pushed
2021-07-17T12:14:20.9881907Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-17T12:14:20.9920744Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-17T12:14:20.9928781Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-17T12:14:20.9935832Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-17T12:14:21.2254151Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-17T12:14:21.2274422Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-17T12:14:22.8028232Z devel: Pulling from submariner/lighthouse-agent
2021-07-17T12:14:22.8028961Z ecd69139dc76: Pulling fs layer
2021-07-17T12:14:22.8029329Z 8261c1767de3: Pulling fs layer
2021-07-17T12:14:23.1733900Z ecd69139dc76: Verifying Checksum
2021-07-17T12:14:23.1734466Z ecd69139dc76: Download complete
2021-07-17T12:14:23.2700038Z 8261c1767de3: Verifying Checksum
2021-07-17T12:14:23.2702424Z 8261c1767de3: Download complete
2021-07-17T12:14:23.2818448Z ecd69139dc76: Pull complete
2021-07-17T12:14:23.4650656Z 8261c1767de3: Pull complete
2021-07-17T12:14:23.4710862Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-17T12:14:23.4740593Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-17T12:14:23.4753871Z quay.io/submariner/lighthouse-agent:devel
2021-07-17T12:14:23.4781129Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-17T12:14:23.7134125Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-17T12:14:23.9625366Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-17T12:14:24.1942965Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-17T12:14:24.2031321Z 83c79e393e11: Preparing
2021-07-17T12:14:24.2031818Z 0026d2f62bbf: Preparing
2021-07-17T12:14:24.2556186Z 0026d2f62bbf: Pushed
2021-07-17T12:14:24.8003009Z 83c79e393e11: Pushed
2021-07-17T12:14:24.8385490Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-17T12:14:24.8430419Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-17T12:14:24.8447896Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-17T12:14:24.8468216Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-17T12:14:25.1382038Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-17T12:14:25.1404013Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-17T12:14:26.7504058Z devel: Pulling from submariner/lighthouse-coredns
2021-07-17T12:14:26.7504668Z 088e56360f76: Pulling fs layer
2021-07-17T12:14:26.7506735Z 18aed70882d2: Pulling fs layer
2021-07-17T12:14:27.1242145Z 088e56360f76: Verifying Checksum
2021-07-17T12:14:27.1242940Z 088e56360f76: Download complete
2021-07-17T12:14:27.2595496Z 088e56360f76: Pull complete
2021-07-17T12:14:27.2974219Z 18aed70882d2: Download complete
2021-07-17T12:14:27.5298682Z 18aed70882d2: Pull complete
2021-07-17T12:14:27.5342089Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-17T12:14:27.5373120Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-17T12:14:27.5415890Z quay.io/submariner/lighthouse-coredns:devel
2021-07-17T12:14:27.5441517Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-17T12:14:27.7578639Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-17T12:14:27.9871782Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-17T12:14:28.2144891Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-17T12:14:28.2174530Z 7fca351e51be: Preparing
2021-07-17T12:14:28.2175010Z 4fa0ece06e25: Preparing
2021-07-17T12:14:28.2629162Z 4fa0ece06e25: Pushed
2021-07-17T12:14:28.8801794Z 7fca351e51be: Pushed
2021-07-17T12:14:28.8996002Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-17T12:14:28.9033054Z Successfully remade target file 'preload-images'.
2021-07-17T12:14:28.9033821Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-17T12:14:28.9034566Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-17T12:14:28.9035322Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-17T12:14:28.9035896Z Must remake target 'deploy'.
2021-07-17T12:14:28.9042078Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:14:28.9910655Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-17T12:14:28.9939198Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T12:14:28.9953917Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:14:28.9965794Z [submariner-operator]$ script_name=utils
2021-07-17T12:14:28.9977907Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:14:28.9995535Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-17T12:14:29.0007947Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:14:29.0021931Z [submariner-operator]$ script_name=deploy_funcs
2021-07-17T12:14:29.0032375Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:14:29.0050217Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T12:14:29.0061784Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:14:29.0072711Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:14:29.0083253Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:14:29.0103302Z [submariner-operator]$ broker=cluster1
2021-07-17T12:14:29.0112296Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T12:14:29.0126121Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T12:14:29.0136084Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T12:14:29.0145938Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T12:14:29.0156068Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T12:14:29.0182161Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T12:14:29.0191954Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T12:14:29.0203424Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T12:14:29.0214298Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T12:14:29.0227784Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T12:14:29.0238757Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T12:14:29.0251639Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:14:29.0267438Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:14:29.0278245Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:14:29.0289880Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T12:14:29.0309859Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T12:14:29.0331775Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T12:14:29.0356506Z [submariner-operator]$ declare_cidrs
2021-07-17T12:14:29.0366940Z [submariner-operator]$ declare_cidrs
2021-07-17T12:14:29.0376835Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T12:14:29.0386718Z [submariner-operator]$ i=1
2021-07-17T12:14:29.0397770Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:14:29.0409050Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:14:29.0424437Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T12:14:29.0462188Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T12:14:29.0487862Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T12:14:29.0501447Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:14:29.0513642Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:14:29.0530393Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T12:14:29.0543654Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T12:14:29.0559073Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T12:14:29.0571939Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-17T12:14:29.0585040Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-17T12:14:29.0597637Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-17T12:14:29.0619967Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-17T12:14:29.0637077Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-17T12:14:29.0653814Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-17T12:14:29.0683836Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-17T12:14:29.2159375Z Installing subctl version devel
2021-07-17T12:14:29.2159853Z OS detected: linux
2021-07-17T12:14:29.2167641Z Architecture detected: amd64
2021-07-17T12:14:29.2169337Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-17T12:14:29.2170214Z
2021-07-17T12:14:29.2170523Z Downloading...
2021-07-17T12:14:30.3085243Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-17T12:14:30.3443086Z This provides subctl version: devel
2021-07-17T12:14:30.3469145Z
2021-07-17T12:14:30.3469794Z please update your path (and consider adding it to ~/.profile):
2021-07-17T12:14:30.3470522Z export PATH=$PATH:/go/bin
2021-07-17T12:14:30.3470849Z
2021-07-17T12:14:30.3568362Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-17T12:14:30.3580603Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-17T12:14:30.3586925Z Will deploy submariner using operator
2021-07-17T12:14:30.3596724Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-17T12:14:30.3613080Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:14:30.3624777Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-17T12:14:30.3635860Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-17T12:14:30.3655668Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-17T12:14:30.3669247Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-17T12:14:30.3679635Z 
2021-07-17T12:14:30.3690957Z [submariner-operator]$ [cluster2] subctl version
2021-07-17T12:14:30.3916644Z subctl version: devel-0105e4d
2021-07-17T12:14:30.3936159Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-17T12:14:30.3950897Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-17T12:14:30.3965352Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-17T12:14:30.4010441Z [submariner-operator]$ [cluster2] grep -q function
2021-07-17T12:14:30.4068239Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:14:30.4089372Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-17T12:14:30.4105256Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-17T12:14:30.4114967Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T12:14:30.4143499Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-17T12:14:30.4154937Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-17T12:14:30.4169504Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:14:30.4184081Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:14:30.4230446Z [submariner-operator]$ [cluster1] pids[cluster1]=8638
2021-07-17T12:14:30.4244889Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:14:30.4256840Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-17T12:14:30.4280214Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:14:30.4281068Z [submariner-operator]$ [cluster2] pids[cluster2]=8641
2021-07-17T12:14:30.4293680Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:14:30.4306365Z [submariner-operator]$ [cluster2] wait 8641
2021-07-17T12:14:30.4315917Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-17T12:14:30.4338172Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:14:30.7562861Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-17T12:14:30.7563969Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-17T12:14:30.7564782Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-17T12:14:30.7565774Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T12:14:30.7566970Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T12:14:30.7570979Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T12:14:30.7572155Z [cluster1] node/cluster1-worker not labeled
2021-07-17T12:14:30.7572925Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-17T12:14:30.7573910Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-17T12:14:30.7574677Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-17T12:14:30.7575658Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T12:14:30.7576852Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T12:14:30.7578134Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T12:14:30.7579466Z [cluster2] node/cluster2-worker not labeled
2021-07-17T12:14:30.7607104Z [submariner-operator]$ [cluster2] wait 8638
2021-07-17T12:14:30.7620039Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-17T12:14:30.7633322Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-17T12:14:30.7645965Z [submariner-operator]$ [cluster1] setup_broker
2021-07-17T12:14:30.7658333Z [submariner-operator]$ [cluster1] setup_broker
2021-07-17T12:14:30.7685817Z Installing broker...
2021-07-17T12:14:30.7709177Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-17T12:14:30.7724589Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-17T12:14:30.7745113Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-17T12:14:30.7760642Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-17T12:14:30.7952501Z • Setting up broker RBAC ...
2021-07-17T12:14:30.8371333Z ✓ Setting up broker RBAC
2021-07-17T12:14:30.8372044Z • Deploying the Submariner operator ...
2021-07-17T12:14:37.0840607Z ✓ Deploying the Submariner operator
2021-07-17T12:14:37.0841291Z ✓ Created operator service account and role
2021-07-17T12:14:37.0841912Z ✓ Created Lighthouse service accounts and roles
2021-07-17T12:14:37.0842620Z • Deploying the broker ...
2021-07-17T12:14:38.1189935Z ✓ Deploying the broker
2021-07-17T12:14:38.1190564Z ✓ The broker has been deployed
2021-07-17T12:14:38.1194413Z • Creating broker-info.subm file ...
2021-07-17T12:14:38.1561488Z ✓ Creating broker-info.subm file
2021-07-17T12:14:38.1562660Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-17T12_14_38Z
2021-07-17T12:14:38.1569295Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-17T12:14:38.1642777Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-17T12:14:38.1658578Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-17T12:14:38.1671151Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-17T12:14:38.1686167Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-17T12:14:38.1698772Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T12:14:38.1728075Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-17T12:14:38.1747751Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-17T12:14:38.1761183Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:14:38.1777509Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:14:38.1795587Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:14:38.1802026Z [submariner-operator]$ [cluster1] pids[cluster1]=8704
2021-07-17T12:14:38.1811142Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-17T12:14:38.1822295Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:14:38.1831197Z [submariner-operator]$ [cluster2] pids[cluster2]=8708
2021-07-17T12:14:38.1853303Z [submariner-operator]$ [cluster2] wait 8708
2021-07-17T12:14:38.1857501Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:14:38.1862012Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-17T12:14:38.1884679Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:14:53.9277621Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-17T12:14:53.9279365Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-17T12:14:53.9280798Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-17T12:14:53.9282270Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-17T12:14:53.9284846Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-17T12:14:53.9287764Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-17T12:14:53.9312605Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-17T12:14:53.9317955Z [cluster2] - cluster2-worker
2021-07-17T12:14:53.9318948Z [cluster2] • Discovering network details ...
2021-07-17T12:14:53.9319745Z [cluster2] Network plugin: weave-net
2021-07-17T12:14:53.9320230Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-17T12:14:53.9320646Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-17T12:14:53.9321247Z [cluster2] ✓ Discovering network details
2021-07-17T12:14:53.9322072Z [cluster2] • Discovering multi cluster details ...
2021-07-17T12:14:53.9322973Z [cluster2] • Validating Globalnet configurations ...
2021-07-17T12:14:53.9323713Z [cluster2] ✓ Validating Globalnet configurations
2021-07-17T12:14:53.9324433Z [cluster2] ✓ Discovering multi cluster details
2021-07-17T12:14:53.9325150Z [cluster2] • Deploying the Submariner operator ...
2021-07-17T12:14:53.9326032Z [cluster2] ✓ Deploying the Submariner operator
2021-07-17T12:14:53.9326814Z [cluster2] ✓ Created operator service account and role
2021-07-17T12:14:53.9327527Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-17T12:14:53.9329009Z [cluster2] • Creating SA for cluster ...
2021-07-17T12:14:53.9329845Z [cluster2] ✓ Creating SA for cluster
2021-07-17T12:14:53.9330612Z [cluster2] • Deploying Submariner ...
2021-07-17T12:14:53.9331351Z [cluster2] ✓ Deploying Submariner
2021-07-17T12:14:53.9332311Z [cluster2] ✓ Submariner is up and running
2021-07-17T12:14:53.9343739Z [submariner-operator]$ [cluster2] wait 8704
2021-07-17T12:14:57.8423199Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-17T12:14:57.8424639Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-17T12:14:57.8426537Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-17T12:14:57.8427902Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-17T12:14:57.8431316Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-17T12:14:57.8434673Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-17T12:14:57.8435833Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-17T12:14:57.8436739Z [cluster1] - cluster1-worker
2021-07-17T12:14:57.8437879Z [cluster1] • Discovering network details ...
2021-07-17T12:14:57.8439009Z [cluster1] Network plugin: weave-net
2021-07-17T12:14:57.8440013Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-17T12:14:57.8440708Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-17T12:14:57.8441561Z [cluster1] ✓ Discovering network details
2021-07-17T12:14:57.8442332Z [cluster1] • Discovering multi cluster details ...
2021-07-17T12:14:57.8443079Z [cluster1] • Validating Globalnet configurations ...
2021-07-17T12:14:57.8443822Z [cluster1] ✓ Validating Globalnet configurations
2021-07-17T12:14:57.8444705Z [cluster1] ✓ Discovering multi cluster details
2021-07-17T12:14:57.8445399Z [cluster1] • Deploying the Submariner operator ...
2021-07-17T12:14:57.8446099Z [cluster1] ✓ Deploying the Submariner operator
2021-07-17T12:14:57.8446996Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-17T12:14:57.8447656Z [cluster1] • Creating SA for cluster ...
2021-07-17T12:14:57.8448213Z [cluster1] ✓ Creating SA for cluster
2021-07-17T12:14:57.8448794Z [cluster1] • Deploying Submariner ...
2021-07-17T12:14:57.8449648Z [cluster1] ✓ Deploying Submariner
2021-07-17T12:14:57.8450247Z [cluster1] ✓ Submariner is up and running
2021-07-17T12:14:57.8475565Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-17T12:14:57.8489739Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-17T12:14:57.8502983Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-17T12:14:57.8515174Z [submariner-operator]$ [cluster2] with_retries
2021-07-17T12:14:57.8536673Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T12:14:57.8557548Z [submariner-operator]$ [cluster2] wait 8747
2021-07-17T12:14:57.8562657Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:14:57.8593028Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:14:57.8601433Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:14:57.8609876Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:14:57.8668983Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:14:57.9496639Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:14:57.9518936Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:14:58.0708445Z • Showing Connections ...
2021-07-17T12:14:58.0750409Z ✗ Showing Connections
2021-07-17T12:14:58.0751029Z ✗ There are no gateways detected
2021-07-17T12:14:58.1180841Z • Showing Connections ...
2021-07-17T12:14:58.1303381Z ✗ Showing Connections
2021-07-17T12:14:58.1304016Z ✗ There are no gateways detected
2021-07-17T12:14:58.1325977Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:14:58.1339071Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:15:04.1376396Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:15:04.1408990Z [submariner-operator]$ [cluster2] wait 8774
2021-07-17T12:15:04.1421279Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:04.1430786Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:04.1452866Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:15:04.1528627Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:04.1552646Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:15:04.7937701Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:04.7951268Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:15:04.9930114Z • Showing Connections ...
2021-07-17T12:15:05.0361343Z ✗ Showing Connections
2021-07-17T12:15:05.0362181Z ✗ There are no gateways detected
2021-07-17T12:15:05.1926867Z • Showing Connections ...
2021-07-17T12:15:05.2880420Z ✗ Showing Connections
2021-07-17T12:15:05.2881351Z ✗ There are no gateways detected
2021-07-17T12:15:05.2907594Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:15:05.2918875Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:15:11.2940478Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:15:11.2979571Z [submariner-operator]$ [cluster2] wait 8800
2021-07-17T12:15:11.3014802Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:11.3044835Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:11.3124990Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:15:11.3177582Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:11.3218342Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:15:12.2842530Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:12.2916983Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:15:12.6420328Z • Showing Connections ...
2021-07-17T12:15:12.8817944Z ✗ Showing Connections
2021-07-17T12:15:12.8818558Z ✗ There are no gateways detected
2021-07-17T12:15:12.9077741Z • Showing Connections ...
2021-07-17T12:15:12.9125153Z ✗ Showing Connections
2021-07-17T12:15:12.9125682Z ✗ No connections found
2021-07-17T12:15:12.9148396Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:15:12.9165614Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:15:18.9192020Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:15:18.9222488Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:18.9225832Z [submariner-operator]$ [cluster2] wait 8826
2021-07-17T12:15:18.9233677Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:18.9246006Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:15:18.9256082Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:18.9269738Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:15:18.9885371Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:18.9904412Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:15:19.0374470Z • Showing Connections ...
2021-07-17T12:15:19.0422688Z ✗ Showing Connections
2021-07-17T12:15:19.0423195Z ✗ No connections found
2021-07-17T12:15:19.0612401Z • Showing Connections ...
2021-07-17T12:15:19.0657202Z ✓ Showing Connections
2021-07-17T12:15:19.0707478Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-17T12:15:19.0730594Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T12:15:25.0773474Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:15:25.0825868Z [submariner-operator]$ [cluster2] wait 8852
2021-07-17T12:15:25.0840272Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:25.0852598Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T12:15:25.0872899Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T12:15:25.0888235Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:25.1006706Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T12:15:25.1651443Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T12:15:25.1664255Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T12:15:25.2167691Z • Showing Connections ...
2021-07-17T12:15:25.2217773Z ✓ Showing Connections
2021-07-17T12:15:25.2383394Z • Showing Connections ...
2021-07-17T12:15:25.2442005Z ✓ Showing Connections
2021-07-17T12:15:25.2468610Z cluster2-worker cluster2 172.18.0.9 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 0s
2021-07-17T12:15:25.2469525Z cluster1-worker cluster1 172.18.0.8 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 205.401µs
2021-07-17T12:15:25.2491705Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:15:25.2592462Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:15:25.2602547Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-17T12:15:25.2617576Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-17T12:15:25.2634590Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-17T12:15:25.2654530Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-17T12:15:25.2676832Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-17T12:15:25.2691102Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-17T12:15:25.2708750Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-17T12:15:25.2740543Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-17T12:15:25.5631521Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-17T12:15:25.5675296Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-17T12:15:27.2022894Z devel: Pulling from submariner/nettest
2021-07-17T12:15:27.2026614Z 5843afab3874: Already exists
2021-07-17T12:15:27.2055804Z 9565bb92f43f: Pulling fs layer
2021-07-17T12:15:27.2058292Z a31c0d5b4ad6: Pulling fs layer
2021-07-17T12:15:27.2060510Z dc3d13650205: Pulling fs layer
2021-07-17T12:15:27.5492259Z 9565bb92f43f: Verifying Checksum
2021-07-17T12:15:27.5494076Z 9565bb92f43f: Download complete
2021-07-17T12:15:27.5896873Z dc3d13650205: Verifying Checksum
2021-07-17T12:15:27.5897771Z dc3d13650205: Download complete
2021-07-17T12:15:27.6335428Z a31c0d5b4ad6: Verifying Checksum
2021-07-17T12:15:27.6335994Z a31c0d5b4ad6: Download complete
2021-07-17T12:15:27.6770320Z 9565bb92f43f: Pull complete
2021-07-17T12:15:28.0823603Z a31c0d5b4ad6: Pull complete
2021-07-17T12:15:28.1685822Z dc3d13650205: Pull complete
2021-07-17T12:15:28.1730754Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-17T12:15:28.1751035Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-17T12:15:28.1799725Z quay.io/submariner/nettest:devel
2021-07-17T12:15:28.1840700Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-17T12:15:28.4299482Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-17T12:15:28.6690348Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-17T12:15:28.9091792Z The push refers to repository [localhost:5000/nettest]
2021-07-17T12:15:28.9378422Z 4f2cdf68c81d: Preparing
2021-07-17T12:15:28.9379100Z 1f803d62c8b3: Preparing
2021-07-17T12:15:28.9379556Z 80c9eaab4c9e: Preparing
2021-07-17T12:15:28.9380009Z 72e830a4dff5: Preparing
2021-07-17T12:15:29.3043879Z 80c9eaab4c9e: Pushed
2021-07-17T12:15:29.5022141Z 4f2cdf68c81d: Pushed
2021-07-17T12:15:29.5170800Z 72e830a4dff5: Pushed
2021-07-17T12:15:29.9621287Z 1f803d62c8b3: Pushed
2021-07-17T12:15:29.9823931Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-17T12:15:29.9897670Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:15:29.9909243Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:15:29.9918712Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-17T12:15:29.9938219Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-17T12:15:29.9957898Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:15:29.9969083Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:15:29.9983637Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:15:30.4852927Z deployment.apps/netshoot created
2021-07-17T12:15:30.4985697Z Waiting for netshoot pods to be ready.
2021-07-17T12:15:30.5007827Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-17T12:15:30.5037530Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-17T12:15:30.5076674Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-17T12:15:30.7955298Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-17T12:15:32.0281172Z deployment "netshoot" successfully rolled out
2021-07-17T12:15:32.0327339Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:15:32.0337033Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:15:32.0348347Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:15:32.0370243Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-17T12:15:32.0385771Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-17T12:15:32.0402846Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-17T12:15:32.0421013Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:15:32.0432199Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:15:32.0445421Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:15:32.5512780Z deployment.apps/nginx-demo created
2021-07-17T12:15:32.5836673Z service/nginx-demo created
2021-07-17T12:15:32.6651160Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-17T12:15:32.6697591Z Waiting for nginx-demo pods to be ready.
2021-07-17T12:15:32.6710974Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-17T12:15:32.6723233Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-17T12:15:32.6739252Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-17T12:15:33.2088757Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T12:15:34.1401457Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T12:15:34.4450362Z deployment "nginx-demo" successfully rolled out
2021-07-17T12:15:34.4511123Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-17T12:15:34.4541850Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-17T12:15:34.4562746Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-17T12:15:34.4601607Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-17T12:15:34.4624805Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-17T12:15:34.7657023Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-17T12:15:34.7670349Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-17T12:15:34.7683872Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-17T12:15:34.7713827Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-17T12:15:34.7729752Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-17T12:15:34.7742359Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-17T12:15:34.7756884Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T12:15:34.7768815Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-17T12:15:34.7777667Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T12:15:34.7787858Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T12:15:35.0114675Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-nz8zd 100.1.82.8
2021-07-17T12:15:35.0128749Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-nz8zd 100.1.82.8
2021-07-17T12:15:35.0141503Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T12:15:35.0162561Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-nz8zd 100.1.82.8
2021-07-17T12:15:35.0167605Z [submariner-operator]$ [cluster2] wait 9005
2021-07-17T12:15:35.0175767Z [submariner-operator]$ [cluster2] test_connection
2021-07-17T12:15:35.0181939Z Attempting connectivity between clusters - netshoot-57677568b8-nz8zd --> 100.1.82.8
2021-07-17T12:15:35.0191907Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-17T12:15:35.0204040Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-17T12:15:35.0217109Z [submariner-operator]$ [cluster2] date +%s
2021-07-17T12:15:35.0240294Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-nz8zd -- curl --output /dev/null -m 30 --silent --head --fail 100.1.82.8
2021-07-17T12:15:35.0257665Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-nz8zd -- curl --output /dev/null -m 30 --silent --head --fail 100.1.82.8
2021-07-17T12:15:35.0269310Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-nz8zd -- curl --output /dev/null -m 30 --silent --head --fail 100.1.82.8
2021-07-17T12:16:05.4107124Z command terminated with exit code 28
2021-07-17T12:16:05.4156042Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-17T12:16:05.4175193Z [submariner-operator]$ [cluster2] date +%s
2021-07-17T12:16:05.4195186Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-17T12:16:05.4205869Z [submariner-operator]$ [cluster2] return 1
2021-07-17T12:16:05.4243489Z [submariner-operator]$ [cluster2] wait 9028
2021-07-17T12:16:05.4255098Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-nz8zd 100.1.82.8
2021-07-17T12:16:05.4263655Z [submariner-operator]$ [cluster2] test_connection
2021-07-17T12:16:05.4268883Z Attempting connectivity between clusters - netshoot-57677568b8-nz8zd --> 100.1.82.8
2021-07-17T12:16:05.4279028Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-17T12:16:05.4289122Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-17T12:16:05.4302485Z [submariner-operator]$ [cluster2] date +%s
2021-07-17T12:16:05.4322653Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-nz8zd -- curl --output /dev/null -m 30 --silent --head --fail 100.1.82.8
2021-07-17T12:16:05.4342134Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-nz8zd -- curl --output /dev/null -m 30 --silent --head --fail 100.1.82.8
2021-07-17T12:16:05.4353543Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-nz8zd -- curl --output /dev/null -m 30 --silent --head --fail 100.1.82.8
2021-07-17T12:16:05.7577238Z Connection test was successful!
2021-07-17T12:16:05.7624640Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:16:05.7634299Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:16:05.7645818Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:16:05.7657941Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:16:05.7671071Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:16:05.7686450Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T12:16:05.9939930Z deployment.apps "netshoot" deleted
2021-07-17T12:16:06.0059481Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:16:06.0080735Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:16:06.0094522Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:16:06.0104949Z [submariner-operator]$ [cluster1] remove_resource
2021-07-17T12:16:06.0115550Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:16:06.0125727Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:16:06.0135684Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T12:16:06.2520558Z deployment.apps "nginx-demo" deleted
2021-07-17T12:16:06.3118875Z service "nginx-demo" deleted
2021-07-17T12:16:06.3320301Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-17T12:16:06.3557200Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-17T12:16:06.3571891Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-17T12:16:06.3590437Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-17T12:16:06.3663312Z [submariner-operator]$ [cluster2] grep -q function
2021-07-17T12:16:06.3664274Z Successfully remade target file 'deploy'.
2021-07-17T12:16:06.3665066Z [submariner-operator]$ [cluster2] return 0
2021-07-17T12:16:06.3665697Z File 'e2e' does not exist.
2021-07-17T12:16:06.3666454Z Must remake target 'e2e'.
2021-07-17T12:16:06.3666982Z scripts/kind-e2e/e2e.sh
2021-07-17T12:16:06.3716940Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T12:16:06.3736292Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:16:06.3749237Z [submariner-operator]$ script_name=utils
2021-07-17T12:16:06.3778007Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T12:16:06.3814186Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-17T12:16:06.3825840Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:16:06.3842379Z [submariner-operator]$ script_name=deploy_funcs
2021-07-17T12:16:06.3858866Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T12:16:06.3876745Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-17T12:16:06.3892263Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:16:06.3904658Z [submariner-operator]$ script_name=deploy_operator
2021-07-17T12:16:06.3933149Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T12:16:06.3964124Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T12:16:06.3980847Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:16:06.4012812Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:16:06.4038991Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T12:16:06.4060655Z [submariner-operator]$ broker=cluster1
2021-07-17T12:16:06.4072972Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T12:16:06.4089907Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T12:16:06.4100098Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T12:16:06.4110869Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T12:16:06.4122055Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T12:16:06.4135289Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T12:16:06.4147109Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T12:16:06.4155736Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T12:16:06.4164636Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T12:16:06.4173557Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T12:16:06.4183384Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T12:16:06.4204554Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T12:16:06.4243048Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T12:16:06.4260874Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T12:16:06.4272540Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T12:16:06.4292824Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T12:16:06.4303376Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T12:16:06.4328564Z [submariner-operator]$ timeout=2m
2021-07-17T12:16:06.4341693Z [submariner-operator]$ declare_kubeconfig
2021-07-17T12:16:06.4352256Z [submariner-operator]$ declare_kubeconfig
2021-07-17T12:16:06.4361604Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-17T12:16:06.4372002Z [submariner-operator]$ export KUBECONFIG
2021-07-17T12:16:06.4382521Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-17T12:16:06.4404672Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-17T12:16:06.4446859Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-17T12:16:06.4470638Z [submariner-operator]$ create_subm_vars
2021-07-17T12:16:06.4479703Z [submariner-operator]$ create_subm_vars
2021-07-17T12:16:06.4489913Z [submariner-operator]$ deployment_name=submariner
2021-07-17T12:16:06.4499495Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-17T12:16:06.4518242Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-17T12:16:06.4527121Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-17T12:16:06.4538449Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-17T12:16:06.4564317Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-17T12:16:06.4575251Z [submariner-operator]$ declare_cidrs
2021-07-17T12:16:06.4586903Z [submariner-operator]$ declare_cidrs
2021-07-17T12:16:06.4605433Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T12:16:06.4616900Z [submariner-operator]$ i=1
2021-07-17T12:16:06.4626081Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:16:06.4637777Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T12:16:06.4657495Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T12:16:06.4667386Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T12:16:06.4679052Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T12:16:06.4687851Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:16:06.4704244Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T12:16:06.4715591Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T12:16:06.4724516Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T12:16:06.4734261Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T12:16:06.4745674Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-17T12:16:06.4754088Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-17T12:16:06.4762472Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-17T12:16:06.4771933Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-17T12:16:06.4782123Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-17T12:16:06.4790097Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-17T12:16:06.4798534Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-17T12:16:06.4807174Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-17T12:16:06.4817502Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-17T12:16:06.4825510Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-17T12:16:06.4839675Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-17T12:16:06.4852955Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-17T12:16:06.4866021Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-17T12:16:06.4883706Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-17T12:16:06.4897687Z [submariner-operator]$ [cluster1] broker_vars
2021-07-17T12:16:06.4908534Z [submariner-operator]$ [cluster1] broker_vars
2021-07-17T12:16:06.4919086Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-17T12:16:06.4938241Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-17T12:16:06.4951371Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-17T12:16:06.4978191Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-17T12:16:06.7407810Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-17T12:16:06.7422955Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-17T12:16:06.7433463Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-17T12:16:06.7444604Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-17T12:16:07.2467645Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-17T12:16:07.2483960Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-17T12:16:07.2502146Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-17T12:16:07.2522747Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-17T12:16:07.2542563Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-17T12:16:07.5193412Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-17T12:16:07.5204833Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-17T12:16:07.5219462Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-17T12:16:07.5233470Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-17T12:16:07.5675560Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-17T12:16:07.6487026Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-17T12:16:07.6874088Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-17T12:16:07.6875405Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-17T12:16:07.6876415Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-17T12:16:07.6877294Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-17T12:16:07.6878196Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-17T12:16:07.6879647Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-17T12:16:07.7858675Z [submariner-operator]$ [cluster1] return
2021-07-17T12:16:07.7867743Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-17T12:16:07.7880816Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-17T12:16:07.7891956Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-17T12:16:08.0132042Z NAME TYPE DATA AGE
2021-07-17T12:16:08.0133472Z cluster-cluster1-token-mkd4w kubernetes.io/service-account-token 3 4m16s
2021-07-17T12:16:08.0134646Z cluster-cluster2-token-45gmn kubernetes.io/service-account-token 3 4m16s
2021-07-17T12:16:08.0135748Z default-token-2qdlm kubernetes.io/service-account-token 3 4m38s
2021-07-17T12:16:08.0136934Z submariner-k8s-broker-admin-token-5qvqw kubernetes.io/service-account-token 3 4m38s
2021-07-17T12:16:08.0138342Z submariner-k8s-broker-client-token-mqzvn kubernetes.io/service-account-token 3 4m38s
2021-07-17T12:16:08.0195160Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-17T12:16:08.0209866Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-17T12:16:08.0224263Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-17T12:16:08.2839392Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.2852219Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-mqzvn -n submariner-k8s-broker -o json
2021-07-17T12:16:08.2877103Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.2895628Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-mqzvn -n submariner-k8s-broker -o json
2021-07-17T12:16:08.2914971Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-mqzvn -n submariner-k8s-broker -o json
2021-07-17T12:16:08.5706231Z {
2021-07-17T12:16:08.5707096Z "apiVersion": "v1",
2021-07-17T12:16:08.5707423Z "data": {
2021-07-17T12:16:08.6136083Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-17T12:16:08.6514615Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-17T12:16:08.6907033Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNkluWmZPRU15ZERKR1dYTmxTazQyVmtGNWFVRkdaR3hoUjFOWFZtWjVRWFl3VEVjMlJWODNMVVJGYUdNaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxdGNYcDJiaUlzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pTXprd1pUazFNamd0TWpaa09DMDBPVEEzTFRsaVkyVXRNMk15TVRVMVpqTTBOR1F5SWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLklPVHgxdVZ6YnpnUzNGZEJ3d0kxc21ENjQtMy1wbk5pdTFHbU1rS1VBeXNVZ1pTU2lweld3Nk8wSUlTeGwyTml0MEZLcUxpT3Mxcm12TkV3dklfVXB3X2xvM1BZOHlmRXZTeXZHVE9KQzlJLWM3SFIxT2FDWDVaaVN1RVNKQjFKaHByWi03MllJdXN5REN2cm9KZDZwLVowNHU1X3BjVVJKSW12ZUdrMnNsaHppdUFUVW5fWGdXODFTYVVLdklHMGtNck1tMEsxSTBTNEkzX1RQUDdIeFdBM1FJZ1hBdl9VckxYZmZFR1dHTE1vNkx1NDRVLW5iczNFby10a2JydHZwMlFNdnpXeUt2X0k2NUFtQmI5ZlFXUUlrVjdiejJYUmttMy11YVBCeDR2TkdWWWlFN1BIZW1wa1VtMVlucHFpdEgzRkZhLWY0LWNJMUJ6QmRFMjdhdw=="
2021-07-17T12:16:08.7299906Z },
2021-07-17T12:16:08.7300251Z "kind": "Secret",
2021-07-17T12:16:08.7300601Z "metadata": {
2021-07-17T12:16:08.7301232Z "annotations": {
2021-07-17T12:16:08.7302586Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-17T12:16:08.7303720Z "kubernetes.io/service-account.uid": "390e9528-26d8-4907-9bce-3c2155f344d2"
2021-07-17T12:16:08.7304284Z },
2021-07-17T12:16:08.7304829Z "creationTimestamp": "2021-07-17T12:11:30Z",
2021-07-17T12:16:08.7305304Z "managedFields": [
2021-07-17T12:16:08.7305646Z {
2021-07-17T12:16:08.7305980Z "apiVersion": "v1",
2021-07-17T12:16:08.7306401Z "fieldsType": "FieldsV1",
2021-07-17T12:16:08.7306960Z "fieldsV1": {
2021-07-17T12:16:08.7307306Z "f:data": {
2021-07-17T12:16:08.7307612Z ".": {},
2021-07-17T12:16:08.7307942Z "f:ca.crt": {},
2021-07-17T12:16:08.7308302Z "f:namespace": {},
2021-07-17T12:16:08.7308673Z "f:token": {}
2021-07-17T12:16:08.7308981Z },
2021-07-17T12:16:08.7309317Z "f:metadata": {
2021-07-17T12:16:08.7309692Z "f:annotations": {
2021-07-17T12:16:08.7310050Z ".": {},
2021-07-17T12:16:08.7310907Z "f:kubernetes.io/service-account.name": {},
2021-07-17T12:16:08.7311727Z "f:kubernetes.io/service-account.uid": {}
2021-07-17T12:16:08.7312209Z }
2021-07-17T12:16:08.7312782Z },
2021-07-17T12:16:08.7313083Z "f:type": {}
2021-07-17T12:16:08.7313363Z },
2021-07-17T12:16:08.7313988Z "manager": "kube-controller-manager",
2021-07-17T12:16:08.7314493Z "operation": "Update",
2021-07-17T12:16:08.7315022Z "time": "2021-07-17T12:11:30Z"
2021-07-17T12:16:08.7315855Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-17T12:16:08.7316739Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-17T12:16:08.7318564Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.7320840Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-17T12:16:08.7322371Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-17T12:16:08.7324015Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.7325859Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-mqzvn
2021-07-17T12:16:08.7327524Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-mqzvn
2021-07-17T12:16:08.7329413Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.7331305Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-17T12:16:08.7332626Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-17T12:16:08.7334416Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.7335711Z }
2021-07-17T12:16:08.7335973Z ],
2021-07-17T12:16:08.7336767Z "name": "submariner-k8s-broker-client-token-mqzvn",
2021-07-17T12:16:08.7337692Z "namespace": "submariner-k8s-broker",
2021-07-17T12:16:08.7338211Z "resourceVersion": "1177",
2021-07-17T12:16:08.7338898Z "uid": "5cd1d90a-2bdf-47ac-a243-d6228d46ede6"
2021-07-17T12:16:08.7339359Z },
2021-07-17T12:16:08.7339953Z "type": "kubernetes.io/service-account-token"
2021-07-17T12:16:08.7340424Z }
2021-07-17T12:16:08.7583678Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-mqzvn.cluster1.json
2021-07-17T12:16:08.7987344Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-17T12:16:08.8000992Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-17T12:16:08.8013667Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-17T12:16:08.8025583Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T12:16:08.8056355Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-17T12:16:08.8068402Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-17T12:16:08.8089657Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T12:16:08.8108280Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T12:16:08.8210918Z [submariner-operator]$ [cluster1] pids[cluster1]=9277
2021-07-17T12:16:08.8247659Z [submariner-operator]$ [cluster2] pids[cluster2]=9280
2021-07-17T12:16:08.8253440Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T12:16:08.8262297Z [submariner-operator]$ [cluster2] wait 9280
2021-07-17T12:16:08.8271102Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-17T12:16:08.8277994Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T12:16:08.8290874Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-17T12:16:08.8320850Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T12:16:08.8329217Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T12:16:09.4915957Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-17T12:16:09.4916869Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-17T12:16:09.4917912Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-17T12:16:09.4919793Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T12:16:09.4921379Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T12:16:09.4923242Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-17T12:16:09.4924328Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-17T12:16:09.4925724Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-17T12:16:09.4926484Z [cluster2] NAME CREATED AT
2021-07-17T12:16:09.4927161Z [cluster2] endpoints.submariner.io 2021-07-17T12:11:52Z
2021-07-17T12:16:09.4928266Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:09.4929963Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-17T12:16:09.4931406Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:09.4932744Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-17T12:16:09.4934293Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-17T12:16:09.4935001Z [cluster2] {
2021-07-17T12:16:09.4935655Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:09.4936394Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-17T12:16:09.4936916Z [cluster2] "metadata": {
2021-07-17T12:16:09.4937322Z [cluster2] "annotations": {
2021-07-17T12:16:09.4939549Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T12:16:09.4940332Z [cluster2] },
2021-07-17T12:16:09.4941207Z [cluster2] "creationTimestamp": "2021-07-17T12:11:52Z",
2021-07-17T12:16:09.4942247Z [cluster2] "generation": 1,
2021-07-17T12:16:09.4942969Z [cluster2] "managedFields": [
2021-07-17T12:16:09.4943588Z [cluster2] {
2021-07-17T12:16:09.4944949Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:09.4945675Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:09.4946237Z [cluster2] "fieldsV1": {
2021-07-17T12:16:09.4946731Z [cluster2] "f:metadata": {
2021-07-17T12:16:09.4947281Z [cluster2] "f:annotations": {
2021-07-17T12:16:09.4948123Z [cluster2] ".": {},
2021-07-17T12:16:09.4949348Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-17T12:16:09.4950000Z [cluster2] }
2021-07-17T12:16:09.4950338Z [cluster2] },
2021-07-17T12:16:09.4950710Z [cluster2] "f:spec": {
2021-07-17T12:16:09.4951130Z [cluster2] "f:conversion": {
2021-07-17T12:16:09.4951539Z [cluster2] ".": {},
2021-07-17T12:16:09.4951927Z [cluster2] "f:strategy": {}
2021-07-17T12:16:09.4952320Z [cluster2] },
2021-07-17T12:16:09.4952685Z [cluster2] "f:group": {},
2021-07-17T12:16:09.4953092Z [cluster2] "f:names": {
2021-07-17T12:16:09.4953478Z [cluster2] "f:kind": {},
2021-07-17T12:16:09.4954035Z [cluster2] "f:listKind": {},
2021-07-17T12:16:09.4954467Z [cluster2] "f:plural": {},
2021-07-17T12:16:09.4954880Z [cluster2] "f:singular": {}
2021-07-17T12:16:09.4955268Z [cluster2] },
2021-07-17T12:16:09.4955636Z [cluster2] "f:scope": {},
2021-07-17T12:16:09.4956052Z [cluster2] "f:versions": {}
2021-07-17T12:16:09.4956429Z [cluster2] },
2021-07-17T12:16:09.4956804Z [cluster2] "f:status": {
2021-07-17T12:16:09.4957244Z [cluster2] "f:acceptedNames": {
2021-07-17T12:16:09.4957818Z [cluster2] "f:kind": {},
2021-07-17T12:16:09.4958225Z [cluster2] "f:plural": {}
2021-07-17T12:16:09.4958865Z [cluster2] },
2021-07-17T12:16:09.4959277Z [cluster2] "f:conditions": {},
2021-07-17T12:16:09.4959749Z [cluster2] "f:storedVersions": {}
2021-07-17T12:16:09.4960176Z [cluster2] }
2021-07-17T12:16:09.4960507Z [cluster2] },
2021-07-17T12:16:09.4961226Z [cluster2] "manager": "submariner-operator",
2021-07-17T12:16:09.4961770Z [cluster2] "operation": "Update",
2021-07-17T12:16:09.4962377Z [cluster2] "time": "2021-07-17T12:12:00Z"
2021-07-17T12:16:09.4962746Z [cluster2] }
2021-07-17T12:16:09.4963086Z [cluster2] ],
2021-07-17T12:16:09.4963591Z [cluster2] "name": "endpoints.submariner.io",
2021-07-17T12:16:09.4964164Z [cluster2] "resourceVersion": "1345",
2021-07-17T12:16:09.4964941Z [cluster2] "uid": "a319af9d-bff7-4183-bc08-03290d4c6a9c"
2021-07-17T12:16:09.4965438Z [cluster2] },
2021-07-17T12:16:09.4965784Z [cluster2] "spec": {
2021-07-17T12:16:09.4966226Z [cluster2] "conversion": {
2021-07-17T12:16:09.4966653Z [cluster2] "strategy": "None"
2021-07-17T12:16:09.4967034Z [cluster2] },
2021-07-17T12:16:09.4967488Z [cluster2] "group": "submariner.io",
2021-07-17T12:16:09.4967984Z [cluster2] "names": {
2021-07-17T12:16:09.4968387Z [cluster2] "kind": "Endpoint",
2021-07-17T12:16:09.4968869Z [cluster2] "listKind": "EndpointList",
2021-07-17T12:16:09.4969353Z [cluster2] "plural": "endpoints",
2021-07-17T12:16:09.4969829Z [cluster2] "singular": "endpoint"
2021-07-17T12:16:09.4970375Z [cluster2] },
2021-07-17T12:16:09.4970803Z [cluster2] "scope": "Namespaced",
2021-07-17T12:16:09.4971225Z [cluster2] "versions": [
2021-07-17T12:16:09.4971594Z [cluster2] {
2021-07-17T12:16:09.4971940Z [cluster2] "name": "v1",
2021-07-17T12:16:09.4972328Z [cluster2] "schema": {
2021-07-17T12:16:09.4972774Z [cluster2] "openAPIV3Schema": {
2021-07-17T12:16:09.4973263Z [cluster2] "properties": {
2021-07-17T12:16:09.4973713Z [cluster2] "apiVersion": {
2021-07-17T12:16:09.4975660Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T12:16:09.4977171Z [cluster2] "type": "string"
2021-07-17T12:16:09.4977568Z [cluster2] },
2021-07-17T12:16:09.4978099Z [cluster2] "kind": {
2021-07-17T12:16:09.4979962Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T12:16:09.4981611Z [cluster2] "type": "string"
2021-07-17T12:16:09.4982018Z [cluster2] },
2021-07-17T12:16:09.4982420Z [cluster2] "metadata": {
2021-07-17T12:16:09.4982844Z [cluster2] "type": "object"
2021-07-17T12:16:09.4983246Z [cluster2] },
2021-07-17T12:16:09.4983619Z [cluster2] "spec": {
2021-07-17T12:16:09.4984052Z [cluster2] "properties": {
2021-07-17T12:16:09.4984484Z [cluster2] "backend": {
2021-07-17T12:16:09.4984927Z [cluster2] "type": "string"
2021-07-17T12:16:09.4985342Z [cluster2] },
2021-07-17T12:16:09.4985754Z [cluster2] "backend_config": {
2021-07-17T12:16:09.4986316Z [cluster2] "additionalProperties": {
2021-07-17T12:16:09.4986854Z [cluster2] "type": "string"
2021-07-17T12:16:09.4987590Z [cluster2] },
2021-07-17T12:16:09.4988006Z [cluster2] "type": "object"
2021-07-17T12:16:09.4988431Z [cluster2] },
2021-07-17T12:16:09.4988843Z [cluster2] "cable_name": {
2021-07-17T12:16:09.4989426Z [cluster2] "type": "string"
2021-07-17T12:16:09.4989848Z [cluster2] },
2021-07-17T12:16:09.4990251Z [cluster2] "cluster_id": {
2021-07-17T12:16:09.4990904Z [cluster2] "type": "string"
2021-07-17T12:16:09.4991303Z [cluster2] },
2021-07-17T12:16:09.4991747Z [cluster2] "healthCheckIP": {
2021-07-17T12:16:09.4992221Z [cluster2] "type": "string"
2021-07-17T12:16:09.4992656Z [cluster2] },
2021-07-17T12:16:09.4993145Z [cluster2] "hostname": {
2021-07-17T12:16:09.4993589Z [cluster2] "type": "string"
2021-07-17T12:16:09.4993996Z [cluster2] },
2021-07-17T12:16:09.4994500Z [cluster2] "nat_enabled": {
2021-07-17T12:16:09.4994975Z [cluster2] "type": "boolean"
2021-07-17T12:16:09.4995379Z [cluster2] },
2021-07-17T12:16:09.4995790Z [cluster2] "private_ip": {
2021-07-17T12:16:09.4996229Z [cluster2] "type": "string"
2021-07-17T12:16:09.4996638Z [cluster2] },
2021-07-17T12:16:09.4997046Z [cluster2] "public_ip": {
2021-07-17T12:16:09.4997480Z [cluster2] "type": "string"
2021-07-17T12:16:09.4997889Z [cluster2] },
2021-07-17T12:16:09.4998273Z [cluster2] "subnets": {
2021-07-17T12:16:09.5039848Z [cluster2] "items": {
2021-07-17T12:16:09.5040437Z [cluster2] "type": "string"
2021-07-17T12:16:09.5040958Z [cluster2] },
2021-07-17T12:16:09.5041448Z [cluster2] "type": "array"
2021-07-17T12:16:09.5041950Z [cluster2] }
2021-07-17T12:16:09.5042399Z [cluster2] },
2021-07-17T12:16:09.5043166Z [cluster2] "required": [
2021-07-17T12:16:09.5043599Z [cluster2] "backend",
2021-07-17T12:16:09.5044201Z [cluster2] "cable_name",
2021-07-17T12:16:09.5044641Z [cluster2] "cluster_id",
2021-07-17T12:16:09.6012504Z [cluster2] [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-17T12:16:09.6013924Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-17T12:16:09.6015993Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-17T12:16:09.6017297Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T12:16:09.6018655Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T12:16:09.6020047Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-17T12:16:09.6021260Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-17T12:16:09.6022604Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-17T12:16:09.6023462Z [cluster1] NAME CREATED AT
2021-07-17T12:16:09.6024236Z [cluster1] endpoints.submariner.io 2021-07-17T12:11:42Z
2021-07-17T12:16:09.6025467Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:09.6027001Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-17T12:16:09.6028425Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:09.6029819Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-17T12:16:09.6031163Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-17T12:16:09.6031973Z [cluster1] {
2021-07-17T12:16:09.6032513Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:09.6033248Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-17T12:16:09.6033832Z [cluster1] "metadata": {
2021-07-17T12:16:09.6034259Z [cluster1] "annotations": {
2021-07-17T12:16:09.6035141Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T12:16:09.6035764Z [cluster1] },
2021-07-17T12:16:09.6036431Z [cluster1] "creationTimestamp": "2021-07-17T12:11:42Z",
2021-07-17T12:16:09.6037138Z [cluster1] "generation": 1,
2021-07-17T12:16:09.6037644Z [cluster1] "managedFields": [
2021-07-17T12:16:09.6038232Z [cluster1] {
2021-07-17T12:16:09.6040031Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:09.6040709Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:09.6041202Z [cluster1] "fieldsV1": {
2021-07-17T12:16:09.6041814Z [cluster1] "f:metadata": {
2021-07-17T12:16:09.6042274Z [cluster1] "f:annotations": {
2021-07-17T12:16:09.6042728Z [cluster1] ".": {},
2021-07-17T12:16:09.6043643Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-17T12:16:09.6044300Z [cluster1] }
2021-07-17T12:16:09.6044662Z [cluster1] },
2021-07-17T12:16:09.6045066Z [cluster1] "f:spec": {
2021-07-17T12:16:09.6045500Z [cluster1] "f:conversion": {
2021-07-17T12:16:09.6045947Z [cluster1] ".": {},
2021-07-17T12:16:09.6046378Z [cluster1] "f:strategy": {}
2021-07-17T12:16:09.6047621Z [cluster1] },
2021-07-17T12:16:09.6048101Z [cluster1] "f:group": {},
2021-07-17T12:16:09.6048580Z [cluster1] "f:names": {
2021-07-17T12:16:09.6049065Z [cluster1] "f:kind": {},
2021-07-17T12:16:09.6049718Z [cluster1] "f:listKind": {},
2021-07-17T12:16:09.6050574Z [cluster1] "f:plural": {},
2021-07-17T12:16:09.6051012Z [cluster1] "f:singular": {}
2021-07-17T12:16:09.6051430Z [cluster1] },
2021-07-17T12:16:09.6051840Z [cluster1] "f:scope": {},
2021-07-17T12:16:09.6052275Z [cluster1] "f:versions": {}
2021-07-17T12:16:09.6052690Z [cluster1] },
2021-07-17T12:16:09.6053080Z [cluster1] "f:status": {
2021-07-17T12:16:09.6053566Z [cluster1] "f:acceptedNames": {
2021-07-17T12:16:09.6054032Z [cluster1] "f:kind": {},
2021-07-17T12:16:09.6054467Z [cluster1] "f:plural": {}
2021-07-17T12:16:09.6054863Z [cluster1] },
2021-07-17T12:16:09.6055294Z [cluster1] "f:conditions": {},
2021-07-17T12:16:09.6055793Z [cluster1] "f:storedVersions": {}
2021-07-17T12:16:09.6056255Z [cluster1] }
2021-07-17T12:16:09.6056663Z [cluster1] },
2021-07-17T12:16:09.6057466Z [cluster1] "manager": "submariner-operator",
2021-07-17T12:16:09.6058064Z [cluster1] "operation": "Update",
2021-07-17T12:16:09.6058702Z [cluster1] "time": "2021-07-17T12:11:48Z"
2021-07-17T12:16:09.6059107Z [cluster1] }
2021-07-17T12:16:09.6059451Z [cluster1] ],
2021-07-17T12:16:09.6059996Z [cluster1] "name": "endpoints.submariner.io",
2021-07-17T12:16:09.6060611Z [cluster1] "resourceVersion": "1361",
2021-07-17T12:16:09.6061414Z [cluster1] "uid": "68d8fa83-9050-481e-aec8-61f8a2024ef7"
2021-07-17T12:16:09.6061916Z [cluster1] },
2021-07-17T12:16:09.6062289Z [cluster1] "spec": {
2021-07-17T12:16:09.6062709Z [cluster1] "conversion": {
2021-07-17T12:16:09.6063154Z [cluster1] "strategy": "None"
2021-07-17T12:16:09.6063569Z [cluster1] },
2021-07-17T12:16:09.6064122Z [cluster1] "group": "submariner.io",
2021-07-17T12:16:09.6064596Z [cluster1] "names": {
2021-07-17T12:16:09.6065017Z [cluster1] "kind": "Endpoint",
2021-07-17T12:16:09.6065533Z [cluster1] "listKind": "EndpointList",
2021-07-17T12:16:09.6066050Z [cluster1] "plural": "endpoints",
2021-07-17T12:16:09.6066557Z [cluster1] "singular": "endpoint"
2021-07-17T12:16:09.6067074Z [cluster1] },
2021-07-17T12:16:09.6067609Z [cluster1] "scope": "Namespaced",
2021-07-17T12:16:09.6068095Z [cluster1] "versions": [
2021-07-17T12:16:09.6068473Z [cluster1] {
2021-07-17T12:16:09.6068858Z [cluster1] "name": "v1",
2021-07-17T12:16:09.6069261Z [cluster1] "schema": {
2021-07-17T12:16:09.6069757Z [cluster1] "openAPIV3Schema": {
2021-07-17T12:16:09.6070265Z [cluster1] "properties": {
2021-07-17T12:16:09.6070761Z [cluster1] "apiVersion": {
2021-07-17T12:16:09.6072851Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T12:16:09.6074598Z [cluster1] "type": "string"
2021-07-17T12:16:09.6075039Z [cluster1] },
2021-07-17T12:16:09.6075446Z [cluster1] "kind": {
2021-07-17T12:16:09.6077594Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T12:16:09.6079938Z [cluster1] "type": "string"
2021-07-17T12:16:09.6080416Z [cluster1] },
2021-07-17T12:16:09.6080878Z [cluster1] "metadata": {
2021-07-17T12:16:09.6081396Z [cluster1] "type": "object"
2021-07-17T12:16:09.6082143Z [cluster1] },
2021-07-17T12:16:09.6082561Z [cluster1] "spec": {
2021-07-17T12:16:09.6083029Z [cluster1] "properties": {
2021-07-17T12:16:09.6083526Z [cluster1] "backend": {
2021-07-17T12:16:09.6083998Z [cluster1] "type": "string"
2021-07-17T12:16:09.6084457Z [cluster1] },
2021-07-17T12:16:09.6084928Z [cluster1] "backend_config": {
2021-07-17T12:16:09.6085526Z [cluster1] "additionalProperties": {
2021-07-17T12:16:09.6086136Z [cluster1] "type": "string"
2021-07-17T12:16:09.6086582Z [cluster1] },
2021-07-17T12:16:09.6087041Z [cluster1] "type": "object"
2021-07-17T12:16:09.6087480Z [cluster1] },
2021-07-17T12:16:09.6087928Z [cluster1] "cable_name": {
2021-07-17T12:16:09.6088422Z [cluster1] "type": "string"
2021-07-17T12:16:09.6088863Z [cluster1] },
2021-07-17T12:16:09.6089308Z [cluster1] "cluster_id": {
2021-07-17T12:16:09.6089786Z [cluster1] "type": "string"
2021-07-17T12:16:09.6090242Z [cluster1] },
2021-07-17T12:16:09.6090718Z [cluster1] "healthCheckIP": {
2021-07-17T12:16:09.6091256Z [cluster1] "type": "string"
2021-07-17T12:16:09.6091696Z [cluster1] },
2021-07-17T12:16:09.6092145Z [cluster1] "hostname": {
2021-07-17T12:16:09.6092639Z [cluster1] "type": "string"
2021-07-17T12:16:09.6120392Z [cluster1] },
2021-07-17T12:16:09.6121053Z [cluster1] "nat_enabled": {
2021-07-17T12:16:09.6130703Z [cluster1] "type": "boolean"
2021-07-17T12:16:09.6131188Z [cluster1] },
2021-07-17T12:16:09.6131636Z [cluster1] "private_ip": {
2021-07-17T12:16:09.6132288Z [cluster1] "type": "string"
2021-07-17T12:16:09.6132719Z [cluster1] },
2021-07-17T12:16:09.6133166Z [cluster1] "public_ip": {
2021-07-17T12:16:09.6133642Z [cluster1] "type": "string"
2021-07-17T12:16:09.6134067Z [cluster1] },
2021-07-17T12:16:09.6134494Z [cluster1] "subnets": {
2021-07-17T12:16:09.6134938Z [cluster1] "items": {
2021-07-17T12:16:09.6135591Z [cluster1] "type": "string"
2021-07-17T12:16:09.6136026Z [cluster1] },
2021-07-17T12:16:09.6136651Z [cluster1] "type": "array"
2021-07-17T12:16:09.6137086Z [cluster1] }
2021-07-17T12:16:09.6137496Z [cluster1] },
2021-07-17T12:16:09.6138026Z [cluster1] "required": [
2021-07-17T12:16:09.6138485Z [cluster1] "backend",
2021-07-17T12:16:09.6139133Z [cluster1] "cable_name",
2021-07-17T12:16:09.6139966Z [cluster1] "cluster_id",
2021-07-17T12:16:10.1131584Z [cluster1] "hostname",
2021-07-17T12:16:10.1132150Z [cluster2] "nat_enabled",
2021-07-17T12:16:10.1132553Z [cluster2] "private_ip",
2021-07-17T12:16:10.1132977Z [cluster2] "public_ip",
2021-07-17T12:16:10.1133357Z [cluster2] "subnets"
2021-07-17T12:16:10.1133715Z [cluster2] ],
2021-07-17T12:16:10.1134070Z [cluster2] "type": "object"
2021-07-17T12:16:10.1134432Z [cluster2] }
2021-07-17T12:16:10.1134848Z [cluster2] },
2021-07-17T12:16:10.1135206Z [cluster2] "required": [
2021-07-17T12:16:10.1135630Z [cluster2] "spec"
2021-07-17T12:16:10.1135966Z [cluster2] ],
2021-07-17T12:16:10.1136322Z [cluster2] "type": "object"
2021-07-17T12:16:10.1136661Z [cluster2] }
2021-07-17T12:16:10.1136973Z [cluster2] },
2021-07-17T12:16:10.1137306Z [cluster2] "served": true,
2021-07-17T12:16:10.1137687Z [cluster2] "storage": true
2021-07-17T12:16:10.1138019Z [cluster2] }
2021-07-17T12:16:10.1138322Z [cluster2] ]
2021-07-17T12:16:10.1138607Z [cluster2] },
2021-07-17T12:16:10.1138924Z [cluster2] "status": {
2021-07-17T12:16:10.1139295Z [cluster2] "acceptedNames": {
2021-07-17T12:16:10.1139703Z [cluster2] "kind": "Endpoint",
2021-07-17T12:16:10.1140123Z [cluster2] "listKind": "EndpointList",
2021-07-17T12:16:10.1140573Z [cluster2] "plural": "endpoints",
2021-07-17T12:16:10.1141006Z [cluster2] "singular": "endpoint"
2021-07-17T12:16:10.1141361Z [cluster2] },
2021-07-17T12:16:10.1141702Z [cluster2] "conditions": [
2021-07-17T12:16:10.1142028Z [cluster2] {
2021-07-17T12:16:10.1143028Z [cluster2] "lastTransitionTime": "2021-07-17T12:11:52Z",
2021-07-17T12:16:10.1143535Z [cluster2] "message": "no conflicts found",
2021-07-17T12:16:10.1143993Z [cluster2] "reason": "NoConflicts",
2021-07-17T12:16:10.1144584Z [cluster2] "status": "True",
2021-07-17T12:16:10.1145044Z [cluster2] "type": "NamesAccepted"
2021-07-17T12:16:10.1145431Z [cluster2] },
2021-07-17T12:16:10.1145725Z [cluster2] {
2021-07-17T12:16:10.1146351Z [cluster2] "lastTransitionTime": "2021-07-17T12:11:52Z",
2021-07-17T12:16:10.1146905Z [cluster2] "message": "the initial names have been accepted",
2021-07-17T12:16:10.1147491Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-17T12:16:10.1147967Z [cluster2] "status": "True",
2021-07-17T12:16:10.1148373Z [cluster2] "type": "Established"
2021-07-17T12:16:10.1148723Z [cluster2] }
2021-07-17T12:16:10.1149022Z [cluster2] ],
2021-07-17T12:16:10.1149377Z [cluster2] "storedVersions": [
2021-07-17T12:16:10.1149749Z [cluster2] "v1"
2021-07-17T12:16:10.1150042Z [cluster2] ]
2021-07-17T12:16:10.1150337Z [cluster2] }
2021-07-17T12:16:10.1150631Z [cluster2] }
2021-07-17T12:16:10.1151446Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T12:16:10.1152585Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T12:16:10.1153873Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:10.1155050Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T12:16:10.1156139Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T12:16:10.1157446Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:10.1158825Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T12:16:10.1159802Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T12:16:10.1160986Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:10.1162137Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-17T12:16:10.1163086Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-17T12:16:10.1164627Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:10.1165974Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T12:16:10.1167325Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T12:16:10.1168697Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T12:16:10.1169882Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-17T12:16:10.1170632Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-17T12:16:10.1171537Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T12:16:10.1172569Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T12:16:10.1173564Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-17T12:16:10.1174548Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-17T12:16:10.1175626Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-17T12:16:10.1176325Z [cluster2] NAME CREATED AT
2021-07-17T12:16:10.3182972Z [cluster2] clusters.submariner.io 20 "hostname",
2021-07-17T12:16:10.3183568Z [cluster1] "nat_enabled",
2021-07-17T12:16:10.3184004Z [cluster1] "private_ip",
2021-07-17T12:16:10.3184611Z [cluster1] "public_ip",
2021-07-17T12:16:10.3185046Z [cluster1] "subnets"
2021-07-17T12:16:10.3185433Z [cluster1] ],
2021-07-17T12:16:10.3185984Z [cluster1] "type": "object"
2021-07-17T12:16:10.3186551Z [cluster1] }
2021-07-17T12:16:10.3186893Z [cluster1] },
2021-07-17T12:16:10.3187259Z [cluster1] "required": [
2021-07-17T12:16:10.3187663Z [cluster1] "spec"
2021-07-17T12:16:10.3187998Z [cluster1] ],
2021-07-17T12:16:10.3188377Z [cluster1] "type": "object"
2021-07-17T12:16:10.3188743Z [cluster1] }
2021-07-17T12:16:10.3189073Z [cluster1] },
2021-07-17T12:16:10.3189600Z [cluster1] "served": true,
2021-07-17T12:16:10.3190471Z [cluster1] "storage": true
2021-07-17T12:16:10.3190858Z [cluster1] }
2021-07-17T12:16:10.3191211Z [cluster1] ]
2021-07-17T12:16:10.3191534Z [cluster1] },
2021-07-17T12:16:10.3191898Z [cluster1] "status": {
2021-07-17T12:16:10.3192335Z [cluster1] "acceptedNames": {
2021-07-17T12:16:10.3192791Z [cluster1] "kind": "Endpoint",
2021-07-17T12:16:10.3193603Z [cluster1] "listKind": "EndpointList",
2021-07-17T12:16:10.3194076Z [cluster1] "plural": "endpoints",
2021-07-17T12:16:10.3194703Z [cluster1] "singular": "endpoint"
2021-07-17T12:16:10.3195292Z [cluster1] },
2021-07-17T12:16:10.3195650Z [cluster1] "conditions": [
2021-07-17T12:16:10.3195996Z [cluster1] {
2021-07-17T12:16:10.3197040Z [cluster1] "lastTransitionTime": "2021-07-17T12:11:42Z",
2021-07-17T12:16:10.3197572Z [cluster1] "message": "no conflicts found",
2021-07-17T12:16:10.3198056Z [cluster1] "reason": "NoConflicts",
2021-07-17T12:16:10.3199162Z [cluster1] "status": "True",
2021-07-17T12:16:10.3199602Z [cluster1] "type": "NamesAccepted"
2021-07-17T12:16:10.3200008Z [cluster1] },
2021-07-17T12:16:10.3200312Z [cluster1] {
2021-07-17T12:16:10.3201004Z [cluster1] "lastTransitionTime": "2021-07-17T12:11:42Z",
2021-07-17T12:16:10.3201595Z [cluster1] "message": "the initial names have been accepted",
2021-07-17T12:16:10.3202214Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-17T12:16:10.3202719Z [cluster1] "status": "True",
2021-07-17T12:16:10.3203273Z [cluster1] "type": "Established"
2021-07-17T12:16:10.3203647Z [cluster1] }
2021-07-17T12:16:10.3203966Z [cluster1] ],
2021-07-17T12:16:10.3204354Z [cluster1] "storedVersions": [
2021-07-17T12:16:10.3204737Z [cluster1] "v1"
2021-07-17T12:16:10.3205058Z [cluster1] ]
2021-07-17T12:16:10.3205354Z [cluster1] }
2021-07-17T12:16:10.3205665Z [cluster1] }
2021-07-17T12:16:10.3206564Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T12:16:10.3207788Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T12:16:10.3209146Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:10.3210531Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T12:16:10.3211518Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T12:16:10.3212748Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:10.3213978Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T12:16:10.3214963Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T12:16:10.3216332Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:10.3217616Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-17T12:16:10.3218605Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-17T12:16:10.3219889Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:10.3221337Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T12:16:10.3222534Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T12:16:10.3223990Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T12:16:10.3225240Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-17T12:16:10.3226052Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-17T12:16:10.3227001Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T12:16:10.3228101Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T12:16:10.3229155Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-17T12:16:10.3230206Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-17T12:16:10.3231516Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-17T12:16:10.3232244Z [cluster1] NAME CREATED AT
2021-07-17T12:16:10.3985321Z [cluster1] clusters.submariner.io 2021-07-17T12:11:52Z
2021-07-17T12:16:10.3986468Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:10.3987730Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-17T12:16:10.3988940Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:10.3990148Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-17T12:16:10.3991323Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-17T12:16:10.3992028Z [cluster2] {
2021-07-17T12:16:10.3992495Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:10.3993165Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-17T12:16:10.3993670Z [cluster2] "metadata": {
2021-07-17T12:16:10.3994063Z [cluster2] "annotations": {
2021-07-17T12:16:10.3994850Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T12:16:10.3995546Z [cluster2] },
2021-07-17T12:16:10.3996175Z [cluster2] "creationTimestamp": "2021-07-17T12:11:52Z",
2021-07-17T12:16:10.3996649Z [cluster2] "generation": 1,
2021-07-17T12:16:10.3997077Z [cluster2] "managedFields": [
2021-07-17T12:16:10.3997446Z [cluster2] {
2021-07-17T12:16:10.3997941Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:10.3999099Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:10.3999549Z [cluster2] "fieldsV1": {
2021-07-17T12:16:10.4000136Z [cluster2] "f:metadata": {
2021-07-17T12:16:10.4000557Z [cluster2] "f:annotations": {
2021-07-17T12:16:10.4000976Z [cluster2] ".": {},
2021-07-17T12:16:10.4001827Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-17T12:16:10.4002426Z [cluster2] }
2021-07-17T12:16:10.4002758Z [cluster2] },
2021-07-17T12:16:10.4003294Z [cluster2] "f:spec": {
2021-07-17T12:16:10.4003682Z [cluster2] "f:conversion": {
2021-07-17T12:16:10.4004260Z [cluster2] ".": {},
2021-07-17T12:16:10.4004661Z [cluster2] "f:strategy": {}
2021-07-17T12:16:10.4005038Z [cluster2] },
2021-07-17T12:16:10.4005403Z [cluster2] "f:group": {},
2021-07-17T12:16:10.4005772Z [cluster2] "f:names": {
2021-07-17T12:16:10.4006153Z [cluster2] "f:kind": {},
2021-07-17T12:16:10.4006728Z [cluster2] "f:listKind": {},
2021-07-17T12:16:10.4007339Z [cluster2] "f:plural": {},
2021-07-17T12:16:10.4007754Z [cluster2] "f:singular": {}
2021-07-17T12:16:10.4008148Z [cluster2] },
2021-07-17T12:16:10.4008518Z [cluster2] "f:scope": {},
2021-07-17T12:16:10.4008939Z [cluster2] "f:versions": {}
2021-07-17T12:16:10.4009329Z [cluster2] },
2021-07-17T12:16:10.4009696Z [cluster2] "f:status": {
2021-07-17T12:16:10.4010310Z [cluster2] "f:acceptedNames": {
2021-07-17T12:16:10.4010736Z [cluster2] "f:kind": {},
2021-07-17T12:16:10.4011313Z [cluster2] "f:plural": {}
2021-07-17T12:16:10.4011664Z [cluster2] },
2021-07-17T12:16:10.4012046Z [cluster2] "f:conditions": {},
2021-07-17T12:16:10.4012487Z [cluster2] "f:storedVersions": {}
2021-07-17T12:16:10.4013023Z [cluster2] }
2021-07-17T12:16:10.4013342Z [cluster2] },
2021-07-17T12:16:10.4014011Z [cluster2] "manager": "submariner-operator",
2021-07-17T12:16:10.4014541Z [cluster2] "operation": "Update",
2021-07-17T12:16:10.4015110Z [cluster2] "time": "2021-07-17T12:12:00Z"
2021-07-17T12:16:10.4015475Z [cluster2] }
2021-07-17T12:16:10.4015780Z [cluster2] ],
2021-07-17T12:16:10.4016252Z [cluster2] "name": "clusters.submariner.io",
2021-07-17T12:16:10.4016783Z [cluster2] "resourceVersion": "1344",
2021-07-17T12:16:10.4017711Z [cluster2] "uid": "52addfe1-d468-4d53-98fc-b29adf844be8"
2021-07-17T12:16:10.4018198Z [cluster2] },
2021-07-17T12:16:10.4018529Z [cluster2] "spec": {
2021-07-17T12:16:10.4018890Z [cluster2] "conversion": {
2021-07-17T12:16:10.4019298Z [cluster2] "strategy": "None"
2021-07-17T12:16:10.4019655Z [cluster2] },
2021-07-17T12:16:10.4020165Z [cluster2] "group": "submariner.io",
2021-07-17T12:16:10.4020583Z [cluster2] "names": {
2021-07-17T12:16:10.4020949Z [cluster2] "kind": "Cluster",
2021-07-17T12:16:10.4021395Z [cluster2] "listKind": "ClusterList",
2021-07-17T12:16:10.4021836Z [cluster2] "plural": "clusters",
2021-07-17T12:16:10.4022272Z [cluster2] "singular": "cluster"
2021-07-17T12:16:10.4022634Z [cluster2] },
2021-07-17T12:16:10.4023022Z [cluster2] "scope": "Namespaced",
2021-07-17T12:16:10.4023425Z [cluster2] "versions": [
2021-07-17T12:16:10.4023775Z [cluster2] {
2021-07-17T12:16:10.4024106Z [cluster2] "name": "v1",
2021-07-17T12:16:10.4024473Z [cluster2] "schema": {
2021-07-17T12:16:10.4024909Z [cluster2] "openAPIV3Schema": {
2021-07-17T12:16:10.4025361Z [cluster2] "properties": {
2021-07-17T12:16:10.4025802Z [cluster2] "apiVersion": {
2021-07-17T12:16:10.4027615Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T12:16:10.4029188Z [cluster2] "type": "string"
2021-07-17T12:16:10.4029601Z [cluster2] },
2021-07-17T12:16:10.4029954Z [cluster2] "kind": {
2021-07-17T12:16:10.4031717Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T12:16:10.4033116Z [cluster2] "type": "string"
2021-07-17T12:16:10.4033489Z [cluster2] },
2021-07-17T12:16:10.4033868Z [cluster2] "metadata": {
2021-07-17T12:16:10.4034273Z [cluster2] "type": "object"
2021-07-17T12:16:10.4034653Z [cluster2] },
2021-07-17T12:16:10.4034997Z [cluster2] "spec": {
2021-07-17T12:16:10.4035416Z [cluster2] "properties": {
2021-07-17T12:16:10.4035855Z [cluster2] "cluster_cidr": {
2021-07-17T12:16:10.4036257Z [cluster2] "items": {
2021-07-17T12:16:10.4036673Z [cluster2] "type": "string"
2021-07-17T12:16:10.4037057Z [cluster2] },
2021-07-17T12:16:10.4037449Z [cluster2] "type": "array"
2021-07-17T12:16:10.4037934Z [cluster2] },
2021-07-17T12:16:10.4038434Z [cluster2] "cluster_id": {
2021-07-17T12:16:10.4038857Z [cluster2] "type": "string"
2021-07-17T12:16:10.4039251Z [cluster2] },
2021-07-17T12:16:10.4039638Z [cluster2] "color_codes": {
2021-07-17T12:16:10.4040035Z [cluster2] "items": {
2021-07-17T12:16:10.4040452Z [cluster2] "type": "string"
2021-07-17T12:16:10.4040836Z [cluster2] },
2021-07-17T12:16:10.4041224Z [cluster2] "type": "array"
2021-07-17T12:16:10.4041594Z [cluster2] },
2021-07-17T12:16:10.4041983Z [cluster2] "global_cidr": {
2021-07-17T12:16:10.4043360Z [cluster2] "items": {
2021-07-17T12:16:10.4043936Z [cluster2] "type": "string"
2021-07-17T12:16:10.4044448Z [cluster2] },
2021-07-17T12:16:10.4044944Z [cluster2] "type": "array"
2021-07-17T12:16:10.4045437Z [cluster2] },
2021-07-17T12:16:10.4045943Z [cluster2] "service_cidr": {
2021-07-17T12:16:10.4046772Z [cluster2] "items": {
2021-07-17T12:16:10.4047361Z [cluster2] "type": "string"
2021-07-17T12:16:10.4047758Z [cluster2] },
2021-07-17T12:16:10.4048155Z [cluster2] "type": "array"
2021-07-17T12:16:10.4048530Z [cluster2] }
2021-07-17T12:16:10.4048887Z [cluster2] },
2021-07-17T12:16:10.4049255Z [cluster2] "required": [
2021-07-17T12:16:10.4049677Z [cluster2] "cluster_cidr",
2021-07-17T12:16:10.4050082Z [cluster2] "cluster_id",
2021-07-17T12:16:10.4050501Z [cluster2] "color_codes",
2021-07-17T12:16:10.4050901Z [cluster2] "global_cidr",
2021-07-17T12:16:10.4051461Z [cluster2] "service_cidr"
2021-07-17T12:16:10.4051875Z [cluster2] ],
2021-07-17T12:16:10.4052248Z [cluster2] "type": "object"
2021-07-17T12:16:10.4052632Z [cluster2] }
2021-07-17T12:16:10.4052956Z [cluster2] },
2021-07-17T12:16:10.4053327Z [cluster2] "required": [
2021-07-17T12:16:10.4053699Z [cluster2] "spec"
2021-07-17T12:16:10.4054056Z [cluster2] ],
2021-07-17T12:16:10.4054420Z [cluster2] "type": "object"
2021-07-17T12:16:10.4054791Z [cluster2] }
2021-07-17T12:16:10.4055101Z [cluster2] },
2021-07-17T12:16:10.4055467Z [cluster2] "served": true,
2021-07-17T12:16:10.4055869Z [cluster2] "storage": true
2021-07-17T12:16:10.4056213Z [cluster2] }
2021-07-17T12:16:10.4056534Z [cluster2] ]
2021-07-17T12:16:10.4056833Z [cluster2] },
2021-07-17T12:16:10.4057166Z [cluster2] "status": {
2021-07-17T12:16:10.4057552Z [cluster2] "acceptedNames": {
2021-07-17T12:16:10.4057979Z [cluster2] "kind": "Cluster",
2021-07-17T12:16:10.4058408Z [cluster2] "listKind": "ClusterList",
2021-07-17T12:16:10.4058868Z [cluster2] "plural": "clusters",
2021-07-17T12:16:10.4059291Z [cluster2] "singular": "cluster"
2021-07-17T12:16:10.4059779Z [cluster2] },
2021-07-17T12:16:10.4060119Z [cluster2] "conditions": [
2021-07-17T12:16:10.4060482Z [cluster2] {
2021-07-17T12:16:10.4061225Z [cluster2] "lastTransitionTime": "2021-07-17T12:11:52Z",
2021-07-17T12:16:10.4061752Z [cluster2] "message": "no conflicts found",
2021-07-17T12:16:10.4062231Z [cluster2] "reason": "NoConflicts",
2021-07-17T12:16:10.4062647Z [cluster2] "status": "True",
2021-07-17T12:16:10.4063103Z [cluster2] "type": "NamesAccepted"
2021-07-17T12:16:10.7138865Z [cluste21-07-17T12:11:42Z
2021-07-17T12:16:10.7139903Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:10.7141137Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-17T12:16:10.7142469Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:10.7143632Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-17T12:16:10.7144757Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-17T12:16:10.7145408Z [cluster1] {
2021-07-17T12:16:10.7145868Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:10.7146488Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-17T12:16:10.7146968Z [cluster1] "metadata": {
2021-07-17T12:16:10.7147494Z [cluster1] "annotations": {
2021-07-17T12:16:10.7148253Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T12:16:10.7148791Z [cluster1] },
2021-07-17T12:16:10.7149340Z [cluster1] "creationTimestamp": "2021-07-17T12:11:42Z",
2021-07-17T12:16:10.7149798Z [cluster1] "generation": 1,
2021-07-17T12:16:10.7150187Z [cluster1] "managedFields": [
2021-07-17T12:16:10.7150550Z [cluster1] {
2021-07-17T12:16:10.7151007Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:10.7151548Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:10.7151963Z [cluster1] "fieldsV1": {
2021-07-17T12:16:10.7152325Z [cluster1] "f:metadata": {
2021-07-17T12:16:10.7152725Z [cluster1] "f:annotations": {
2021-07-17T12:16:10.7153084Z [cluster1] ".": {},
2021-07-17T12:16:10.7153988Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-17T12:16:10.7154551Z [cluster1] }
2021-07-17T12:16:10.7154870Z [cluster1] },
2021-07-17T12:16:10.7155300Z [cluster1] "f:spec": {
2021-07-17T12:16:10.7155691Z [cluster1] "f:conversion": {
2021-07-17T12:16:10.7156126Z [cluster1] ".": {},
2021-07-17T12:16:10.7156493Z [cluster1] "f:strategy": {}
2021-07-17T12:16:10.7156858Z [cluster1] },
2021-07-17T12:16:10.7157187Z [cluster1] "f:group": {},
2021-07-17T12:16:10.7157550Z [cluster1] "f:names": {
2021-07-17T12:16:10.7158038Z [cluster1] "f:kind": {},
2021-07-17T12:16:10.7158651Z [cluster1] "f:listKind": {},
2021-07-17T12:16:10.7159033Z [cluster1] "f:plural": {},
2021-07-17T12:16:10.7159423Z [cluster1] "f:singular": {}
2021-07-17T12:16:10.7159762Z [cluster1] },
2021-07-17T12:16:10.7160108Z [cluster1] "f:scope": {},
2021-07-17T12:16:10.7160486Z [cluster1] "f:versions": {}
2021-07-17T12:16:10.7160820Z [cluster1] },
2021-07-17T12:16:10.7161157Z [cluster1] "f:status": {
2021-07-17T12:16:10.7161550Z [cluster1] "f:acceptedNames": {
2021-07-17T12:16:10.7162097Z [cluster1] "f:kind": {},
2021-07-17T12:16:10.7162630Z [cluster1] "f:plural": {}
2021-07-17T12:16:10.7163164Z [cluster1] },
2021-07-17T12:16:10.7163726Z [cluster1] "f:conditions": {},
2021-07-17T12:16:10.7164321Z [cluster1] "f:storedVersions": {}
2021-07-17T12:16:10.7164745Z [cluster1] }
2021-07-17T12:16:10.7165075Z [cluster1] },
2021-07-17T12:16:10.7165827Z [cluster1] "manager": "submariner-operator",
2021-07-17T12:16:10.7166473Z [cluster1] "operation": "Update",
2021-07-17T12:16:10.7167415Z [cluster1] "time": "2021-07-17T12:11:46Z"
2021-07-17T12:16:10.7167745Z [cluster1] }
2021-07-17T12:16:10.7168048Z [cluster1] ],
2021-07-17T12:16:10.7168475Z [cluster1] "name": "clusters.submariner.io",
2021-07-17T12:16:10.7168989Z [cluster1] "resourceVersion": "1334",
2021-07-17T12:16:10.7169639Z [cluster1] "uid": "08261b29-f9a4-46c2-8ee0-4b7c2656c277"
2021-07-17T12:16:10.7170056Z [cluster1] },
2021-07-17T12:16:10.7170354Z [cluster1] "spec": {
2021-07-17T12:16:10.7170711Z [cluster1] "conversion": {
2021-07-17T12:16:10.7171092Z [cluster1] "strategy": "None"
2021-07-17T12:16:10.7171421Z [cluster1] },
2021-07-17T12:16:10.7171794Z [cluster1] "group": "submariner.io",
2021-07-17T12:16:10.7172168Z [cluster1] "names": {
2021-07-17T12:16:10.7172530Z [cluster1] "kind": "Cluster",
2021-07-17T12:16:10.7172997Z [cluster1] "listKind": "ClusterList",
2021-07-17T12:16:10.7174744Z [cluster1] "plural": "clusters",
2021-07-17T12:16:10.7175301Z [cluster1] "singular": "cluster"
2021-07-17T12:16:10.7175782Z [cluster1] },
2021-07-17T12:16:10.7176433Z [cluster1] "scope": "Namespaced",
2021-07-17T12:16:10.7177489Z [cluster1] "versions": [
2021-07-17T12:16:10.7178036Z [cluster1] {
2021-07-17T12:16:10.7178382Z [cluster1] "name": "v1",
2021-07-17T12:16:10.7178769Z [cluster1] "schema": {
2021-07-17T12:16:10.7179216Z [cluster1] "openAPIV3Schema": {
2021-07-17T12:16:10.7179709Z [cluster1] "properties": {
2021-07-17T12:16:10.7180157Z [cluster1] "apiVersion": {
2021-07-17T12:16:10.7182604Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T12:16:10.7183969Z [cluster1] "type": "string"
2021-07-17T12:16:10.7184322Z [cluster1] },
2021-07-17T12:16:10.7184667Z [cluster1] "kind": {
2021-07-17T12:16:10.7186321Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T12:16:10.7187812Z [cluster1] "type": "string"
2021-07-17T12:16:10.7188185Z [cluster1] },
2021-07-17T12:16:10.7188532Z [cluster1] "metadata": {
2021-07-17T12:16:10.7188931Z [cluster1] "type": "object"
2021-07-17T12:16:10.7189278Z [cluster1] },
2021-07-17T12:16:10.7189623Z [cluster1] "spec": {
2021-07-17T12:16:10.7190010Z [cluster1] "properties": {
2021-07-17T12:16:10.7190413Z [cluster1] "cluster_cidr": {
2021-07-17T12:16:10.7190920Z [cluster1] "items": {
2021-07-17T12:16:10.7191304Z [cluster1] "type": "string"
2021-07-17T12:16:10.7191684Z [cluster1] },
2021-07-17T12:16:10.7192046Z [cluster1] "type": "array"
2021-07-17T12:16:10.7192414Z [cluster1] },
2021-07-17T12:16:10.7192786Z [cluster1] "cluster_id": {
2021-07-17T12:16:10.7193177Z [cluster1] "type": "string"
2021-07-17T12:16:10.7193551Z [cluster1] },
2021-07-17T12:16:10.7193903Z [cluster1] "color_codes": {
2021-07-17T12:16:10.7194284Z [cluster1] "items": {
2021-07-17T12:16:10.7194662Z [cluster1] "type": "string"
2021-07-17T12:16:10.7195044Z [cluster1] },
2021-07-17T12:16:10.7195402Z [cluster1] "type": "array"
2021-07-17T12:16:10.7195771Z [cluster1] },
2021-07-17T12:16:10.7196137Z [cluster1] "global_cidr": {
2021-07-17T12:16:10.7196510Z [cluster1] "items": {
2021-07-17T12:16:10.7196905Z [cluster1] "type": "string"
2021-07-17T12:16:10.7197267Z [cluster1] },
2021-07-17T12:16:10.7197636Z [cluster1] "type": "array"
2021-07-17T12:16:10.7197986Z [cluster1] },
2021-07-17T12:16:10.7198453Z [cluster1] "service_cidr": {
2021-07-17T12:16:10.7198836Z [cluster1] "items": {
2021-07-17T12:16:10.7210174Z [cluster1] "type": "string"
2021-07-17T12:16:10.7210594Z [cluster1] },
2021-07-17T12:16:10.7210958Z [cluster1] "type": "array"
2021-07-17T12:16:10.7211327Z [cluster1] }
2021-07-17T12:16:10.7211644Z [cluster1] },
2021-07-17T12:16:10.7212006Z [cluster1] "required": [
2021-07-17T12:16:10.7212535Z [cluster1] "cluster_cidr",
2021-07-17T12:16:10.7212961Z [cluster1] "cluster_id",
2021-07-17T12:16:10.7213345Z [cluster1] "color_codes",
2021-07-17T12:16:10.7213743Z [cluster1] "global_cidr",
2021-07-17T12:16:10.7214143Z [cluster1] "service_cidr"
2021-07-17T12:16:10.7214492Z [cluster1] ],
2021-07-17T12:16:10.7214868Z [cluster1] "type": "object"
2021-07-17T12:16:10.7215215Z [cluster1] }
2021-07-17T12:16:10.7215535Z [cluster1] },
2021-07-17T12:16:10.7215872Z [cluster1] "required": [
2021-07-17T12:16:10.7216237Z [cluster1] "spec"
2021-07-17T12:16:10.7216553Z [cluster1] ],
2021-07-17T12:16:10.7216908Z [cluster1] "type": "object"
2021-07-17T12:16:10.7217261Z [cluster1] }
2021-07-17T12:16:10.7217556Z [cluster1] },
2021-07-17T12:16:10.7217902Z [cluster1] "served": true,
2021-07-17T12:16:10.7218267Z [cluster1] "storage": true
2021-07-17T12:16:10.7218609Z [cluster1] }
2021-07-17T12:16:10.7218897Z [cluster1] ]
2021-07-17T12:16:10.7219191Z [cluster1] },
2021-07-17T12:16:10.7219490Z [cluster1] "status": {
2021-07-17T12:16:10.7219869Z [cluster1] "acceptedNames": {
2021-07-17T12:16:10.7220352Z [cluster1] "kind": "Cluster",
2021-07-17T12:16:10.7220775Z [cluster1] "listKind": "ClusterList",
2021-07-17T12:16:10.7221197Z [cluster1] "plural": "clusters",
2021-07-17T12:16:10.7221609Z [cluster1] "singular": "cluster"
2021-07-17T12:16:10.7221964Z [cluster1] },
2021-07-17T12:16:10.7222289Z [cluster1] "conditions": [
2021-07-17T12:16:10.7222628Z [cluster1] {
2021-07-17T12:16:10.7223343Z [cluster1] "lastTransitionTime": "2021-07-17T12:11:42Z",
2021-07-17T12:16:10.7223856Z [cluster1] "message": "no conflicts found",
2021-07-17T12:16:10.7224295Z [cluster1] "reason": "NoConflicts",
2021-07-17T12:16:10.7224702Z [cluster1] "status": "True",
2021-07-17T12:16:10.7225111Z [cluster1] "type": "NamesAccepted"
2021-07-17T12:16:11.4039831Z [cluster2] },
2021-07-17T12:16:11.4040202Z [cluster2] {
2021-07-17T12:16:11.4041306Z [cluster2] "lastTransitionTime": "2021-07-17T12:11:52Z",
2021-07-17T12:16:11.4041906Z [cluster2] "message": "the initial names have been accepted",
2021-07-17T12:16:11.4042685Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-17T12:16:11.4043172Z [cluster2] "status": "True",
2021-07-17T12:16:11.4044681Z [cluster2] "type": "Established"
2021-07-17T12:16:11.4045194Z [cluster2] }
2021-07-17T12:16:11.4045605Z [cluster2] ],
2021-07-17T12:16:11.4046110Z [cluster2] "storedVersions": [
2021-07-17T12:16:11.4046599Z [cluster2] "v1"
2021-07-17T12:16:11.4047307Z [cluster2] ]
2021-07-17T12:16:11.4047592Z [cluster2] }
2021-07-17T12:16:11.4047888Z [cluster2] }
2021-07-17T12:16:11.4048781Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-17T12:16:11.4049911Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-17T12:16:11.4051636Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:11.4052883Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T12:16:11.4053893Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T12:16:11.4055446Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:11.4056672Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T12:16:11.4057620Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T12:16:11.4058768Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:11.4059912Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-17T12:16:11.4060852Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-17T12:16:11.4062039Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:11.4063285Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T12:16:11.4064417Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T12:16:11.4065795Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-17T12:16:11.4066928Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-17T12:16:11.4067654Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-17T12:16:11.4068659Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T12:16:11.4069854Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T12:16:11.4071115Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T12:16:11.4072171Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T12:16:11.4073328Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-17T12:16:11.4074048Z [cluster2] NAME CREATED AT
2021-07-17T12:16:11.4074719Z [cluster2] submariners.submariner.io 2021-07-17T12:11:41Z
2021-07-17T12:16:11.4075800Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-17T12:16:11.4077033Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-17T12:16:11.4078253Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-17T12:16:11.4079647Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-17T12:16:11.4080844Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-17T12:16:11.4081519Z [cluster2] {
2021-07-17T12:16:11.4081975Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:11.4082579Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-17T12:16:11.4083073Z [cluster2] "metadata": {
2021-07-17T12:16:11.4083436Z [cluster2] "annotations": {
2021-07-17T12:16:11.4084181Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T12:16:11.4084718Z [cluster2] },
2021-07-17T12:16:11.4085270Z [cluster2] "creationTimestamp": "2021-07-17T12:11:41Z",
2021-07-17T12:16:11.4085728Z [cluster2] "generation": 2,
2021-07-17T12:16:11.4086115Z [cluster2] "managedFields": [
2021-07-17T12:16:11.4086477Z [cluster2] {
2021-07-17T12:16:11.4086925Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:11.4087471Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:11.4087870Z [cluster2] "fieldsV1": {
2021-07-17T12:16:11.4088248Z [cluster2] "f:metadata": {
2021-07-17T12:16:11.4088633Z [cluster2] "f:annotations": {
2021-07-17T12:16:11.4089008Z [cluster2] ".": {},
2021-07-17T12:16:11.4089846Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-17T12:16:11.4090402Z [cluster2] }
2021-07-17T12:16:11.4090720Z [cluster2] },
2021-07-17T12:16:11.4091045Z [cluster2] "f:spec": {
2021-07-17T12:16:11.4091428Z [cluster2] "f:conversion": {
2021-07-17T12:16:11.4091784Z [cluster2] ".": {},
2021-07-17T12:16:11.4092148Z [cluster2] "f:strategy": {}
2021-07-17T12:16:11.4092495Z [cluster2] },
2021-07-17T12:16:11.4092840Z [cluster2] "f:group": {},
2021-07-17T12:16:11.4093187Z [cluster2] "f:names": {
2021-07-17T12:16:11.4093550Z [cluster2] "f:kind": {},
2021-07-17T12:16:11.4093929Z [cluster2] "f:listKind": {},
2021-07-17T12:16:11.4094304Z [cluster2] "f:plural": {},
2021-07-17T12:16:11.4094693Z [cluster2] "f:singular": {}
2021-07-17T12:16:11.4095217Z [cluster2] },
2021-07-17T12:16:11.4095584Z [cluster2] "f:scope": {},
2021-07-17T12:16:11.4096148Z [cluster2] "f:versions": {}
2021-07-17T12:16:11.4096531Z [cluster2] },
2021-07-17T12:16:11.4096883Z [cluster2] "f:status": {
2021-07-17T12:16:11.4097331Z [cluster2] "f:acceptedNames": {
2021-07-17T12:16:11.4097773Z [cluster2] "f:kind": {},
2021-07-17T12:16:11.4098265Z [cluster2] "f:plural": {}
2021-07-17T12:16:11.4098813Z [cluster2] },
2021-07-17T12:16:11.4099181Z [cluster2] "f:conditions": {},
2021-07-17T12:16:11.4099796Z [cluster2] "f:storedVersions": {}
2021-07-17T12:16:11.4100168Z [cluster2] }
2021-07-17T12:16:11.4100480Z [cluster2] },
2021-07-17T12:16:11.4100829Z [cluster2] "manager": "subctl",
2021-07-17T12:16:11.4101250Z [cluster2] "operation": "Update",
2021-07-17T12:16:11.4101830Z [cluster2] "time": "2021-07-17T12:14:38Z"
2021-07-17T12:16:11.4102182Z [cluster2] }
2021-07-17T12:16:11.4102485Z [cluster2] ],
2021-07-17T12:16:11.4102939Z [cluster2] "name": "submariners.submariner.io",
2021-07-17T12:16:11.4103485Z [cluster2] "resourceVersion": "1953",
2021-07-17T12:16:11.4104134Z [cluster2] "uid": "a5658763-242d-431c-a4cd-579f6d63598c"
2021-07-17T12:16:11.4104546Z [cluster2] },
2021-07-17T12:16:11.4104848Z [cluster2] "spec": {
2021-07-17T12:16:11.4105247Z [cluster2] "conversion": {
2021-07-17T12:16:11.4105625Z [cluster2] "strategy": "None"
2021-07-17T12:16:11.4105972Z [cluster2] },
2021-07-17T12:16:11.4106339Z [cluster2] "group": "submariner.io",
2021-07-17T12:16:11.4106730Z [cluster2] "names": {
2021-07-17T12:16:11.4107093Z [cluster2] "kind": "Submariner",
2021-07-17T12:16:11.4107553Z [cluster2] "listKind": "SubmarinerList",
2021-07-17T12:16:11.4108023Z [cluster2] "plural": "submariners",
2021-07-17T12:16:11.4108448Z [cluster2] "singular": "submariner"
2021-07-17T12:16:11.4108817Z [cluster2] },
2021-07-17T12:16:11.4109167Z [cluster2] "scope": "Namespaced",
2021-07-17T12:16:11.4109562Z [cluster2] "versions": [
2021-07-17T12:16:11.4109881Z [cluster2] {
2021-07-17T12:16:11.4110239Z [cluster2] "name": "v1alpha1",
2021-07-17T12:16:11.4110599Z [cluster2] "schema": {
2021-07-17T12:16:11.4111012Z [cluster2] "openAPIV3Schema": {
2021-07-17T12:16:11.4111581Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-17T12:16:11.4112136Z [cluster2] "properties": {
2021-07-17T12:16:11.4112630Z [cluster2] "apiVersion": {
2021-07-17T12:16:11.4114586Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T12:16:11.4115937Z [cluster2] "type": "string"
2021-07-17T12:16:11.4116315Z [cluster2] },
2021-07-17T12:16:11.4116646Z [cluster2] "kind": {
2021-07-17T12:16:11.4118290Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T12:16:11.4157839Z [cluster2] "type": "string"
2021-07-17T12:16:11.4158212Z [cluster2] },
2021-07-17T12:16:11.4158740Z [cluster2] "metadata": {
2021-07-17T12:16:11.4159126Z [cluster2] "type": "object"
2021-07-17T12:16:11.4159495Z [cluster2] },
2021-07-17T12:16:11.4159829Z [cluster2] "spec": {
2021-07-17T12:16:11.4160411Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-17T12:16:11.4161202Z [cluster2] "properties": {
2021-07-17T12:16:11.4161590Z [cluster2] "broker": {
2021-07-17T12:16:11.4161987Z [cluster2] "type": "string"
2021-07-17T12:16:11.4162354Z [cluster2] },
2021-07-17T12:16:11.4162800Z [cluster2] "brokerK8sApiServer": {
2021-07-17T12:16:11.4163259Z [cluster2] "type": "string"
2021-07-17T12:16:11.4163632Z [cluster2] },
2021-07-17T12:16:11.4164269Z [cluster2] "brokerK8sApiServerToken": {
2021-07-17T12:16:11.4164773Z [cluster2] "type": "string"
2021-07-17T12:16:11.4165147Z [cluster2] },
2021-07-17T12:16:11.4165525Z [cluster2] "brokerK8sCA": {
2021-07-17T12:16:11.4165947Z [cluster2] "type": "string"
2021-07-17T12:16:11.4166308Z [cluster2] },
2021-07-17T12:16:11.4166835Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-17T12:16:11.4167351Z [cluster2] "type": "string"
2021-07-17T12:16:11.4167729Z [cluster2] },
2021-07-17T12:16:11.4168115Z [cluster2] "cableDriver": {
2021-07-17T12:16:11.4168520Z [cluster2] "type": "string"
2021-07-17T12:16:11.4168888Z [cluster2] },
2021-07-17T12:16:11.4169269Z [cluster2] "ceIPSecDebug": {
2021-07-17T12:16:11.4169706Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4170079Z [cluster2] },
2021-07-17T12:16:11.4170552Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-17T12:16:11.4171053Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4171437Z [cluster2] },
2021-07-17T12:16:11.4171848Z [cluster2] "ceIPSecIKEPort": {
2021-07-17T12:16:11.4172384Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4172788Z [cluster2] },
2021-07-17T12:16:11.4173192Z [cluster2] "ceIPSecNATTPort": {
2021-07-17T12:16:11.4173651Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4174017Z [cluster2] },
2021-07-17T12:16:11.4174403Z [cluster2] "ceIPSecPSK": {
2021-07-17T12:16:11.4174807Z [cluster2] "type": "string"
2021-07-17T12:16:11.4175187Z [cluster2] },
2021-07-17T12:16:11.4175671Z [cluster2] "ceIPSecPreferredServer": {
2021-07-17T12:16:11.4176182Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4176562Z [cluster2] },
2021-07-17T12:16:11.4176935Z [cluster2] "clusterCIDR": {
2021-07-17T12:16:11.4177359Z [cluster2] "type": "string"
2021-07-17T12:16:11.4177716Z [cluster2] },
2021-07-17T12:16:11.4178088Z [cluster2] "clusterID": {
2021-07-17T12:16:11.4178496Z [cluster2] "type": "string"
2021-07-17T12:16:11.4178850Z [cluster2] },
2021-07-17T12:16:11.4179230Z [cluster2] "colorCodes": {
2021-07-17T12:16:11.4179712Z [cluster2] "type": "string"
2021-07-17T12:16:11.4180082Z [cluster2] },
2021-07-17T12:16:11.4180528Z [cluster2] "connectionHealthCheck": {
2021-07-17T12:16:11.4181038Z [cluster2] "properties": {
2021-07-17T12:16:11.4181438Z [cluster2] "enabled": {
2021-07-17T12:16:11.4181861Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4182255Z [cluster2] },
2021-07-17T12:16:11.4182662Z [cluster2] "intervalSeconds": {
2021-07-17T12:16:11.4183256Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-17T12:16:11.4183793Z [cluster2] "format": "int64",
2021-07-17T12:16:11.4184225Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4184597Z [cluster2] },
2021-07-17T12:16:11.4185040Z [cluster2] "maxPacketLossCount": {
2021-07-17T12:16:11.4185776Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-17T12:16:11.4186427Z [cluster2] "format": "int64",
2021-07-17T12:16:11.4186853Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4187228Z [cluster2] }
2021-07-17T12:16:11.4187572Z [cluster2] },
2021-07-17T12:16:11.4187949Z [cluster2] "type": "object"
2021-07-17T12:16:11.4188315Z [cluster2] },
2021-07-17T12:16:11.4188759Z [cluster2] "coreDNSCustomConfig": {
2021-07-17T12:16:11.4189237Z [cluster2] "properties": {
2021-07-17T12:16:11.4189681Z [cluster2] "configMapName": {
2021-07-17T12:16:11.4190104Z [cluster2] "type": "string"
2021-07-17T12:16:11.4190553Z [cluster2] },
2021-07-17T12:16:11.4190959Z [cluster2] "namespace": {
2021-07-17T12:16:11.4191363Z [cluster2] "type": "string"
2021-07-17T12:16:11.4191744Z [cluster2] }
2021-07-17T12:16:11.4192072Z [cluster2] },
2021-07-17T12:16:11.4192450Z [cluster2] "type": "object"
2021-07-17T12:16:11.4192809Z [cluster2] },
2021-07-17T12:16:11.4193206Z [cluster2] "customDomains": {
2021-07-17T12:16:11.4193603Z [cluster2] "items": {
2021-07-17T12:16:11.4194003Z [cluster2] "type": "string"
2021-07-17T12:16:11.4194379Z [cluster2] },
2021-07-17T12:16:11.4194742Z [cluster2] "type": "array",
2021-07-17T12:16:11.4195557Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-17T12:16:11.4196018Z [cluster2] },
2021-07-17T12:16:11.4196376Z [cluster2] "debug": {
2021-07-17T12:16:11.4196758Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4197134Z [cluster2] },
2021-07-17T12:16:11.4197605Z [cluster2] "globalCIDR": {
2021-07-17T12:16:11.4198022Z [cluster2] "type": "string"
2021-07-17T12:16:11.4223960Z [cluster2] },
2021-07-17T12:16:11.4224417Z [cluster2] "imageOverrides": {
2021-07-17T12:16:11.4224978Z [cluster2] "additionalProperties": {
2021-07-17T12:16:11.4225497Z [cluster2] "type": "string"
2021-07-17T12:16:11.4225902Z [cluster2] },
2021-07-17T12:16:11.4226290Z [cluster2] "type": "object"
2021-07-17T12:16:11.4226684Z [cluster2] },
2021-07-17T12:16:11.4227295Z [cluster2] "loadBalancerEnabled": {
2021-07-17T12:16:11.4227767Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4228152Z [cluster2] },
2021-07-17T12:16:11.4228517Z [cluster2] "namespace": {
2021-07-17T12:16:11.4228927Z [cluster2] "type": "string"
2021-07-17T12:16:11.4229283Z [cluster2] },
2021-07-17T12:16:11.4229662Z [cluster2] "natEnabled": {
2021-07-17T12:16:11.4230068Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4230450Z [cluster2] },
2021-07-17T12:16:11.4230831Z [cluster2] "repository": {
2021-07-17T12:16:11.4231228Z [cluster2] "type": "string"
2021-07-17T12:16:11.4231601Z [cluster2] },
2021-07-17T12:16:11.4231972Z [cluster2] "serviceCIDR": {
2021-07-17T12:16:11.4232392Z [cluster2] "type": "string"
2021-07-17T12:16:11.4232752Z [cluster2] },
2021-07-17T12:16:11.4233231Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-17T12:16:11.4233740Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4234119Z [cluster2] },
2021-07-17T12:16:11.4234481Z [cluster2] "version": {
2021-07-17T12:16:11.4234989Z [cluster2] "type": "string"
2021-07-17T12:16:11.4235388Z [cluster2] }
2021-07-17T12:16:11.4235706Z [cluster2] },
2021-07-17T12:16:11.4236071Z [cluster2] "required": [
2021-07-17T12:16:11.4236442Z [cluster2] "broker",
2021-07-17T12:16:11.4236900Z [cluster2] "brokerK8sApiServer",
2021-07-17T12:16:11.4237460Z [cluster2] "brokerK8sApiServerToken",
2021-07-17T12:16:11.4237988Z [cluster2] "brokerK8sCA",
2021-07-17T12:16:11.4238630Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-17T12:16:11.4239168Z [cluster2] "ceIPSecDebug",
2021-07-17T12:16:11.4239610Z [cluster2] "ceIPSecPSK",
2021-07-17T12:16:11.4240028Z [cluster2] "clusterCIDR",
2021-07-17T12:16:11.4240442Z [cluster2] "clusterID",
2021-07-17T12:16:11.4240817Z [cluster2] "debug",
2021-07-17T12:16:11.4241212Z [cluster2] "namespace",
2021-07-17T12:16:11.4241626Z [cluster2] "natEnabled",
2021-07-17T12:16:11.4242033Z [cluster2] "serviceCIDR"
2021-07-17T12:16:11.4242412Z [cluster2] ],
2021-07-17T12:16:11.4242869Z [cluster2] "type": "object"
2021-07-17T12:16:11.4243237Z [cluster2] },
2021-07-17T12:16:11.4243568Z [cluster2] "status": {
2021-07-17T12:16:11.4244170Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-17T12:16:11.4245818Z [cluster2] "properties": {
2021-07-17T12:16:11.4246464Z [cluster2] "clusterCIDR": {
2021-07-17T12:16:11.4247040Z [cluster2] "type": "string"
2021-07-17T12:16:11.4247535Z [cluster2] },
2021-07-17T12:16:11.4248049Z [cluster2] "clusterID": {
2021-07-17T12:16:11.4249019Z [cluster2] "type": "string"
2021-07-17T12:16:11.4249392Z [cluster2] },
2021-07-17T12:16:11.4249762Z [cluster2] "colorCodes": {
2021-07-17T12:16:11.4250175Z [cluster2] "type": "string"
2021-07-17T12:16:11.4250532Z [cluster2] },
2021-07-17T12:16:11.4250939Z [cluster2] "deploymentInfo": {
2021-07-17T12:16:11.4251395Z [cluster2] "properties": {
2021-07-17T12:16:11.4251830Z [cluster2] "cloudProvider": {
2021-07-17T12:16:11.4252275Z [cluster2] "type": "string"
2021-07-17T12:16:11.4252644Z [cluster2] },
2021-07-17T12:16:11.4253066Z [cluster2] "kubernetesType": {
2021-07-17T12:16:11.4253502Z [cluster2] "type": "string"
2021-07-17T12:16:11.4254049Z [cluster2] },
2021-07-17T12:16:11.4254530Z [cluster2] "kubernetesTypeVersion": {
2021-07-17T12:16:11.4255024Z [cluster2] "type": "string"
2021-07-17T12:16:11.4255410Z [cluster2] },
2021-07-17T12:16:11.4255836Z [cluster2] "kubernetesVersion": {
2021-07-17T12:16:11.4256438Z [cluster2] "type": "string"
2021-07-17T12:16:11.4256831Z [cluster2] }
2021-07-17T12:16:11.4257181Z [cluster2] },
2021-07-17T12:16:11.4257549Z [cluster2] "type": "object"
2021-07-17T12:16:11.4257926Z [cluster2] },
2021-07-17T12:16:11.4258403Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-17T12:16:11.4258913Z [cluster2] "properties": {
2021-07-17T12:16:11.4259408Z [cluster2] "lastResourceVersion": {
2021-07-17T12:16:11.4259881Z [cluster2] "type": "string"
2021-07-17T12:16:11.4260260Z [cluster2] },
2021-07-17T12:16:11.4260759Z [cluster2] "mismatchedContainerImages": {
2021-07-17T12:16:11.4261318Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4261707Z [cluster2] },
2021-07-17T12:16:11.4262181Z [cluster2] "nonReadyContainerStates": {
2021-07-17T12:16:11.4262692Z [cluster2] "items": {
2021-07-17T12:16:11.4263610Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T12:16:11.4264664Z [cluster2] "properties": {
2021-07-17T12:16:11.4265137Z [cluster2] "running": {
2021-07-17T12:16:11.4265659Z [cluster2] "description": "Details about a running container",
2021-07-17T12:16:11.4266212Z [cluster2] "properties": {
2021-07-17T12:16:11.4266666Z [cluster2] "startedAt": {
2021-07-17T12:16:11.4267572Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-17T12:16:11.4268338Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4268791Z [cluster2] "type": "string"
2021-07-17T12:16:11.4269195Z [cluster2] }
2021-07-17T12:16:11.4269565Z [cluster2] },
2021-07-17T12:16:11.4269950Z [cluster2] "type": "object"
2021-07-17T12:16:11.4270351Z [cluster2] },
2021-07-17T12:16:11.4270737Z [cluster2] "terminated": {
2021-07-17T12:16:11.4271297Z [cluster2] "description": "Details about a terminated container",
2021-07-17T12:16:11.4271844Z [cluster2] "properties": {
2021-07-17T12:16:11.4272299Z [cluster2] "containerID": {
2021-07-17T12:16:11.4273166Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T12:16:11.4273764Z [cluster2] "type": "string"
2021-07-17T12:16:11.4274180Z [cluster2] },
2021-07-17T12:16:11.4274666Z [cluster2] "exitCode": {
2021-07-17T12:16:11.4275279Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-17T12:16:11.4275871Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4276303Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4276720Z [cluster2] },
2021-07-17T12:16:11.4277129Z [cluster2] "finishedAt": {
2021-07-17T12:16:11.4277690Z [cluster2] "description": "Time at which the container last terminated",
2021-07-17T12:16:11.4318740Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4319224Z [cluster2] "type": "string"
2021-07-17T12:16:11.4319751Z [cluster2] },
2021-07-17T12:16:11.4320135Z [cluster2] "message": {
2021-07-17T12:16:11.4320743Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-17T12:16:11.4321514Z [cluster2] "type": "string"
2021-07-17T12:16:11.4321903Z [cluster2] },
2021-07-17T12:16:11.4322293Z [cluster2] "reason": {
2021-07-17T12:16:11.4322872Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-17T12:16:11.4323472Z [cluster2] "type": "string"
2021-07-17T12:16:11.4323870Z [cluster2] },
2021-07-17T12:16:11.4324250Z [cluster2] "signal": {
2021-07-17T12:16:11.4324988Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-17T12:16:11.4325589Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4326121Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4326553Z [cluster2] },
2021-07-17T12:16:11.4326966Z [cluster2] "startedAt": {
2021-07-17T12:16:11.4327615Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-17T12:16:11.4328830Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4329313Z [cluster2] "type": "string"
2021-07-17T12:16:11.4329727Z [cluster2] }
2021-07-17T12:16:11.4330078Z [cluster2] },
2021-07-17T12:16:11.4330482Z [cluster2] "required": [
2021-07-17T12:16:11.4330898Z [cluster2] "exitCode"
2021-07-17T12:16:11.4331393Z [cluster2] ],
2021-07-17T12:16:11.4331803Z [cluster2] "type": "object"
2021-07-17T12:16:11.4332201Z [cluster2] },
2021-07-17T12:16:11.4332585Z [cluster2] "waiting": {
2021-07-17T12:16:11.4333096Z [cluster2] "description": "Details about a waiting container",
2021-07-17T12:16:11.4333653Z [cluster2] "properties": {
2021-07-17T12:16:11.4334072Z [cluster2] "message": {
2021-07-17T12:16:11.4334664Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-17T12:16:11.4335251Z [cluster2] "type": "string"
2021-07-17T12:16:11.4335656Z [cluster2] },
2021-07-17T12:16:11.4336042Z [cluster2] "reason": {
2021-07-17T12:16:11.4336577Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-17T12:16:11.4337145Z [cluster2] "type": "string"
2021-07-17T12:16:11.4337618Z [cluster2] }
2021-07-17T12:16:11.4337990Z [cluster2] },
2021-07-17T12:16:11.4338393Z [cluster2] "type": "object"
2021-07-17T12:16:11.4338773Z [cluster2] }
2021-07-17T12:16:11.4339134Z [cluster2] },
2021-07-17T12:16:11.4339513Z [cluster2] "type": "object"
2021-07-17T12:16:11.4339961Z [cluster2] },
2021-07-17T12:16:11.4340438Z [cluster2] "type": "array"
2021-07-17T12:16:11.4340839Z [cluster2] },
2021-07-17T12:16:11.4341266Z [cluster2] "status": {
2021-07-17T12:16:11.4341968Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T12:16:11.4342626Z [cluster2] "properties": {
2021-07-17T12:16:11.4343170Z [cluster2] "collisionCount": {
2021-07-17T12:16:11.4344203Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T12:16:11.4345250Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4354541Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4355160Z [cluster2] },
2021-07-17T12:16:11.4355859Z [cluster2] "conditions": {
2021-07-17T12:16:11.4357972Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T12:16:11.4359350Z [cluster2] "items": {
2021-07-17T12:16:11.4360761Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T12:16:11.4361637Z [cluster2] "properties": {
2021-07-17T12:16:11.4362746Z [cluster2] "lastTransitionTime": {
2021-07-17T12:16:11.4363885Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T12:16:11.4365409Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4366055Z [cluster2] "type": "string"
2021-07-17T12:16:11.4367603Z [cluster2] },
2021-07-17T12:16:11.4368471Z [cluster2] "message": {
2021-07-17T12:16:11.4369928Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-17T12:16:11.4370957Z [cluster2] "type": "string"
2021-07-17T12:16:11.4371874Z [cluster2] },
2021-07-17T12:16:11.4415203Z [cluster2] "reason": {
2021-07-17T12:16:11.4416286Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-17T12:16:11.4416871Z [cluster2] "type": "string"
2021-07-17T12:16:11.4417259Z [cluster2] },
2021-07-17T12:16:11.4417648Z [cluster2] "status": {
2021-07-17T12:16:11.4418210Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T12:16:11.4418794Z [cluster2] "type": "string"
2021-07-17T12:16:11.4419199Z [cluster2] },
2021-07-17T12:16:11.4419568Z [cluster2] "type": {
2021-07-17T12:16:11.4420088Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-17T12:16:11.4420603Z [cluster2] "type": "string"
2021-07-17T12:16:11.4421003Z [cluster2] }
2021-07-17T12:16:11.4421369Z [cluster2] },
2021-07-17T12:16:11.4421750Z [cluster2] "required": [
2021-07-17T12:16:11.4422166Z [cluster2] "status",
2021-07-17T12:16:11.4422552Z [cluster2] "type"
2021-07-17T12:16:11.4422932Z [cluster2] ],
2021-07-17T12:16:11.4423317Z [cluster2] "type": "object"
2021-07-17T12:16:11.4423714Z [cluster2] },
2021-07-17T12:16:11.4424106Z [cluster2] "type": "array"
2021-07-17T12:16:11.4424476Z [cluster2] },
2021-07-17T12:16:11.4424966Z [cluster2] "currentNumberScheduled": {
2021-07-17T12:16:11.4426291Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4427501Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4427968Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4428389Z [cluster2] },
2021-07-17T12:16:11.4428905Z [cluster2] "desiredNumberScheduled": {
2021-07-17T12:16:11.4430198Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4431190Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4431629Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4432028Z [cluster2] },
2021-07-17T12:16:11.4432437Z [cluster2] "numberAvailable": {
2021-07-17T12:16:11.4433342Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.4434294Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4434727Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4435114Z [cluster2] },
2021-07-17T12:16:11.4435569Z [cluster2] "numberMisscheduled": {
2021-07-17T12:16:11.4436566Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4437508Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4437932Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4438432Z [cluster2] },
2021-07-17T12:16:11.4438849Z [cluster2] "numberReady": {
2021-07-17T12:16:11.4439555Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T12:16:11.4440254Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4440671Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4441066Z [cluster2] },
2021-07-17T12:16:11.4441490Z [cluster2] "numberUnavailable": {
2021-07-17T12:16:11.4442395Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.4443418Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4443853Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4444724Z [cluster2] },
2021-07-17T12:16:11.4445232Z [cluster2] "observedGeneration": {
2021-07-17T12:16:11.4446002Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T12:16:11.4448027Z [cluster2] "format": "int64",
2021-07-17T12:16:11.4448618Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4449171Z [cluster2] },
2021-07-17T12:16:11.4449825Z [cluster2] "updatedNumberScheduled": {
2021-07-17T12:16:11.4450999Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T12:16:11.4451638Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4452088Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4452521Z [cluster2] }
2021-07-17T12:16:11.4452890Z [cluster2] },
2021-07-17T12:16:11.4453476Z [cluster2] "required": [
2021-07-17T12:16:11.4454358Z [cluster2] "currentNumberScheduled",
2021-07-17T12:16:11.4456198Z [cluster2] "desiredNumberScheduled",
2021-07-17T12:16:11.4457864Z [cluster2] "numberMisscheduled",
2021-07-17T12:16:11.4458536Z [cluster2] "numberReady"
2021-07-17T12:16:11.4459214Z [cluster2] ],
2021-07-17T12:16:11.4460022Z [cluster2] "type": "object"
2021-07-17T12:16:11.4460932Z [cluster2] }
2021-07-17T12:16:11.4461262Z [cluster2] },
2021-07-17T12:16:11.4461635Z [cluster2] "required": [
2021-07-17T12:16:11.4462174Z [cluster2] "mismatchedContainerImages"
2021-07-17T12:16:11.4462662Z [cluster2] ],
2021-07-17T12:16:11.4463047Z [cluster2] "type": "object"
2021-07-17T12:16:11.4463577Z [cluster2] },
2021-07-17T12:16:11.4463964Z [cluster2] "gateways": {
2021-07-17T12:16:11.4464357Z [cluster2] "items": {
2021-07-17T12:16:11.4464785Z [cluster2] "properties": {
2021-07-17T12:16:11.4465233Z [cluster2] "connections": {
2021-07-17T12:16:11.4465671Z [cluster2] "items": {
2021-07-17T12:16:11.4466111Z [cluster2] "properties": {
2021-07-17T12:16:11.4466560Z [cluster2] "endpoint": {
2021-07-17T12:16:11.4467026Z [cluster2] "properties": {
2021-07-17T12:16:11.4467618Z [cluster2] "backend": {
2021-07-17T12:16:11.4468064Z [cluster2] "type": "string"
2021-07-17T12:16:11.4468465Z [cluster2] },
2021-07-17T12:16:11.4469055Z [cluster2] "backend_config": {
2021-07-17T12:16:11.4469705Z [cluster2] "additionalProperties": {
2021-07-17T12:16:11.4470267Z [cluster2] "type": "string"
2021-07-17T12:16:11.4470699Z [cluster2] },
2021-07-17T12:16:11.4471118Z [cluster2] "type": "object"
2021-07-17T12:16:11.4471595Z [cluster2] },
2021-07-17T12:16:11.4472016Z [cluster2] "cable_name": {
2021-07-17T12:16:11.4472607Z [cluster2] "type": "string"
2021-07-17T12:16:11.4473026Z [cluster2] },
2021-07-17T12:16:11.4473427Z [cluster2] "cluster_id": {
2021-07-17T12:16:11.4473872Z [cluster2] "type": "string"
2021-07-17T12:16:11.4474275Z [cluster2] },
2021-07-17T12:16:11.4474719Z [cluster2] "healthCheckIP": {
2021-07-17T12:16:11.4475197Z [cluster2] "type": "string"
2021-07-17T12:16:11.4475692Z [cluster2] },
2021-07-17T12:16:11.4476107Z [cluster2] "hostname": {
2021-07-17T12:16:11.4476539Z [cluster2] "type": "string"
2021-07-17T12:16:11.4476959Z [cluster2] },
2021-07-17T12:16:11.4477373Z [cluster2] "nat_enabled": {
2021-07-17T12:16:11.4477919Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4509551Z [cluster2] },
2021-07-17T12:16:11.4510014Z [cluster2] "private_ip": {
2021-07-17T12:16:11.4510471Z [cluster2] "type": "string"
2021-07-17T12:16:11.4510867Z [cluster2] },
2021-07-17T12:16:11.4511268Z [cluster2] "public_ip": {
2021-07-17T12:16:11.4511704Z [cluster2] "type": "string"
2021-07-17T12:16:11.4512102Z [cluster2] },
2021-07-17T12:16:11.4512499Z [cluster2] "subnets": {
2021-07-17T12:16:11.4512898Z [cluster2] "items": {
2021-07-17T12:16:11.4513320Z [cluster2] "type": "string"
2021-07-17T12:16:11.4513734Z [cluster2] },
2021-07-17T12:16:11.4514272Z [cluster2] "type": "array"
2021-07-17T12:16:11.4514677Z [cluster2] }
2021-07-17T12:16:11.4515027Z [cluster2] },
2021-07-17T12:16:11.4515664Z [cluster2] "required": [
2021-07-17T12:16:11.4516116Z [cluster2] "backend",
2021-07-17T12:16:11.4516544Z [cluster2] "cable_name",
2021-07-17T12:16:11.4516972Z [cluster2] "cluster_id",
2021-07-17T12:16:11.4517383Z [cluster2] "hostname",
2021-07-17T12:16:11.4517821Z [cluster2] "nat_enabled",
2021-07-17T12:16:11.4518240Z [cluster2] "private_ip",
2021-07-17T12:16:11.4519108Z [cluster2] "public_ip",
2021-07-17T12:16:11.4519518Z [cluster2] "subnets"
2021-07-17T12:16:11.4520096Z [cluster2] ],
2021-07-17T12:16:11.4520751Z [cluster2] "type": "object"
2021-07-17T12:16:11.4521170Z [cluster2] },
2021-07-17T12:16:11.4521613Z [cluster2] "latencyRTT": {
2021-07-17T12:16:11.4522424Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-17T12:16:11.4523366Z [cluster2] "properties": {
2021-07-17T12:16:11.4524149Z [cluster2] "average": {
2021-07-17T12:16:11.4524564Z [cluster2] "type": "string"
2021-07-17T12:16:11.4524974Z [cluster2] },
2021-07-17T12:16:11.4525344Z [cluster2] "last": {
2021-07-17T12:16:11.4525761Z [cluster2] "type": "string"
2021-07-17T12:16:11.4526173Z [cluster2] },
2021-07-17T12:16:11.4526541Z [cluster2] "max": {
2021-07-17T12:16:11.4526961Z [cluster2] "type": "string"
2021-07-17T12:16:11.4527528Z [cluster2] },
2021-07-17T12:16:11.4527927Z [cluster2] "min": {
2021-07-17T12:16:11.4528354Z [cluster2] "type": "string"
2021-07-17T12:16:11.4528783Z [cluster2] },
2021-07-17T12:16:11.4529195Z [cluster2] "stdDev": {
2021-07-17T12:16:11.4529632Z [cluster2] "type": "string"
2021-07-17T12:16:11.4530057Z [cluster2] }
2021-07-17T12:16:11.4530436Z [cluster2] },
2021-07-17T12:16:11.4530999Z [cluster2] "type": "object"
2021-07-17T12:16:11.4531380Z [cluster2] },
2021-07-17T12:16:11.4531763Z [cluster2] "status": {
2021-07-17T12:16:11.4532261Z [cluster2] "type": "string"
2021-07-17T12:16:11.4532662Z [cluster2] },
2021-07-17T12:16:11.4533088Z [cluster2] "statusMessage": {
2021-07-17T12:16:11.4533528Z [cluster2] "type": "string"
2021-07-17T12:16:11.4533925Z [cluster2] },
2021-07-17T12:16:11.4534305Z [cluster2] "usingIP": {
2021-07-17T12:16:11.4534730Z [cluster2] "type": "string"
2021-07-17T12:16:11.4535127Z [cluster2] },
2021-07-17T12:16:11.4535505Z [cluster2] "usingNAT": {
2021-07-17T12:16:11.4535940Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4536330Z [cluster2] }
2021-07-17T12:16:11.4536690Z [cluster2] },
2021-07-17T12:16:11.4537068Z [cluster2] "required": [
2021-07-17T12:16:11.4537494Z [cluster2] "endpoint",
2021-07-17T12:16:11.4537909Z [cluster2] "status",
2021-07-17T12:16:11.4538417Z [cluster2] "statusMessage"
2021-07-17T12:16:11.4538837Z [cluster2] ],
2021-07-17T12:16:11.4539220Z [cluster2] "type": "object"
2021-07-17T12:16:11.4539605Z [cluster2] },
2021-07-17T12:16:11.4539983Z [cluster2] "type": "array"
2021-07-17T12:16:11.4540368Z [cluster2] },
2021-07-17T12:16:11.4540745Z [cluster2] "haStatus": {
2021-07-17T12:16:11.4541143Z [cluster2] "type": "string"
2021-07-17T12:16:11.4541525Z [cluster2] },
2021-07-17T12:16:11.4541922Z [cluster2] "localEndpoint": {
2021-07-17T12:16:11.4542372Z [cluster2] "properties": {
2021-07-17T12:16:11.4542782Z [cluster2] "backend": {
2021-07-17T12:16:11.4543200Z [cluster2] "type": "string"
2021-07-17T12:16:11.4543591Z [cluster2] },
2021-07-17T12:16:11.4543983Z [cluster2] "backend_config": {
2021-07-17T12:16:11.4544502Z [cluster2] "additionalProperties": {
2021-07-17T12:16:11.4544997Z [cluster2] "type": "string"
2021-07-17T12:16:11.4545392Z [cluster2] },
2021-07-17T12:16:11.4545778Z [cluster2] "type": "object"
2021-07-17T12:16:11.4546180Z [cluster2] },
2021-07-17T12:16:11.4546569Z [cluster2] "cable_name": {
2021-07-17T12:16:11.4546980Z [cluster2] "type": "string"
2021-07-17T12:16:11.4547377Z [cluster2] },
2021-07-17T12:16:11.4549166Z [cluster2] "cluster_id": {
2021-07-17T12:16:11.4549778Z [cluster2] "type": "string"
2021-07-17T12:16:11.4550318Z [cluster2] },
2021-07-17T12:16:11.4550873Z [cluster2] "healthCheckIP": {
2021-07-17T12:16:11.4551678Z [cluster2] "type": "string"
2021-07-17T12:16:11.4552592Z [cluster2] },
2021-07-17T12:16:11.4553355Z [cluster2] "hostname": {
2021-07-17T12:16:11.4554193Z [cluster2] "type": "string"
2021-07-17T12:16:11.4554630Z [cluster2] },
2021-07-17T12:16:11.4555070Z [cluster2] "nat_enabled": {
2021-07-17T12:16:11.4555543Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4555989Z [cluster2] },
2021-07-17T12:16:11.4556412Z [cluster2] "private_ip": {
2021-07-17T12:16:11.4556889Z [cluster2] "type": "string"
2021-07-17T12:16:11.4557402Z [cluster2] },
2021-07-17T12:16:11.4557989Z [cluster2] "public_ip": {
2021-07-17T12:16:11.4589474Z [cluster2] "type": "string"
2021-07-17T12:16:11.4589893Z [cluster2] },
2021-07-17T12:16:11.4590293Z [cluster2] "subnets": {
2021-07-17T12:16:11.4590682Z [cluster2] "items": {
2021-07-17T12:16:11.4591099Z [cluster2] "type": "string"
2021-07-17T12:16:11.4591482Z [cluster2] },
2021-07-17T12:16:11.4591879Z [cluster2] "type": "array"
2021-07-17T12:16:11.4592272Z [cluster2] }
2021-07-17T12:16:11.4592618Z [cluster2] },
2021-07-17T12:16:11.4593007Z [cluster2] "required": [
2021-07-17T12:16:11.4593504Z [cluster2] "backend",
2021-07-17T12:16:11.4593921Z [cluster2] "cable_name",
2021-07-17T12:16:11.4594328Z [cluster2] "cluster_id",
2021-07-17T12:16:11.4594741Z [cluster2] "hostname",
2021-07-17T12:16:11.4595165Z [cluster2] "nat_enabled",
2021-07-17T12:16:11.4595576Z [cluster2] "private_ip",
2021-07-17T12:16:11.4595994Z [cluster2] "public_ip",
2021-07-17T12:16:11.4596398Z [cluster2] "subnets"
2021-07-17T12:16:11.4596778Z [cluster2] ],
2021-07-17T12:16:11.4597155Z [cluster2] "type": "object"
2021-07-17T12:16:11.4597542Z [cluster2] },
2021-07-17T12:16:11.4597937Z [cluster2] "statusFailure": {
2021-07-17T12:16:11.4598591Z [cluster2] "type": "string"
2021-07-17T12:16:11.4599008Z [cluster2] },
2021-07-17T12:16:11.4599365Z [cluster2] "version": {
2021-07-17T12:16:11.4599783Z [cluster2] "type": "string"
2021-07-17T12:16:11.4600155Z [cluster2] }
2021-07-17T12:16:11.4600507Z [cluster2] },
2021-07-17T12:16:11.4600869Z [cluster2] "required": [
2021-07-17T12:16:11.4601290Z [cluster2] "connections",
2021-07-17T12:16:11.4601708Z [cluster2] "haStatus",
2021-07-17T12:16:11.4602127Z [cluster2] "localEndpoint",
2021-07-17T12:16:11.4602595Z [cluster2] "statusFailure",
2021-07-17T12:16:11.4603008Z [cluster2] "version"
2021-07-17T12:16:11.4603376Z [cluster2] ],
2021-07-17T12:16:11.4603744Z [cluster2] "type": "object"
2021-07-17T12:16:11.4604121Z [cluster2] },
2021-07-17T12:16:11.4604491Z [cluster2] "type": "array"
2021-07-17T12:16:11.4604941Z [cluster2] },
2021-07-17T12:16:11.4605317Z [cluster2] "globalCIDR": {
2021-07-17T12:16:11.4605717Z [cluster2] "type": "string"
2021-07-17T12:16:11.4606089Z [cluster2] },
2021-07-17T12:16:11.4606571Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-17T12:16:11.4607113Z [cluster2] "properties": {
2021-07-17T12:16:11.4607593Z [cluster2] "lastResourceVersion": {
2021-07-17T12:16:11.4608082Z [cluster2] "type": "string"
2021-07-17T12:16:11.4608469Z [cluster2] },
2021-07-17T12:16:11.4608960Z [cluster2] "mismatchedContainerImages": {
2021-07-17T12:16:11.4609687Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4610084Z [cluster2] },
2021-07-17T12:16:11.4610785Z [cluster2] "nonReadyContainerStates": {
2021-07-17T12:16:11.4611323Z [cluster2] "items": {
2021-07-17T12:16:11.4612526Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T12:16:11.4613928Z [cluster2] "properties": {
2021-07-17T12:16:11.4614392Z [cluster2] "running": {
2021-07-17T12:16:11.4614980Z [cluster2] "description": "Details about a running container",
2021-07-17T12:16:11.4615729Z [cluster2] "properties": {
2021-07-17T12:16:11.4616213Z [cluster2] "startedAt": {
2021-07-17T12:16:11.4617482Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-17T12:16:11.4618321Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4618802Z [cluster2] "type": "string"
2021-07-17T12:16:11.4619190Z [cluster2] }
2021-07-17T12:16:11.4619556Z [cluster2] },
2021-07-17T12:16:11.4619955Z [cluster2] "type": "object"
2021-07-17T12:16:11.4620341Z [cluster2] },
2021-07-17T12:16:11.4620749Z [cluster2] "terminated": {
2021-07-17T12:16:11.4621294Z [cluster2] "description": "Details about a terminated container",
2021-07-17T12:16:11.4621852Z [cluster2] "properties": {
2021-07-17T12:16:11.4622298Z [cluster2] "containerID": {
2021-07-17T12:16:11.4623167Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T12:16:11.4623772Z [cluster2] "type": "string"
2021-07-17T12:16:11.4624166Z [cluster2] },
2021-07-17T12:16:11.4624565Z [cluster2] "exitCode": {
2021-07-17T12:16:11.4625244Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-17T12:16:11.4625836Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4626280Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4626679Z [cluster2] },
2021-07-17T12:16:11.4627086Z [cluster2] "finishedAt": {
2021-07-17T12:16:11.4627645Z [cluster2] "description": "Time at which the container last terminated",
2021-07-17T12:16:11.4628607Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4629100Z [cluster2] "type": "string"
2021-07-17T12:16:11.4629509Z [cluster2] },
2021-07-17T12:16:11.4629922Z [cluster2] "message": {
2021-07-17T12:16:11.4630547Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-17T12:16:11.4631184Z [cluster2] "type": "string"
2021-07-17T12:16:11.4631592Z [cluster2] },
2021-07-17T12:16:11.4632149Z [cluster2] "reason": {
2021-07-17T12:16:11.4632736Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-17T12:16:11.4633317Z [cluster2] "type": "string"
2021-07-17T12:16:11.4633717Z [cluster2] },
2021-07-17T12:16:11.4634085Z [cluster2] "signal": {
2021-07-17T12:16:11.4634733Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-17T12:16:11.4635326Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4635754Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4636158Z [cluster2] },
2021-07-17T12:16:11.4636548Z [cluster2] "startedAt": {
2021-07-17T12:16:11.4637164Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-17T12:16:11.4637988Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4641461Z [cluster2] "type": "string"
2021-07-17T12:16:11.4641913Z [cluster2] }
2021-07-17T12:16:11.4642267Z [cluster2] },
2021-07-17T12:16:11.4642664Z [cluster2] "required": [
2021-07-17T12:16:11.4643082Z [cluster2] "exitCode"
2021-07-17T12:16:11.4643479Z [cluster2] ],
2021-07-17T12:16:11.4644048Z [cluster2] "type": "object"
2021-07-17T12:16:11.4644432Z [cluster2] },
2021-07-17T12:16:11.4644819Z [cluster2] "waiting": {
2021-07-17T12:16:11.4645330Z [cluster2] "description": "Details about a waiting container",
2021-07-17T12:16:11.4645883Z [cluster2] "properties": {
2021-07-17T12:16:11.4646306Z [cluster2] "message": {
2021-07-17T12:16:11.4646901Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-17T12:16:11.4647501Z [cluster2] "type": "string"
2021-07-17T12:16:11.4647892Z [cluster2] },
2021-07-17T12:16:11.4648282Z [cluster2] "reason": {
2021-07-17T12:16:11.4649802Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-17T12:16:11.4650587Z [cluster2] "type": "string"
2021-07-17T12:16:11.4651146Z [cluster2] }
2021-07-17T12:16:11.4651629Z [cluster2] },
2021-07-17T12:16:11.4652337Z [cluster2] "type": "object"
2021-07-17T12:16:11.4652882Z [cluster2] }
2021-07-17T12:16:11.4653242Z [cluster2] },
2021-07-17T12:16:11.4653623Z [cluster2] "type": "object"
2021-07-17T12:16:11.4654011Z [cluster2] },
2021-07-17T12:16:11.4654390Z [cluster2] "type": "array"
2021-07-17T12:16:11.4654754Z [cluster2] },
2021-07-17T12:16:11.4655119Z [cluster2] "status": {
2021-07-17T12:16:11.4655851Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T12:16:11.4656519Z [cluster2] "properties": {
2021-07-17T12:16:11.4656962Z [cluster2] "collisionCount": {
2021-07-17T12:16:11.4657974Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T12:16:11.4658957Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4659539Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4659940Z [cluster2] },
2021-07-17T12:16:11.4660325Z [cluster2] "conditions": {
2021-07-17T12:16:11.4661347Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T12:16:11.4661998Z [cluster2] "items": {
2021-07-17T12:16:11.4662647Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T12:16:11.4671545Z [cluster2] "properties": {
2021-07-17T12:16:11.4672050Z [cluster2] "lastTransitionTime": {
2021-07-17T12:16:11.4672736Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T12:16:11.4673691Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4674138Z [cluster2] "type": "string"
2021-07-17T12:16:11.4674539Z [cluster2] },
2021-07-17T12:16:11.4675111Z [cluster2] "message": {
2021-07-17T12:16:11.4675775Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-17T12:16:11.4676820Z [cluster2] "type": "string"
2021-07-17T12:16:11.4677606Z [cluster2] },
2021-07-17T12:16:11.4678066Z [cluster2] "reason": {
2021-07-17T12:16:11.4679276Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-17T12:16:11.4680271Z [cluster2] "type": "string"
2021-07-17T12:16:11.4680873Z [cluster2] },
2021-07-17T12:16:11.4681266Z [cluster2] "status": {
2021-07-17T12:16:11.4681875Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T12:16:11.4682472Z [cluster2] "type": "string"
2021-07-17T12:16:11.4683038Z [cluster2] },
2021-07-17T12:16:11.4683408Z [cluster2] "type": {
2021-07-17T12:16:11.4684090Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-17T12:16:11.4684650Z [cluster2] "type": "string"
2021-07-17T12:16:11.4685037Z [cluster2] }
2021-07-17T12:16:11.4685403Z [cluster2] },
2021-07-17T12:16:11.4685791Z [cluster2] "required": [
2021-07-17T12:16:11.4686209Z [cluster2] "status",
2021-07-17T12:16:11.4686608Z [cluster2] "type"
2021-07-17T12:16:11.4686973Z [cluster2] ],
2021-07-17T12:16:11.4687375Z [cluster2] "type": "object"
2021-07-17T12:16:11.4687760Z [cluster2] },
2021-07-17T12:16:11.4688150Z [cluster2] "type": "array"
2021-07-17T12:16:11.4688523Z [cluster2] },
2021-07-17T12:16:11.4689007Z [cluster2] "currentNumberScheduled": {
2021-07-17T12:16:11.4690074Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4691100Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4691533Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4691922Z [cluster2] },
2021-07-17T12:16:11.4692412Z [cluster2] "desiredNumberScheduled": {
2021-07-17T12:16:11.4693526Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4694515Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4694954Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4695334Z [cluster2] },
2021-07-17T12:16:11.4695759Z [cluster2] "numberAvailable": {
2021-07-17T12:16:11.4696667Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.4697510Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4697942Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4698322Z [cluster2] },
2021-07-17T12:16:11.4698773Z [cluster2] "numberMisscheduled": {
2021-07-17T12:16:11.4699787Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4700716Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4701216Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4701615Z [cluster2] },
2021-07-17T12:16:11.4702016Z [cluster2] "numberReady": {
2021-07-17T12:16:11.4702736Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T12:16:11.4703429Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4703859Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4704242Z [cluster2] },
2021-07-17T12:16:11.4704677Z [cluster2] "numberUnavailable": {
2021-07-17T12:16:11.4705588Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.4706417Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4706847Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4707228Z [cluster2] },
2021-07-17T12:16:11.4707756Z [cluster2] "observedGeneration": {
2021-07-17T12:16:11.4708429Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T12:16:11.4709044Z [cluster2] "format": "int64",
2021-07-17T12:16:11.4709467Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4709848Z [cluster2] },
2021-07-17T12:16:11.4710332Z [cluster2] "updatedNumberScheduled": {
2021-07-17T12:16:11.4711010Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T12:16:11.4711593Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4712027Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4712409Z [cluster2] }
2021-07-17T12:16:11.4712762Z [cluster2] },
2021-07-17T12:16:11.4713132Z [cluster2] "required": [
2021-07-17T12:16:11.4713658Z [cluster2] "currentNumberScheduled",
2021-07-17T12:16:11.4714267Z [cluster2] "desiredNumberScheduled",
2021-07-17T12:16:11.4714847Z [cluster2] "numberMisscheduled",
2021-07-17T12:16:11.4715533Z [cluster2] "numberReady"
2021-07-17T12:16:11.4715940Z [cluster2] ],
2021-07-17T12:16:11.4716349Z [cluster2] "type": "object"
2021-07-17T12:16:11.4716742Z [cluster2] }
2021-07-17T12:16:11.4717103Z [cluster2] },
2021-07-17T12:16:11.4717482Z [cluster2] "required": [
2021-07-17T12:16:11.4718053Z [cluster2] "mismatchedContainerImages"
2021-07-17T12:16:11.4773838Z [cluster2] ],
2021-07-17T12:16:11.4774388Z [cluster2] "type": "object"
2021-07-17T12:16:11.4774795Z [cluster2] },
2021-07-17T12:16:11.4775209Z [cluster2] "loadBalancerStatus": {
2021-07-17T12:16:11.4775677Z [cluster2] "properties": {
2021-07-17T12:16:11.4776060Z [cluster2] "status": {
2021-07-17T12:16:11.4777033Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-17T12:16:11.4777698Z [cluster2] "properties": {
2021-07-17T12:16:11.4778120Z [cluster2] "ingress": {
2021-07-17T12:16:11.4779198Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-17T12:16:11.4779983Z [cluster2] "items": {
2021-07-17T12:16:11.4781246Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-17T12:16:11.4782155Z [cluster2] "properties": {
2021-07-17T12:16:11.4782712Z [cluster2] "hostname": {
2021-07-17T12:16:11.4783727Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-17T12:16:11.4784442Z [cluster2] "type": "string"
2021-07-17T12:16:11.4784855Z [cluster2] },
2021-07-17T12:16:11.4785238Z [cluster2] "ip": {
2021-07-17T12:16:11.4786206Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-17T12:16:11.4786952Z [cluster2] "type": "string"
2021-07-17T12:16:11.4787349Z [cluster2] }
2021-07-17T12:16:11.4787715Z [cluster2] },
2021-07-17T12:16:11.4788099Z [cluster2] "type": "object"
2021-07-17T12:16:11.4788497Z [cluster2] },
2021-07-17T12:16:11.4788894Z [cluster2] "type": "array"
2021-07-17T12:16:11.4789265Z [cluster2] }
2021-07-17T12:16:11.4789618Z [cluster2] },
2021-07-17T12:16:11.4789989Z [cluster2] "type": "object"
2021-07-17T12:16:11.4790372Z [cluster2] }
2021-07-17T12:16:11.4790699Z [cluster2] },
2021-07-17T12:16:11.4791082Z [cluster2] "type": "object"
2021-07-17T12:16:11.4791442Z [cluster2] },
2021-07-17T12:16:11.4791805Z [cluster2] "natEnabled": {
2021-07-17T12:16:11.4792221Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4792586Z [cluster2] },
2021-07-17T12:16:11.4793068Z [cluster2] "networkPlugin": {
2021-07-17T12:16:11.4793506Z [cluster2] "type": "string"
2021-07-17T12:16:11.4793883Z [cluster2] },
2021-07-17T12:16:11.4794374Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-17T12:16:11.4794925Z [cluster2] "properties": {
2021-07-17T12:16:11.4795419Z [cluster2] "lastResourceVersion": {
2021-07-17T12:16:11.4795895Z [cluster2] "type": "string"
2021-07-17T12:16:11.4796284Z [cluster2] },
2021-07-17T12:16:11.4796775Z [cluster2] "mismatchedContainerImages": {
2021-07-17T12:16:11.4797325Z [cluster2] "type": "boolean"
2021-07-17T12:16:11.4797700Z [cluster2] },
2021-07-17T12:16:11.4798191Z [cluster2] "nonReadyContainerStates": {
2021-07-17T12:16:11.4821684Z [cluster2] "items": {
2021-07-17T12:16:11.4822624Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T12:16:11.4823745Z [cluster2] "properties": {
2021-07-17T12:16:11.4824159Z [cluster2] "running": {
2021-07-17T12:16:11.4824680Z [cluster2] "description": "Details about a running container",
2021-07-17T12:16:11.4825227Z [cluster2] "properties": {
2021-07-17T12:16:11.4825661Z [cluster2] "startedAt": {
2021-07-17T12:16:11.4826567Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-17T12:16:11.4827310Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4827769Z [cluster2] "type": "string"
2021-07-17T12:16:11.4828177Z [cluster2] }
2021-07-17T12:16:11.4828530Z [cluster2] },
2021-07-17T12:16:11.4828928Z [cluster2] "type": "object"
2021-07-17T12:16:11.4829316Z [cluster2] },
2021-07-17T12:16:11.4829719Z [cluster2] "terminated": {
2021-07-17T12:16:11.4830265Z [cluster2] "description": "Details about a terminated container",
2021-07-17T12:16:11.4830993Z [cluster2] "properties": {
2021-07-17T12:16:11.4831477Z [cluster2] "containerID": {
2021-07-17T12:16:11.4832365Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T12:16:11.4833203Z [cluster2] "type": "string"
2021-07-17T12:16:11.4833625Z [cluster2] },
2021-07-17T12:16:11.4834061Z [cluster2] "exitCode": {
2021-07-17T12:16:11.4834961Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-17T12:16:11.4835743Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4836185Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4836580Z [cluster2] },
2021-07-17T12:16:11.4836993Z [cluster2] "finishedAt": {
2021-07-17T12:16:11.4837550Z [cluster2] "description": "Time at which the container last terminated",
2021-07-17T12:16:11.4838554Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4839042Z [cluster2] "type": "string"
2021-07-17T12:16:11.4839434Z [cluster2] },
2021-07-17T12:16:11.4839826Z [cluster2] "message": {
2021-07-17T12:16:11.4840417Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-17T12:16:11.4841027Z [cluster2] "type": "string"
2021-07-17T12:16:11.4841558Z [cluster2] },
2021-07-17T12:16:11.4841934Z [cluster2] "reason": {
2021-07-17T12:16:11.4842523Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-17T12:16:11.4843105Z [cluster2] "type": "string"
2021-07-17T12:16:11.4843507Z [cluster2] },
2021-07-17T12:16:11.4843891Z [cluster2] "signal": {
2021-07-17T12:16:11.4844443Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-17T12:16:11.4845017Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4845446Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4845851Z [cluster2] },
2021-07-17T12:16:11.4846241Z [cluster2] "startedAt": {
2021-07-17T12:16:11.4846861Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-17T12:16:11.4847718Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4848164Z [cluster2] "type": "string"
2021-07-17T12:16:11.4848570Z [cluster2] }
2021-07-17T12:16:11.4848924Z [cluster2] },
2021-07-17T12:16:11.4849322Z [cluster2] "required": [
2021-07-17T12:16:11.4849752Z [cluster2] "exitCode"
2021-07-17T12:16:11.4850133Z [cluster2] ],
2021-07-17T12:16:11.4850531Z [cluster2] "type": "object"
2021-07-17T12:16:11.4850998Z [cluster2] },
2021-07-17T12:16:11.4851401Z [cluster2] "waiting": {
2021-07-17T12:16:11.4852965Z [cluster2] "description": "Details about a waiting container",
2021-07-17T12:16:11.4853722Z [cluster2] "properties": {
2021-07-17T12:16:11.4854313Z [cluster2] "message": {
2021-07-17T12:16:11.4855115Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-17T12:16:11.4855925Z [cluster2] "type": "string"
2021-07-17T12:16:11.4856312Z [cluster2] },
2021-07-17T12:16:11.4856700Z [cluster2] "reason": {
2021-07-17T12:16:11.4857257Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-17T12:16:11.4857802Z [cluster2] "type": "string"
2021-07-17T12:16:11.4858204Z [cluster2] }
2021-07-17T12:16:11.4858706Z [cluster2] },
2021-07-17T12:16:11.4859107Z [cluster2] "type": "object"
2021-07-17T12:16:11.4859489Z [cluster2] }
2021-07-17T12:16:11.4859845Z [cluster2] },
2021-07-17T12:16:11.4860239Z [cluster2] "type": "object"
2021-07-17T12:16:11.4860759Z [cluster2] },
2021-07-17T12:16:11.4861162Z [cluster2] "type": "array"
2021-07-17T12:16:11.4861524Z [cluster2] },
2021-07-17T12:16:11.4861891Z [cluster2] "status": {
2021-07-17T12:16:11.4862491Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T12:16:11.4863132Z [cluster2] "properties": {
2021-07-17T12:16:11.4863675Z [cluster2] "collisionCount": {
2021-07-17T12:16:11.4864684Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T12:16:11.4865687Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4866107Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4866508Z [cluster2] },
2021-07-17T12:16:11.4866901Z [cluster2] "conditions": {
2021-07-17T12:16:11.4867881Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T12:16:11.4868548Z [cluster2] "items": {
2021-07-17T12:16:11.4869195Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T12:16:11.4869980Z [cluster2] "properties": {
2021-07-17T12:16:11.4870582Z [cluster2] "lastTransitionTime": {
2021-07-17T12:16:11.4871245Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T12:16:11.4872090Z [cluster2] "format": "date-time",
2021-07-17T12:16:11.4872546Z [cluster2] "type": "string"
2021-07-17T12:16:11.4872951Z [cluster2] },
2021-07-17T12:16:11.4873346Z [cluster2] "message": {
2021-07-17T12:16:11.4873957Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-17T12:16:11.4874596Z [cluster2] "type": "string"
2021-07-17T12:16:11.4874982Z [cluster2] },
2021-07-17T12:16:11.4875371Z [cluster2] "reason": {
2021-07-17T12:16:11.4876128Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-17T12:16:11.4876804Z [cluster2] "type": "string"
2021-07-17T12:16:11.4877211Z [cluster2] },
2021-07-17T12:16:11.4877582Z [cluster2] "status": {
2021-07-17T12:16:11.4878159Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T12:16:11.4880204Z [cluster2] "type": "string"
2021-07-17T12:16:11.4880618Z [cluster2] },
2021-07-17T12:16:11.4881007Z [cluster2] "type": {
2021-07-17T12:16:11.4881509Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-17T12:16:11.4882054Z [cluster2] "type": "string"
2021-07-17T12:16:11.4882443Z [cluster2] }
2021-07-17T12:16:11.4882808Z [cluster2] },
2021-07-17T12:16:11.4883201Z [cluster2] "required": [
2021-07-17T12:16:11.4883608Z [cluster2] "status",
2021-07-17T12:16:11.4884009Z [cluster2] "type"
2021-07-17T12:16:11.4884370Z [cluster2] ],
2021-07-17T12:16:11.4884770Z [cluster2] "type": "object"
2021-07-17T12:16:11.4885156Z [cluster2] },
2021-07-17T12:16:11.4885551Z [cluster2] "type": "array"
2021-07-17T12:16:11.4885936Z [cluster2] },
2021-07-17T12:16:11.4886411Z [cluster2] "currentNumberScheduled": {
2021-07-17T12:16:11.4887593Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4888557Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4888994Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4889395Z [cluster2] },
2021-07-17T12:16:11.4889857Z [cluster2] "desiredNumberScheduled": {
2021-07-17T12:16:11.4890980Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4891984Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4892405Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4892804Z [cluster2] },
2021-07-17T12:16:11.4893231Z [cluster2] "numberAvailable": {
2021-07-17T12:16:11.4894118Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.4895069Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4895484Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4895884Z [cluster2] },
2021-07-17T12:16:11.4896321Z [cluster2] "numberMisscheduled": {
2021-07-17T12:16:11.4897337Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.4898282Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4898699Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4899095Z [cluster2] },
2021-07-17T12:16:11.4899775Z [cluster2] "numberReady": {
2021-07-17T12:16:11.4900501Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T12:16:11.4901200Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4901624Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4902007Z [cluster2] },
2021-07-17T12:16:11.4902425Z [cluster2] "numberUnavailable": {
2021-07-17T12:16:11.4903307Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.4904142Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4904557Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4904952Z [cluster2] },
2021-07-17T12:16:11.4905386Z [cluster2] "observedGeneration": {
2021-07-17T12:16:11.4906152Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T12:16:11.4906790Z [cluster2] "format": "int64",
2021-07-17T12:16:11.4907206Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4907604Z [cluster2] },
2021-07-17T12:16:11.4908083Z [cluster2] "updatedNumberScheduled": {
2021-07-17T12:16:11.4908769Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T12:16:11.4909354Z [cluster2] "format": "int32",
2021-07-17T12:16:11.4909771Z [cluster2] "type": "integer"
2021-07-17T12:16:11.4910166Z [cluster2] }
2021-07-17T12:16:11.4910500Z [cluster2] },
2021-07-17T12:16:11.4910879Z [cluster2] "required": [
2021-07-17T12:16:11.4911384Z [cluster2] "currentNumberScheduled",
2021-07-17T12:16:11.4912003Z [cluster2] "desiredNumberScheduled",
2021-07-17T12:16:11.4912670Z [cluster2] "numberMisscheduled",
2021-07-17T12:16:11.4913148Z [cluster2] "numberReady"
2021-07-17T12:16:11.4913548Z [cluster2] ],
2021-07-17T12:16:11.4913924Z [cluster2] "type": "object"
2021-07-17T12:16:11.4914310Z [cluster2] }
2021-07-17T12:16:11.4914637Z [cluster2] },
2021-07-17T12:16:11.4915009Z [cluster2] "required": [
2021-07-17T12:16:11.4915534Z [cluster2] "mismatchedContainerImages"
2021-07-17T12:16:11.4916040Z [cluster2] ],
2021-07-17T12:16:11.4916417Z [cluster2] "type": "object"
2021-07-17T12:16:11.4916777Z [cluster2] },
2021-07-17T12:16:11.4917161Z [cluster2] "serviceCIDR": {
2021-07-17T12:16:11.4917565Z [cluster2] "type": "string"
2021-07-17T12:16:11.4917933Z [cluster2] }
2021-07-17T12:16:11.4918249Z [cluster2] },
2021-07-17T12:16:11.4918804Z [cluster2] "required": [
2021-07-17T12:16:11.4919198Z [cluster2] "clusterID",
2021-07-17T12:16:11.4919611Z [cluster2] "natEnabled"
2021-07-17T12:16:11.4919981Z [cluster2] ],
2021-07-17T12:16:11.4920334Z [cluster2] "type": "object"
2021-07-17T12:16:11.4920695Z [cluster2] }
2021-07-17T12:16:11.4921005Z [cluster2] },
2021-07-17T12:16:11.4921360Z [cluster2] "type": "object"
2021-07-17T12:16:11.4921703Z [cluster2] }
2021-07-17T12:16:11.4922187Z [cluster2] },
2021-07-17T12:16:11.4922539Z [cluster2] "served": true,
2021-07-17T12:16:11.4923126Z [cluster2] "storage": true,
2021-07-17T12:16:11.4923543Z [cluster2] "subresources": {
2021-07-17T12:16:11.4923959Z [cluster2] "status": {}
2021-07-17T12:16:11.4924322Z [cluster2] }
2021-07-17T12:16:11.4924728Z [cluster2] }
2021-07-17T12:16:11.4925072Z [cluster2] ]
2021-07-17T12:16:11.4925379Z [cluster2] },
2021-07-17T12:16:11.4925721Z [cluster2] "status": {
2021-07-17T12:16:11.4926122Z [cluster2] "acceptedNames": {
2021-07-17T12:16:11.4926892Z [cluster2] "kind": "Submariner",
2021-07-17T12:16:11.4927329Z [cluster2] "listKind": "SubmarinerList",
2021-07-17T12:16:11.4927796Z [cluster2] "plural": "submariners",
2021-07-17T12:16:11.4928228Z [cluster2] "singular": "submariner"
2021-07-17T12:16:11.4928596Z [cluster2] },
2021-07-17T12:16:11.4928923Z [cluster2] "conditions": [
2021-07-17T12:16:11.4929263Z [cluster2] {
2021-07-17T12:16:11.4929965Z [cluster2] "lastTransitionTime": "2021-07-17T12:11:41Z",
2021-07-17T12:16:11.7743926Z [cluster2] "message": "nr1] },
2021-07-17T12:16:11.7744323Z [cluster1] {
2021-07-17T12:16:11.7745422Z [cluster1] "lastTransitionTime": "2021-07-17T12:11:42Z",
2021-07-17T12:16:11.7746054Z [cluster1] "message": "the initial names have been accepted",
2021-07-17T12:16:11.7746679Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-17T12:16:11.7747203Z [cluster1] "status": "True",
2021-07-17T12:16:11.7747628Z [cluster1] "type": "Established"
2021-07-17T12:16:11.7748025Z [cluster1] }
2021-07-17T12:16:11.7748337Z [cluster1] ],
2021-07-17T12:16:11.7748927Z [cluster1] "storedVersions": [
2021-07-17T12:16:11.7749315Z [cluster1] "v1"
2021-07-17T12:16:11.7749646Z [cluster1] ]
2021-07-17T12:16:11.7749952Z [cluster1] }
2021-07-17T12:16:11.7750266Z [cluster1] }
2021-07-17T12:16:11.7751310Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-17T12:16:11.7752536Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-17T12:16:11.7753917Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:11.7755328Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T12:16:11.7756332Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T12:16:11.7757567Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:11.7759054Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T12:16:11.7760091Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T12:16:11.7761337Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:11.7762578Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-17T12:16:11.7763593Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-17T12:16:11.7764894Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:11.7766267Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T12:16:11.7767468Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T12:16:11.7768955Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-17T12:16:11.7770192Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-17T12:16:11.7770982Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-17T12:16:11.7772013Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T12:16:11.7773291Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T12:16:11.7774631Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T12:16:11.7775803Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T12:16:11.7777309Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-17T12:16:11.7778095Z [cluster1] NAME CREATED AT
2021-07-17T12:16:11.7778837Z [cluster1] submariners.submariner.io 2021-07-17T12:11:30Z
2021-07-17T12:16:11.7780014Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-17T12:16:11.7782545Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-17T12:16:11.7784387Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-17T12:16:11.7786370Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-17T12:16:11.7787659Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-17T12:16:11.7788394Z [cluster1] {
2021-07-17T12:16:11.7788884Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:11.7789546Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-17T12:16:11.7790084Z [cluster1] "metadata": {
2021-07-17T12:16:11.7790492Z [cluster1] "annotations": {
2021-07-17T12:16:11.7791492Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T12:16:11.7792142Z [cluster1] },
2021-07-17T12:16:11.7792741Z [cluster1] "creationTimestamp": "2021-07-17T12:11:30Z",
2021-07-17T12:16:11.7793343Z [cluster1] "generation": 2,
2021-07-17T12:16:11.7793767Z [cluster1] "managedFields": [
2021-07-17T12:16:11.7794286Z [cluster1] {
2021-07-17T12:16:11.7794776Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T12:16:11.7795369Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:11.7795806Z [cluster1] "fieldsV1": {
2021-07-17T12:16:11.7796239Z [cluster1] "f:metadata": {
2021-07-17T12:16:11.7796675Z [cluster1] "f:annotations": {
2021-07-17T12:16:11.7834222Z [cluster1] ".": {},
2021-07-17T12:16:11.7835192Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-17T12:16:11.7835793Z [cluster1] }
2021-07-17T12:16:11.7836138Z [cluster1] },
2021-07-17T12:16:11.7836490Z [cluster1] "f:spec": {
2021-07-17T12:16:11.7836904Z [cluster1] "f:conversion": {
2021-07-17T12:16:11.7837295Z [cluster1] ".": {},
2021-07-17T12:16:11.7837691Z [cluster1] "f:strategy": {}
2021-07-17T12:16:11.7838075Z [cluster1] },
2021-07-17T12:16:11.7838643Z [cluster1] "f:group": {},
2021-07-17T12:16:11.7839054Z [cluster1] "f:names": {
2021-07-17T12:16:11.7839437Z [cluster1] "f:kind": {},
2021-07-17T12:16:11.7839849Z [cluster1] "f:listKind": {},
2021-07-17T12:16:11.7840256Z [cluster1] "f:plural": {},
2021-07-17T12:16:11.7840677Z [cluster1] "f:singular": {}
2021-07-17T12:16:11.7841048Z [cluster1] },
2021-07-17T12:16:11.7841519Z [cluster1] "f:scope": {},
2021-07-17T12:16:11.7841915Z [cluster1] "f:versions": {}
2021-07-17T12:16:11.7842296Z [cluster1] },
2021-07-17T12:16:11.7842664Z [cluster1] "f:status": {
2021-07-17T12:16:11.7843092Z [cluster1] "f:acceptedNames": {
2021-07-17T12:16:11.7843616Z [cluster1] "f:kind": {},
2021-07-17T12:16:11.7844148Z [cluster1] "f:plural": {}
2021-07-17T12:16:11.7844550Z [cluster1] },
2021-07-17T12:16:11.7844934Z [cluster1] "f:conditions": {},
2021-07-17T12:16:11.7845410Z [cluster1] "f:storedVersions": {}
2021-07-17T12:16:11.7845810Z [cluster1] }
2021-07-17T12:16:11.7846150Z [cluster1] },
2021-07-17T12:16:11.7846537Z [cluster1] "manager": "subctl",
2021-07-17T12:16:11.7846982Z [cluster1] "operation": "Update",
2021-07-17T12:16:11.7847654Z [cluster1] "time": "2021-07-17T12:11:42Z"
2021-07-17T12:16:11.7848016Z [cluster1] }
2021-07-17T12:16:11.7848345Z [cluster1] ],
2021-07-17T12:16:11.7848839Z [cluster1] "name": "submariners.submariner.io",
2021-07-17T12:16:11.7849476Z [cluster1] "resourceVersion": "2034",
2021-07-17T12:16:11.7850184Z [cluster1] "uid": "d38ba728-0255-413c-b230-72a3774e1e31"
2021-07-17T12:16:11.7850647Z [cluster1] },
2021-07-17T12:16:11.7850971Z [cluster1] "spec": {
2021-07-17T12:16:11.7851356Z [cluster1] "conversion": {
2021-07-17T12:16:11.7851759Z [cluster1] "strategy": "None"
2021-07-17T12:16:11.7852133Z [cluster1] },
2021-07-17T12:16:11.7852627Z [cluster1] "group": "submariner.io",
2021-07-17T12:16:11.7853150Z [cluster1] "names": {
2021-07-17T12:16:11.7853558Z [cluster1] "kind": "Submariner",
2021-07-17T12:16:11.7854153Z [cluster1] "listKind": "SubmarinerList",
2021-07-17T12:16:11.7854659Z [cluster1] "plural": "submariners",
2021-07-17T12:16:11.7855121Z [cluster1] "singular": "submariner"
2021-07-17T12:16:11.7855521Z [cluster1] },
2021-07-17T12:16:11.7855900Z [cluster1] "scope": "Namespaced",
2021-07-17T12:16:11.7856323Z [cluster1] "versions": [
2021-07-17T12:16:11.7856670Z [cluster1] {
2021-07-17T12:16:11.7857056Z [cluster1] "name": "v1alpha1",
2021-07-17T12:16:11.7857902Z [cluster1] "schema": {
2021-07-17T12:16:11.7858347Z [cluster1] "openAPIV3Schema": {
2021-07-17T12:16:11.7858986Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-17T12:16:11.7859576Z [cluster1] "properties": {
2021-07-17T12:16:11.7860161Z [cluster1] "apiVersion": {
2021-07-17T12:16:11.7862075Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T12:16:11.7863553Z [cluster1] "type": "string"
2021-07-17T12:16:11.7863951Z [cluster1] },
2021-07-17T12:16:11.7864316Z [cluster1] "kind": {
2021-07-17T12:16:11.7866106Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T12:16:11.7867541Z [cluster1] "type": "string"
2021-07-17T12:16:11.7867926Z [cluster1] },
2021-07-17T12:16:11.7868317Z [cluster1] "metadata": {
2021-07-17T12:16:11.7868731Z [cluster1] "type": "object"
2021-07-17T12:16:11.7869125Z [cluster1] },
2021-07-17T12:16:11.7869602Z [cluster1] "spec": {
2021-07-17T12:16:11.7870327Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-17T12:16:11.7871088Z [cluster1] "properties": {
2021-07-17T12:16:11.7871515Z [cluster1] "broker": {
2021-07-17T12:16:11.7871944Z [cluster1] "type": "string"
2021-07-17T12:16:11.7872335Z [cluster1] },
2021-07-17T12:16:11.7872815Z [cluster1] "brokerK8sApiServer": {
2021-07-17T12:16:11.7873329Z [cluster1] "type": "string"
2021-07-17T12:16:11.7873718Z [cluster1] },
2021-07-17T12:16:11.7874238Z [cluster1] "brokerK8sApiServerToken": {
2021-07-17T12:16:11.7874778Z [cluster1] "type": "string"
2021-07-17T12:16:11.7875182Z [cluster1] },
2021-07-17T12:16:11.7875586Z [cluster1] "brokerK8sCA": {
2021-07-17T12:16:11.7876037Z [cluster1] "type": "string"
2021-07-17T12:16:11.7876423Z [cluster1] },
2021-07-17T12:16:11.7876956Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-17T12:16:11.7877527Z [cluster1] "type": "string"
2021-07-17T12:16:11.7877910Z [cluster1] },
2021-07-17T12:16:11.7914203Z [cluster1] "cableDriver": {
2021-07-17T12:16:11.7914695Z [cluster1] "type": "string"
2021-07-17T12:16:11.7915097Z [cluster1] },
2021-07-17T12:16:11.7915506Z [cluster1] "ceIPSecDebug": {
2021-07-17T12:16:11.7915968Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7916372Z [cluster1] },
2021-07-17T12:16:11.7916865Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-17T12:16:11.7917408Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7917910Z [cluster1] },
2021-07-17T12:16:11.7918690Z [cluster1] "ceIPSecIKEPort": {
2021-07-17T12:16:11.7919181Z [cluster1] "type": "integer"
2021-07-17T12:16:11.7919784Z [cluster1] },
2021-07-17T12:16:11.7920241Z [cluster1] "ceIPSecNATTPort": {
2021-07-17T12:16:11.7920826Z [cluster1] "type": "integer"
2021-07-17T12:16:11.7921473Z [cluster1] },
2021-07-17T12:16:11.7921874Z [cluster1] "ceIPSecPSK": {
2021-07-17T12:16:11.7922426Z [cluster1] "type": "string"
2021-07-17T12:16:11.7922832Z [cluster1] },
2021-07-17T12:16:11.7923531Z [cluster1] "ceIPSecPreferredServer": {
2021-07-17T12:16:11.7924213Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7924635Z [cluster1] },
2021-07-17T12:16:11.7925049Z [cluster1] "clusterCIDR": {
2021-07-17T12:16:11.7925523Z [cluster1] "type": "string"
2021-07-17T12:16:11.7926093Z [cluster1] },
2021-07-17T12:16:11.7926488Z [cluster1] "clusterID": {
2021-07-17T12:16:11.7927004Z [cluster1] "type": "string"
2021-07-17T12:16:11.7927395Z [cluster1] },
2021-07-17T12:16:11.7927803Z [cluster1] "colorCodes": {
2021-07-17T12:16:11.7928657Z [cluster1] "type": "string"
2021-07-17T12:16:11.7929077Z [cluster1] },
2021-07-17T12:16:11.7929735Z [cluster1] "connectionHealthCheck": {
2021-07-17T12:16:11.7930293Z [cluster1] "properties": {
2021-07-17T12:16:11.7930746Z [cluster1] "enabled": {
2021-07-17T12:16:11.7931186Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7931706Z [cluster1] },
2021-07-17T12:16:11.7932154Z [cluster1] "intervalSeconds": {
2021-07-17T12:16:11.7932852Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-17T12:16:11.7933444Z [cluster1] "format": "int64",
2021-07-17T12:16:11.7933909Z [cluster1] "type": "integer"
2021-07-17T12:16:11.7934336Z [cluster1] },
2021-07-17T12:16:11.7934803Z [cluster1] "maxPacketLossCount": {
2021-07-17T12:16:11.7935599Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-17T12:16:11.7936316Z [cluster1] "format": "int64",
2021-07-17T12:16:11.7936885Z [cluster1] "type": "integer"
2021-07-17T12:16:11.7937309Z [cluster1] }
2021-07-17T12:16:11.7937665Z [cluster1] },
2021-07-17T12:16:11.7938412Z [cluster1] "type": "object"
2021-07-17T12:16:11.7938819Z [cluster1] },
2021-07-17T12:16:11.7939506Z [cluster1] "coreDNSCustomConfig": {
2021-07-17T12:16:11.7940048Z [cluster1] "properties": {
2021-07-17T12:16:11.7940550Z [cluster1] "configMapName": {
2021-07-17T12:16:11.7941159Z [cluster1] "type": "string"
2021-07-17T12:16:11.7941893Z [cluster1] },
2021-07-17T12:16:11.7942301Z [cluster1] "namespace": {
2021-07-17T12:16:11.7942727Z [cluster1] "type": "string"
2021-07-17T12:16:11.7943166Z [cluster1] }
2021-07-17T12:16:11.7943518Z [cluster1] },
2021-07-17T12:16:11.7943996Z [cluster1] "type": "object"
2021-07-17T12:16:11.7944386Z [cluster1] },
2021-07-17T12:16:11.7944805Z [cluster1] "customDomains": {
2021-07-17T12:16:11.7945239Z [cluster1] "items": {
2021-07-17T12:16:11.7945730Z [cluster1] "type": "string"
2021-07-17T12:16:11.7946132Z [cluster1] },
2021-07-17T12:16:11.7946510Z [cluster1] "type": "array",
2021-07-17T12:16:11.7947393Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-17T12:16:11.7947883Z [cluster1] },
2021-07-17T12:16:11.7948256Z [cluster1] "debug": {
2021-07-17T12:16:11.7948675Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7949056Z [cluster1] },
2021-07-17T12:16:11.7949549Z [cluster1] "globalCIDR": {
2021-07-17T12:16:11.7950072Z [cluster1] "type": "string"
2021-07-17T12:16:11.7950679Z [cluster1] },
2021-07-17T12:16:11.7951106Z [cluster1] "imageOverrides": {
2021-07-17T12:16:11.7951669Z [cluster1] "additionalProperties": {
2021-07-17T12:16:11.7952192Z [cluster1] "type": "string"
2021-07-17T12:16:11.7952608Z [cluster1] },
2021-07-17T12:16:11.7953019Z [cluster1] "type": "object"
2021-07-17T12:16:11.7953405Z [cluster1] },
2021-07-17T12:16:11.7954310Z [cluster1] "loadBalancerEnabled": {
2021-07-17T12:16:11.7954805Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7955239Z [cluster1] },
2021-07-17T12:16:11.7955626Z [cluster1] "namespace": {
2021-07-17T12:16:11.7956055Z [cluster1] "type": "string"
2021-07-17T12:16:11.7956428Z [cluster1] },
2021-07-17T12:16:11.7956824Z [cluster1] "natEnabled": {
2021-07-17T12:16:11.7957263Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.7957646Z [cluster1] },
2021-07-17T12:16:11.7958536Z [cluster1] "repository": {
2021-07-17T12:16:11.7958978Z [cluster1] "type": "string"
2021-07-17T12:16:11.8003809Z [cluster1] },
2021-07-17T12:16:11.8004226Z [cluster1] "serviceCIDR": {
2021-07-17T12:16:11.8004680Z [cluster1] "type": "string"
2021-07-17T12:16:11.8005242Z [cluster1] },
2021-07-17T12:16:11.8005770Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-17T12:16:11.8006337Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8006733Z [cluster1] },
2021-07-17T12:16:11.8007126Z [cluster1] "version": {
2021-07-17T12:16:11.8007540Z [cluster1] "type": "string"
2021-07-17T12:16:11.8007951Z [cluster1] }
2021-07-17T12:16:11.8008296Z [cluster1] },
2021-07-17T12:16:11.8008858Z [cluster1] "required": [
2021-07-17T12:16:11.8009250Z [cluster1] "broker",
2021-07-17T12:16:11.8009730Z [cluster1] "brokerK8sApiServer",
2021-07-17T12:16:11.8010335Z [cluster1] "brokerK8sApiServerToken",
2021-07-17T12:16:11.8010871Z [cluster1] "brokerK8sCA",
2021-07-17T12:16:11.8011431Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-17T12:16:11.8011990Z [cluster1] "ceIPSecDebug",
2021-07-17T12:16:11.8012452Z [cluster1] "ceIPSecPSK",
2021-07-17T12:16:11.8012887Z [cluster1] "clusterCIDR",
2021-07-17T12:16:11.8013326Z [cluster1] "clusterID",
2021-07-17T12:16:11.8013864Z [cluster1] "debug",
2021-07-17T12:16:11.8014264Z [cluster1] "namespace",
2021-07-17T12:16:11.8014695Z [cluster1] "natEnabled",
2021-07-17T12:16:11.8015123Z [cluster1] "serviceCIDR"
2021-07-17T12:16:11.8015518Z [cluster1] ],
2021-07-17T12:16:11.8016034Z [cluster1] "type": "object"
2021-07-17T12:16:11.8016446Z [cluster1] },
2021-07-17T12:16:11.8016798Z [cluster1] "status": {
2021-07-17T12:16:11.8017428Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-17T12:16:11.8018464Z [cluster1] "properties": {
2021-07-17T12:16:11.8018922Z [cluster1] "clusterCIDR": {
2021-07-17T12:16:11.8019539Z [cluster1] "type": "string"
2021-07-17T12:16:11.8019925Z [cluster1] },
2021-07-17T12:16:11.8020320Z [cluster1] "clusterID": {
2021-07-17T12:16:11.8020737Z [cluster1] "type": "string"
2021-07-17T12:16:11.8021127Z [cluster1] },
2021-07-17T12:16:11.8021516Z [cluster1] "colorCodes": {
2021-07-17T12:16:11.8021954Z [cluster1] "type": "string"
2021-07-17T12:16:11.8022344Z [cluster1] },
2021-07-17T12:16:11.8022756Z [cluster1] "deploymentInfo": {
2021-07-17T12:16:11.8023502Z [cluster1] "properties": {
2021-07-17T12:16:11.8024251Z [cluster1] "cloudProvider": {
2021-07-17T12:16:11.8024872Z [cluster1] "type": "string"
2021-07-17T12:16:11.8025613Z [cluster1] },
2021-07-17T12:16:11.8026091Z [cluster1] "kubernetesType": {
2021-07-17T12:16:11.8026755Z [cluster1] "type": "string"
2021-07-17T12:16:11.8027163Z [cluster1] },
2021-07-17T12:16:11.8027848Z [cluster1] "kubernetesTypeVersion": {
2021-07-17T12:16:11.8028390Z [cluster1] "type": "string"
2021-07-17T12:16:11.8028961Z [cluster1] },
2021-07-17T12:16:11.8029402Z [cluster1] "kubernetesVersion": {
2021-07-17T12:16:11.8030129Z [cluster1] "type": "string"
2021-07-17T12:16:11.8030544Z [cluster1] }
2021-07-17T12:16:11.8030897Z [cluster1] },
2021-07-17T12:16:11.8031303Z [cluster1] "type": "object"
2021-07-17T12:16:11.8031694Z [cluster1] },
2021-07-17T12:16:11.8032209Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-17T12:16:11.8032758Z [cluster1] "properties": {
2021-07-17T12:16:11.8033582Z [cluster1] "lastResourceVersion": {
2021-07-17T12:16:11.8034082Z [cluster1] "type": "string"
2021-07-17T12:16:11.8034487Z [cluster1] },
2021-07-17T12:16:11.8035024Z [cluster1] "mismatchedContainerImages": {
2021-07-17T12:16:11.8035593Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8036003Z [cluster1] },
2021-07-17T12:16:11.8036572Z [cluster1] "nonReadyContainerStates": {
2021-07-17T12:16:11.8037118Z [cluster1] "items": {
2021-07-17T12:16:11.8038411Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T12:16:11.8039483Z [cluster1] "properties": {
2021-07-17T12:16:11.8039945Z [cluster1] "running": {
2021-07-17T12:16:11.8040507Z [cluster1] "description": "Details about a running container",
2021-07-17T12:16:11.8041674Z [cluster1] "properties": {
2021-07-17T12:16:11.8042159Z [cluster1] "startedAt": {
2021-07-17T12:16:11.8043098Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-17T12:16:11.8044084Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8044767Z [cluster1] "type": "string"
2021-07-17T12:16:11.8045626Z [cluster1] }
2021-07-17T12:16:11.8046060Z [cluster1] },
2021-07-17T12:16:11.8046522Z [cluster1] "type": "object"
2021-07-17T12:16:11.8046989Z [cluster1] },
2021-07-17T12:16:11.8047739Z [cluster1] "terminated": {
2021-07-17T12:16:11.8048382Z [cluster1] "description": "Details about a terminated container",
2021-07-17T12:16:11.8049330Z [cluster1] "properties": {
2021-07-17T12:16:11.8049800Z [cluster1] "containerID": {
2021-07-17T12:16:11.8050896Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T12:16:11.8051727Z [cluster1] "type": "string"
2021-07-17T12:16:11.8052184Z [cluster1] },
2021-07-17T12:16:11.8052636Z [cluster1] "exitCode": {
2021-07-17T12:16:11.8053469Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-17T12:16:11.8054296Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8055020Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8055449Z [cluster1] },
2021-07-17T12:16:11.8055893Z [cluster1] "finishedAt": {
2021-07-17T12:16:11.8056634Z [cluster1] "description": "Time at which the container last terminated",
2021-07-17T12:16:11.8057642Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8058120Z [cluster1] "type": "string"
2021-07-17T12:16:11.8058544Z [cluster1] },
2021-07-17T12:16:11.8058958Z [cluster1] "message": {
2021-07-17T12:16:11.8059579Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-17T12:16:11.8060307Z [cluster1] "type": "string"
2021-07-17T12:16:11.8060738Z [cluster1] },
2021-07-17T12:16:11.8061147Z [cluster1] "reason": {
2021-07-17T12:16:11.8061767Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-17T12:16:11.8062386Z [cluster1] "type": "string"
2021-07-17T12:16:11.8062808Z [cluster1] },
2021-07-17T12:16:11.8063240Z [cluster1] "signal": {
2021-07-17T12:16:11.8063848Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-17T12:16:11.8064457Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8064906Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8065441Z [cluster1] },
2021-07-17T12:16:11.8065850Z [cluster1] "startedAt": {
2021-07-17T12:16:11.8066585Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-17T12:16:11.8067469Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8067943Z [cluster1] "type": "string"
2021-07-17T12:16:11.8068372Z [cluster1] }
2021-07-17T12:16:11.8068742Z [cluster1] },
2021-07-17T12:16:11.8069399Z [cluster1] "required": [
2021-07-17T12:16:11.8069853Z [cluster1] "exitCode"
2021-07-17T12:16:11.8070285Z [cluster1] ],
2021-07-17T12:16:11.8070723Z [cluster1] "type": "object"
2021-07-17T12:16:11.8071137Z [cluster1] },
2021-07-17T12:16:11.8071552Z [cluster1] "waiting": {
2021-07-17T12:16:11.8072108Z [cluster1] "description": "Details about a waiting container",
2021-07-17T12:16:11.8072902Z [cluster1] "properties": {
2021-07-17T12:16:11.8073347Z [cluster1] "message": {
2021-07-17T12:16:11.8073977Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-17T12:16:11.8074609Z [cluster1] "type": "string"
2021-07-17T12:16:11.8075015Z [cluster1] },
2021-07-17T12:16:11.8075427Z [cluster1] "reason": {
2021-07-17T12:16:11.8076000Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-17T12:16:11.8076599Z [cluster1] "type": "string"
2021-07-17T12:16:11.8077118Z [cluster1] }
2021-07-17T12:16:11.8077628Z [cluster1] },
2021-07-17T12:16:11.8109530Z [cluster1] "type": "object"
2021-07-17T12:16:11.8109978Z [cluster1] }
2021-07-17T12:16:11.8110341Z [cluster1] },
2021-07-17T12:16:11.8110734Z [cluster1] "type": "object"
2021-07-17T12:16:11.8111125Z [cluster1] },
2021-07-17T12:16:11.8111506Z [cluster1] "type": "array"
2021-07-17T12:16:11.8112009Z [cluster1] },
2021-07-17T12:16:11.8112378Z [cluster1] "status": {
2021-07-17T12:16:11.8112984Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T12:16:11.8113627Z [cluster1] "properties": {
2021-07-17T12:16:11.8114073Z [cluster1] "collisionCount": {
2021-07-17T12:16:11.8115080Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T12:16:11.8116217Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8116640Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8117044Z [cluster1] },
2021-07-17T12:16:11.8117439Z [cluster1] "conditions": {
2021-07-17T12:16:11.8118756Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T12:16:11.8119532Z [cluster1] "items": {
2021-07-17T12:16:11.8120224Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T12:16:11.8120960Z [cluster1] "properties": {
2021-07-17T12:16:11.8121635Z [cluster1] "lastTransitionTime": {
2021-07-17T12:16:11.8122298Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T12:16:11.8123154Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8123602Z [cluster1] "type": "string"
2021-07-17T12:16:11.8124004Z [cluster1] },
2021-07-17T12:16:11.8124402Z [cluster1] "message": {
2021-07-17T12:16:11.8125013Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-17T12:16:11.8125641Z [cluster1] "type": "string"
2021-07-17T12:16:11.8126025Z [cluster1] },
2021-07-17T12:16:11.8126410Z [cluster1] "reason": {
2021-07-17T12:16:11.8127284Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-17T12:16:11.8127862Z [cluster1] "type": "string"
2021-07-17T12:16:11.8128263Z [cluster1] },
2021-07-17T12:16:11.8128633Z [cluster1] "status": {
2021-07-17T12:16:11.8129201Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T12:16:11.8129786Z [cluster1] "type": "string"
2021-07-17T12:16:11.8130170Z [cluster1] },
2021-07-17T12:16:11.8130556Z [cluster1] "type": {
2021-07-17T12:16:11.8131262Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-17T12:16:11.8132011Z [cluster1] "type": "string"
2021-07-17T12:16:11.8132432Z [cluster1] }
2021-07-17T12:16:11.8132827Z [cluster1] },
2021-07-17T12:16:11.8133254Z [cluster1] "required": [
2021-07-17T12:16:11.8133776Z [cluster1] "status",
2021-07-17T12:16:11.8134210Z [cluster1] "type"
2021-07-17T12:16:11.8134605Z [cluster1] ],
2021-07-17T12:16:11.8135041Z [cluster1] "type": "object"
2021-07-17T12:16:11.8135626Z [cluster1] },
2021-07-17T12:16:11.8136040Z [cluster1] "type": "array"
2021-07-17T12:16:11.8136600Z [cluster1] },
2021-07-17T12:16:11.8137072Z [cluster1] "currentNumberScheduled": {
2021-07-17T12:16:11.8138137Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8139094Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8139519Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8139918Z [cluster1] },
2021-07-17T12:16:11.8140538Z [cluster1] "desiredNumberScheduled": {
2021-07-17T12:16:11.8141650Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8142651Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8143074Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8143473Z [cluster1] },
2021-07-17T12:16:11.8143900Z [cluster1] "numberAvailable": {
2021-07-17T12:16:11.8144941Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.8145827Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8146245Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8146642Z [cluster1] },
2021-07-17T12:16:11.8147095Z [cluster1] "numberMisscheduled": {
2021-07-17T12:16:11.8148095Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8149034Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8149454Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8149853Z [cluster1] },
2021-07-17T12:16:11.8150242Z [cluster1] "numberReady": {
2021-07-17T12:16:11.8150961Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T12:16:11.8151728Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8152144Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8152538Z [cluster1] },
2021-07-17T12:16:11.8152964Z [cluster1] "numberUnavailable": {
2021-07-17T12:16:11.8153872Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.8154717Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8155134Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8155528Z [cluster1] },
2021-07-17T12:16:11.8155966Z [cluster1] "observedGeneration": {
2021-07-17T12:16:11.8156650Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T12:16:11.8157265Z [cluster1] "format": "int64",
2021-07-17T12:16:11.8157680Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8158073Z [cluster1] },
2021-07-17T12:16:11.8230983Z [cluster1] "updatedNumberScheduled": {
2021-07-17T12:16:11.8231806Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T12:16:11.8232447Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8233098Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8233542Z [cluster1] }
2021-07-17T12:16:11.8233921Z [cluster1] },
2021-07-17T12:16:11.8234349Z [cluster1] "required": [
2021-07-17T12:16:11.8234914Z [cluster1] "currentNumberScheduled",
2021-07-17T12:16:11.8236189Z [cluster1] "desiredNumberScheduled",
2021-07-17T12:16:11.8236798Z [cluster1] "numberMisscheduled",
2021-07-17T12:16:11.8237279Z [cluster1] "numberReady"
2021-07-17T12:16:11.8237842Z [cluster1] ],
2021-07-17T12:16:11.8238931Z [cluster1] "type": "object"
2021-07-17T12:16:11.8239370Z [cluster1] }
2021-07-17T12:16:11.8239716Z [cluster1] },
2021-07-17T12:16:11.8240198Z [cluster1] "required": [
2021-07-17T12:16:11.8240826Z [cluster1] "mismatchedContainerImages"
2021-07-17T12:16:11.8241501Z [cluster1] ],
2021-07-17T12:16:11.8241888Z [cluster1] "type": "object"
2021-07-17T12:16:11.8242248Z [cluster1] },
2021-07-17T12:16:11.8242616Z [cluster1] "gateways": {
2021-07-17T12:16:11.8242989Z [cluster1] "items": {
2021-07-17T12:16:11.8243394Z [cluster1] "properties": {
2021-07-17T12:16:11.8243814Z [cluster1] "connections": {
2021-07-17T12:16:11.8244343Z [cluster1] "items": {
2021-07-17T12:16:11.8244761Z [cluster1] "properties": {
2021-07-17T12:16:11.8245186Z [cluster1] "endpoint": {
2021-07-17T12:16:11.8245630Z [cluster1] "properties": {
2021-07-17T12:16:11.8246056Z [cluster1] "backend": {
2021-07-17T12:16:11.8246487Z [cluster1] "type": "string"
2021-07-17T12:16:11.8246880Z [cluster1] },
2021-07-17T12:16:11.8247294Z [cluster1] "backend_config": {
2021-07-17T12:16:11.8247822Z [cluster1] "additionalProperties": {
2021-07-17T12:16:11.8248336Z [cluster1] "type": "string"
2021-07-17T12:16:11.8248749Z [cluster1] },
2021-07-17T12:16:11.8249144Z [cluster1] "type": "object"
2021-07-17T12:16:11.8249553Z [cluster1] },
2021-07-17T12:16:11.8249955Z [cluster1] "cable_name": {
2021-07-17T12:16:11.8250373Z [cluster1] "type": "string"
2021-07-17T12:16:11.8250778Z [cluster1] },
2021-07-17T12:16:11.8251257Z [cluster1] "cluster_id": {
2021-07-17T12:16:11.8251706Z [cluster1] "type": "string"
2021-07-17T12:16:11.8252099Z [cluster1] },
2021-07-17T12:16:11.8252538Z [cluster1] "healthCheckIP": {
2021-07-17T12:16:11.8253083Z [cluster1] "type": "string"
2021-07-17T12:16:11.8253495Z [cluster1] },
2021-07-17T12:16:11.8253895Z [cluster1] "hostname": {
2021-07-17T12:16:11.8254313Z [cluster1] "type": "string"
2021-07-17T12:16:11.8254722Z [cluster1] },
2021-07-17T12:16:11.8255131Z [cluster1] "nat_enabled": {
2021-07-17T12:16:11.8255565Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8255976Z [cluster1] },
2021-07-17T12:16:11.8256363Z [cluster1] "private_ip": {
2021-07-17T12:16:11.8256803Z [cluster1] "type": "string"
2021-07-17T12:16:11.8257194Z [cluster1] },
2021-07-17T12:16:11.8257593Z [cluster1] "public_ip": {
2021-07-17T12:16:11.8258025Z [cluster1] "type": "string"
2021-07-17T12:16:11.8258414Z [cluster1] },
2021-07-17T12:16:11.8258885Z [cluster1] "subnets": {
2021-07-17T12:16:11.8259283Z [cluster1] "items": {
2021-07-17T12:16:11.8259707Z [cluster1] "type": "string"
2021-07-17T12:16:11.8260119Z [cluster1] },
2021-07-17T12:16:11.8260512Z [cluster1] "type": "array"
2021-07-17T12:16:11.8260912Z [cluster1] }
2021-07-17T12:16:11.8261264Z [cluster1] },
2021-07-17T12:16:11.8261694Z [cluster1] "required": [
2021-07-17T12:16:11.8262113Z [cluster1] "backend",
2021-07-17T12:16:11.8262537Z [cluster1] "cable_name",
2021-07-17T12:16:11.8262961Z [cluster1] "cluster_id",
2021-07-17T12:16:11.8263373Z [cluster1] "hostname",
2021-07-17T12:16:11.8263804Z [cluster1] "nat_enabled",
2021-07-17T12:16:11.8264227Z [cluster1] "private_ip",
2021-07-17T12:16:11.8264749Z [cluster1] "public_ip",
2021-07-17T12:16:11.8265158Z [cluster1] "subnets"
2021-07-17T12:16:11.8265553Z [cluster1] ],
2021-07-17T12:16:11.8265956Z [cluster1] "type": "object"
2021-07-17T12:16:11.8266341Z [cluster1] },
2021-07-17T12:16:11.8266746Z [cluster1] "latencyRTT": {
2021-07-17T12:16:11.8267559Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-17T12:16:11.8268340Z [cluster1] "properties": {
2021-07-17T12:16:11.8268779Z [cluster1] "average": {
2021-07-17T12:16:11.8269195Z [cluster1] "type": "string"
2021-07-17T12:16:11.8269604Z [cluster1] },
2021-07-17T12:16:11.8269971Z [cluster1] "last": {
2021-07-17T12:16:11.8270389Z [cluster1] "type": "string"
2021-07-17T12:16:11.8270778Z [cluster1] },
2021-07-17T12:16:11.8271157Z [cluster1] "max": {
2021-07-17T12:16:11.8271747Z [cluster1] "type": "string"
2021-07-17T12:16:11.8272384Z [cluster1] },
2021-07-17T12:16:11.8272802Z [cluster1] "min": {
2021-07-17T12:16:11.8273227Z [cluster1] "type": "string"
2021-07-17T12:16:11.8273752Z [cluster1] },
2021-07-17T12:16:11.8274165Z [cluster1] "stdDev": {
2021-07-17T12:16:11.8274603Z [cluster1] "type": "string"
2021-07-17T12:16:11.8275184Z [cluster1] }
2021-07-17T12:16:11.8275541Z [cluster1] },
2021-07-17T12:16:11.8275941Z [cluster1] "type": "object"
2021-07-17T12:16:11.8276324Z [cluster1] },
2021-07-17T12:16:11.8276708Z [cluster1] "status": {
2021-07-17T12:16:11.8277127Z [cluster1] "type": "string"
2021-07-17T12:16:11.8277515Z [cluster1] },
2021-07-17T12:16:11.8277938Z [cluster1] "statusMessage": {
2021-07-17T12:16:11.8278719Z [cluster1] "type": "string"
2021-07-17T12:16:11.8279143Z [cluster1] },
2021-07-17T12:16:11.8279546Z [cluster1] "usingIP": {
2021-07-17T12:16:11.8280002Z [cluster1] "type": "string"
2021-07-17T12:16:11.8280425Z [cluster1] },
2021-07-17T12:16:11.8280827Z [cluster1] "usingNAT": {
2021-07-17T12:16:11.8281516Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8281916Z [cluster1] }
2021-07-17T12:16:11.8282280Z [cluster1] },
2021-07-17T12:16:11.8282656Z [cluster1] "required": [
2021-07-17T12:16:11.8283081Z [cluster1] "endpoint",
2021-07-17T12:16:11.8283573Z [cluster1] "status",
2021-07-17T12:16:11.8284088Z [cluster1] "statusMessage"
2021-07-17T12:16:11.8284516Z [cluster1] ],
2021-07-17T12:16:11.8284899Z [cluster1] "type": "object"
2021-07-17T12:16:11.8285293Z [cluster1] },
2021-07-17T12:16:11.8285664Z [cluster1] "type": "array"
2021-07-17T12:16:11.8286054Z [cluster1] },
2021-07-17T12:16:11.8286496Z [cluster1] "haStatus": {
2021-07-17T12:16:11.8287944Z [cluster1] "type": "string"
2021-07-17T12:16:11.8288478Z [cluster1] },
2021-07-17T12:16:11.8289029Z [cluster1] "localEndpoint": {
2021-07-17T12:16:11.8289647Z [cluster1] "properties": {
2021-07-17T12:16:11.8290382Z [cluster1] "backend": {
2021-07-17T12:16:11.8290822Z [cluster1] "type": "string"
2021-07-17T12:16:11.8291242Z [cluster1] },
2021-07-17T12:16:11.8291792Z [cluster1] "backend_config": {
2021-07-17T12:16:11.8292457Z [cluster1] "additionalProperties": {
2021-07-17T12:16:11.8293186Z [cluster1] "type": "string"
2021-07-17T12:16:11.8293594Z [cluster1] },
2021-07-17T12:16:11.8293981Z [cluster1] "type": "object"
2021-07-17T12:16:11.8294383Z [cluster1] },
2021-07-17T12:16:11.8294775Z [cluster1] "cable_name": {
2021-07-17T12:16:11.8295183Z [cluster1] "type": "string"
2021-07-17T12:16:11.8295575Z [cluster1] },
2021-07-17T12:16:11.8295946Z [cluster1] "cluster_id": {
2021-07-17T12:16:11.8296371Z [cluster1] "type": "string"
2021-07-17T12:16:11.8296746Z [cluster1] },
2021-07-17T12:16:11.8297167Z [cluster1] "healthCheckIP": {
2021-07-17T12:16:11.8297621Z [cluster1] "type": "string"
2021-07-17T12:16:11.8297997Z [cluster1] },
2021-07-17T12:16:11.8298385Z [cluster1] "hostname": {
2021-07-17T12:16:11.8298791Z [cluster1] "type": "string"
2021-07-17T12:16:11.8299186Z [cluster1] },
2021-07-17T12:16:11.8299562Z [cluster1] "nat_enabled": {
2021-07-17T12:16:11.8299998Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8300393Z [cluster1] },
2021-07-17T12:16:11.8300773Z [cluster1] "private_ip": {
2021-07-17T12:16:11.8301197Z [cluster1] "type": "string"
2021-07-17T12:16:11.8301651Z [cluster1] },
2021-07-17T12:16:11.8302060Z [cluster1] "public_ip": {
2021-07-17T12:16:11.8302470Z [cluster1] "type": "string"
2021-07-17T12:16:11.8302866Z [cluster1] },
2021-07-17T12:16:11.8303251Z [cluster1] "subnets": {
2021-07-17T12:16:11.8303638Z [cluster1] "items": {
2021-07-17T12:16:11.8304058Z [cluster1] "type": "string"
2021-07-17T12:16:11.8304439Z [cluster1] },
2021-07-17T12:16:11.8304828Z [cluster1] "type": "array"
2021-07-17T12:16:11.8305205Z [cluster1] }
2021-07-17T12:16:11.8305563Z [cluster1] },
2021-07-17T12:16:11.8305951Z [cluster1] "required": [
2021-07-17T12:16:11.8306348Z [cluster1] "backend",
2021-07-17T12:16:11.8306755Z [cluster1] "cable_name",
2021-07-17T12:16:11.8307149Z [cluster1] "cluster_id",
2021-07-17T12:16:11.8307641Z [cluster1] "hostname",
2021-07-17T12:16:11.8308044Z [cluster1] "nat_enabled",
2021-07-17T12:16:11.8308465Z [cluster1] "private_ip",
2021-07-17T12:16:11.8308878Z [cluster1] "public_ip",
2021-07-17T12:16:11.8309276Z [cluster1] "subnets"
2021-07-17T12:16:11.8309658Z [cluster1] ],
2021-07-17T12:16:11.8310032Z [cluster1] "type": "object"
2021-07-17T12:16:11.8310420Z [cluster1] },
2021-07-17T12:16:11.8310813Z [cluster1] "statusFailure": {
2021-07-17T12:16:11.8311253Z [cluster1] "type": "string"
2021-07-17T12:16:11.8311639Z [cluster1] },
2021-07-17T12:16:11.8311996Z [cluster1] "version": {
2021-07-17T12:16:11.8312408Z [cluster1] "type": "string"
2021-07-17T12:16:11.8312776Z [cluster1] }
2021-07-17T12:16:11.8313122Z [cluster1] },
2021-07-17T12:16:11.8313484Z [cluster1] "required": [
2021-07-17T12:16:11.8313904Z [cluster1] "connections",
2021-07-17T12:16:11.8314324Z [cluster1] "haStatus",
2021-07-17T12:16:11.8314747Z [cluster1] "localEndpoint",
2021-07-17T12:16:11.8315207Z [cluster1] "statusFailure",
2021-07-17T12:16:11.8315624Z [cluster1] "version"
2021-07-17T12:16:11.8315993Z [cluster1] ],
2021-07-17T12:16:11.8316357Z [cluster1] "type": "object"
2021-07-17T12:16:11.8316732Z [cluster1] },
2021-07-17T12:16:11.8317092Z [cluster1] "type": "array"
2021-07-17T12:16:11.8317518Z [cluster1] },
2021-07-17T12:16:11.8317913Z [cluster1] "globalCIDR": {
2021-07-17T12:16:11.8359026Z [cluster1] "type": "string"
2021-07-17T12:16:11.8359444Z [cluster1] },
2021-07-17T12:16:11.8360218Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-17T12:16:11.8360797Z [cluster1] "properties": {
2021-07-17T12:16:11.8361356Z [cluster1] "lastResourceVersion": {
2021-07-17T12:16:11.8361848Z [cluster1] "type": "string"
2021-07-17T12:16:11.8362229Z [cluster1] },
2021-07-17T12:16:11.8362724Z [cluster1] "mismatchedContainerImages": {
2021-07-17T12:16:11.8363280Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8363659Z [cluster1] },
2021-07-17T12:16:11.8364150Z [cluster1] "nonReadyContainerStates": {
2021-07-17T12:16:11.8364645Z [cluster1] "items": {
2021-07-17T12:16:11.8365574Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T12:16:11.8366694Z [cluster1] "properties": {
2021-07-17T12:16:11.8367105Z [cluster1] "running": {
2021-07-17T12:16:11.8367631Z [cluster1] "description": "Details about a running container",
2021-07-17T12:16:11.8368254Z [cluster1] "properties": {
2021-07-17T12:16:11.8368710Z [cluster1] "startedAt": {
2021-07-17T12:16:11.8369628Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-17T12:16:11.8370380Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8370843Z [cluster1] "type": "string"
2021-07-17T12:16:11.8371240Z [cluster1] }
2021-07-17T12:16:11.8371606Z [cluster1] },
2021-07-17T12:16:11.8371992Z [cluster1] "type": "object"
2021-07-17T12:16:11.8372392Z [cluster1] },
2021-07-17T12:16:11.8372979Z [cluster1] "terminated": {
2021-07-17T12:16:11.8373554Z [cluster1] "description": "Details about a terminated container",
2021-07-17T12:16:11.8374144Z [cluster1] "properties": {
2021-07-17T12:16:11.8374607Z [cluster1] "containerID": {
2021-07-17T12:16:11.8375609Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T12:16:11.8376409Z [cluster1] "type": "string"
2021-07-17T12:16:11.8376802Z [cluster1] },
2021-07-17T12:16:11.8377306Z [cluster1] "exitCode": {
2021-07-17T12:16:11.8377906Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-17T12:16:11.8378497Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8378944Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8379342Z [cluster1] },
2021-07-17T12:16:11.8379759Z [cluster1] "finishedAt": {
2021-07-17T12:16:11.8380318Z [cluster1] "description": "Time at which the container last terminated",
2021-07-17T12:16:11.8381224Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8381691Z [cluster1] "type": "string"
2021-07-17T12:16:11.8382094Z [cluster1] },
2021-07-17T12:16:11.8382487Z [cluster1] "message": {
2021-07-17T12:16:11.8383077Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-17T12:16:11.8383788Z [cluster1] "type": "string"
2021-07-17T12:16:11.8384176Z [cluster1] },
2021-07-17T12:16:11.8384564Z [cluster1] "reason": {
2021-07-17T12:16:11.8385150Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-17T12:16:11.8385738Z [cluster1] "type": "string"
2021-07-17T12:16:11.8386138Z [cluster1] },
2021-07-17T12:16:11.8386509Z [cluster1] "signal": {
2021-07-17T12:16:11.8387072Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-17T12:16:11.8396314Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8396922Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8397637Z [cluster1] },
2021-07-17T12:16:11.8398294Z [cluster1] "startedAt": {
2021-07-17T12:16:11.8431625Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-17T12:16:11.8432574Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8433046Z [cluster1] "type": "string"
2021-07-17T12:16:11.8433450Z [cluster1] }
2021-07-17T12:16:11.8433811Z [cluster1] },
2021-07-17T12:16:11.8434208Z [cluster1] "required": [
2021-07-17T12:16:11.8434625Z [cluster1] "exitCode"
2021-07-17T12:16:11.8435027Z [cluster1] ],
2021-07-17T12:16:11.8435567Z [cluster1] "type": "object"
2021-07-17T12:16:11.8435979Z [cluster1] },
2021-07-17T12:16:11.8436475Z [cluster1] "waiting": {
2021-07-17T12:16:11.8437003Z [cluster1] "description": "Details about a waiting container",
2021-07-17T12:16:11.8437549Z [cluster1] "properties": {
2021-07-17T12:16:11.8437980Z [cluster1] "message": {
2021-07-17T12:16:11.8438731Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-17T12:16:11.8439336Z [cluster1] "type": "string"
2021-07-17T12:16:11.8439731Z [cluster1] },
2021-07-17T12:16:11.8440121Z [cluster1] "reason": {
2021-07-17T12:16:11.8440661Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-17T12:16:11.8441234Z [cluster1] "type": "string"
2021-07-17T12:16:11.8441633Z [cluster1] }
2021-07-17T12:16:11.8442095Z [cluster1] },
2021-07-17T12:16:11.8442500Z [cluster1] "type": "object"
2021-07-17T12:16:11.8442885Z [cluster1] }
2021-07-17T12:16:11.8443240Z [cluster1] },
2021-07-17T12:16:11.8443623Z [cluster1] "type": "object"
2021-07-17T12:16:11.8444011Z [cluster1] },
2021-07-17T12:16:11.8444390Z [cluster1] "type": "array"
2021-07-17T12:16:11.8444754Z [cluster1] },
2021-07-17T12:16:11.8445119Z [cluster1] "status": {
2021-07-17T12:16:11.8445715Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T12:16:11.8446353Z [cluster1] "properties": {
2021-07-17T12:16:11.8446798Z [cluster1] "collisionCount": {
2021-07-17T12:16:11.8447809Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T12:16:11.8448775Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8449197Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8449588Z [cluster1] },
2021-07-17T12:16:11.8449963Z [cluster1] "conditions": {
2021-07-17T12:16:11.8450919Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T12:16:11.8451574Z [cluster1] "items": {
2021-07-17T12:16:11.8452220Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T12:16:11.8452997Z [cluster1] "properties": {
2021-07-17T12:16:11.8453501Z [cluster1] "lastTransitionTime": {
2021-07-17T12:16:11.8454183Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T12:16:11.8455156Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8455619Z [cluster1] "type": "string"
2021-07-17T12:16:11.8456027Z [cluster1] },
2021-07-17T12:16:11.8456407Z [cluster1] "message": {
2021-07-17T12:16:11.8457044Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-17T12:16:11.8457676Z [cluster1] "type": "string"
2021-07-17T12:16:11.8458063Z [cluster1] },
2021-07-17T12:16:11.8458447Z [cluster1] "reason": {
2021-07-17T12:16:11.8459214Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-17T12:16:11.8459897Z [cluster1] "type": "string"
2021-07-17T12:16:11.8460299Z [cluster1] },
2021-07-17T12:16:11.8460673Z [cluster1] "status": {
2021-07-17T12:16:11.8461250Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T12:16:11.8461816Z [cluster1] "type": "string"
2021-07-17T12:16:11.8462218Z [cluster1] },
2021-07-17T12:16:11.8462587Z [cluster1] "type": {
2021-07-17T12:16:11.8463107Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-17T12:16:11.8463643Z [cluster1] "type": "string"
2021-07-17T12:16:11.8464029Z [cluster1] }
2021-07-17T12:16:11.8464393Z [cluster1] },
2021-07-17T12:16:11.8464773Z [cluster1] "required": [
2021-07-17T12:16:11.8465188Z [cluster1] "status",
2021-07-17T12:16:11.8465572Z [cluster1] "type"
2021-07-17T12:16:11.8465948Z [cluster1] ],
2021-07-17T12:16:11.8466388Z [cluster1] "type": "object"
2021-07-17T12:16:11.8466776Z [cluster1] },
2021-07-17T12:16:11.8467177Z [cluster1] "type": "array"
2021-07-17T12:16:11.8467550Z [cluster1] },
2021-07-17T12:16:11.8468035Z [cluster1] "currentNumberScheduled": {
2021-07-17T12:16:11.8469274Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8470233Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8470669Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8471053Z [cluster1] },
2021-07-17T12:16:11.8471546Z [cluster1] "desiredNumberScheduled": {
2021-07-17T12:16:11.8472655Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8473642Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8474273Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8474678Z [cluster1] },
2021-07-17T12:16:11.8475128Z [cluster1] "numberAvailable": {
2021-07-17T12:16:11.8476084Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.8477061Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8477659Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8478040Z [cluster1] },
2021-07-17T12:16:11.8478796Z [cluster1] "numberMisscheduled": {
2021-07-17T12:16:11.8479871Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8480848Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8481306Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8481863Z [cluster1] },
2021-07-17T12:16:11.8482266Z [cluster1] "numberReady": {
2021-07-17T12:16:11.8482982Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T12:16:11.8483669Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8484103Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8484485Z [cluster1] },
2021-07-17T12:16:11.8484925Z [cluster1] "numberUnavailable": {
2021-07-17T12:16:11.8485814Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.8486664Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8487093Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8487472Z [cluster1] },
2021-07-17T12:16:11.8488003Z [cluster1] "observedGeneration": {
2021-07-17T12:16:11.8489246Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T12:16:11.8490177Z [cluster1] "format": "int64",
2021-07-17T12:16:11.8490766Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8491303Z [cluster1] },
2021-07-17T12:16:11.8491973Z [cluster1] "updatedNumberScheduled": {
2021-07-17T12:16:11.8492896Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T12:16:11.8493479Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8493915Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8494298Z [cluster1] }
2021-07-17T12:16:11.8494652Z [cluster1] },
2021-07-17T12:16:11.8495025Z [cluster1] "required": [
2021-07-17T12:16:11.8495544Z [cluster1] "currentNumberScheduled",
2021-07-17T12:16:11.8496302Z [cluster1] "desiredNumberScheduled",
2021-07-17T12:16:11.8496890Z [cluster1] "numberMisscheduled",
2021-07-17T12:16:11.8497387Z [cluster1] "numberReady"
2021-07-17T12:16:11.8497773Z [cluster1] ],
2021-07-17T12:16:11.8498161Z [cluster1] "type": "object"
2021-07-17T12:16:11.8498536Z [cluster1] }
2021-07-17T12:16:11.8498880Z [cluster1] },
2021-07-17T12:16:11.8499237Z [cluster1] "required": [
2021-07-17T12:16:11.8499772Z [cluster1] "mismatchedContainerImages"
2021-07-17T12:16:11.8500261Z [cluster1] ],
2021-07-17T12:16:11.8500641Z [cluster1] "type": "object"
2021-07-17T12:16:11.8501015Z [cluster1] },
2021-07-17T12:16:11.8501432Z [cluster1] "loadBalancerStatus": {
2021-07-17T12:16:11.8536354Z [cluster1] "properties": {
2021-07-17T12:16:11.8536751Z [cluster1] "status": {
2021-07-17T12:16:11.8537725Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-17T12:16:11.8538380Z [cluster1] "properties": {
2021-07-17T12:16:11.8538805Z [cluster1] "ingress": {
2021-07-17T12:16:11.8540007Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-17T12:16:11.8540804Z [cluster1] "items": {
2021-07-17T12:16:11.8541923Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-17T12:16:11.8542814Z [cluster1] "properties": {
2021-07-17T12:16:11.8543367Z [cluster1] "hostname": {
2021-07-17T12:16:11.8544380Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-17T12:16:11.8545091Z [cluster1] "type": "string"
2021-07-17T12:16:11.8545501Z [cluster1] },
2021-07-17T12:16:11.8545873Z [cluster1] "ip": {
2021-07-17T12:16:11.8546841Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-17T12:16:11.8547584Z [cluster1] "type": "string"
2021-07-17T12:16:11.8547976Z [cluster1] }
2021-07-17T12:16:11.8548344Z [cluster1] },
2021-07-17T12:16:11.8548727Z [cluster1] "type": "object"
2021-07-17T12:16:11.8549127Z [cluster1] },
2021-07-17T12:16:11.8549519Z [cluster1] "type": "array"
2021-07-17T12:16:11.8550003Z [cluster1] }
2021-07-17T12:16:11.8550360Z [cluster1] },
2021-07-17T12:16:11.8550734Z [cluster1] "type": "object"
2021-07-17T12:16:11.8551114Z [cluster1] }
2021-07-17T12:16:11.8551442Z [cluster1] },
2021-07-17T12:16:11.8551825Z [cluster1] "type": "object"
2021-07-17T12:16:11.8552197Z [cluster1] },
2021-07-17T12:16:11.8552561Z [cluster1] "natEnabled": {
2021-07-17T12:16:11.8552976Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8553341Z [cluster1] },
2021-07-17T12:16:11.8553736Z [cluster1] "networkPlugin": {
2021-07-17T12:16:11.8554158Z [cluster1] "type": "string"
2021-07-17T12:16:11.8554528Z [cluster1] },
2021-07-17T12:16:11.8555022Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-17T12:16:11.8555575Z [cluster1] "properties": {
2021-07-17T12:16:11.8556064Z [cluster1] "lastResourceVersion": {
2021-07-17T12:16:11.8556538Z [cluster1] "type": "string"
2021-07-17T12:16:11.8556919Z [cluster1] },
2021-07-17T12:16:11.8557411Z [cluster1] "mismatchedContainerImages": {
2021-07-17T12:16:11.8557961Z [cluster1] "type": "boolean"
2021-07-17T12:16:11.8558444Z [cluster1] },
2021-07-17T12:16:11.8558959Z [cluster1] "nonReadyContainerStates": {
2021-07-17T12:16:11.8559470Z [cluster1] "items": {
2021-07-17T12:16:11.8560386Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T12:16:11.8561424Z [cluster1] "properties": {
2021-07-17T12:16:11.8561850Z [cluster1] "running": {
2021-07-17T12:16:11.8562372Z [cluster1] "description": "Details about a running container",
2021-07-17T12:16:11.8562917Z [cluster1] "properties": {
2021-07-17T12:16:11.8563344Z [cluster1] "startedAt": {
2021-07-17T12:16:11.8564169Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-17T12:16:11.8564948Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8565418Z [cluster1] "type": "string"
2021-07-17T12:16:11.8565808Z [cluster1] }
2021-07-17T12:16:11.8566174Z [cluster1] },
2021-07-17T12:16:11.8566575Z [cluster1] "type": "object"
2021-07-17T12:16:11.8566958Z [cluster1] },
2021-07-17T12:16:11.8567357Z [cluster1] "terminated": {
2021-07-17T12:16:11.8568003Z [cluster1] "description": "Details about a terminated container",
2021-07-17T12:16:11.8568563Z [cluster1] "properties": {
2021-07-17T12:16:11.8569019Z [cluster1] "containerID": {
2021-07-17T12:16:11.8569874Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T12:16:11.8570479Z [cluster1] "type": "string"
2021-07-17T12:16:11.8570868Z [cluster1] },
2021-07-17T12:16:11.8571270Z [cluster1] "exitCode": {
2021-07-17T12:16:11.8571847Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-17T12:16:11.8572440Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8572886Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8573278Z [cluster1] },
2021-07-17T12:16:11.8573688Z [cluster1] "finishedAt": {
2021-07-17T12:16:11.8574251Z [cluster1] "description": "Time at which the container last terminated",
2021-07-17T12:16:11.8575017Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8575673Z [cluster1] "type": "string"
2021-07-17T12:16:11.8576083Z [cluster1] },
2021-07-17T12:16:11.8576502Z [cluster1] "message": {
2021-07-17T12:16:11.8577121Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-17T12:16:11.8577759Z [cluster1] "type": "string"
2021-07-17T12:16:11.8578274Z [cluster1] },
2021-07-17T12:16:11.8578829Z [cluster1] "reason": {
2021-07-17T12:16:11.8579411Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-17T12:16:11.8579989Z [cluster1] "type": "string"
2021-07-17T12:16:11.8580399Z [cluster1] },
2021-07-17T12:16:11.8580770Z [cluster1] "signal": {
2021-07-17T12:16:11.8581334Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-17T12:16:11.8581906Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8582338Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8582748Z [cluster1] },
2021-07-17T12:16:11.8583134Z [cluster1] "startedAt": {
2021-07-17T12:16:11.8583744Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-17T12:16:11.8584641Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8585087Z [cluster1] "type": "string"
2021-07-17T12:16:11.8585488Z [cluster1] }
2021-07-17T12:16:11.8585838Z [cluster1] },
2021-07-17T12:16:11.8586238Z [cluster1] "required": [
2021-07-17T12:16:11.8586665Z [cluster1] "exitCode"
2021-07-17T12:16:11.8587044Z [cluster1] ],
2021-07-17T12:16:11.8587443Z [cluster1] "type": "object"
2021-07-17T12:16:11.8587821Z [cluster1] },
2021-07-17T12:16:11.8588209Z [cluster1] "waiting": {
2021-07-17T12:16:11.8588716Z [cluster1] "description": "Details about a waiting container",
2021-07-17T12:16:11.8589261Z [cluster1] "properties": {
2021-07-17T12:16:11.8590597Z [cluster1] "message": {
2021-07-17T12:16:11.8591417Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-17T12:16:11.8592232Z [cluster1] "type": "string"
2021-07-17T12:16:11.8592765Z [cluster1] },
2021-07-17T12:16:11.8593743Z [cluster1] "reason": {
2021-07-17T12:16:11.8594523Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-17T12:16:11.8595322Z [cluster1] "type": "string"
2021-07-17T12:16:11.8596317Z [cluster1] }
2021-07-17T12:16:11.8597137Z [cluster1] },
2021-07-17T12:16:11.8597671Z [cluster1] "type": "object"
2021-07-17T12:16:11.8598453Z [cluster1] }
2021-07-17T12:16:11.8638950Z [cluster1] },
2021-07-17T12:16:11.8639362Z [cluster1] "type": "object"
2021-07-17T12:16:11.8639742Z [cluster1] },
2021-07-17T12:16:11.8640131Z [cluster1] "type": "array"
2021-07-17T12:16:11.8640496Z [cluster1] },
2021-07-17T12:16:11.8640863Z [cluster1] "status": {
2021-07-17T12:16:11.8641466Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T12:16:11.8642111Z [cluster1] "properties": {
2021-07-17T12:16:11.8642572Z [cluster1] "collisionCount": {
2021-07-17T12:16:11.8643564Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T12:16:11.8644672Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8645092Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8645496Z [cluster1] },
2021-07-17T12:16:11.8645890Z [cluster1] "conditions": {
2021-07-17T12:16:11.8646902Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T12:16:11.8647560Z [cluster1] "items": {
2021-07-17T12:16:11.8648211Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T12:16:11.8648900Z [cluster1] "properties": {
2021-07-17T12:16:11.8649405Z [cluster1] "lastTransitionTime": {
2021-07-17T12:16:11.8650065Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T12:16:11.8650887Z [cluster1] "format": "date-time",
2021-07-17T12:16:11.8651337Z [cluster1] "type": "string"
2021-07-17T12:16:11.8651743Z [cluster1] },
2021-07-17T12:16:11.8652122Z [cluster1] "message": {
2021-07-17T12:16:11.8652751Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-17T12:16:11.8653385Z [cluster1] "type": "string"
2021-07-17T12:16:11.8653772Z [cluster1] },
2021-07-17T12:16:11.8654159Z [cluster1] "reason": {
2021-07-17T12:16:11.8654912Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-17T12:16:11.8655727Z [cluster1] "type": "string"
2021-07-17T12:16:11.8656165Z [cluster1] },
2021-07-17T12:16:11.8656540Z [cluster1] "status": {
2021-07-17T12:16:11.8657112Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T12:16:11.8657682Z [cluster1] "type": "string"
2021-07-17T12:16:11.8658084Z [cluster1] },
2021-07-17T12:16:11.8658467Z [cluster1] "type": {
2021-07-17T12:16:11.8658970Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-17T12:16:11.8659507Z [cluster1] "type": "string"
2021-07-17T12:16:11.8659895Z [cluster1] }
2021-07-17T12:16:11.8660262Z [cluster1] },
2021-07-17T12:16:11.8660641Z [cluster1] "required": [
2021-07-17T12:16:11.8661055Z [cluster1] "status",
2021-07-17T12:16:11.8661533Z [cluster1] "type"
2021-07-17T12:16:11.8661899Z [cluster1] ],
2021-07-17T12:16:11.8662297Z [cluster1] "type": "object"
2021-07-17T12:16:11.8662680Z [cluster1] },
2021-07-17T12:16:11.8663076Z [cluster1] "type": "array"
2021-07-17T12:16:11.8663446Z [cluster1] },
2021-07-17T12:16:11.8663973Z [cluster1] "currentNumberScheduled": {
2021-07-17T12:16:11.8665040Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8665979Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8666417Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8666799Z [cluster1] },
2021-07-17T12:16:11.8667290Z [cluster1] "desiredNumberScheduled": {
2021-07-17T12:16:11.8668402Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8669393Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8669826Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8670210Z [cluster1] },
2021-07-17T12:16:11.8670641Z [cluster1] "numberAvailable": {
2021-07-17T12:16:11.8671549Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.8672459Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8672913Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8673293Z [cluster1] },
2021-07-17T12:16:11.8673741Z [cluster1] "numberMisscheduled": {
2021-07-17T12:16:11.8674754Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T12:16:11.8675687Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8676118Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8676684Z [cluster1] },
2021-07-17T12:16:11.8677116Z [cluster1] "numberReady": {
2021-07-17T12:16:11.8677875Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T12:16:11.8678780Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8679240Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8679743Z [cluster1] },
2021-07-17T12:16:11.8680345Z [cluster1] "numberUnavailable": {
2021-07-17T12:16:11.8681251Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T12:16:11.8682080Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8682508Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8683066Z [cluster1] },
2021-07-17T12:16:11.8683891Z [cluster1] "observedGeneration": {
2021-07-17T12:16:11.8684924Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T12:16:11.8685797Z [cluster1] "format": "int64",
2021-07-17T12:16:11.8686306Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8686755Z [cluster1] },
2021-07-17T12:16:11.8687654Z [cluster1] "updatedNumberScheduled": {
2021-07-17T12:16:11.8688559Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T12:16:11.8689604Z [cluster1] "format": "int32",
2021-07-17T12:16:11.8690043Z [cluster1] "type": "integer"
2021-07-17T12:16:11.8691159Z [cluster1] }
2021-07-17T12:16:11.8691713Z [cluster1] },
2021-07-17T12:16:11.8692222Z [cluster1] "required": [
2021-07-17T12:16:11.8692932Z [cluster1] "currentNumberScheduled",
2021-07-17T12:16:11.8693781Z [cluster1] "desiredNumberScheduled",
2021-07-17T12:16:11.8694749Z [cluster1] "numberMisscheduled",
2021-07-17T12:16:11.8695301Z [cluster1] "numberReady"
2021-07-17T12:16:11.8695981Z [cluster1] ],
2021-07-17T12:16:11.8696375Z [cluster1] "type": "object"
2021-07-17T12:16:11.8696746Z [cluster1] }
2021-07-17T12:16:11.8697090Z [cluster1] },
2021-07-17T12:16:11.8697452Z [cluster1] "required": [
2021-07-17T12:16:11.8697988Z [cluster1] "mismatchedContainerImages"
2021-07-17T12:16:11.8698491Z [cluster1] ],
2021-07-17T12:16:11.8698854Z [cluster1] "type": "object"
2021-07-17T12:16:11.8699229Z [cluster1] },
2021-07-17T12:16:11.8699602Z [cluster1] "serviceCIDR": {
2021-07-17T12:16:11.8700027Z [cluster1] "type": "string"
2021-07-17T12:16:11.8700382Z [cluster1] }
2021-07-17T12:16:11.8700716Z [cluster1] },
2021-07-17T12:16:11.8701063Z [cluster1] "required": [
2021-07-17T12:16:11.8701465Z [cluster1] "clusterID",
2021-07-17T12:16:11.8701961Z [cluster1] "natEnabled"
2021-07-17T12:16:11.8702317Z [cluster1] ],
2021-07-17T12:16:11.8702690Z [cluster1] "type": "object"
2021-07-17T12:16:11.8703033Z [cluster1] }
2021-07-17T12:16:11.8703354Z [cluster1] },
2021-07-17T12:16:11.8703696Z [cluster1] "type": "object"
2021-07-17T12:16:11.8704054Z [cluster1] }
2021-07-17T12:16:11.8704351Z [cluster1] },
2021-07-17T12:16:11.8704700Z [cluster1] "served": true,
2021-07-17T12:16:11.8705087Z [cluster1] "storage": true,
2021-07-17T12:16:11.8705473Z [cluster1] "subresources": {
2021-07-17T12:16:11.8705857Z [cluster1] "status": {}
2021-07-17T12:16:11.8706171Z [cluster1] }
2021-07-17T12:16:11.8706478Z [cluster1] }
2021-07-17T12:16:11.8706766Z [cluster1] ]
2021-07-17T12:16:11.8707060Z [cluster1] },
2021-07-17T12:16:11.8707355Z [cluster1] "status": {
2021-07-17T12:16:11.8707735Z [cluster1] "acceptedNames": {
2021-07-17T12:16:11.8708139Z [cluster1] "kind": "Submariner",
2021-07-17T12:16:11.8708591Z [cluster1] "listKind": "SubmarinerList",
2021-07-17T12:16:11.8709043Z [cluster1] "plural": "submariners",
2021-07-17T12:16:11.8709486Z [cluster1] "singular": "submariner"
2021-07-17T12:16:11.8709858Z [cluster1] },
2021-07-17T12:16:11.8710184Z [cluster1] "conditions": [
2021-07-17T12:16:11.8710522Z [cluster1] {
2021-07-17T12:16:11.8711211Z [cluster1] "lastTransitionTime": "2021-07-17T12:11:30Z",
2021-07-17T12:16:13.5430890Z [cluster1] "message": "no conflicts found",
2021-07-17T12:16:13.5431426Z [cluster2] "reason": "NoConflicts",
2021-07-17T12:16:13.5431851Z [cluster2] "status": "True",
2021-07-17T12:16:13.5432342Z [cluster2] "type": "NamesAccepted"
2021-07-17T12:16:13.5432735Z [cluster2] },
2021-07-17T12:16:13.5433061Z [cluster2] {
2021-07-17T12:16:13.5434074Z [cluster2] "lastTransitionTime": "2021-07-17T12:11:41Z",
2021-07-17T12:16:13.5434677Z [cluster2] "message": "the initial names have been accepted",
2021-07-17T12:16:13.5435297Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-17T12:16:13.5435972Z [cluster2] "status": "True",
2021-07-17T12:16:13.5436430Z [cluster2] "type": "Established"
2021-07-17T12:16:13.5436803Z [cluster2] }
2021-07-17T12:16:13.5437117Z [cluster2] ],
2021-07-17T12:16:13.5437494Z [cluster2] "storedVersions": [
2021-07-17T12:16:13.5437911Z [cluster2] "v1alpha1"
2021-07-17T12:16:13.5438244Z [cluster2] ]
2021-07-17T12:16:13.5438716Z [cluster2] }
2021-07-17T12:16:13.5439012Z [cluster2] }
2021-07-17T12:16:13.5439965Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-17T12:16:13.5441221Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-17T12:16:13.5442623Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-17T12:16:13.5443892Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T12:16:13.5444854Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T12:16:13.5446119Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-17T12:16:13.5447383Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T12:16:13.5448366Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T12:16:13.5449637Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-17T12:16:13.5451073Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-17T12:16:13.5452256Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-17T12:16:13.5453674Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-17T12:16:13.5454988Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-17T12:16:13.5455806Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-17T12:16:13.5456690Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-17T12:16:13.5457679Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-17T12:16:13.5458753Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-17T12:16:13.5459473Z [cluster2] NAME STATUS AGE
2021-07-17T12:16:13.5460099Z [cluster2] submariner-operator Active 4m31s
2021-07-17T12:16:13.5461033Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T12:16:13.5462140Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T12:16:13.5463340Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-17T12:16:13.5464115Z [cluster2] NAME CREATED AT
2021-07-17T12:16:13.5464803Z [cluster2] submariners.submariner.io 2021-07-17T12:11:41Z
2021-07-17T12:16:13.5465640Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-17T12:16:13.5466450Z [submariner-operator]$ [cluster2] grep submariners
2021-07-17T12:16:13.5467281Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-17T12:16:13.5468238Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-17T12:16:13.5469042Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-17T12:16:13.5470156Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.5471574Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.5473096Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.5474956Z [cluster2] NAME SECRETS AGE
2021-07-17T12:16:13.5476205Z [cluster2] submariner-operator 1 4m32s
2021-07-17T12:16:13.5477929Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.5479632Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.5481080Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.5481934Z [cluster2] NAME CREATED AT
2021-07-17T12:16:13.5482579Z [cluster2] submariner-operator 2021-07-17T12:11:42Z
2021-07-17T12:16:13.7265432Z [submariner-operator]$ [cluster2] kubectl geto conflicts found",
2021-07-17T12:16:13.7266077Z [cluster1] "reason": "NoConflicts",
2021-07-17T12:16:13.7266501Z [cluster1] "status": "True",
2021-07-17T12:16:13.7266912Z [cluster1] "type": "NamesAccepted"
2021-07-17T12:16:13.7267300Z [cluster1] },
2021-07-17T12:16:13.7267590Z [cluster1] {
2021-07-17T12:16:13.7268348Z [cluster1] "lastTransitionTime": "2021-07-17T12:11:30Z",
2021-07-17T12:16:13.7268936Z [cluster1] "message": "the initial names have been accepted",
2021-07-17T12:16:13.7269725Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-17T12:16:13.7270212Z [cluster1] "status": "True",
2021-07-17T12:16:13.7270604Z [cluster1] "type": "Established"
2021-07-17T12:16:13.7271074Z [cluster1] }
2021-07-17T12:16:13.7271364Z [cluster1] ],
2021-07-17T12:16:13.7271734Z [cluster1] "storedVersions": [
2021-07-17T12:16:13.7272115Z [cluster1] "v1alpha1"
2021-07-17T12:16:13.7272510Z [cluster1] ]
2021-07-17T12:16:13.7272831Z [cluster1] }
2021-07-17T12:16:13.7273252Z [cluster1] }
2021-07-17T12:16:13.7274171Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-17T12:16:13.7275439Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-17T12:16:13.7276812Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-17T12:16:13.7278096Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T12:16:13.7279233Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T12:16:13.7280511Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-17T12:16:13.7281801Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T12:16:13.7282789Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T12:16:13.7284065Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-17T12:16:13.7285371Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-17T12:16:13.7286406Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-17T12:16:13.7287687Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-17T12:16:13.7288890Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-17T12:16:13.7289725Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-17T12:16:13.7290634Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-17T12:16:13.7291640Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-17T12:16:13.7294276Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-17T12:16:13.7295324Z [cluster1] NAME STATUS AGE
2021-07-17T12:16:13.7296604Z [cluster1] submariner-operator Active 4m42s
2021-07-17T12:16:13.7297608Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T12:16:13.7298758Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T12:16:13.7299936Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-17T12:16:13.7300739Z [cluster1] NAME CREATED AT
2021-07-17T12:16:13.7301426Z [cluster1] submariners.submariner.io 2021-07-17T12:11:30Z
2021-07-17T12:16:13.7302317Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-17T12:16:13.7303146Z [submariner-operator]$ [cluster1] grep submariners
2021-07-17T12:16:13.7304030Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-17T12:16:13.7305012Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-17T12:16:13.7305798Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-17T12:16:13.7306947Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.7308222Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.7309743Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.7310619Z [cluster1] NAME SECRETS AGE
2021-07-17T12:16:13.7311228Z [cluster1] submariner-operator 1 4m43s
2021-07-17T12:16:13.7312312Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.7313598Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.7314993Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-17T12:16:13.7315822Z [cluster1] NAME CREATED AT
2021-07-17T12:16:13.7316476Z [cluster1] submariner-operator 2021-07-17T12:11:31Z
2021-07-17T12:16:14.8546078Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.8549047Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.8551991Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.8552908Z [cluster2] NAME ROLE AGE
2021-07-17T12:16:14.8553864Z [cluster2] submariner-operator Role/submariner-operator 4m31s
2021-07-17T12:16:14.8555024Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.8556332Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.8557748Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.8558930Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-17T12:16:14.8559628Z [cluster2] submariner-operator 1/1 1 1 4m27s
2021-07-17T12:16:14.8560332Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-17T12:16:14.8561082Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-17T12:16:14.8562462Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T12:16:14.8564070Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T12:16:14.8565651Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T12:16:14.8567335Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T12:16:14.8569008Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator -o json
2021-07-17T12:16:14.8570653Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator -o json
2021-07-17T12:16:14.8572389Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator -o json
2021-07-17T12:16:14.8573497Z [cluster2] {
2021-07-17T12:16:14.8573849Z [cluster2] "apiVersion": "v1",
2021-07-17T12:16:14.8574208Z [cluster2] "kind": "Pod",
2021-07-17T12:16:14.8574559Z [cluster2] "metadata": {
2021-07-17T12:16:14.8575271Z [cluster2] "creationTimestamp": "2021-07-17T12:14:44Z",
2021-07-17T12:16:14.8576477Z [cluster2] "generateName": "submariner-operator-5bfdb87494-",
2021-07-17T12:16:14.8577297Z [cluster2] "labels": {
2021-07-17T12:16:14.8577908Z [cluster2] "name": "submariner-operator",
2021-07-17T12:16:14.8578825Z [cluster2] "pod-template-hash": "5bfdb87494"
2021-07-17T12:16:14.8579276Z [cluster2] },
2021-07-17T12:16:14.8579680Z [cluster2] "managedFields": [
2021-07-17T12:16:14.8580077Z [cluster2] {
2021-07-17T12:16:14.8580801Z [cluster2] "apiVersion": "v1",
2021-07-17T12:16:14.8581245Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:14.8581845Z [cluster2] "fieldsV1": {
2021-07-17T12:16:14.8582207Z [cluster2] "f:metadata": {
2021-07-17T12:16:14.8582620Z [cluster2] "f:generateName": {},
2021-07-17T12:16:14.8583031Z [cluster2] "f:labels": {
2021-07-17T12:16:14.8583374Z [cluster2] ".": {},
2021-07-17T12:16:14.8583719Z [cluster2] "f:name": {},
2021-07-17T12:16:14.8584303Z [cluster2] "f:pod-template-hash": {}
2021-07-17T12:16:14.8584720Z [cluster2] },
2021-07-17T12:16:14.8585111Z [cluster2] "f:ownerReferences": {
2021-07-17T12:16:14.8585517Z [cluster2] ".": {},
2021-07-17T12:16:14.8586198Z [cluster2] "k:{\"uid\":\"b0a747ce-a5c5-4606-9e87-fe4c5b5043e6\"}": {
2021-07-17T12:16:14.8586712Z [cluster2] ".": {},
2021-07-17T12:16:14.8587101Z [cluster2] "f:apiVersion": {},
2021-07-17T12:16:14.8587568Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-17T12:16:14.8588046Z [cluster2] "f:controller": {},
2021-07-17T12:16:14.8588420Z [cluster2] "f:kind": {},
2021-07-17T12:16:14.8588789Z [cluster2] "f:name": {},
2021-07-17T12:16:14.8589136Z [cluster2] "f:uid": {}
2021-07-17T12:16:14.8589472Z [cluster2] }
2021-07-17T12:16:14.8589777Z [cluster2] }
2021-07-17T12:16:14.8590090Z [cluster2] },
2021-07-17T12:16:14.8590410Z [cluster2] "f:spec": {
2021-07-17T12:16:14.8590880Z [cluster2] "f:containers": {
2021-07-17T12:16:14.8591718Z [cluster2] "k:{\"name\":\"submariner-operator\"}": {
2021-07-17T12:16:14.8592183Z [cluster2] ".": {},
2021-07-17T12:16:14.8592537Z [cluster2] "f:command": {},
2021-07-17T12:16:14.8592912Z [cluster2] "f:env": {
2021-07-17T12:16:14.8593248Z [cluster2] ".": {},
2021-07-17T12:16:14.8593668Z [cluster2] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-17T12:16:14.8594078Z [cluster2] ".": {},
2021-07-17T12:16:14.8594427Z [cluster2] "f:name": {},
2021-07-17T12:16:14.8594806Z [cluster2] "f:value": {}
2021-07-17T12:16:14.8595145Z [cluster2] },
2021-07-17T12:16:14.8595533Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-17T12:16:14.8595911Z [cluster2] ".": {},
2021-07-17T12:16:14.8596270Z [cluster2] "f:name": {},
2021-07-17T12:16:14.8596792Z [cluster2] "f:valueFrom": {
2021-07-17T12:16:14.8597193Z [cluster2] ".": {},
2021-07-17T12:16:14.8597582Z [cluster2] "f:fieldRef": {
2021-07-17T12:16:14.8625142Z [cluster2] ".": {},
2021-07-17T12:16:14.8625651Z [cluster2] "f:apiVersion": {},
2021-07-17T12:16:14.8626078Z [cluster2] "f:fieldPath": {}
2021-07-17T12:16:14.8626467Z [cluster2] }
2021-07-17T12:16:14.8626798Z [cluster2] }
2021-07-17T12:16:14.8627147Z [cluster2] },
2021-07-17T12:16:14.8627556Z [cluster2] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-17T12:16:14.8627978Z [cluster2] ".": {},
2021-07-17T12:16:14.8628344Z [cluster2] "f:name": {},
2021-07-17T12:16:14.8628729Z [cluster2] "f:valueFrom": {
2021-07-17T12:16:14.8629115Z [cluster2] ".": {},
2021-07-17T12:16:14.8629489Z [cluster2] "f:fieldRef": {
2021-07-17T12:16:14.8629873Z [cluster2] ".": {},
2021-07-17T12:16:14.8630260Z [cluster2] "f:apiVersion": {},
2021-07-17T12:16:14.8630698Z [cluster2] "f:fieldPath": {}
2021-07-17T12:16:14.8631087Z [cluster2] }
2021-07-17T12:16:14.8631418Z [cluster2] }
2021-07-17T12:16:14.8631756Z [cluster2] }
2021-07-17T12:16:14.8632071Z [cluster2] },
2021-07-17T12:16:14.8632424Z [cluster2] "f:image": {},
2021-07-17T12:16:14.8632845Z [cluster2] "f:imagePullPolicy": {},
2021-07-17T12:16:14.8633272Z [cluster2] "f:name": {},
2021-07-17T12:16:14.8633651Z [cluster2] "f:resources": {},
2021-07-17T12:16:14.8634165Z [cluster2] "f:terminationMessagePath": {},
2021-07-17T12:16:14.8634792Z [cluster2] "f:terminationMessagePolicy": {}
2021-07-17T12:16:14.8635257Z [cluster2] }
2021-07-17T12:16:14.8635578Z [cluster2] },
2021-07-17T12:16:14.8635925Z [cluster2] "f:dnsPolicy": {},
2021-07-17T12:16:14.8636538Z [cluster2] "f:enableServiceLinks": {},
2021-07-17T12:16:14.8637047Z [cluster2] "f:restartPolicy": {},
2021-07-17T12:16:14.8637497Z [cluster2] "f:schedulerName": {},
2021-07-17T12:16:14.8637944Z [cluster2] "f:securityContext": {},
2021-07-17T12:16:14.8638558Z [cluster2] "f:serviceAccount": {},
2021-07-17T12:16:14.8639062Z [cluster2] "f:serviceAccountName": {},
2021-07-17T12:16:14.8639688Z [cluster2] "f:terminationGracePeriodSeconds": {}
2021-07-17T12:16:14.8640221Z [cluster2] }
2021-07-17T12:16:14.8640520Z [cluster2] },
2021-07-17T12:16:14.8641297Z [cluster2] "manager": "kube-controller-manager",
2021-07-17T12:16:14.8641818Z [cluster2] "operation": "Update",
2021-07-17T12:16:14.8642375Z [cluster2] "time": "2021-07-17T12:14:44Z"
2021-07-17T12:16:14.8642712Z [cluster2] },
2021-07-17T12:16:14.8643018Z [cluster2] {
2021-07-17T12:16:14.8643362Z [cluster2] "apiVersion": "v1",
2021-07-17T12:16:14.8643796Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:14.8644210Z [cluster2] "fieldsV1": {
2021-07-17T12:16:14.8644561Z [cluster2] "f:status": {
2021-07-17T12:16:14.8644946Z [cluster2] "f:conditions": {
2021-07-17T12:16:14.8645533Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-17T12:16:14.8645969Z [cluster2] ".": {},
2021-07-17T12:16:14.8646358Z [cluster2] "f:lastProbeTime": {},
2021-07-17T12:16:14.8646851Z [cluster2] "f:lastTransitionTime": {},
2021-07-17T12:16:14.8647292Z [cluster2] "f:status": {},
2021-07-17T12:16:14.8647669Z [cluster2] "f:type": {}
2021-07-17T12:16:14.8648016Z [cluster2] },
2021-07-17T12:16:14.8648403Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-17T12:16:14.8648805Z [cluster2] ".": {},
2021-07-17T12:16:14.8649195Z [cluster2] "f:lastProbeTime": {},
2021-07-17T12:16:14.8649683Z [cluster2] "f:lastTransitionTime": {},
2021-07-17T12:16:14.8650123Z [cluster2] "f:status": {},
2021-07-17T12:16:14.8650502Z [cluster2] "f:type": {}
2021-07-17T12:16:14.8650834Z [cluster2] },
2021-07-17T12:16:14.8651203Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-17T12:16:14.8651574Z [cluster2] ".": {},
2021-07-17T12:16:14.8651960Z [cluster2] "f:lastProbeTime": {},
2021-07-17T12:16:14.8652460Z [cluster2] "f:lastTransitionTime": {},
2021-07-17T12:16:14.8652898Z [cluster2] "f:status": {},
2021-07-17T12:16:14.8653270Z [cluster2] "f:type": {}
2021-07-17T12:16:14.8653600Z [cluster2] }
2021-07-17T12:16:14.8653919Z [cluster2] },
2021-07-17T12:16:14.8654319Z [cluster2] "f:containerStatuses": {},
2021-07-17T12:16:14.8654757Z [cluster2] "f:hostIP": {},
2021-07-17T12:16:14.8655136Z [cluster2] "f:phase": {},
2021-07-17T12:16:14.8655495Z [cluster2] "f:podIP": {},
2021-07-17T12:16:14.8655868Z [cluster2] "f:podIPs": {
2021-07-17T12:16:14.8656209Z [cluster2] ".": {},
2021-07-17T12:16:14.8656564Z [cluster2] "k:{\"ip\":\"10.2.128.5\"}": {
2021-07-17T12:16:14.8656991Z [cluster2] ".": {},
2021-07-17T12:16:14.8657366Z [cluster2] "f:ip": {}
2021-07-17T12:16:14.8657688Z [cluster2] }
2021-07-17T12:16:14.8658009Z [cluster2] },
2021-07-17T12:16:14.8658371Z [cluster2] "f:startTime": {}
2021-07-17T12:16:14.8658710Z [cluster2] }
2021-07-17T12:16:14.8659023Z [cluster2] },
2021-07-17T12:16:14.8659371Z [cluster2] "manager": "kubelet",
2021-07-17T12:16:14.8659798Z [cluster2] "operation": "Update",
2021-07-17T12:16:14.8660383Z [cluster2] "time": "2021-07-17T12:14:46Z"
2021-07-17T12:16:14.8660731Z [cluster2] }
2021-07-17T12:16:14.8661020Z [cluster2] ],
2021-07-17T12:16:14.8661762Z [cluster2] "name": "submariner-operator-5bfdb87494-cjf62",
2021-07-17T12:16:14.8662611Z [cluster2] "namespace": "submariner-operator",
2021-07-17T12:16:14.8663128Z [cluster2] "ownerReferences": [
2021-07-17T12:16:14.8663514Z [cluster2] {
2021-07-17T12:16:14.8663872Z [cluster2] "apiVersion": "apps/v1",
2021-07-17T12:16:14.8664359Z [cluster2] "blockOwnerDeletion": true,
2021-07-17T12:16:14.8664818Z [cluster2] "controller": true,
2021-07-17T12:16:14.8665401Z [cluster2] "kind": "ReplicaSet",
2021-07-17T12:16:14.8666168Z [cluster2] "name": "submariner-operator-5bfdb87494",
2021-07-17T12:16:14.8667166Z [cluster2] "uid": "b0a747ce-a5c5-4606-9e87-fe4c5b5043e6"
2021-07-17T12:16:14.8667619Z [cluster2] }
2021-07-17T12:16:14.8667920Z [cluster2] ],
2021-07-17T12:16:14.8668289Z [cluster2] "resourceVersion": "2059",
2021-07-17T12:16:14.8668943Z [cluster2] "uid": "8f90f564-96c3-44c3-8a17-c3a971cc6b1b"
2021-07-17T12:16:14.8669360Z [cluster2] },
2021-07-17T12:16:14.8669657Z [cluster2] "spec": {
2021-07-17T12:16:14.8670011Z [cluster2] "containers": [
2021-07-17T12:16:14.8670345Z [cluster2] {
2021-07-17T12:16:14.8670677Z [cluster2] "command": [
2021-07-17T12:16:14.8671293Z [cluster2] "submariner-operator",
2021-07-17T12:16:14.8671928Z [cluster2] "-alsologtostderr",
2021-07-17T12:16:14.8672428Z [cluster2] "-v=1"
2021-07-17T12:16:14.8672751Z [cluster2] ],
2021-07-17T12:16:14.8673063Z [cluster2] "env": [
2021-07-17T12:16:14.8673388Z [cluster2] {
2021-07-17T12:16:14.8673787Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-17T12:16:14.8674193Z [cluster2] "valueFrom": {
2021-07-17T12:16:14.8674582Z [cluster2] "fieldRef": {
2021-07-17T12:16:14.8674980Z [cluster2] "apiVersion": "v1",
2021-07-17T12:16:14.8675493Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-17T12:16:14.8675935Z [cluster2] }
2021-07-17T12:16:14.8676253Z [cluster2] }
2021-07-17T12:16:14.8676555Z [cluster2] },
2021-07-17T12:16:14.8676867Z [cluster2] {
2021-07-17T12:16:14.8677213Z [cluster2] "name": "POD_NAME",
2021-07-17T12:16:14.8677608Z [cluster2] "valueFrom": {
2021-07-17T12:16:14.8677998Z [cluster2] "fieldRef": {
2021-07-17T12:16:14.8678872Z [cluster2] "apiVersion": "v1",
2021-07-17T12:16:14.8679654Z [cluster2] "fieldPath": "metadata.name"
2021-07-17T12:16:14.8680088Z [cluster2] }
2021-07-17T12:16:14.8680426Z [cluster2] }
2021-07-17T12:16:14.8680743Z [cluster2] },
2021-07-17T12:16:14.8681070Z [cluster2] {
2021-07-17T12:16:14.8681460Z [cluster2] "name": "OPERATOR_NAME",
2021-07-17T12:16:14.8682357Z [cluster2] "value": "submariner-operator"
2021-07-17T12:16:14.8683006Z [cluster2] }
2021-07-17T12:16:14.8683349Z [cluster2] ],
2021-07-17T12:16:14.8684023Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-17T12:16:14.8700459Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-17T12:16:14.8701483Z [cluster2] "name": "submariner-operator",
2021-07-17T12:16:14.8701963Z [cluster2] "resources": {},
2021-07-17T12:16:14.8702701Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-17T12:16:14.8703392Z [cluster2] "terminationMessagePolicy": "File",
2021-07-17T12:16:14.8703925Z [cluster2] "volumeMounts": [
2021-07-17T12:16:14.8704275Z [cluster2] {
2021-07-17T12:16:14.8704803Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-17T12:16:14.8729015Z [cluster2] "name": "submariner-operator-token-wlmrb",
2021-07-17T12:16:14.8729756Z [cluster2] "readOnly": true
2021-07-17T12:16:14.8730160Z [cluster2] }
2021-07-17T12:16:14.8730487Z [cluster2] ]
2021-07-17T12:16:14.8730823Z [cluster2] }
2021-07-17T12:16:14.8731138Z [cluster2] ],
2021-07-17T12:16:14.8731567Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-17T12:16:14.8732304Z [cluster2] "enableServiceLinks": true,
2021-07-17T12:16:14.8733220Z [cluster2] "nodeName": "cluster2-worker2",
2021-07-17T12:16:14.8733906Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-17T12:16:14.8734479Z [cluster2] "priority": 0,
2021-07-17T12:16:14.8734937Z [cluster2] "restartPolicy": "Always",
2021-07-17T12:16:14.8735845Z [cluster2] "schedulerName": "default-scheduler",
2021-07-17T12:16:14.8736430Z [cluster2] "securityContext": {},
2021-07-17T12:16:14.8737211Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-17T12:16:14.8738259Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-17T12:16:14.8739009Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-17T12:16:14.8739606Z [cluster2] "tolerations": [
2021-07-17T12:16:14.8739963Z [cluster2] {
2021-07-17T12:16:14.8740361Z [cluster2] "effect": "NoExecute",
2021-07-17T12:16:14.8741063Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-17T12:16:14.8741586Z [cluster2] "operator": "Exists",
2021-07-17T12:16:14.8742072Z [cluster2] "tolerationSeconds": 300
2021-07-17T12:16:14.8742478Z [cluster2] },
2021-07-17T12:16:14.8742807Z [cluster2] {
2021-07-17T12:16:14.8743187Z [cluster2] "effect": "NoExecute",
2021-07-17T12:16:14.8743737Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-17T12:16:14.8744266Z [cluster2] "operator": "Exists",
2021-07-17T12:16:14.8744748Z [cluster2] "tolerationSeconds": 300
2021-07-17T12:16:14.8745151Z [cluster2] }
2021-07-17T12:16:14.8745470Z [cluster2] ],
2021-07-17T12:16:14.8745815Z [cluster2] "volumes": [
2021-07-17T12:16:14.8746144Z [cluster2] {
2021-07-17T12:16:14.8746900Z [cluster2] "name": "submariner-operator-token-wlmrb",
2021-07-17T12:16:14.8747493Z [cluster2] "secret": {
2021-07-17T12:16:14.8747915Z [cluster2] "defaultMode": 420,
2021-07-17T12:16:14.8748739Z [cluster2] "secretName": "submariner-operator-token-wlmrb"
2021-07-17T12:16:14.8749358Z [cluster2] }
2021-07-17T12:16:14.8749667Z [cluster2] }
2021-07-17T12:16:14.8749985Z [cluster2] ]
2021-07-17T12:16:14.8750290Z [cluster2] },
2021-07-17T12:16:14.8750625Z [cluster2] "status": {
2021-07-17T12:16:14.8751281Z [cluster2] "conditions": [
2021-07-17T12:16:14.8751634Z [cluster2] {
2021-07-17T12:16:14.8752025Z [cluster2] "lastProbeTime": null,
2021-07-17T12:16:14.8752710Z [cluster2] "lastTransitionTime": "2021-07-17T12:14:44Z",
2021-07-17T12:16:14.8753176Z [cluster2] "status": "True",
2021-07-17T12:16:14.8753569Z [cluster2] "type": "Initialized"
2021-07-17T12:16:14.8753941Z [cluster2] },
2021-07-17T12:16:14.8754232Z [cluster2] {
2021-07-17T12:16:14.8754626Z [cluster2] "lastProbeTime": null,
2021-07-17T12:16:14.8755279Z [cluster2] "lastTransitionTime": "2021-07-17T12:14:46Z",
2021-07-17T12:16:14.8755933Z [cluster2] "status": "True",
2021-07-17T12:16:14.8756494Z [cluster2] "type": "Ready"
2021-07-17T12:16:14.8757392Z [cluster2] },
2021-07-17T12:16:14.8757764Z [cluster2] {
2021-07-17T12:16:14.8758212Z [cluster2] "lastProbeTime": null,
2021-07-17T12:16:14.8759876Z [cluster2] "lastTransitionTime": "2021-07-17T12:14:46Z",
2021-07-17T12:16:14.8760425Z [cluster2] "status": "True",
2021-07-17T12:16:14.8761398Z [cluster2] "type": "ContainersReady"
2021-07-17T12:16:14.8761781Z [cluster2] },
2021-07-17T12:16:14.8762087Z [cluster2] {
2021-07-17T12:16:14.8762455Z [cluster2] "lastProbeTime": null,
2021-07-17T12:16:14.8763125Z [cluster2] "lastTransitionTime": "2021-07-17T12:14:44Z",
2021-07-17T12:16:14.8763753Z [cluster2] "status": "True",
2021-07-17T12:16:14.8764164Z [cluster2] "type": "PodScheduled"
2021-07-17T12:16:14.8764552Z [cluster2] }
2021-07-17T12:16:14.8764841Z [cluster2] ],
2021-07-17T12:16:14.8765236Z [cluster2] "containerStatuses": [
2021-07-17T12:16:14.8765614Z [cluster2] {
2021-07-17T12:16:14.8766863Z [cluster2] "containerID": "containerd://d5b5a18a2d3406c64496043cd1d6ea9446bd0addbf459186bde7199417d5c1d2",
2021-07-17T12:16:14.8768451Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-17T12:16:14.8769633Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-17T12:16:14.8770462Z [cluster2] "lastState": {},
2021-07-17T12:16:14.8771056Z [cluster2] "name": "submariner-operator",
2021-07-17T12:16:14.8771529Z [cluster2] "ready": true,
2021-07-17T12:16:14.8771911Z [cluster2] "restartCount": 0,
2021-07-17T12:16:14.8772319Z [cluster2] "started": true,
2021-07-17T12:16:14.8772669Z [cluster2] "state": {
2021-07-17T12:16:14.8773028Z [cluster2] "running": {
2021-07-17T12:16:14.9959129Z [cluster2] "startedAt": " rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.9961064Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.9962815Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.9965289Z [cluster1] NAME ROLE AGE
2021-07-17T12:16:14.9966144Z [cluster1] submariner-operator Role/submariner-operator 4m43s
2021-07-17T12:16:14.9967339Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.9968945Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.9970483Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-17T12:16:14.9971959Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-17T12:16:14.9972752Z [cluster1] submariner-operator 1/1 1 1 4m38s
2021-07-17T12:16:14.9973675Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-17T12:16:14.9974488Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-17T12:16:14.9975729Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T12:16:14.9977369Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T12:16:14.9979032Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T12:16:14.9980817Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T12:16:14.9982584Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator -o json
2021-07-17T12:16:14.9984430Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator -o json
2021-07-17T12:16:14.9986313Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator -o json
2021-07-17T12:16:14.9987455Z [cluster1] {
2021-07-17T12:16:14.9987822Z [cluster1] "apiVersion": "v1",
2021-07-17T12:16:14.9988202Z [cluster1] "kind": "Pod",
2021-07-17T12:16:14.9988572Z [cluster1] "metadata": {
2021-07-17T12:16:14.9989216Z [cluster1] "creationTimestamp": "2021-07-17T12:14:37Z",
2021-07-17T12:16:14.9990112Z [cluster1] "generateName": "submariner-operator-5bfdb87494-",
2021-07-17T12:16:14.9990881Z [cluster1] "labels": {
2021-07-17T12:16:14.9991504Z [cluster1] "name": "submariner-operator",
2021-07-17T12:16:14.9992216Z [cluster1] "pod-template-hash": "5bfdb87494"
2021-07-17T12:16:14.9992922Z [cluster1] },
2021-07-17T12:16:14.9993324Z [cluster1] "managedFields": [
2021-07-17T12:16:14.9993701Z [cluster1] {
2021-07-17T12:16:14.9994089Z [cluster1] "apiVersion": "v1",
2021-07-17T12:16:14.9994553Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:14.9995004Z [cluster1] "fieldsV1": {
2021-07-17T12:16:14.9995664Z [cluster1] "f:metadata": {
2021-07-17T12:16:14.9996109Z [cluster1] "f:generateName": {},
2021-07-17T12:16:14.9996540Z [cluster1] "f:labels": {
2021-07-17T12:16:14.9996896Z [cluster1] ".": {},
2021-07-17T12:16:14.9997341Z [cluster1] "f:name": {},
2021-07-17T12:16:14.9997979Z [cluster1] "f:pod-template-hash": {}
2021-07-17T12:16:14.9998766Z [cluster1] },
2021-07-17T12:16:14.9999156Z [cluster1] "f:ownerReferences": {
2021-07-17T12:16:14.9999561Z [cluster1] ".": {},
2021-07-17T12:16:15.0000232Z [cluster1] "k:{\"uid\":\"a048111d-d72e-455b-bb06-9896908a2c59\"}": {
2021-07-17T12:16:15.0000723Z [cluster1] ".": {},
2021-07-17T12:16:15.0001303Z [cluster1] "f:apiVersion": {},
2021-07-17T12:16:15.0001902Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-17T12:16:15.0002407Z [cluster1] "f:controller": {},
2021-07-17T12:16:15.0002805Z [cluster1] "f:kind": {},
2021-07-17T12:16:15.0003197Z [cluster1] "f:name": {},
2021-07-17T12:16:15.0003681Z [cluster1] "f:uid": {}
2021-07-17T12:16:15.0004062Z [cluster1] }
2021-07-17T12:16:15.0004385Z [cluster1] }
2021-07-17T12:16:15.0004719Z [cluster1] },
2021-07-17T12:16:15.0005074Z [cluster1] "f:spec": {
2021-07-17T12:16:15.0005460Z [cluster1] "f:containers": {
2021-07-17T12:16:15.0006204Z [cluster1] "k:{\"name\":\"submariner-operator\"}": {
2021-07-17T12:16:15.0006686Z [cluster1] ".": {},
2021-07-17T12:16:15.0007073Z [cluster1] "f:command": {},
2021-07-17T12:16:15.0007454Z [cluster1] "f:env": {
2021-07-17T12:16:15.0007831Z [cluster1] ".": {},
2021-07-17T12:16:15.0008251Z [cluster1] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-17T12:16:15.0008688Z [cluster1] ".": {},
2021-07-17T12:16:15.0009355Z [cluster1] "f:name": {},
2021-07-17T12:16:15.0009730Z [cluster1] "f:value": {}
2021-07-17T12:16:15.0010087Z [cluster1] },
2021-07-17T12:16:15.0010460Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-17T12:16:15.0010849Z [cluster1] ".": {},
2021-07-17T12:16:15.0011314Z [cluster1] "f:name": {},
2021-07-17T12:16:15.0011714Z [cluster1] "f:valueFrom": {
2021-07-17T12:16:15.0012084Z [cluster1] ".": {},
2021-07-17T12:16:15.0012467Z [cluster1] "f:fieldRef": {
2021-07-17T12:16:15.0012937Z [cluster1] ".": {},
2021-07-17T12:16:15.0013337Z [cluster1] "f:apiVersion": {},
2021-07-17T12:16:15.0013779Z [cluster1] "f:fieldPath": {}
2021-07-17T12:16:15.0014155Z [cluster1] }
2021-07-17T12:16:15.0014497Z [cluster1] }
2021-07-17T12:16:15.0014823Z [cluster1] },
2021-07-17T12:16:15.0015241Z [cluster1] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-17T12:16:15.0015664Z [cluster1] ".": {},
2021-07-17T12:16:15.0016018Z [cluster1] "f:name": {},
2021-07-17T12:16:15.0016416Z [cluster1] "f:valueFrom": {
2021-07-17T12:16:15.0016790Z [cluster1] ".": {},
2021-07-17T12:16:15.0017175Z [cluster1] "f:fieldRef": {
2021-07-17T12:16:15.0017549Z [cluster1] ".": {},
2021-07-17T12:16:15.0017954Z [cluster1] "f:apiVersion": {},
2021-07-17T12:16:15.0018381Z [cluster1] "f:fieldPath": {}
2021-07-17T12:16:15.0018769Z [cluster1] }
2021-07-17T12:16:15.0019114Z [cluster1] }
2021-07-17T12:16:15.0019436Z [cluster1] }
2021-07-17T12:16:15.0019775Z [cluster1] },
2021-07-17T12:16:15.0020116Z [cluster1] "f:image": {},
2021-07-17T12:16:15.0020552Z [cluster1] "f:imagePullPolicy": {},
2021-07-17T12:16:15.0020968Z [cluster1] "f:name": {},
2021-07-17T12:16:15.0021362Z [cluster1] "f:resources": {},
2021-07-17T12:16:15.0021978Z [cluster1] "f:terminationMessagePath": {},
2021-07-17T12:16:15.0022633Z [cluster1] "f:terminationMessagePolicy": {}
2021-07-17T12:16:15.0024402Z [cluster1] }
2021-07-17T12:16:15.0024839Z [cluster1] },
2021-07-17T12:16:15.0025335Z [cluster1] "f:dnsPolicy": {},
2021-07-17T12:16:15.0025958Z [cluster1] "f:enableServiceLinks": {},
2021-07-17T12:16:15.0026917Z [cluster1] "f:restartPolicy": {},
2021-07-17T12:16:15.0027379Z [cluster1] "f:schedulerName": {},
2021-07-17T12:16:15.0028237Z [cluster1] "f:securityContext": {},
2021-07-17T12:16:15.0028746Z [cluster1] "f:serviceAccount": {},
2021-07-17T12:16:15.0029298Z [cluster1] "f:serviceAccountName": {},
2021-07-17T12:16:15.0030013Z [cluster1] "f:terminationGracePeriodSeconds": {}
2021-07-17T12:16:15.0030600Z [cluster1] }
2021-07-17T12:16:15.0031296Z [cluster1] },
2021-07-17T12:16:15.0032015Z [cluster1] "manager": "kube-controller-manager",
2021-07-17T12:16:15.0032548Z [cluster1] "operation": "Update",
2021-07-17T12:16:15.0033090Z [cluster1] "time": "2021-07-17T12:14:37Z"
2021-07-17T12:16:15.0033436Z [cluster1] },
2021-07-17T12:16:15.0033725Z [cluster1] {
2021-07-17T12:16:15.0034241Z [cluster1] "apiVersion": "v1",
2021-07-17T12:16:15.0034676Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:15.0035075Z [cluster1] "fieldsV1": {
2021-07-17T12:16:15.0035445Z [cluster1] "f:status": {
2021-07-17T12:16:15.0035814Z [cluster1] "f:conditions": {
2021-07-17T12:16:15.0036282Z [cluster1] "k:{\"type\":\"ContainersReady\"}": {
2021-07-17T12:16:15.0036705Z [cluster1] ".": {},
2021-07-17T12:16:15.0037110Z [cluster1] "f:lastProbeTime": {},
2021-07-17T12:16:15.0037590Z [cluster1] "f:lastTransitionTime": {},
2021-07-17T12:16:15.0038043Z [cluster1] "f:status": {},
2021-07-17T12:16:15.0076114Z [cluster1] "f:type": {}
2021-07-17T12:16:15.0076493Z [cluster1] },
2021-07-17T12:16:15.0076914Z [cluster1] "k:{\"type\":\"Initialized\"}": {
2021-07-17T12:16:15.0077305Z [cluster1] ".": {},
2021-07-17T12:16:15.0077707Z [cluster1] "f:lastProbeTime": {},
2021-07-17T12:16:15.0078189Z [cluster1] "f:lastTransitionTime": {},
2021-07-17T12:16:15.0079041Z [cluster1] "f:status": {},
2021-07-17T12:16:15.0079424Z [cluster1] "f:type": {}
2021-07-17T12:16:15.0079801Z [cluster1] },
2021-07-17T12:16:15.0080192Z [cluster1] "k:{\"type\":\"Ready\"}": {
2021-07-17T12:16:15.0080570Z [cluster1] ".": {},
2021-07-17T12:16:15.0080993Z [cluster1] "f:lastProbeTime": {},
2021-07-17T12:16:15.0081660Z [cluster1] "f:lastTransitionTime": {},
2021-07-17T12:16:15.0082116Z [cluster1] "f:status": {},
2021-07-17T12:16:15.0082479Z [cluster1] "f:type": {}
2021-07-17T12:16:15.0082825Z [cluster1] }
2021-07-17T12:16:15.0083132Z [cluster1] },
2021-07-17T12:16:15.0083553Z [cluster1] "f:containerStatuses": {},
2021-07-17T12:16:15.0083995Z [cluster1] "f:hostIP": {},
2021-07-17T12:16:15.0084355Z [cluster1] "f:phase": {},
2021-07-17T12:16:15.0085060Z [cluster1] "f:podIP": {},
2021-07-17T12:16:15.0085469Z [cluster1] "f:podIPs": {
2021-07-17T12:16:15.0085847Z [cluster1] ".": {},
2021-07-17T12:16:15.0086209Z [cluster1] "k:{\"ip\":\"10.1.128.5\"}": {
2021-07-17T12:16:15.0086588Z [cluster1] ".": {},
2021-07-17T12:16:15.0086941Z [cluster1] "f:ip": {}
2021-07-17T12:16:15.0087306Z [cluster1] }
2021-07-17T12:16:15.0087629Z [cluster1] },
2021-07-17T12:16:15.0088178Z [cluster1] "f:startTime": {}
2021-07-17T12:16:15.0088536Z [cluster1] }
2021-07-17T12:16:15.0088828Z [cluster1] },
2021-07-17T12:16:15.0089192Z [cluster1] "manager": "kubelet",
2021-07-17T12:16:15.0089598Z [cluster1] "operation": "Update",
2021-07-17T12:16:15.0090321Z [cluster1] "time": "2021-07-17T12:14:38Z"
2021-07-17T12:16:15.0090656Z [cluster1] }
2021-07-17T12:16:15.0090958Z [cluster1] ],
2021-07-17T12:16:15.0091696Z [cluster1] "name": "submariner-operator-5bfdb87494-bxpkd",
2021-07-17T12:16:15.0092555Z [cluster1] "namespace": "submariner-operator",
2021-07-17T12:16:15.0093061Z [cluster1] "ownerReferences": [
2021-07-17T12:16:15.0093590Z [cluster1] {
2021-07-17T12:16:15.0093963Z [cluster1] "apiVersion": "apps/v1",
2021-07-17T12:16:15.0094576Z [cluster1] "blockOwnerDeletion": true,
2021-07-17T12:16:15.0095057Z [cluster1] "controller": true,
2021-07-17T12:16:15.0095461Z [cluster1] "kind": "ReplicaSet",
2021-07-17T12:16:15.0096454Z [cluster1] "name": "submariner-operator-5bfdb87494",
2021-07-17T12:16:15.0097326Z [cluster1] "uid": "a048111d-d72e-455b-bb06-9896908a2c59"
2021-07-17T12:16:15.0097771Z [cluster1] }
2021-07-17T12:16:15.0098095Z [cluster1] ],
2021-07-17T12:16:15.0098486Z [cluster1] "resourceVersion": "2105",
2021-07-17T12:16:15.0099248Z [cluster1] "uid": "2cdbf84d-fdb6-4f41-a28a-925d85568cb9"
2021-07-17T12:16:15.0099742Z [cluster1] },
2021-07-17T12:16:15.0100075Z [cluster1] "spec": {
2021-07-17T12:16:15.0100447Z [cluster1] "containers": [
2021-07-17T12:16:15.0100791Z [cluster1] {
2021-07-17T12:16:15.0101143Z [cluster1] "command": [
2021-07-17T12:16:15.0101758Z [cluster1] "submariner-operator",
2021-07-17T12:16:15.0102555Z [cluster1] "-alsologtostderr",
2021-07-17T12:16:15.0103256Z [cluster1] "-v=1"
2021-07-17T12:16:15.0103595Z [cluster1] ],
2021-07-17T12:16:15.0103923Z [cluster1] "env": [
2021-07-17T12:16:15.0104264Z [cluster1] {
2021-07-17T12:16:15.0104655Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-17T12:16:15.0105108Z [cluster1] "valueFrom": {
2021-07-17T12:16:15.0105519Z [cluster1] "fieldRef": {
2021-07-17T12:16:15.0106092Z [cluster1] "apiVersion": "v1",
2021-07-17T12:16:15.0106601Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-17T12:16:15.0107040Z [cluster1] }
2021-07-17T12:16:15.0107360Z [cluster1] }
2021-07-17T12:16:15.0107667Z [cluster1] },
2021-07-17T12:16:15.0107983Z [cluster1] {
2021-07-17T12:16:15.0108326Z [cluster1] "name": "POD_NAME",
2021-07-17T12:16:15.0108838Z [cluster1] "valueFrom": {
2021-07-17T12:16:15.0109219Z [cluster1] "fieldRef": {
2021-07-17T12:16:15.0109630Z [cluster1] "apiVersion": "v1",
2021-07-17T12:16:15.0110279Z [cluster1] "fieldPath": "metadata.name"
2021-07-17T12:16:15.0110706Z [cluster1] }
2021-07-17T12:16:15.0111024Z [cluster1] }
2021-07-17T12:16:15.0111328Z [cluster1] },
2021-07-17T12:16:15.0111640Z [cluster1] {
2021-07-17T12:16:15.0112002Z [cluster1] "name": "OPERATOR_NAME",
2021-07-17T12:16:15.0112702Z [cluster1] "value": "submariner-operator"
2021-07-17T12:16:15.0113125Z [cluster1] }
2021-07-17T12:16:15.0113444Z [cluster1] ],
2021-07-17T12:16:15.0114073Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-17T12:16:15.0114696Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-17T12:16:15.0115549Z [cluster1] "name": "submariner-operator",
2021-07-17T12:16:15.0116202Z [cluster1] "resources": {},
2021-07-17T12:16:15.0116968Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-17T12:16:15.0117693Z [cluster1] "terminationMessagePolicy": "File",
2021-07-17T12:16:15.0118436Z [cluster1] "volumeMounts": [
2021-07-17T12:16:15.0119694Z [cluster1] {
2021-07-17T12:16:15.0120275Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-17T12:16:15.0121559Z [cluster1] "name": "submariner-operator-token-zdttn",
2021-07-17T12:16:15.0122306Z [cluster1] "readOnly": true
2021-07-17T12:16:15.0122664Z [cluster1] }
2021-07-17T12:16:15.0123153Z [cluster1] ]
2021-07-17T12:16:15.0123475Z [cluster1] }
2021-07-17T12:16:15.0125238Z [cluster1] ],
2021-07-17T12:16:15.0125827Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-17T12:16:15.0126501Z [cluster1] "enableServiceLinks": true,
2021-07-17T12:16:15.0127531Z [cluster1] "nodeName": "cluster1-worker2",
2021-07-17T12:16:15.0128754Z [cluster1] "preemptionPolicy": "PreemptLowerPriority",
2021-07-17T12:16:15.0129297Z [cluster1] "priority": 0,
2021-07-17T12:16:15.0129711Z [cluster1] "restartPolicy": "Always",
2021-07-17T12:16:15.0130374Z [cluster1] "schedulerName": "default-scheduler",
2021-07-17T12:16:15.0130901Z [cluster1] "securityContext": {},
2021-07-17T12:16:15.0131574Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-17T12:16:15.0132392Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-17T12:16:15.0133097Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-17T12:16:15.0133656Z [cluster1] "tolerations": [
2021-07-17T12:16:15.0133991Z [cluster1] {
2021-07-17T12:16:15.0134361Z [cluster1] "effect": "NoExecute",
2021-07-17T12:16:15.0135004Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-17T12:16:15.0135515Z [cluster1] "operator": "Exists",
2021-07-17T12:16:15.0143399Z [cluster1] "tolerationSeconds": 300
2021-07-17T12:16:15.0143876Z [cluster1] },
2021-07-17T12:16:15.0144192Z [cluster1] {
2021-07-17T12:16:15.0144732Z [cluster1] "effect": "NoExecute",
2021-07-17T12:16:15.0145283Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-17T12:16:15.0145805Z [cluster1] "operator": "Exists",
2021-07-17T12:16:15.0146281Z [cluster1] "tolerationSeconds": 300
2021-07-17T12:16:15.0146867Z [cluster1] }
2021-07-17T12:16:15.0147249Z [cluster1] ],
2021-07-17T12:16:15.0147580Z [cluster1] "volumes": [
2021-07-17T12:16:15.0147924Z [cluster1] {
2021-07-17T12:16:15.0148810Z [cluster1] "name": "submariner-operator-token-zdttn",
2021-07-17T12:16:15.0149411Z [cluster1] "secret": {
2021-07-17T12:16:15.0149985Z [cluster1] "defaultMode": 420,
2021-07-17T12:16:15.0150923Z [cluster1] "secretName": "submariner-operator-token-zdttn"
2021-07-17T12:16:15.0151534Z [cluster1] }
2021-07-17T12:16:15.0151831Z [cluster1] }
2021-07-17T12:16:15.0152133Z [cluster1] ]
2021-07-17T12:16:15.0152415Z [cluster1] },
2021-07-17T12:16:15.0152732Z [cluster1] "status": {
2021-07-17T12:16:15.0153075Z [cluster1] "conditions": [
2021-07-17T12:16:15.0153411Z [cluster1] {
2021-07-17T12:16:15.0153780Z [cluster1] "lastProbeTime": null,
2021-07-17T12:16:15.0154483Z [cluster1] "lastTransitionTime": "2021-07-17T12:14:37Z",
2021-07-17T12:16:15.0154952Z [cluster1] "status": "True",
2021-07-17T12:16:15.0155345Z [cluster1] "type": "Initialized"
2021-07-17T12:16:15.0155712Z [cluster1] },
2021-07-17T12:16:15.0156002Z [cluster1] {
2021-07-17T12:16:15.0156385Z [cluster1] "lastProbeTime": null,
2021-07-17T12:16:15.0157043Z [cluster1] "lastTransitionTime": "2021-07-17T12:14:38Z",
2021-07-17T12:16:15.0157510Z [cluster1] "status": "True",
2021-07-17T12:16:15.0157875Z [cluster1] "type": "Ready"
2021-07-17T12:16:15.0158215Z [cluster1] },
2021-07-17T12:16:15.0158851Z [cluster1] {
2021-07-17T12:16:15.0159693Z [cluster1] "lastProbeTime": null,
2021-07-17T12:16:15.0160455Z [cluster1] "lastTransitionTime": "2021-07-17T12:14:38Z",
2021-07-17T12:16:15.0161120Z [cluster1] "status": "True",
2021-07-17T12:16:15.0161608Z [cluster1] "type": "ContainersReady"
2021-07-17T12:16:15.0163696Z [cluster1] },
2021-07-17T12:16:15.0164294Z [cluster1] {
2021-07-17T12:16:15.0164850Z [cluster1] "lastProbeTime": null,
2021-07-17T12:16:15.0166191Z [cluster1] "lastTransitionTime": "2021-07-17T12:14:37Z",
2021-07-17T12:16:15.0167194Z [cluster1] "status": "True",
2021-07-17T12:16:15.0167697Z [cluster1] "type": "PodScheduled"
2021-07-17T12:16:15.0168126Z [cluster1] }
2021-07-17T12:16:15.0168448Z [cluster1] ],
2021-07-17T12:16:15.0169040Z [cluster1] "containerStatuses": [
2021-07-17T12:16:15.0169848Z [cluster1] {
2021-07-17T12:16:15.0171327Z [cluster1] "containerID": "containerd://9f9c58ca5d4ae3a284c483ccfc1710bb56e77d1e0336816717cfe8884291cf87",
2021-07-17T12:16:15.0172984Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-17T12:16:15.0174173Z [cluster1] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-17T12:16:15.0175428Z [cluster1] "lastState": {},
2021-07-17T12:16:15.0176334Z [cluster1] "name": "submariner-operator",
2021-07-17T12:16:15.0176803Z [cluster1] "ready": true,
2021-07-17T12:16:15.0177193Z [cluster1] "restartCount": 0,
2021-07-17T12:16:15.0177594Z [cluster1] "started": true,
2021-07-17T12:16:15.0178415Z [cluster1] "state": {
2021-07-17T12:16:15.0178773Z [cluster1] "running": {
2021-07-17T12:16:15.5024158Z [cluster1] "startedAt": "2021-07-17T12:14:45Z"
2021-07-17T12:16:15.5024619Z [cluster2] }
2021-07-17T12:16:15.5024960Z [cluster2] }
2021-07-17T12:16:15.5025376Z [cluster2] }
2021-07-17T12:16:15.5025732Z [cluster2] ],
2021-07-17T12:16:15.5026107Z [cluster2] "hostIP": "172.18.0.4",
2021-07-17T12:16:15.5026507Z [cluster2] "phase": "Running",
2021-07-17T12:16:15.5026916Z [cluster2] "podIP": "10.2.128.5",
2021-07-17T12:16:15.5027287Z [cluster2] "podIPs": [
2021-07-17T12:16:15.5027640Z [cluster2] {
2021-07-17T12:16:15.5028163Z [cluster2] "ip": "10.2.128.5"
2021-07-17T12:16:15.5028532Z [cluster2] }
2021-07-17T12:16:15.5029048Z [cluster2] ],
2021-07-17T12:16:15.5029775Z [cluster2] "qosClass": "BestEffort",
2021-07-17T12:16:15.5031264Z [cluster2] "startTime": "2021-07-17T12:14:44Z"
2021-07-17T12:16:15.5031738Z [cluster2] }
2021-07-17T12:16:15.5032205Z [cluster2] }
2021-07-17T12:16:15.5033905Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T12:16:15.5035884Z [submariner-operator]$ [cluster2] grep Running
2021-07-17T12:16:15.5038925Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T12:16:15.5043346Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T12:16:15.5044895Z [cluster2] Running
2021-07-17T12:16:15.5046246Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator
2021-07-17T12:16:15.5048287Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator
2021-07-17T12:16:15.5050588Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-cjf62 --namespace=submariner-operator
2021-07-17T12:16:15.5052745Z [cluster2] I0717 12:14:45.822846 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-17T12:16:15.5053741Z [cluster2] I0717 12:14:45.822897 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-17T12:16:15.5055215Z [cluster2] I0717 12:14:45.822903 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-17T12:16:15.5057101Z [cluster2] I0717 12:14:45.822908 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-17T12:16:15.5058532Z [cluster2] I0717 12:14:45.823267 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-17T12:16:15.5059952Z [cluster2] I0717 12:14:46.439994 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-svrpv"
2021-07-17T12:16:15.5061314Z [cluster2] I0717 12:14:46.464578 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-17T12:16:15.5061982Z [cluster2] I0717 12:14:47.595427 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-17T12:16:15.5062768Z [cluster2] I0717 12:14:49.990580 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-17T12:16:15.5063514Z [cluster2] I0717 12:14:54.529972 1 leader.go:149] leader "msg"="Became the leader."
2021-07-17T12:16:15.5064598Z [cluster2] I0717 12:14:55.133371 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-17T12:16:15.5065414Z [cluster2] I0717 12:14:55.133691 1 main.go:129] cmd "msg"="Registering Components."
2021-07-17T12:16:15.5066075Z [cluster2] I0717 12:14:55.133811 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-17T12:16:15.5066930Z [cluster2] I0717 12:14:58.874236 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5068400Z [cluster2] I0717 12:14:58.874275 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5069379Z [cluster2] I0717 12:14:58.874315 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-17T12:16:15.5070368Z [cluster2] I0717 12:14:58.874944 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-17T12:16:15.5077757Z [cluster2] I0717 12:14:58.875518 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T12:16:15.5086800Z [cluster2] I0717 12:14:58.875755 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T12:16:15.5092791Z [cluster2] I0717 12:14:58.876019 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T12:16:15.5096931Z [cluster2] I0717 12:14:58.876201 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T12:16:15.5099861Z [cluster2] I0717 12:14:58.876374 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-17T12:16:15.5101889Z [cluster2] I0717 12:14:58.976309 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.5103844Z [cluster2] I0717 12:14:58.976350 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-17T12:16:15.5105862Z [cluster2] I0717 12:14:58.976542 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.5107581Z [cluster2] I0717 12:14:58.976733 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-17T12:16:15.5110513Z [cluster2] I0717 12:14:58.978109 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-17T12:16:15.5113798Z [cluster2] I0717 12:14:58.978618 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T12:16:15.5184890Z [cluster2] I0717 12:14:58.978804 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T12:16:15.5188273Z [cluster2] I0717 12:14:59.078510 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-17T12:16:15.5190634Z [cluster2] I0717 12:14:59.086083 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T12:16:15.5192394Z [cluster2] I0717 12:14:59.086153 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-17T12:16:15.5194476Z [cluster2] I0717 12:14:59.086314 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-17T12:16:15.5196105Z [cluster2] I0717 12:14:59.086435 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-17T12:16:15.5197814Z [cluster2] I0717 12:14:59.087446 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5199387Z [cluster2] I0717 12:14:59.141076 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-17T12:16:15.5200834Z [cluster2] I0717 12:14:59.141108 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-17T12:16:15.5202187Z [cluster2] I0717 12:14:59.141117 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5203264Z [cluster2] I0717 12:14:59.141124 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5205208Z [cluster2] I0717 12:14:59.151860 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5208144Z [cluster2] E0717 12:14:59.152022 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T12:16:15.5210857Z [cluster2] I0717 12:14:59.157359 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5212290Z [cluster2] I0717 12:14:59.157413 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5213388Z [cluster2] I0717 12:14:59.157422 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5214809Z [cluster2] I0717 12:14:59.179241 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-17T12:16:15.5216280Z [cluster2] I0717 12:14:59.179395 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-17T12:16:15.5217899Z [cluster2] I0717 12:14:59.179562 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5219203Z [cluster2] I0717 12:14:59.179690 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5220395Z [cluster2] I0717 12:14:59.179769 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5222355Z [cluster2] I0717 12:14:59.214074 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5225175Z [cluster2] I0717 12:14:59.448092 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5227780Z [cluster2] I0717 12:14:59.464859 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5230294Z [cluster2] I0717 12:14:59.572668 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5232825Z [cluster2] I0717 12:15:00.049902 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5235301Z [cluster2] I0717 12:15:00.073398 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5238845Z [cluster2] E0717 12:15:00.073540 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: DaemonSet.apps \"submariner-routeagent\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T12:16:15.5241615Z [cluster2] I0717 12:15:00.084138 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5243217Z [cluster2] I0717 12:15:00.084243 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5244449Z [cluster2] I0717 12:15:00.084334 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5246637Z [cluster2] I0717 12:15:00.167950 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5257075Z [cluster2] I0717 12:15:00.242550 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5261864Z [cluster2] I0717 12:15:00.265123 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5264886Z [cluster2] I0717 12:15:00.314039 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5267678Z [cluster2] I0717 12:15:00.437276 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5270277Z [cluster2] I0717 12:15:00.435593 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5273261Z [cluster2] I0717 12:15:00.490598 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-17T12:16:15.5276445Z [cluster2] I0717 12:15:00.540156 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5283844Z [cluster2] E0717 12:15:00.540228 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: Deployment.apps \"submariner-lighthouse-agent\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.5287968Z [cluster2] I0717 12:15:00.545259 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5292426Z [cluster2] I0717 12:15:00.790995 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5295266Z [cluster2] I0717 12:15:00.792434 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5297980Z [cluster2] I0717 12:15:00.792469 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5299563Z [cluster2] I0717 12:15:00.792478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5302945Z [cluster2] E0717 12:15:00.832761 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T12:16:15.5322314Z [cluster2] I0717 12:15:00.832800 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5324967Z [cluster2] I0717 12:15:00.867174 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5328135Z [cluster2] I0717 12:15:01.037309 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5332496Z [cluster2] E0717 12:15:01.037606 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.5337787Z [cluster2] I0717 12:15:01.038263 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5342230Z [cluster2] I0717 12:15:01.041023 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5345609Z [cluster2] I0717 12:15:01.052174 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5348876Z [cluster2] E0717 12:15:01.114152 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5387274Z [cluster2] I0717 12:15:01.119396 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5388701Z [cluster2] I0717 12:15:01.120556 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5389823Z [cluster2] I0717 12:15:01.121491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5392217Z [cluster2] I0717 12:15:01.126160 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5395797Z [cluster2] I0717 12:15:01.132126 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5399378Z [cluster2] I0717 12:15:01.189379 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5402531Z [cluster2] I0717 12:15:01.192231 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5405193Z [cluster2] I0717 12:15:01.203703 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5408089Z [cluster2] I0717 12:15:01.234189 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5410890Z [cluster2] I0717 12:15:01.410830 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5413490Z [cluster2] I0717 12:15:01.791301 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5416289Z [cluster2] I0717 12:15:01.821684 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5418909Z [cluster2] I0717 12:15:01.822338 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5421768Z [cluster2] E0717 12:15:01.839914 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5424506Z [cluster2] I0717 12:15:01.839964 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5425959Z [cluster2] I0717 12:15:01.839992 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5427027Z [cluster2] I0717 12:15:01.840008 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5428915Z [cluster2] I0717 12:15:01.858115 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5431472Z [cluster2] I0717 12:15:01.868158 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5434145Z [cluster2] I0717 12:15:01.940285 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-17T12:16:15.5436834Z [cluster2] I0717 12:15:01.952258 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5439846Z [cluster2] I0717 12:15:01.985177 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5448370Z [cluster2] E0717 12:15:01.985225 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found"
2021-07-17T12:16:15.5452107Z [cluster2] E0717 12:15:01.985285 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.5463509Z [cluster2] I0717 12:15:02.005438 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5466492Z [cluster2] E0717 12:15:02.104595 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: deployments.apps \"submariner-lighthouse-coredns\" already exists"
2021-07-17T12:16:15.5470037Z [cluster2] E0717 12:15:02.104671 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: deployments.apps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T12:16:15.5472924Z [cluster2] I0717 12:15:02.104701 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5475187Z [cluster2] I0717 12:15:02.105561 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5477611Z [cluster2] I0717 12:15:02.241054 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5481696Z [cluster2] I0717 12:15:02.431179 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5485935Z [cluster2] I0717 12:15:02.447764 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5488764Z [cluster2] I0717 12:15:02.693758 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5490035Z [cluster2] I0717 12:15:02.693802 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5491106Z [cluster2] I0717 12:15:02.693813 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5492971Z [cluster2] I0717 12:15:02.861239 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5495388Z [cluster2] I0717 12:15:03.456041 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5498075Z [cluster2] I0717 12:15:03.466472 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5501112Z [cluster2] I0717 12:15:03.469179 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5503742Z [cluster2] I0717 12:15:03.472158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5506481Z [cluster2] E0717 12:15:03.843852 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5508777Z [cluster2] I0717 12:15:03.843899 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5510050Z [cluster2] I0717 12:15:03.843935 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5511099Z [cluster2] I0717 12:15:03.843944 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5513020Z [cluster2] I0717 12:15:03.859141 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5515564Z [cluster2] I0717 12:15:04.067927 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5518191Z [cluster2] I0717 12:15:04.074445 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5535088Z [cluster2] I0717 12:15:04.468370 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5538336Z [cluster2] I0717 12:15:04.468883 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5542350Z [cluster2] I0717 12:15:04.521368 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5545271Z [cluster2] I0717 12:15:04.521739 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5553370Z [cluster2] I0717 12:15:04.558138 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5560085Z [cluster2] I0717 12:15:04.725257 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5562929Z [cluster2] I0717 12:15:04.739633 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5565913Z [cluster2] E0717 12:15:04.858375 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists"
2021-07-17T12:16:15.5570090Z [cluster2] E0717 12:15:04.858419 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T12:16:15.5572986Z [cluster2] I0717 12:15:04.858443 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5585154Z [cluster2] I0717 12:15:04.875995 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5590222Z [cluster2] I0717 12:15:04.983220 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5593842Z [cluster2] I0717 12:15:05.264991 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5596557Z [cluster2] I0717 12:15:05.297657 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5599838Z [cluster2] I0717 12:15:05.421086 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5602588Z [cluster2] I0717 12:15:05.550357 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5606426Z [cluster2] I0717 12:15:05.626113 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5609939Z [cluster2] I0717 12:15:05.626152 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.73.252\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.5613691Z [cluster2] I0717 12:15:05.877352 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5625912Z [cluster2] I0717 12:15:06.030927 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5628896Z [cluster2] I0717 12:15:06.101760 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5631675Z [cluster2] I0717 12:15:06.703772 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5634078Z [cluster2] I0717 12:15:06.717221 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5637851Z [cluster2] I0717 12:15:06.717274 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.73.252\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.5642201Z [cluster2] I0717 12:15:06.730670 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5645162Z [cluster2] I0717 12:15:06.741994 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5648590Z [cluster2] I0717 12:15:06.758322 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5651552Z [cluster2] I0717 12:15:07.372480 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5654650Z [cluster2] I0717 12:15:07.406752 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5657903Z [cluster2] I0717 12:15:07.449413 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5660789Z [cluster2] I0717 12:15:08.035465 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5662561Z [cluster2] I0717 12:15:08.035550 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5663791Z [cluster2] I0717 12:15:08.035560 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5666268Z [cluster2] I0717 12:15:08.072203 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5668853Z [cluster2] I0717 12:15:08.091247 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5672490Z [cluster2] I0717 12:15:08.091290 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.73.252\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.5685643Z [cluster2] I0717 12:15:08.104952 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5689808Z [cluster2] I0717 12:15:08.164733 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5693197Z [cluster2] I0717 12:15:08.766851 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5695649Z [cluster2] I0717 12:15:08.782020 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5697722Z [cluster2] I0717 12:15:08.855290 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5699087Z [cluster2] I0717 12:15:08.855330 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5700300Z [cluster2] I0717 12:15:08.855339 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5704166Z [cluster2] I0717 12:15:08.866594 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5705469Z [cluster2] I0717 12:15:08.866645 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5706510Z [cluster2] I0717 12:15:08.866655 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5708475Z [cluster2] I0717 12:15:08.917884 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5710892Z [cluster2] I0717 12:15:08.945616 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5713326Z [cluster2] I0717 12:15:08.962413 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5716733Z [cluster2] I0717 12:15:08.988909 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5719688Z [cluster2] I0717 12:15:09.603189 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5722300Z [cluster2] I0717 12:15:09.612348 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5724745Z [cluster2] I0717 12:15:09.946497 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5727206Z [cluster2] I0717 12:15:09.947562 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5729676Z [cluster2] I0717 12:15:10.081106 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5731037Z [cluster2] I0717 12:15:10.081150 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5732335Z [cluster2] I0717 12:15:10.081159 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5734708Z [cluster2] E0717 12:15:10.093563 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5739043Z [cluster2] I0717 12:15:10.093614 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5740519Z [cluster2] I0717 12:15:10.093677 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5741584Z [cluster2] I0717 12:15:10.093685 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5743526Z [cluster2] I0717 12:15:10.172084 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5745938Z [cluster2] I0717 12:15:10.193450 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5748654Z [cluster2] I0717 12:15:10.376627 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5751386Z [cluster2] I0717 12:15:10.393197 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5754632Z [cluster2] I0717 12:15:10.982018 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5763137Z [cluster2] I0717 12:15:11.003669 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5766420Z [cluster2] I0717 12:15:11.004537 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5769352Z [cluster2] E0717 12:15:11.071715 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5771659Z [cluster2] I0717 12:15:11.071760 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5772930Z [cluster2] I0717 12:15:11.071814 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5773988Z [cluster2] I0717 12:15:11.071825 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5775888Z [cluster2] I0717 12:15:11.072272 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5778519Z [cluster2] I0717 12:15:11.145400 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5782353Z [cluster2] I0717 12:15:11.183467 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5786336Z [cluster2] I0717 12:15:12.237988 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5789625Z [cluster2] I0717 12:15:12.320326 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5792758Z [cluster2] I0717 12:15:13.080307 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5796388Z [cluster2] I0717 12:15:13.085725 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5797955Z [cluster2] I0717 12:15:13.085745 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5800749Z [cluster2] I0717 12:15:13.139774 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5805172Z [cluster2] I0717 12:15:13.193499 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5808924Z [cluster2] I0717 12:15:13.808480 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5812264Z [cluster2] I0717 12:15:13.821784 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5816949Z [cluster2] I0717 12:15:13.863128 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5818851Z [cluster2] I0717 12:15:13.863173 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5821360Z [cluster2] I0717 12:15:13.863182 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5824015Z [cluster2] I0717 12:15:13.879623 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5825628Z [cluster2] I0717 12:15:13.879663 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5827539Z [cluster2] I0717 12:15:13.879672 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5829483Z [cluster2] I0717 12:15:13.907277 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5831934Z [cluster2] I0717 12:15:13.922570 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5834792Z [cluster2] I0717 12:15:13.937063 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5837263Z [cluster2] I0717 12:15:13.972756 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5840143Z [cluster2] I0717 12:15:14.564159 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5843693Z [cluster2] I0717 12:15:14.606570 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5846412Z [cluster2] I0717 12:15:14.618101 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5849083Z [cluster2] I0717 12:15:14.666634 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5851203Z [cluster2] I0717 12:15:14.681931 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5852795Z [cluster2] I0717 12:15:14.790699 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5853866Z [cluster2] I0717 12:15:14.790796 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5881193Z [cluster2] E0717 12:15:14.828319 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5884899Z [cluster2] I0717 12:15:14.828457 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5886744Z [cluster2] I0717 12:15:14.828550 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5887987Z [cluster2] I0717 12:15:14.828620 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5890056Z [cluster2] I0717 12:15:14.878436 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5892487Z [cluster2] I0717 12:15:14.878936 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5894937Z [cluster2] I0717 12:15:14.910254 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5897561Z [cluster2] I0717 12:15:14.910588 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5899880Z [cluster2] I0717 12:15:15.289952 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5902500Z [cluster2] I0717 12:15:15.356413 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5905458Z [cluster2] I0717 12:15:15.427980 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5908236Z [cluster2] I0717 12:15:15.528703 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5910655Z [cluster2] I0717 12:15:15.551333 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5913053Z [cluster2] I0717 12:15:15.567600 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5915504Z [cluster2] I0717 12:15:15.576663 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5917561Z [cluster2] I0717 12:15:15.601647 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5918954Z [cluster2] I0717 12:15:15.601686 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5939904Z [cluster2] I0717 12:15:15.601744 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5942988Z [cluster2] E0717 12:15:15.625307 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5946182Z [cluster2] I0717 12:15:15.625342 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5947877Z [cluster2] I0717 12:15:15.625384 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5948921Z [cluster2] I0717 12:15:15.625418 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5951440Z [cluster2] I0717 12:15:15.677143 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5955665Z [cluster2] I0717 12:15:15.677707 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5959484Z [cluster2] I0717 12:15:15.696479 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5962577Z [cluster2] I0717 12:15:15.696685 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5965306Z [cluster2] I0717 12:15:16.029415 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5968398Z [cluster2] I0717 12:15:16.062975 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.5971593Z [cluster2] I0717 12:15:16.103903 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.5974402Z [cluster2] I0717 12:15:16.319202 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5976832Z [cluster2] I0717 12:15:16.319484 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.5979310Z [cluster2] I0717 12:15:16.334651 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5981956Z [cluster2] I0717 12:15:16.346856 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.5985750Z [cluster2] I0717 12:15:16.355997 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5987874Z [cluster2] I0717 12:15:16.356158 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5989031Z [cluster2] I0717 12:15:16.356177 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5991480Z [cluster2] E0717 12:15:16.364048 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5994494Z [cluster2] I0717 12:15:16.364075 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.5995858Z [cluster2] I0717 12:15:16.364097 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.5997334Z [cluster2] I0717 12:15:16.364105 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.5999516Z [cluster2] I0717 12:15:16.365079 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6002701Z [cluster2] I0717 12:15:16.380762 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6031429Z [cluster2] I0717 12:15:16.381869 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6033917Z [cluster2] I0717 12:15:16.401999 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6036479Z [cluster2] I0717 12:15:16.705723 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6039217Z [cluster2] I0717 12:15:16.707068 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6042848Z [cluster2] I0717 12:15:16.707140 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.73.252\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.6046010Z [cluster2] I0717 12:15:16.709958 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6048487Z [cluster2] I0717 12:15:16.714498 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.6051499Z [cluster2] I0717 12:15:16.721349 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6054149Z [cluster2] I0717 12:15:16.982134 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6056671Z [cluster2] I0717 12:15:16.989068 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6059110Z [cluster2] I0717 12:15:17.004520 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6061531Z [cluster2] I0717 12:15:17.010173 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6064142Z [cluster2] I0717 12:15:17.323115 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6066903Z [cluster2] I0717 12:15:17.330796 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.6070109Z [cluster2] I0717 12:15:17.334269 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6073070Z [cluster2] I0717 12:15:17.936695 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6075463Z [cluster2] I0717 12:15:17.938883 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6079226Z [cluster2] I0717 12:15:17.939057 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.73.252\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.6082431Z [cluster2] I0717 12:15:17.945020 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6086535Z [cluster2] I0717 12:15:17.950911 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.6089898Z [cluster2] I0717 12:15:17.955225 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6092626Z [cluster2] I0717 12:15:18.560966 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6119427Z [cluster2] I0717 12:15:18.570013 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.6123214Z [cluster2] I0717 12:15:18.584342 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6126627Z [cluster2] I0717 12:15:19.188197 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6129079Z [cluster2] I0717 12:15:19.189857 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6132442Z [cluster2] I0717 12:15:19.189942 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.73.252\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.6135218Z [cluster2] I0717 12:15:19.591205 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6136474Z [cluster2] I0717 12:15:19.591637 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6137642Z [cluster2] I0717 12:15:19.591745 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6139553Z [cluster2] I0717 12:15:19.598989 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6142173Z [cluster2] I0717 12:15:19.606057 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6144602Z [cluster2] I0717 12:15:20.207505 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6147030Z [cluster2] I0717 12:15:20.212846 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6149088Z [cluster2] I0717 12:15:20.225865 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6150352Z [cluster2] I0717 12:15:20.226029 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6151397Z [cluster2] I0717 12:15:20.226145 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6152907Z [cluster2] I0717 12:15:20.232099 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6154169Z [cluster2] I0717 12:15:20.232206 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6155295Z [cluster2] I0717 12:15:20.232248 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6157317Z [cluster2] I0717 12:15:20.233430 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6159965Z [cluster2] I0717 12:15:20.236813 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6162541Z [cluster2] I0717 12:15:20.246977 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6165100Z [cluster2] I0717 12:15:20.252785 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6167582Z [cluster2] I0717 12:15:20.838009 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6170351Z [cluster2] I0717 12:15:20.842731 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6172982Z [cluster2] I0717 12:15:20.855738 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6175398Z [cluster2] I0717 12:15:20.861788 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6177875Z [cluster2] I0717 12:15:24.607782 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6179219Z [cluster2] I0717 12:15:24.607848 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6180329Z [cluster2] I0717 12:15:24.607871 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6182582Z [cluster2] I0717 12:15:24.618141 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6185953Z [cluster2] I0717 12:15:24.629034 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6190361Z [cluster2] I0717 12:15:25.230952 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6193092Z [cluster2] I0717 12:15:25.239110 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6195357Z [cluster2] I0717 12:15:25.250576 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6196630Z [cluster2] I0717 12:15:25.250617 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6197676Z [cluster2] I0717 12:15:25.250626 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6234123Z [cluster2] I0717 12:15:25.252383 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6235409Z [cluster2] I0717 12:15:25.252422 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6236582Z [cluster2] I0717 12:15:25.252432 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6238800Z [cluster2] I0717 12:15:25.264608 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6241244Z [cluster2] I0717 12:15:25.266495 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6243778Z [cluster2] I0717 12:15:25.271425 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6246295Z [cluster2] I0717 12:15:25.271790 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6248743Z [cluster2] I0717 12:15:25.873471 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6251194Z [cluster2] I0717 12:15:25.873484 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6253596Z [cluster2] I0717 12:15:25.881346 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6256067Z [cluster2] I0717 12:15:25.884915 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6258225Z [cluster2] I0717 12:15:29.628061 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6259506Z [cluster2] I0717 12:15:29.628108 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6260548Z [cluster2] I0717 12:15:29.628117 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6262448Z [cluster2] I0717 12:15:29.649285 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6264960Z [cluster2] I0717 12:15:29.654422 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6267382Z [cluster2] I0717 12:15:30.255989 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6269975Z [cluster2] I0717 12:15:30.261545 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6272356Z [cluster2] I0717 12:15:30.275658 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6273799Z [cluster2] I0717 12:15:30.275733 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6274859Z [cluster2] I0717 12:15:30.275766 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6276366Z [cluster2] I0717 12:15:30.278057 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6277778Z [cluster2] I0717 12:15:30.278093 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6312639Z [cluster2] I0717 12:15:30.278103 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6314734Z [cluster2] I0717 12:15:30.292929 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6317140Z [cluster2] I0717 12:15:30.294442 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6319724Z [cluster2] I0717 12:15:30.304104 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6322343Z [cluster2] I0717 12:15:30.304413 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6324902Z [cluster2] I0717 12:15:30.907095 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6327324Z [cluster2] I0717 12:15:30.908886 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6329747Z [cluster2] I0717 12:15:30.914092 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6332326Z [cluster2] I0717 12:15:30.914774 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6334600Z [cluster2] I0717 12:15:34.673222 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6335903Z [cluster2] I0717 12:15:34.673285 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6337258Z [cluster2] I0717 12:15:34.673295 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6339154Z [cluster2] I0717 12:15:34.690661 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6341590Z [cluster2] I0717 12:15:34.700405 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6344021Z [cluster2] I0717 12:15:35.302163 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6346427Z [cluster2] I0717 12:15:35.310679 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6348484Z [cluster2] I0717 12:15:35.323616 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6349749Z [cluster2] I0717 12:15:35.323781 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6350791Z [cluster2] I0717 12:15:35.323803 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6352294Z [cluster2] I0717 12:15:35.325337 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6353551Z [cluster2] I0717 12:15:35.325399 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6354812Z [cluster2] I0717 12:15:35.325507 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6357391Z [cluster2] I0717 12:15:35.334924 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6362582Z [cluster2] I0717 12:15:35.339537 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6365207Z [cluster2] I0717 12:15:35.344287 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6367658Z [cluster2] I0717 12:15:35.360019 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6370096Z [cluster2] I0717 12:15:35.940940 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6373380Z [cluster2] I0717 12:15:35.946412 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6424527Z [cluster2] I0717 12:15:35.961291 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6426980Z [cluster2] I0717 12:15:35.965155 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6429048Z [cluster2] I0717 12:15:39.696835 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6430296Z [cluster2] I0717 12:15:39.696902 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6431552Z [cluster2] I0717 12:15:39.696912 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6433496Z [cluster2] I0717 12:15:39.707679 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6436565Z [cluster2] I0717 12:15:39.710639 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6439560Z [cluster2] I0717 12:15:40.312656 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6442243Z [cluster2] I0717 12:15:40.318154 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6444396Z [cluster2] I0717 12:15:40.327931 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6445861Z [cluster2] I0717 12:15:40.328064 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6446921Z [cluster2] I0717 12:15:40.328159 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6448416Z [cluster2] I0717 12:15:40.332471 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6449677Z [cluster2] I0717 12:15:40.332585 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6450735Z [cluster2] I0717 12:15:40.332684 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6452604Z [cluster2] I0717 12:15:40.335702 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6455201Z [cluster2] I0717 12:15:40.339601 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6457636Z [cluster2] I0717 12:15:40.340475 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6460262Z [cluster2] I0717 12:15:40.353310 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6462712Z [cluster2] I0717 12:15:40.940650 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6465134Z [cluster2] I0717 12:15:40.945455 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6467557Z [cluster2] I0717 12:15:40.958235 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6469959Z [cluster2] I0717 12:15:40.963637 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6472107Z [cluster2] I0717 12:15:44.715097 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6473591Z [cluster2] I0717 12:15:44.715168 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6474664Z [cluster2] I0717 12:15:44.715181 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6476761Z [cluster2] I0717 12:15:44.724247 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6479319Z [cluster2] I0717 12:15:44.726974 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6481774Z [cluster2] I0717 12:15:45.329102 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6484187Z [cluster2] I0717 12:15:45.335336 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6486393Z [cluster2] I0717 12:15:45.343708 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6487642Z [cluster2] I0717 12:15:45.343768 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6489579Z [cluster2] I0717 12:15:45.343784 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6491675Z [cluster2] I0717 12:15:45.345884 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6493553Z [cluster2] I0717 12:15:45.346015 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6494619Z [cluster2] I0717 12:15:45.346116 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6496507Z [cluster2] I0717 12:15:45.351429 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6498934Z [cluster2] I0717 12:15:45.355162 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6501376Z [cluster2] I0717 12:15:45.355576 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6503829Z [cluster2] I0717 12:15:45.363768 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6506381Z [cluster2] I0717 12:15:45.958022 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6508844Z [cluster2] I0717 12:15:45.963827 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6511274Z [cluster2] I0717 12:15:45.965494 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6518885Z [cluster2] I0717 12:15:45.970510 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6521409Z [cluster2] I0717 12:15:49.732936 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6522862Z [cluster2] I0717 12:15:49.732990 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6524292Z [cluster2] I0717 12:15:49.733000 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6526260Z [cluster2] I0717 12:15:49.741625 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6528716Z [cluster2] I0717 12:15:49.744761 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6531159Z [cluster2] I0717 12:15:50.346454 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6533560Z [cluster2] I0717 12:15:50.351401 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6535976Z [cluster2] I0717 12:15:50.359414 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6537930Z [cluster2] I0717 12:15:50.359814 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6539292Z [cluster2] I0717 12:15:50.359914 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6540446Z [cluster2] I0717 12:15:50.359932 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6541509Z [cluster2] I0717 12:15:50.361054 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6542674Z [cluster2] I0717 12:15:50.361069 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6544635Z [cluster2] I0717 12:15:50.368798 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6547043Z [cluster2] I0717 12:15:50.370329 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6549485Z [cluster2] I0717 12:15:50.374971 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6551977Z [cluster2] I0717 12:15:50.376180 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6554417Z [cluster2] I0717 12:15:50.977102 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6557053Z [cluster2] I0717 12:15:50.978218 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6559595Z [cluster2] I0717 12:15:50.981909 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6562106Z [cluster2] I0717 12:15:50.982901 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6564166Z [cluster2] I0717 12:15:54.750971 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6565425Z [cluster2] I0717 12:15:54.751030 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6566487Z [cluster2] I0717 12:15:54.751041 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6568379Z [cluster2] I0717 12:15:54.757371 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6570816Z [cluster2] I0717 12:15:54.761813 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6573265Z [cluster2] I0717 12:15:55.363364 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6576184Z [cluster2] I0717 12:15:55.368447 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6578561Z [cluster2] I0717 12:15:55.375574 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6579834Z [cluster2] I0717 12:15:55.375618 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6580902Z [cluster2] I0717 12:15:55.375629 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6582430Z [cluster2] I0717 12:15:55.380518 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6583695Z [cluster2] I0717 12:15:55.380570 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6584750Z [cluster2] I0717 12:15:55.380595 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6586624Z [cluster2] I0717 12:15:55.385876 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6589197Z [cluster2] I0717 12:15:55.386324 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6593609Z [cluster2] I0717 12:15:55.391866 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6601481Z [cluster2] I0717 12:15:55.392085 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6603976Z [cluster2] I0717 12:15:55.993803 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6606370Z [cluster2] I0717 12:15:55.993809 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6608906Z [cluster2] I0717 12:15:55.999942 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6611497Z [cluster2] I0717 12:15:56.000883 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6613585Z [cluster2] I0717 12:15:59.777278 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6615005Z [cluster2] I0717 12:15:59.777369 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6616089Z [cluster2] I0717 12:15:59.777394 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6618014Z [cluster2] I0717 12:15:59.786554 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6633700Z [cluster2] I0717 12:15:59.789636 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6636231Z [cluster2] I0717 12:16:00.391213 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6638832Z [cluster2] I0717 12:16:00.397285 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6641148Z [cluster2] I0717 12:16:00.404864 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6642402Z [cluster2] I0717 12:16:00.405023 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6643592Z [cluster2] I0717 12:16:00.405055 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6645136Z [cluster2] I0717 12:16:00.406355 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6646764Z [cluster2] I0717 12:16:00.406390 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6648074Z [cluster2] I0717 12:16:00.406398 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6650273Z [cluster2] I0717 12:16:00.412946 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6653055Z [cluster2] I0717 12:16:00.413992 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6655511Z [cluster2] I0717 12:16:00.421730 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6658009Z [cluster2] I0717 12:16:00.422013 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6660583Z [cluster2] I0717 12:16:01.023447 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6663025Z [cluster2] I0717 12:16:01.023477 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6665453Z [cluster2] I0717 12:16:01.032151 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6667913Z [cluster2] I0717 12:16:01.034326 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6669956Z [cluster2] I0717 12:16:04.800527 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6671224Z [cluster2] I0717 12:16:04.800601 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6672383Z [cluster2] I0717 12:16:04.800610 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6674273Z [cluster2] I0717 12:16:04.808769 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6676958Z [cluster2] I0717 12:16:04.811493 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6680507Z [cluster2] I0717 12:16:05.413924 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6682948Z [cluster2] I0717 12:16:05.423523 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6685016Z [cluster2] I0717 12:16:05.441026 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6686280Z [cluster2] I0717 12:16:05.441100 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6687322Z [cluster2] I0717 12:16:05.441139 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6688833Z [cluster2] I0717 12:16:05.441622 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6690218Z [cluster2] I0717 12:16:05.441848 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6692429Z [cluster2] I0717 12:16:05.441866 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6695024Z [cluster2] I0717 12:16:05.458173 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6698638Z [cluster2] I0717 12:16:05.462043 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6701249Z [cluster2] I0717 12:16:05.466372 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6703749Z [cluster2] I0717 12:16:05.490165 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6706186Z [cluster2] I0717 12:16:06.068641 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6709355Z [cluster2] I0717 12:16:06.075796 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6711807Z [cluster2] I0717 12:16:06.091821 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6714232Z [cluster2] I0717 12:16:06.099211 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6716281Z [cluster2] I0717 12:16:09.832741 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6717538Z [cluster2] I0717 12:16:09.832808 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6718795Z [cluster2] I0717 12:16:09.832818 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6720737Z [cluster2] I0717 12:16:09.841893 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6723176Z [cluster2] I0717 12:16:09.845134 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6725615Z [cluster2] I0717 12:16:10.447613 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.6728155Z [cluster2] I0717 12:16:10.455710 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6730254Z [cluster2] I0717 12:16:10.467068 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6731518Z [cluster2] I0717 12:16:10.467236 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6749987Z [cluster2] I0717 12:16:10.467313 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6752406Z [cluster2] I0717 12:16:10.472395 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.6754096Z [cluster2] I0717 12:16:10.472467 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.6755159Z [cluster2] I0717 12:16:10.472487 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:15.6757069Z [cluster2] I0717 12:16:10.488339 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6760369Z [cluster2] I0717 12:16:10.492150 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.6762881Z [cluster2] I0717 12:16:10.494770 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6765359Z [cluster2] I0717 12:16:10.512552 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.6767809Z [cluster2] I0717 12:16:11.096735 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.7860046Z [cluster2] I0717 12:16:11.103556 1 helpers.go:85] controller_submariner "msg"="Updated2021-07-17T12:14:37Z"
2021-07-17T12:16:15.7860668Z [cluster1] }
2021-07-17T12:16:15.7861059Z [cluster1] }
2021-07-17T12:16:15.7861372Z [cluster1] }
2021-07-17T12:16:15.7861691Z [cluster1] ],
2021-07-17T12:16:15.7862029Z [cluster1] "hostIP": "172.18.0.7",
2021-07-17T12:16:15.7862428Z [cluster1] "phase": "Running",
2021-07-17T12:16:15.7862808Z [cluster1] "podIP": "10.1.128.5",
2021-07-17T12:16:15.7864896Z [cluster1] "podIPs": [
2021-07-17T12:16:15.7865253Z [cluster1] {
2021-07-17T12:16:15.7865604Z [cluster1] "ip": "10.1.128.5"
2021-07-17T12:16:15.7866120Z [cluster1] }
2021-07-17T12:16:15.7866430Z [cluster1] ],
2021-07-17T12:16:15.7866835Z [cluster1] "qosClass": "BestEffort",
2021-07-17T12:16:15.7867568Z [cluster1] "startTime": "2021-07-17T12:14:37Z"
2021-07-17T12:16:15.7867955Z [cluster1] }
2021-07-17T12:16:15.7868258Z [cluster1] }
2021-07-17T12:16:15.7871313Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T12:16:15.7872763Z [submariner-operator]$ [cluster1] grep Running
2021-07-17T12:16:15.7874140Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T12:16:15.7877680Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T12:16:15.7879703Z [cluster1] Running
2021-07-17T12:16:15.7882665Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator
2021-07-17T12:16:15.7884606Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator
2021-07-17T12:16:15.7886382Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-bxpkd --namespace=submariner-operator
2021-07-17T12:16:15.7890868Z [cluster1] I0717 12:14:38.040084 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-17T12:16:15.7891506Z [cluster1] I0717 12:14:38.040425 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-17T12:16:15.7892436Z [cluster1] I0717 12:14:38.040434 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-17T12:16:15.7893319Z [cluster1] I0717 12:14:38.040439 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-17T12:16:15.7894400Z [cluster1] I0717 12:14:38.040704 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-17T12:16:15.7895602Z [cluster1] I0717 12:14:38.758271 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-9mv8h"
2021-07-17T12:16:15.7896525Z [cluster1] I0717 12:14:38.853420 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-17T12:16:15.7897163Z [cluster1] I0717 12:14:39.987361 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-17T12:16:15.7897770Z [cluster1] I0717 12:14:42.367696 1 leader.go:149] leader "msg"="Became the leader."
2021-07-17T12:16:15.7898791Z [cluster1] I0717 12:14:42.973759 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-17T12:16:15.7899587Z [cluster1] I0717 12:14:42.974037 1 main.go:129] cmd "msg"="Registering Components."
2021-07-17T12:16:15.7900210Z [cluster1] I0717 12:14:42.974225 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-17T12:16:15.7917163Z [cluster1] I0717 12:14:46.806773 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.7923458Z [cluster1] I0717 12:14:46.806876 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.7924421Z [cluster1] I0717 12:14:46.806987 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-17T12:16:15.7925400Z [cluster1] I0717 12:14:46.807287 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-17T12:16:15.7947466Z [cluster1] I0717 12:14:46.807529 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-17T12:16:15.7953957Z [cluster1] I0717 12:14:46.807571 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T12:16:15.7957690Z [cluster1] I0717 12:14:46.807547 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T12:16:15.7963764Z [cluster1] I0717 12:14:46.808808 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T12:16:15.7970666Z [cluster1] I0717 12:14:46.809160 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T12:16:15.7974960Z [cluster1] I0717 12:14:46.908601 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.7976653Z [cluster1] I0717 12:14:46.909128 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-17T12:16:15.7978464Z [cluster1] I0717 12:14:46.910408 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.7981346Z [cluster1] I0717 12:14:46.911497 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-17T12:16:15.7984623Z [cluster1] I0717 12:14:46.911707 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T12:16:15.7987491Z [cluster1] I0717 12:14:46.912957 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T12:16:15.7989765Z [cluster1] I0717 12:14:47.011999 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-17T12:16:15.7992596Z [cluster1] I0717 12:14:47.012213 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-17T12:16:15.7995006Z [cluster1] I0717 12:14:47.014174 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T12:16:15.7997018Z [cluster1] I0717 12:14:47.110631 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-17T12:16:15.7999433Z [cluster1] I0717 12:14:47.110793 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8001294Z [cluster1] I0717 12:14:47.112443 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-17T12:16:15.8003095Z [cluster1] I0717 12:14:47.112593 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-17T12:16:15.8006333Z [cluster1] I0717 12:14:47.112735 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8009168Z [cluster1] I0717 12:14:47.112881 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-17T12:16:15.8011894Z [cluster1] I0717 12:14:47.113015 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8014403Z [cluster1] I0717 12:14:47.115320 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-17T12:16:15.8016567Z [cluster1] I0717 12:14:47.115480 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8049036Z [cluster1] E0717 12:14:47.485180 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8051776Z [cluster1] E0717 12:14:47.585691 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8054426Z [cluster1] E0717 12:14:47.645620 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8057206Z [cluster1] E0717 12:14:47.741982 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8059928Z [cluster1] E0717 12:14:47.871496 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8062567Z [cluster1] E0717 12:14:48.022516 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8065165Z [cluster1] E0717 12:14:48.245348 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8067768Z [cluster1] E0717 12:14:48.606696 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8070516Z [cluster1] E0717 12:14:49.299069 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8072862Z [cluster1] I0717 12:14:49.393536 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8074981Z [cluster1] I0717 12:14:49.480558 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8077116Z [cluster1] I0717 12:14:49.592448 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8086403Z [cluster1] I0717 12:14:49.662395 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8088522Z [cluster1] I0717 12:14:50.090331 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8090665Z [cluster1] I0717 12:14:50.136738 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8093273Z [cluster1] I0717 12:14:50.393036 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8095604Z [cluster1] I0717 12:14:50.460840 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8098068Z [cluster1] I0717 12:14:50.600844 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8100250Z [cluster1] I0717 12:14:50.601722 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8102650Z [cluster1] E0717 12:14:50.673772 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8106637Z [cluster1] E0717 12:14:53.271495 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8109921Z [cluster1] I0717 12:14:54.417189 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8111836Z [cluster1] I0717 12:14:54.436470 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8113586Z [cluster1] I0717 12:14:54.436520 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8115529Z [cluster1] I0717 12:14:57.837679 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8117271Z [cluster1] I0717 12:14:57.837682 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8132296Z [cluster1] I0717 12:14:57.922223 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-17T12:16:15.8133901Z [cluster1] I0717 12:14:57.922495 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-17T12:16:15.8135047Z [cluster1] I0717 12:14:57.922553 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8136151Z [cluster1] I0717 12:14:57.922594 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8137204Z [cluster1] I0717 12:14:57.925739 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-17T12:16:15.8138595Z [cluster1] I0717 12:14:57.925837 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-17T12:16:15.8139739Z [cluster1] I0717 12:14:57.925980 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8140809Z [cluster1] I0717 12:14:57.926030 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8142746Z [cluster1] I0717 12:14:57.932305 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8146022Z [cluster1] E0717 12:14:57.945235 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-17T12:16:15.8148513Z [cluster1] I0717 12:14:57.945356 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8149807Z [cluster1] I0717 12:14:57.945507 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8150903Z [cluster1] I0717 12:14:57.945587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8152861Z [cluster1] I0717 12:14:57.958324 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8155365Z [cluster1] I0717 12:14:57.977751 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8158277Z [cluster1] E0717 12:14:57.977853 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-17T12:16:15.8161262Z [cluster1] I0717 12:14:57.977901 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8163196Z [cluster1] I0717 12:14:57.977944 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8164445Z [cluster1] I0717 12:14:57.977959 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8167090Z [cluster1] I0717 12:14:58.091002 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8169619Z [cluster1] I0717 12:14:58.119988 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8172145Z [cluster1] I0717 12:14:58.175702 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8174757Z [cluster1] E0717 12:14:58.538112 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8177302Z [cluster1] I0717 12:14:58.692277 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8179849Z [cluster1] I0717 12:14:58.695807 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8182192Z [cluster1] I0717 12:14:58.715967 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8184325Z [cluster1] I0717 12:14:58.716222 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8186593Z [cluster1] I0717 12:14:58.718518 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-17T12:16:15.8189242Z [cluster1] I0717 12:14:58.729798 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8192563Z [cluster1] E0717 12:14:58.730154 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: Deployment.apps \"submariner-lighthouse-agent\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T12:16:15.8227227Z [cluster1] I0717 12:14:58.731161 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8230467Z [cluster1] E0717 12:14:58.757145 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.8233922Z [cluster1] I0717 12:14:58.757439 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8236436Z [cluster1] I0717 12:14:58.762544 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8239207Z [cluster1] I0717 12:14:58.786285 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8242179Z [cluster1] I0717 12:14:58.846203 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8245364Z [cluster1] I0717 12:14:58.872074 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8249205Z [cluster1] E0717 12:14:58.873467 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T12:16:15.8252270Z [cluster1] I0717 12:14:58.873508 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8254626Z [cluster1] I0717 12:14:58.896077 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8256758Z [cluster1] I0717 12:14:58.924241 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8258111Z [cluster1] I0717 12:14:58.924413 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8259205Z [cluster1] I0717 12:14:58.924549 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8261430Z [cluster1] I0717 12:14:58.952169 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8264641Z [cluster1] E0717 12:14:58.953926 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8266994Z [cluster1] I0717 12:14:58.953977 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8268295Z [cluster1] I0717 12:14:58.954001 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8269384Z [cluster1] I0717 12:14:58.954010 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8271331Z [cluster1] I0717 12:14:58.959405 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8276523Z [cluster1] I0717 12:14:59.014455 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8282997Z [cluster1] I0717 12:14:59.017616 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8285825Z [cluster1] I0717 12:14:59.022250 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8288488Z [cluster1] I0717 12:14:59.099993 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8292160Z [cluster1] E0717 12:14:59.100784 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.8295350Z [cluster1] I0717 12:14:59.126487 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8297898Z [cluster1] I0717 12:14:59.184911 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8300877Z [cluster1] I0717 12:14:59.188653 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8303944Z [cluster1] I0717 12:14:59.627495 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8306836Z [cluster1] I0717 12:14:59.627628 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8310738Z [cluster1] I0717 12:14:59.650339 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8313716Z [cluster1] I0717 12:14:59.726059 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8316202Z [cluster1] I0717 12:14:59.870806 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8319393Z [cluster1] I0717 12:14:59.871548 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-17T12:16:15.8322447Z [cluster1] I0717 12:14:59.877217 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8324627Z [cluster1] I0717 12:14:59.939637 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8325921Z [cluster1] I0717 12:14:59.948799 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8327175Z [cluster1] I0717 12:14:59.948821 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8329416Z [cluster1] I0717 12:15:00.169911 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8332499Z [cluster1] E0717 12:15:00.169955 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found"
2021-07-17T12:16:15.8336030Z [cluster1] E0717 12:15:00.169998 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T12:16:15.8338953Z [cluster1] I0717 12:15:00.182043 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8341626Z [cluster1] E0717 12:15:00.289577 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8344113Z [cluster1] I0717 12:15:00.290660 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8345416Z [cluster1] I0717 12:15:00.290692 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8346487Z [cluster1] I0717 12:15:00.290701 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8348429Z [cluster1] I0717 12:15:00.290600 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8351349Z [cluster1] E0717 12:15:00.311319 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: deployments.apps \"submariner-lighthouse-coredns\" already exists"
2021-07-17T12:16:15.8355130Z [cluster1] E0717 12:15:00.314251 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: deployments.apps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.8358221Z [cluster1] I0717 12:15:00.331903 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8439584Z [cluster1] I0717 12:15:00.483511 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8442767Z [cluster1] I0717 12:15:00.613229 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8445482Z [cluster1] I0717 12:15:00.679472 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8448018Z [cluster1] I0717 12:15:00.722519 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8450810Z [cluster1] I0717 12:15:00.849914 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8453779Z [cluster1] I0717 12:15:00.850291 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8456902Z [cluster1] I0717 12:15:01.181704 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8459428Z [cluster1] I0717 12:15:01.776068 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8462007Z [cluster1] I0717 12:15:01.776475 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8464685Z [cluster1] I0717 12:15:01.778931 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8467498Z [cluster1] I0717 12:15:01.857042 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8470249Z [cluster1] I0717 12:15:01.862259 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8473001Z [cluster1] I0717 12:15:01.864074 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8475976Z [cluster1] I0717 12:15:01.920226 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8478801Z [cluster1] I0717 12:15:02.004844 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8481338Z [cluster1] I0717 12:15:02.082275 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8484169Z [cluster1] E0717 12:15:02.154124 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists"
2021-07-17T12:16:15.8487796Z [cluster1] E0717 12:15:02.154179 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T12:16:15.8491285Z [cluster1] I0717 12:15:02.154303 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8493990Z [cluster1] I0717 12:15:02.194890 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8496559Z [cluster1] I0717 12:15:02.706653 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8499517Z [cluster1] I0717 12:15:02.788384 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8502333Z [cluster1] I0717 12:15:03.137929 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8505184Z [cluster1] I0717 12:15:03.398091 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8507888Z [cluster1] I0717 12:15:03.447591 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8513051Z [cluster1] I0717 12:15:03.447642 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.181.138\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.8516491Z [cluster1] I0717 12:15:03.562681 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8519626Z [cluster1] I0717 12:15:03.830423 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8522691Z [cluster1] I0717 12:15:04.344127 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8525428Z [cluster1] I0717 12:15:04.357165 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8528211Z [cluster1] I0717 12:15:04.395143 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8530974Z [cluster1] I0717 12:15:05.004326 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8533419Z [cluster1] I0717 12:15:05.012977 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8535684Z [cluster1] I0717 12:15:05.029014 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8538842Z [cluster1] I0717 12:15:05.029069 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.181.138\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.8542036Z [cluster1] I0717 12:15:05.116539 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8544805Z [cluster1] I0717 12:15:05.138041 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8547043Z [cluster1] I0717 12:15:05.419389 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8548258Z [cluster1] I0717 12:15:05.447959 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8549256Z [cluster1] I0717 12:15:05.447981 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8551053Z [cluster1] I0717 12:15:05.480576 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8553379Z [cluster1] I0717 12:15:05.538130 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8555786Z [cluster1] I0717 12:15:05.741659 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8558055Z [cluster1] I0717 12:15:05.745170 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8561843Z [cluster1] I0717 12:15:05.745207 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.181.138\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.8564841Z [cluster1] I0717 12:15:06.150942 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8567134Z [cluster1] I0717 12:15:06.209789 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8569086Z [cluster1] I0717 12:15:06.285634 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8570284Z [cluster1] I0717 12:15:06.285687 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8571271Z [cluster1] I0717 12:15:06.285698 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8572697Z [cluster1] I0717 12:15:06.286081 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8573891Z [cluster1] I0717 12:15:06.286106 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8574987Z [cluster1] I0717 12:15:06.286114 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8577410Z [cluster1] I0717 12:15:06.358188 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8580134Z [cluster1] I0717 12:15:06.358830 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8582765Z [cluster1] I0717 12:15:06.388622 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8585959Z [cluster1] I0717 12:15:06.388935 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8588739Z [cluster1] I0717 12:15:06.992767 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8591536Z [cluster1] I0717 12:15:06.992827 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8656249Z [cluster1] I0717 12:15:07.038677 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8658787Z [cluster1] I0717 12:15:07.141695 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8660834Z [cluster1] I0717 12:15:09.371982 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8662017Z [cluster1] I0717 12:15:09.372039 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8663021Z [cluster1] I0717 12:15:09.372049 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8664810Z [cluster1] I0717 12:15:09.491309 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8667103Z [cluster1] I0717 12:15:09.565876 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8669508Z [cluster1] E0717 12:15:10.009875 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:15.8672018Z [cluster1] I0717 12:15:10.170503 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8674367Z [cluster1] I0717 12:15:10.186841 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8676308Z [cluster1] I0717 12:15:10.223287 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8677502Z [cluster1] I0717 12:15:10.226010 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8719215Z [cluster1] I0717 12:15:10.223819 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8720437Z [cluster1] I0717 12:15:10.226311 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8721439Z [cluster1] I0717 12:15:10.226388 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8722620Z [cluster1] I0717 12:15:10.226276 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8724532Z [cluster1] I0717 12:15:10.432365 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8726824Z [cluster1] I0717 12:15:10.457694 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8729140Z [cluster1] I0717 12:15:10.464072 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8731483Z [cluster1] I0717 12:15:10.464907 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8734275Z [cluster1] I0717 12:15:11.076106 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8737053Z [cluster1] I0717 12:15:11.086302 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8739333Z [cluster1] I0717 12:15:11.151802 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8741738Z [cluster1] I0717 12:15:11.155964 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8743901Z [cluster1] I0717 12:15:11.368224 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8746246Z [cluster1] I0717 12:15:11.451538 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8748970Z [cluster1] I0717 12:15:11.485062 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8751547Z [cluster1] I0717 12:15:12.104217 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8754132Z [cluster1] I0717 12:15:12.138616 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8757026Z [cluster1] I0717 12:15:12.182539 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8759531Z [cluster1] I0717 12:15:12.312651 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8760731Z [cluster1] I0717 12:15:12.312711 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8761713Z [cluster1] I0717 12:15:12.312721 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8763498Z [cluster1] I0717 12:15:12.418634 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8765818Z [cluster1] I0717 12:15:12.519775 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8768198Z [cluster1] I0717 12:15:12.854285 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8770474Z [cluster1] I0717 12:15:12.906467 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8773756Z [cluster1] I0717 12:15:12.906509 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.181.138\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.8776766Z [cluster1] I0717 12:15:13.387453 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8779060Z [cluster1] I0717 12:15:13.568597 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8781010Z [cluster1] I0717 12:15:13.623201 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8782190Z [cluster1] I0717 12:15:13.623489 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8783189Z [cluster1] I0717 12:15:13.623572 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8784732Z [cluster1] I0717 12:15:13.637308 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8785912Z [cluster1] I0717 12:15:13.637459 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8786911Z [cluster1] I0717 12:15:13.637557 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8788675Z [cluster1] I0717 12:15:13.791909 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8790949Z [cluster1] I0717 12:15:13.795733 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8793267Z [cluster1] I0717 12:15:13.817390 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8795615Z [cluster1] I0717 12:15:13.843574 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8797734Z [cluster1] I0717 12:15:14.202767 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8800238Z [cluster1] I0717 12:15:14.240137 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8803054Z [cluster1] I0717 12:15:14.256049 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8805602Z [cluster1] I0717 12:15:14.436239 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8808035Z [cluster1] I0717 12:15:14.449342 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8810445Z [cluster1] I0717 12:15:14.518118 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8816231Z [cluster1] I0717 12:15:14.520444 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8866435Z [cluster1] I0717 12:15:14.858059 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8869857Z [cluster1] I0717 12:15:14.866163 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8873215Z [cluster1] I0717 12:15:14.886451 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8876000Z [cluster1] I0717 12:15:15.488347 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8878551Z [cluster1] I0717 12:15:15.490172 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8881956Z [cluster1] I0717 12:15:15.490289 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.181.138\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.8884925Z [cluster1] I0717 12:15:15.495129 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8887522Z [cluster1] I0717 12:15:15.500932 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8890669Z [cluster1] I0717 12:15:15.505285 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8893860Z [cluster1] I0717 12:15:16.107454 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8896848Z [cluster1] I0717 12:15:16.119174 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T12:16:15.8899765Z [cluster1] I0717 12:15:16.135651 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8902531Z [cluster1] I0717 12:15:16.737040 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8905044Z [cluster1] I0717 12:15:16.738845 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8908387Z [cluster1] I0717 12:15:16.738880 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.181.138\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-17T12:16:15.8911417Z [cluster1] I0717 12:15:17.103658 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8913816Z [cluster1] I0717 12:15:17.103764 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8915262Z [cluster1] I0717 12:15:17.108744 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8918251Z [cluster1] I0717 12:15:17.116133 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8921077Z [cluster1] I0717 12:15:17.120157 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8923534Z [cluster1] I0717 12:15:17.721644 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8925887Z [cluster1] I0717 12:15:17.726518 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8927827Z [cluster1] I0717 12:15:17.734890 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8929612Z [cluster1] I0717 12:15:17.735541 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8930799Z [cluster1] I0717 12:15:17.735641 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8931806Z [cluster1] I0717 12:15:17.735735 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8932801Z [cluster1] I0717 12:15:17.735889 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.8933786Z [cluster1] I0717 12:15:17.735912 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.8935714Z [cluster1] I0717 12:15:17.744793 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8937998Z [cluster1] I0717 12:15:17.747149 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8940298Z [cluster1] I0717 12:15:17.748298 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8942651Z [cluster1] I0717 12:15:17.750822 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.8944947Z [cluster1] I0717 12:15:18.350968 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8947186Z [cluster1] I0717 12:15:18.352173 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.8949466Z [cluster1] I0717 12:15:18.360367 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8953328Z [cluster1] I0717 12:15:18.363690 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.8956106Z [cluster1] I0717 12:15:22.117019 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.8999034Z [cluster1] I0717 12:15:22.117063 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.9000086Z [cluster1] I0717 12:15:22.117072 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.9002016Z [cluster1] I0717 12:15:22.125920 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9004336Z [cluster1] I0717 12:15:22.129289 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.9006644Z [cluster1] I0717 12:15:22.731123 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.9009135Z [cluster1] I0717 12:15:22.736802 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9011322Z [cluster1] I0717 12:15:22.748080 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.9013011Z [cluster1] I0717 12:15:22.748096 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.9015898Z [cluster1] I0717 12:15:22.748114 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.9017269Z [cluster1] I0717 12:15:22.748122 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.9019421Z [cluster1] I0717 12:15:22.748127 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.9020929Z [cluster1] I0717 12:15:22.748135 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.9022956Z [cluster1] I0717 12:15:22.757736 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9025545Z [cluster1] I0717 12:15:22.757959 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9028064Z [cluster1] I0717 12:15:22.761409 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.9030780Z [cluster1] I0717 12:15:22.777597 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.9033585Z [cluster1] I0717 12:15:23.363304 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.9036416Z [cluster1] I0717 12:15:23.374098 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9039138Z [cluster1] I0717 12:15:23.379615 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.9041685Z [cluster1] I0717 12:15:23.386845 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9043628Z [cluster1] I0717 12:15:27.135639 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.9045133Z [cluster1] I0717 12:15:27.135698 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.9046364Z [cluster1] I0717 12:15:27.135710 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.9048336Z [cluster1] I0717 12:15:27.144287 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9050885Z [cluster1] I0717 12:15:27.147129 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:15.9053183Z [cluster1] I0717 12:15:27.749333 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:15.9055469Z [cluster1] I0717 12:15:27.755030 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9057406Z [cluster1] I0717 12:15:27.770096 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.9058601Z [cluster1] I0717 12:15:27.771930 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.9059589Z [cluster1] I0717 12:15:27.772007 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.9061014Z [cluster1] I0717 12:15:27.777518 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:15.9062277Z [cluster1] I0717 12:15:27.777573 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T12:16:15.9063341Z [cluster1] I0717 12:15:27.777587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T12:16:15.9065151Z [cluster1] I0717 12:15:27.783613 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:15.9067418Z [cluster1] I0717 12:15:27.789473 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.3985670Z [cluster1] I0717 12:15:27.790938 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Se existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.3988964Z [cluster2] I0717 12:16:11.117449 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:16.4000214Z [cluster2] I0717 12:16:11.124025 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.4002469Z [cluster2] I0717 12:16:14.853338 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T12:16:16.4003747Z [cluster2] I0717 12:16:14.853402 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T12:16:16.4004922Z [cluster2] I0717 12:16:14.853412 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T12:16:16.4006804Z [cluster2] I0717 12:16:14.878042 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.4009148Z [cluster2] I0717 12:16:14.882028 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:16.4011592Z [cluster2] I0717 12:16:15.484853 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:16.4013888Z [cluster2] I0717 12:16:15.494864 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.4015349Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-17T12:16:16.4016053Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-17T12:16:16.4016970Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-17T12:16:16.4017866Z [submariner-operator]$ [cluster2] grep submariner
2021-07-17T12:16:16.4018955Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-17T12:16:16.4020342Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-17T12:16:16.4021067Z [cluster2] submariner 83s
2021-07-17T12:16:16.4021847Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-17T12:16:16.4022965Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T12:16:16.4024186Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T12:16:16.4025596Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-17T12:16:16.4026762Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-17T12:16:16.4027332Z [cluster2] {
2021-07-17T12:16:16.4027742Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T12:16:16.4028339Z [cluster2] "kind": "Submariner",
2021-07-17T12:16:16.4028706Z [cluster2] "metadata": {
2021-07-17T12:16:16.4029324Z [cluster2] "creationTimestamp": "2021-07-17T12:14:53Z",
2021-07-17T12:16:16.4029769Z [cluster2] "generation": 1,
2021-07-17T12:16:16.4030172Z [cluster2] "managedFields": [
2021-07-17T12:16:16.4030519Z [cluster2] {
2021-07-17T12:16:16.4031081Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T12:16:16.4031719Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:16.4032135Z [cluster2] "fieldsV1": {
2021-07-17T12:16:16.4032497Z [cluster2] "f:spec": {
2021-07-17T12:16:16.4032821Z [cluster2] ".": {},
2021-07-17T12:16:16.4033168Z [cluster2] "f:broker": {},
2021-07-17T12:16:16.4033613Z [cluster2] "f:brokerK8sApiServer": {},
2021-07-17T12:16:16.4034182Z [cluster2] "f:brokerK8sApiServerToken": {},
2021-07-17T12:16:16.4034686Z [cluster2] "f:brokerK8sCA": {},
2021-07-17T12:16:16.4035214Z [cluster2] "f:brokerK8sRemoteNamespace": {},
2021-07-17T12:16:16.4035730Z [cluster2] "f:cableDriver": {},
2021-07-17T12:16:16.4036163Z [cluster2] "f:ceIPSecDebug": {},
2021-07-17T12:16:16.4036625Z [cluster2] "f:ceIPSecIKEPort": {},
2021-07-17T12:16:16.4037084Z [cluster2] "f:ceIPSecNATTPort": {},
2021-07-17T12:16:16.4037537Z [cluster2] "f:ceIPSecPSK": {},
2021-07-17T12:16:16.4038058Z [cluster2] "f:clusterCIDR": {},
2021-07-17T12:16:16.4038573Z [cluster2] "f:clusterID": {},
2021-07-17T12:16:16.4038966Z [cluster2] "f:colorCodes": {},
2021-07-17T12:16:16.4039466Z [cluster2] "f:connectionHealthCheck": {
2021-07-17T12:16:16.4039905Z [cluster2] ".": {},
2021-07-17T12:16:16.4040584Z [cluster2] "f:enabled": {},
2021-07-17T12:16:16.4041137Z [cluster2] "f:intervalSeconds": {},
2021-07-17T12:16:16.4041928Z [cluster2] "f:maxPacketLossCount": {}
2021-07-17T12:16:16.4042470Z [cluster2] },
2021-07-17T12:16:16.4042942Z [cluster2] "f:debug": {},
2021-07-17T12:16:16.4043539Z [cluster2] "f:namespace": {},
2021-07-17T12:16:16.4044059Z [cluster2] "f:natEnabled": {},
2021-07-17T12:16:16.4044762Z [cluster2] "f:repository": {},
2021-07-17T12:16:16.4045476Z [cluster2] "f:serviceCIDR": {},
2021-07-17T12:16:16.4046126Z [cluster2] "f:serviceDiscoveryEnabled": {},
2021-07-17T12:16:16.4046840Z [cluster2] "f:version": {}
2021-07-17T12:16:16.4047338Z [cluster2] }
2021-07-17T12:16:16.4047897Z [cluster2] },
2021-07-17T12:16:16.4048347Z [cluster2] "manager": "subctl",
2021-07-17T12:16:16.4048853Z [cluster2] "operation": "Update",
2021-07-17T12:16:16.4049579Z [cluster2] "time": "2021-07-17T12:14:53Z"
2021-07-17T12:16:16.4050059Z [cluster2] },
2021-07-17T12:16:16.4050459Z [cluster2] {
2021-07-17T12:16:16.4051117Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T12:16:16.4051717Z [cluster2] "fieldsType": "FieldsV1",
2021-07-17T12:16:16.4052215Z [cluster2] "fieldsV1": {
2021-07-17T12:16:16.4052674Z [cluster2] "f:status": {
2021-07-17T12:16:16.4053098Z [cluster2] ".": {},
2021-07-17T12:16:16.4053564Z [cluster2] "f:clusterCIDR": {},
2021-07-17T12:16:16.4054074Z [cluster2] "f:clusterID": {},
2021-07-17T12:16:16.4054564Z [cluster2] "f:colorCodes": {},
2021-07-17T12:16:16.4055093Z [cluster2] "f:deploymentInfo": {},
2021-07-17T12:16:16.4055743Z [cluster2] "f:gatewayDaemonSetStatus": {
2021-07-17T12:16:16.4056461Z [cluster2] ".": {},
2021-07-17T12:16:16.4068060Z [cluster2] "f:lastResourceVersion": {},
2021-07-17T12:16:16.4069056Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-17T12:16:16.4072537Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-17T12:16:16.4073515Z [cluster2] "f:status": {
2021-07-17T12:16:16.4074154Z [cluster2] ".": {},
2021-07-17T12:16:16.4075743Z [cluster2] "f:currentNumberScheduled": {},
2021-07-17T12:16:16.4076809Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-17T12:16:16.4077683Z [cluster2] "f:numberAvailable": {},
2021-07-17T12:16:16.4079218Z [cluster2] "f:numberMisscheduled": {},
2021-07-17T12:16:16.4079873Z [cluster2] "f:numberReady": {},
2021-07-17T12:16:16.4080536Z [cluster2] "f:observedGeneration": {},
2021-07-17T12:16:16.4081300Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-17T12:16:16.4081941Z [cluster2] }
2021-07-17T12:16:16.4082424Z [cluster2] },
2021-07-17T12:16:16.4082927Z [cluster2] "f:gateways": {},
2021-07-17T12:16:16.4083773Z [cluster2] "f:globalnetDaemonSetStatus": {
2021-07-17T12:16:16.4084419Z [cluster2] ".": {},
2021-07-17T12:16:16.4085079Z [cluster2] "f:mismatchedContainerImages": {}
2021-07-17T12:16:16.4085722Z [cluster2] },
2021-07-17T12:16:16.4086277Z [cluster2] "f:loadBalancerStatus": {},
2021-07-17T12:16:16.4086897Z [cluster2] "f:natEnabled": {},
2021-07-17T12:16:16.4087475Z [cluster2] "f:networkPlugin": {},
2021-07-17T12:16:16.4088189Z [cluster2] "f:routeAgentDaemonSetStatus": {
2021-07-17T12:16:16.4088843Z [cluster2] ".": {},
2021-07-17T12:16:16.4089452Z [cluster2] "f:lastResourceVersion": {},
2021-07-17T12:16:16.4090220Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-17T12:16:16.4091044Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-17T12:16:16.4091685Z [cluster2] "f:status": {
2021-07-17T12:16:16.4092183Z [cluster2] ".": {},
2021-07-17T12:16:16.4092966Z [cluster2] "f:currentNumberScheduled": {},
2021-07-17T12:16:16.4093924Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-17T12:16:16.4094637Z [cluster2] "f:numberAvailable": {},
2021-07-17T12:16:16.4095294Z [cluster2] "f:numberMisscheduled": {},
2021-07-17T12:16:16.4095937Z [cluster2] "f:numberReady": {},
2021-07-17T12:16:16.4096575Z [cluster2] "f:observedGeneration": {},
2021-07-17T12:16:16.4097321Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-17T12:16:16.4097946Z [cluster2] }
2021-07-17T12:16:16.4098405Z [cluster2] },
2021-07-17T12:16:16.4098913Z [cluster2] "f:serviceCIDR": {}
2021-07-17T12:16:16.4099418Z [cluster2] }
2021-07-17T12:16:16.4099848Z [cluster2] },
2021-07-17T12:16:16.4100770Z [cluster2] "manager": "submariner-operator",
2021-07-17T12:16:16.4101483Z [cluster2] "operation": "Update",
2021-07-17T12:16:16.4102425Z [cluster2] "time": "2021-07-17T12:15:16Z"
2021-07-17T12:16:16.4102963Z [cluster2] }
2021-07-17T12:16:16.4103404Z [cluster2] ],
2021-07-17T12:16:16.4103917Z [cluster2] "name": "submariner",
2021-07-17T12:16:16.4104968Z [cluster2] "namespace": "submariner-operator",
2021-07-17T12:16:16.4106008Z [cluster2] "resourceVersion": "2580",
2021-07-17T12:16:16.4106983Z [cluster2] "uid": "c9fabd6a-91a2-42a8-8a7c-2cbd5752b775"
2021-07-17T12:16:16.4107646Z [cluster2] },
2021-07-17T12:16:16.4108100Z [cluster2] "spec": {
2021-07-17T12:16:16.4108604Z [cluster2] "broker": "k8s",
2021-07-17T12:16:16.4109197Z [cluster2] "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-17T12:16:16.4253810Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-17T12:16:16.4692914Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-17T12:16:16.5147632Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-17T12:16:16.5150547Z [cluster2] "cableDriver": "libreswan",
2021-07-17T12:16:16.5151283Z [cluster2] "ceIPSecDebug": false,
2021-07-17T12:16:16.5151890Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-17T12:16:16.5152441Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-17T12:16:16.5153957Z [cluster2] "ceIPSecPSK": "VQjFg4s4XiuBeHmCUpRtOhYAcoh4N0BMylG6azg2eJVimXnQc0xJUiHlcMKbIb+W",
2021-07-17T12:16:16.5155740Z [cluster2] "clusterCIDR": "",
2021-07-17T12:16:16.5157768Z [cluster2] "clusterID": "cluster2",
2021-07-17T12:16:16.5158215Z [cluster2] "colorCodes": "blue",
2021-07-17T12:16:16.5159077Z [cluster2] "connectionHealthCheck": {
2021-07-17T12:16:16.5159637Z [cluster2] "enabled": true,
2021-07-17T12:16:16.5161153Z [cluster2] "intervalSeconds": 1,
2021-07-17T12:16:16.5161802Z [cluster2] "maxPacketLossCount": 5
2021-07-17T12:16:16.5286141Z [cluster2] },
2021-07-17T12:16:16.5286633Z [cluster2] "debug": false,
2021-07-17T12:16:16.5287847Z [cluster2] "namespace": "submariner-operator",
2021-07-17T12:16:16.5288340Z [cluster2] "natEnabled": false,
2021-07-17T12:16:16.5288778Z [cluster2] "repository": "localhost:5000",
2021-07-17T12:16:16.5289190Z [cluster2] "serviceCIDR": "",
2021-07-17T12:16:16.5289698Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-17T12:16:16.5290766Z [cluster2] "version": "local"
2021-07-17T12:16:16.5291289Z [cluster2] },
2021-07-17T12:16:16.5291606Z [cluster2] "status": {
2021-07-17T12:16:16.5291967Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-17T12:16:16.5292386Z [cluster2] "clusterID": "cluster2",
2021-07-17T12:16:16.5292793Z [cluster2] "colorCodes": "blue",
2021-07-17T12:16:16.5297215Z [cluster2] "deploymentInfo": {},
2021-07-17T12:16:16.5298118Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-17T12:16:16.5298839Z [cluster2] "lastResourceVersion": "2297",
2021-07-17T12:16:16.5299617Z [cluster2] "mismatchedContainerImages": false,
2021-07-17T12:16:16.5300714Z [cluster2] "nonReadyContainerStates": [],
2021-07-17T12:16:16.5301214Z [cluster2] "status": {
2021-07-17T12:16:16.5301665Z [cluster2] "currentNumberScheduled": 1,
2021-07-17T12:16:16.5302248Z [cluster2] "desiredNumberScheduled": 1,
2021-07-17T12:16:16.5302754Z [cluster2] "numberAvailable": 1,
2021-07-17T12:16:16.5303243Z [cluster2] "numberMisscheduled": 0,
2021-07-17T12:16:16.5303686Z [cluster2] "numberReady": 1,
2021-07-17T12:16:16.5304144Z [cluster2] "observedGeneration": 1,
2021-07-17T12:16:16.5304737Z [cluster2] "updatedNumberScheduled": 1
2021-07-17T12:16:16.5305203Z [cluster2] }
2021-07-17T12:16:16.5305547Z [cluster2] },
2021-07-17T12:16:16.5306230Z [cluster2] "gateways": [
2021-07-17T12:16:16.5306595Z [cluster2] {
2021-07-17T12:16:16.5307027Z [cluster2] "connections": [
2021-07-17T12:16:16.5307396Z [cluster2] {
2021-07-17T12:16:16.5307811Z [cluster2] "endpoint": {
2021-07-17T12:16:16.5308267Z [cluster2] "backend": "libreswan",
2021-07-17T12:16:16.5308826Z [cluster2] "backend_config": {
2021-07-17T12:16:16.5309627Z [cluster2] "natt-discovery-port": "4490",
2021-07-17T12:16:16.5310412Z [cluster2] "preferred-server": "false"
2021-07-17T12:16:16.5310908Z [cluster2] },
2021-07-17T12:16:16.5311757Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-8",
2021-07-17T12:16:16.5312527Z [cluster2] "cluster_id": "cluster1",
2021-07-17T12:16:16.5313006Z [cluster2] "healthCheckIP": "10.1.0.1",
2021-07-17T12:16:16.5313744Z [cluster2] "hostname": "cluster1-worker",
2021-07-17T12:16:16.5314241Z [cluster2] "nat_enabled": false,
2021-07-17T12:16:16.5314748Z [cluster2] "private_ip": "172.18.0.8",
2021-07-17T12:16:16.5315179Z [cluster2] "public_ip": "51.143.100.118",
2021-07-17T12:16:16.5315644Z [cluster2] "subnets": [
2021-07-17T12:16:16.5316191Z [cluster2] "100.1.0.0/16",
2021-07-17T12:16:16.5316849Z [cluster2] "10.1.0.0/16"
2021-07-17T12:16:16.5317280Z [cluster2] ]
2021-07-17T12:16:16.5317955Z [cluster2] },
2021-07-17T12:16:16.5318956Z [cluster2] "latencyRTT": {
2021-07-17T12:16:16.5320108Z [cluster2] "average": "188.28µs",
2021-07-17T12:16:16.5321021Z [cluster2] "last": "164.101µs",
2021-07-17T12:16:16.5321861Z [cluster2] "max": "367.703µs",
2021-07-17T12:16:16.5324437Z [cluster2] "min": "125.301µs",
2021-07-17T12:16:16.5325318Z [cluster2] "stdDev": "55.479µs"
2021-07-17T12:16:16.5325701Z [cluster2] },
2021-07-17T12:16:16.5326146Z [cluster2] "status": "connected",
2021-07-17T12:16:16.5326602Z [cluster2] "statusMessage": "",
2021-07-17T12:16:16.5327405Z [cluster2] "usingIP": "172.18.0.8"
2021-07-17T12:16:16.5347266Z [cluster2] }
2021-07-17T12:16:16.5347606Z [cluster2] ],
2021-07-17T12:16:16.5348007Z [cluster2] "haStatus": "active",
2021-07-17T12:16:16.5348451Z [cluster2] "localEndpoint": {
2021-07-17T12:16:16.5348919Z [cluster2] "backend": "libreswan",
2021-07-17T12:16:16.5349357Z [cluster2] "backend_config": {
2021-07-17T12:16:16.5350614Z [cluster2] "natt-discovery-port": "4490",
2021-07-17T12:16:16.5351344Z [cluster2] "preferred-server": "false"
2021-07-17T12:16:16.5351800Z [cluster2] },
2021-07-17T12:16:16.5352643Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-9",
2021-07-17T12:16:16.5353372Z [cluster2] "cluster_id": "cluster2",
2021-07-17T12:16:16.5353876Z [cluster2] "healthCheckIP": "10.2.0.1",
2021-07-17T12:16:16.5354550Z [cluster2] "hostname": "cluster2-worker",
2021-07-17T12:16:16.5355332Z [cluster2] "nat_enabled": false,
2021-07-17T12:16:16.5355767Z [cluster2] "private_ip": "172.18.0.9",
2021-07-17T12:16:16.5356182Z [cluster2] "public_ip": "51.143.100.118",
2021-07-17T12:16:16.5784275Z [cluster2] "subnets"rvice.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:16.5786233Z [cluster1] I0717 12:15:27.796597 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T12:16:16.5789847Z [cluster1] I0717 12:15:28.393039 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:16.5793055Z [cluster1] I0717 12:15:28.400032 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T12:16:16.5795348Z [cluster1] I0717 12:15:28.402469 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.5797840Z [cluster1] I0717 12:15:28.408651 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T12:16:16.5800489Z [cluster1] E0717 12:15:30.566542 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:16.5803038Z [cluster1] E0717 12:16:11.579542 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T12:16:16.5804649Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-17T12:16:16.5805366Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-17T12:16:16.5806284Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-17T12:16:16.5807206Z [submariner-operator]$ [cluster1] grep submariner
2021-07-17T12:16:16.5808130Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-17T12:16:16.5809323Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-17T12:16:16.5810043Z [cluster1] submariner 79s
2021-07-17T12:16:16.5810822Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-17T12:16:16.5812102Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T12:16:16.5813193Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-17T12:16:16.5814304Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T12:16:16.5815608Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-17T12:16:16.5816353Z [cluster1] {
2021-07-17T12:16:16.5816803Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T12:16:16.5817283Z [cluster1] "kind": "Submariner",
2021-07-17T12:16:16.5817652Z [cluster1] "metadata": {
2021-07-17T12:16:16.5818261Z [cluster1] "creationTimestamp": "2021-07-17T12:14:57Z",
2021-07-17T12:16:16.5818725Z [cluster1] "generation": 1,
2021-07-17T12:16:16.5819115Z [cluster1] "managedFields": [
2021-07-17T12:16:16.5819492Z [cluster1] {
2021-07-17T12:16:16.5819916Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T12:16:16.5820430Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:16.5820833Z [cluster1] "fieldsV1": {
2021-07-17T12:16:16.5821197Z [cluster1] "f:spec": {
2021-07-17T12:16:16.5821528Z [cluster1] ".": {},
2021-07-17T12:16:16.5821886Z [cluster1] "f:broker": {},
2021-07-17T12:16:16.5822325Z [cluster1] "f:brokerK8sApiServer": {},
2021-07-17T12:16:16.5822899Z [cluster1] "f:brokerK8sApiServerToken": {},
2021-07-17T12:16:16.5823422Z [cluster1] "f:brokerK8sCA": {},
2021-07-17T12:16:16.5823938Z [cluster1] "f:brokerK8sRemoteNamespace": {},
2021-07-17T12:16:16.5824470Z [cluster1] "f:cableDriver": {},
2021-07-17T12:16:16.5845049Z [cluster1] "f:ceIPSecDebug": {},
2021-07-17T12:16:16.5845522Z [cluster1] "f:ceIPSecIKEPort": {},
2021-07-17T12:16:16.5846008Z [cluster1] "f:ceIPSecNATTPort": {},
2021-07-17T12:16:16.5846449Z [cluster1] "f:ceIPSecPSK": {},
2021-07-17T12:16:16.5846876Z [cluster1] "f:clusterCIDR": {},
2021-07-17T12:16:16.5847295Z [cluster1] "f:clusterID": {},
2021-07-17T12:16:16.5847828Z [cluster1] "f:colorCodes": {},
2021-07-17T12:16:16.5848352Z [cluster1] "f:connectionHealthCheck": {
2021-07-17T12:16:16.5848795Z [cluster1] ".": {},
2021-07-17T12:16:16.5849168Z [cluster1] "f:enabled": {},
2021-07-17T12:16:16.5849590Z [cluster1] "f:intervalSeconds": {},
2021-07-17T12:16:16.5850099Z [cluster1] "f:maxPacketLossCount": {}
2021-07-17T12:16:16.5850650Z [cluster1] },
2021-07-17T12:16:16.5851002Z [cluster1] "f:debug": {},
2021-07-17T12:16:16.5851394Z [cluster1] "f:namespace": {},
2021-07-17T12:16:16.5851788Z [cluster1] "f:natEnabled": {},
2021-07-17T12:16:16.5852205Z [cluster1] "f:repository": {},
2021-07-17T12:16:16.5852612Z [cluster1] "f:serviceCIDR": {},
2021-07-17T12:16:16.5853226Z [cluster1] "f:serviceDiscoveryEnabled": {},
2021-07-17T12:16:16.5853715Z [cluster1] "f:version": {}
2021-07-17T12:16:16.5854064Z [cluster1] }
2021-07-17T12:16:16.5854362Z [cluster1] },
2021-07-17T12:16:16.5854725Z [cluster1] "manager": "subctl",
2021-07-17T12:16:16.5855129Z [cluster1] "operation": "Update",
2021-07-17T12:16:16.5855830Z [cluster1] "time": "2021-07-17T12:14:57Z"
2021-07-17T12:16:16.5856306Z [cluster1] },
2021-07-17T12:16:16.5856599Z [cluster1] {
2021-07-17T12:16:16.5857043Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T12:16:16.5857538Z [cluster1] "fieldsType": "FieldsV1",
2021-07-17T12:16:16.5857957Z [cluster1] "fieldsV1": {
2021-07-17T12:16:16.5858314Z [cluster1] "f:status": {
2021-07-17T12:16:16.5858662Z [cluster1] ".": {},
2021-07-17T12:16:16.5859030Z [cluster1] "f:clusterCIDR": {},
2021-07-17T12:16:16.5859449Z [cluster1] "f:clusterID": {},
2021-07-17T12:16:16.5859860Z [cluster1] "f:colorCodes": {},
2021-07-17T12:16:16.5860285Z [cluster1] "f:deploymentInfo": {},
2021-07-17T12:16:16.5860822Z [cluster1] "f:gatewayDaemonSetStatus": {
2021-07-17T12:16:16.5861272Z [cluster1] ".": {},
2021-07-17T12:16:16.5861725Z [cluster1] "f:lastResourceVersion": {},
2021-07-17T12:16:16.5862319Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-17T12:16:16.5862963Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-17T12:16:16.5863449Z [cluster1] "f:status": {
2021-07-17T12:16:16.5863808Z [cluster1] ".": {},
2021-07-17T12:16:16.5864289Z [cluster1] "f:currentNumberScheduled": {},
2021-07-17T12:16:16.5864889Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-17T12:16:16.5865437Z [cluster1] "f:numberAvailable": {},
2021-07-17T12:16:16.5865934Z [cluster1] "f:numberMisscheduled": {},
2021-07-17T12:16:16.5866422Z [cluster1] "f:numberReady": {},
2021-07-17T12:16:16.5866893Z [cluster1] "f:observedGeneration": {},
2021-07-17T12:16:16.5867478Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-17T12:16:16.5867948Z [cluster1] }
2021-07-17T12:16:16.5868257Z [cluster1] },
2021-07-17T12:16:16.5868620Z [cluster1] "f:gateways": {},
2021-07-17T12:16:16.5869245Z [cluster1] "f:globalnetDaemonSetStatus": {
2021-07-17T12:16:16.5869841Z [cluster1] ".": {},
2021-07-17T12:16:16.5870342Z [cluster1] "f:mismatchedContainerImages": {}
2021-07-17T12:16:16.5870833Z [cluster1] },
2021-07-17T12:16:16.5871243Z [cluster1] "f:loadBalancerStatus": {},
2021-07-17T12:16:16.5871716Z [cluster1] "f:natEnabled": {},
2021-07-17T12:16:16.5872425Z [cluster1] "f:networkPlugin": {},
2021-07-17T12:16:16.5873021Z [cluster1] "f:routeAgentDaemonSetStatus": {
2021-07-17T12:16:16.5873558Z [cluster1] ".": {},
2021-07-17T12:16:16.5874010Z [cluster1] "f:lastResourceVersion": {},
2021-07-17T12:16:16.5875275Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-17T12:16:16.5876087Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-17T12:16:16.5876655Z [cluster1] "f:status": {
2021-07-17T12:16:16.5877046Z [cluster1] ".": {},
2021-07-17T12:16:16.5878074Z [cluster1] "f:currentNumberScheduled": {},
2021-07-17T12:16:16.5878788Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-17T12:16:16.5879325Z [cluster1] "f:numberAvailable": {},
2021-07-17T12:16:16.5879838Z [cluster1] "f:numberMisscheduled": {},
2021-07-17T12:16:16.5880307Z [cluster1] "f:numberReady": {},
2021-07-17T12:16:16.5880907Z [cluster1] "f:observedGeneration": {},
2021-07-17T12:16:16.5881471Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-17T12:16:16.5881942Z [cluster1] }
2021-07-17T12:16:16.5882253Z [cluster1] },
2021-07-17T12:16:16.5882631Z [cluster1] "f:serviceCIDR": {}
2021-07-17T12:16:16.5883006Z [cluster1] }
2021-07-17T12:16:16.5883308Z [cluster1] },
2021-07-17T12:16:16.5883985Z [cluster1] "manager": "submariner-operator",
2021-07-17T12:16:16.5884474Z [cluster1] "operation": "Update",
2021-07-17T12:16:16.5885023Z [cluster1] "time": "2021-07-17T12:15:13Z"
2021-07-17T12:16:16.5885356Z [cluster1] }
2021-07-17T12:16:16.5885796Z [cluster1] ],
2021-07-17T12:16:16.5886141Z [cluster1] "name": "submariner",
2021-07-17T12:16:16.5886814Z [cluster1] "namespace": "submariner-operator",
2021-07-17T12:16:16.5887324Z [cluster1] "resourceVersion": "2532",
2021-07-17T12:16:16.5888132Z [cluster1] "uid": "2bdeeb95-7011-4fab-8c04-486e2f93196a"
2021-07-17T12:16:16.5888606Z [cluster1] },
2021-07-17T12:16:16.5888908Z [cluster1] "spec": {
2021-07-17T12:16:16.5894034Z [cluster1] "broker": "k8s",
2021-07-17T12:16:16.5894707Z [cluster1] "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-17T12:16:16.6037987Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-17T12:16:16.6495336Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-17T12:16:16.6961516Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-17T12:16:16.6962248Z [cluster1] "cableDriver": "libreswan",
2021-07-17T12:16:16.6962732Z [cluster1] "ceIPSecDebug": false,
2021-07-17T12:16:16.6963216Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-17T12:16:16.6963699Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-17T12:16:16.6965263Z [cluster1] "ceIPSecPSK": "VQjFg4s4XiuBeHmCUpRtOhYAcoh4N0BMylG6azg2eJVimXnQc0xJUiHlcMKbIb+W",
2021-07-17T12:16:16.6966536Z [cluster1] "clusterCIDR": "",
2021-07-17T12:16:16.6966969Z [cluster1] "clusterID": "cluster1",
2021-07-17T12:16:16.6967414Z [cluster1] "colorCodes": "blue",
2021-07-17T12:16:16.6967909Z [cluster1] "connectionHealthCheck": {
2021-07-17T12:16:16.6968407Z [cluster1] "enabled": true,
2021-07-17T12:16:16.6968856Z [cluster1] "intervalSeconds": 1,
2021-07-17T12:16:16.6969349Z [cluster1] "maxPacketLossCount": 5
2021-07-17T12:16:16.6970011Z [cluster1] },
2021-07-17T12:16:16.6970355Z [cluster1] "debug": false,
2021-07-17T12:16:16.6971614Z [cluster1] "namespace": "submariner-operator",
2021-07-17T12:16:16.6972328Z [cluster1] "natEnabled": false,
2021-07-17T12:16:16.6972796Z [cluster1] "repository": "localhost:5000",
2021-07-17T12:16:16.6973234Z [cluster1] "serviceCIDR": "",
2021-07-17T12:16:16.6973785Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-17T12:16:16.6974528Z [cluster1] "version": "local"
2021-07-17T12:16:16.6974892Z [cluster1] },
2021-07-17T12:16:16.6975396Z [cluster1] "status": {
2021-07-17T12:16:16.6976299Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-17T12:16:16.6977002Z [cluster1] "clusterID": "cluster1",
2021-07-17T12:16:16.6977442Z [cluster1] "colorCodes": "blue",
2021-07-17T12:16:16.6977897Z [cluster1] "deploymentInfo": {},
2021-07-17T12:16:16.6978833Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-17T12:16:16.6979584Z [cluster1] "lastResourceVersion": "2418",
2021-07-17T12:16:16.6980356Z [cluster1] "mismatchedContainerImages": false,
2021-07-17T12:16:16.6981175Z [cluster1] "nonReadyContainerStates": [],
2021-07-17T12:16:16.6981804Z [cluster1] "status": {
2021-07-17T12:16:16.6982623Z [cluster1] "currentNumberScheduled": 1,
2021-07-17T12:16:16.6984114Z [cluster1] "desiredNumberScheduled": 1,
2021-07-17T12:16:16.6985356Z [cluster1] "numberAvailable": 1,
2021-07-17T12:16:16.6986411Z [cluster1] "numberMisscheduled": 0,
2021-07-17T12:16:16.6987096Z [cluster1] "numberReady": 1,
2021-07-17T12:16:16.6987629Z [cluster1] "observedGeneration": 1,
2021-07-17T12:16:16.6988542Z [cluster1] "updatedNumberScheduled": 1
2021-07-17T12:16:16.6989025Z [cluster1] }
2021-07-17T12:16:16.6989337Z [cluster1] },
2021-07-17T12:16:16.6989706Z [cluster1] "gateways": [
2021-07-17T12:16:16.6990053Z [cluster1] {
2021-07-17T12:16:16.6990436Z [cluster1] "connections": [
2021-07-17T12:16:16.6990811Z [cluster1] {
2021-07-17T12:16:16.6991197Z [cluster1] "endpoint": {
2021-07-17T12:16:16.6991651Z [cluster1] "backend": "libreswan",
2021-07-17T12:16:16.6992099Z [cluster1] "backend_config": {
2021-07-17T12:16:16.6993285Z [cluster1] "natt-discovery-port": "4490",
2021-07-17T12:16:16.6994155Z [cluster1] "preferred-server": "false"
2021-07-17T12:16:16.6994631Z [cluster1] },
2021-07-17T12:16:16.6995644Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-9",
2021-07-17T12:16:16.6996375Z [cluster1] "cluster_id": "cluster2",
2021-07-17T12:16:16.6996870Z [cluster1] "healthCheckIP": "10.2.0.1",
2021-07-17T12:16:16.7009381Z [cluster1] "hostname": "cluster2-worker",
2021-07-17T12:16:16.7009897Z [cluster1] "nat_enabled": false,
2021-07-17T12:16:16.7010311Z [cluster1] "private_ip": "172.18.0.9",
2021-07-17T12:16:16.7010721Z [cluster1] "public_ip": "51.143.100.118",
2021-07-17T12:16:16.7011107Z [cluster1] "subnets": [
2021-07-17T12:16:16.7011475Z [cluster1] "100.2.0.0/16",
2021-07-17T12:16:16.7011807Z [cluster1] "10.2.0.0/16"
2021-07-17T12:16:16.7012139Z [cluster1] ]
2021-07-17T12:16:16.7012462Z [cluster1] },
2021-07-17T12:16:16.7012814Z [cluster1] "latencyRTT": {
2021-07-17T12:16:16.7013213Z [cluster1] "average": "0s",
2021-07-17T12:16:16.7013795Z [cluster1] "last": "0s",
2021-07-17T12:16:16.7014153Z [cluster1] "max": "0s",
2021-07-17T12:16:16.7014492Z [cluster1] "min": "0s",
2021-07-17T12:16:16.7014861Z [cluster1] "stdDev": "0s"
2021-07-17T12:16:16.7015197Z [cluster1] },
2021-07-17T12:16:16.7015561Z [cluster1] "status": "error",
2021-07-17T12:16:16.7016139Z [cluster1] "statusMessage": "Failed to successfully ping the remote endpoint IP \"10.2.0.1\"",
2021-07-17T12:16:16.7016720Z [cluster1] "usingIP": "172.18.0.9"
2021-07-17T12:16:16.7017076Z [cluster1] }
2021-07-17T12:16:16.7017373Z [cluster1] ],
2021-07-17T12:16:16.7017737Z [cluster1] "haStatus": "active",
2021-07-17T12:16:16.7018145Z [cluster1] "localEndpoint": {
2021-07-17T12:16:16.7018578Z [cluster1] "backend": "libreswan",
2021-07-17T12:16:16.7018989Z [cluster1] "backend_config": {
2021-07-17T12:16:16.7019661Z [cluster1] "natt-discovery-port": "4490",
2021-07-17T12:16:16.7020703Z [cluster1] "preferred-server": "false"
2021-07-17T12:16:16.7021160Z [cluster1] },
2021-07-17T12:16:16.7022192Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-8",
2021-07-17T12:16:16.7022951Z [cluster1] "cluster_id": "cluster1",
2021-07-17T12:16:16.7023453Z [cluster1] "healthCheckIP": "10.1.0.1",
2021-07-17T12:16:16.7024296Z [cluster1] "hostname": "cluster1-worker",
2021-07-17T12:16:16.7024809Z [cluster1] "nat_enabled": false,
2021-07-17T12:16:16.7025239Z [cluster1] "private_ip": "172.18.0.8",
2021-07-17T12:16:16.7026003Z [cluster1] "public_ip": "51.143.100.118",
2021-07-17T12:16:16.7026377Z [cluster1] "subnets": [
2021-07-17T12:16:16.7026732Z [cluster1] "100.1.0.0/16",
2021-07-17T12:16:16.7027072Z [cluster1] "10.1.0.0/16"
2021-07-17T12:16:16.7027380Z [cluster1] ]
2021-07-17T12:16:16.7027695Z [cluster1] },
2021-07-17T12:16:16.7028053Z [cluster1] "statusFailure": "",
2021-07-17T12:16:16.7679255Z [cluster1] : [
2021-07-17T12:16:16.7679734Z [cluster2] "100.2.0.0/16",
2021-07-17T12:16:16.7680102Z [cluster2] "10.2.0.0/16"
2021-07-17T12:16:16.7680414Z [cluster2] ]
2021-07-17T12:16:16.7680729Z [cluster2] },
2021-07-17T12:16:16.7681086Z [cluster2] "statusFailure": "",
2021-07-17T12:16:16.7681831Z [cluster2] "version": "devel-1441a80"
2021-07-17T12:16:16.7682201Z [cluster2] }
2021-07-17T12:16:16.7682650Z [cluster2] ],
2021-07-17T12:16:16.7683109Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-17T12:16:16.7683749Z [cluster2] "mismatchedContainerImages": false
2021-07-17T12:16:16.7684215Z [cluster2] },
2021-07-17T12:16:16.7684614Z [cluster2] "loadBalancerStatus": {},
2021-07-17T12:16:16.7685071Z [cluster2] "natEnabled": false,
2021-07-17T12:16:16.7685698Z [cluster2] "networkPlugin": "weave-net",
2021-07-17T12:16:16.7686271Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-17T12:16:16.7686846Z [cluster2] "lastResourceVersion": "2354",
2021-07-17T12:16:16.7687445Z [cluster2] "mismatchedContainerImages": false,
2021-07-17T12:16:16.7688060Z [cluster2] "nonReadyContainerStates": [],
2021-07-17T12:16:16.7688531Z [cluster2] "status": {
2021-07-17T12:16:16.7688982Z [cluster2] "currentNumberScheduled": 3,
2021-07-17T12:16:16.7689565Z [cluster2] "desiredNumberScheduled": 3,
2021-07-17T12:16:16.7690204Z [cluster2] "numberAvailable": 3,
2021-07-17T12:16:16.7690691Z [cluster2] "numberMisscheduled": 0,
2021-07-17T12:16:16.7691280Z [cluster2] "numberReady": 3,
2021-07-17T12:16:16.7691725Z [cluster2] "observedGeneration": 1,
2021-07-17T12:16:16.7692272Z [cluster2] "updatedNumberScheduled": 3
2021-07-17T12:16:16.7692699Z [cluster2] }
2021-07-17T12:16:16.7693003Z [cluster2] },
2021-07-17T12:16:16.7693354Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-17T12:16:16.7693709Z [cluster2] }
2021-07-17T12:16:16.7693986Z [cluster2] }
2021-07-17T12:16:16.7694858Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-17T12:16:16.7696159Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-17T12:16:16.7697353Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-17T12:16:16.7698468Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T12:16:16.7699464Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T12:16:16.7700514Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-17T12:16:16.7701470Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-17T12:16:16.7702328Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-17T12:16:16.7703365Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-17T12:16:16.7704371Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-17T12:16:16.7705316Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-17T12:16:16.7706339Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-17T12:16:16.7707448Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-17T12:16:16.7708513Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-17T12:16:16.7712008Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-17T12:16:16.7849075Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T12:16:16.9009632Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T12:16:16.9011523Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-17T12:16:16.9528275Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-17T12:16:17.0854401Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-17T12:16:17.1433478Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-17T12:16:17.1434726Z [submariner-operator]$ "version": "devel-1441a80"
2021-07-17T12:16:17.1435282Z [cluster1] }
2021-07-17T12:16:17.1435607Z [cluster1] ],
2021-07-17T12:16:17.1436125Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-17T12:16:17.1436897Z [cluster1] "mismatchedContainerImages": false
2021-07-17T12:16:17.1438588Z [cluster1] },
2021-07-17T12:16:17.1439057Z [cluster1] "loadBalancerStatus": {},
2021-07-17T12:16:17.1439556Z [cluster1] "natEnabled": false,
2021-07-17T12:16:17.1440652Z [cluster1] "networkPlugin": "weave-net",
2021-07-17T12:16:17.1441315Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-17T12:16:17.1441972Z [cluster1] "lastResourceVersion": "2464",
2021-07-17T12:16:17.1442630Z [cluster1] "mismatchedContainerImages": false,
2021-07-17T12:16:17.1443335Z [cluster1] "nonReadyContainerStates": [],
2021-07-17T12:16:17.1443863Z [cluster1] "status": {
2021-07-17T12:16:17.1444369Z [cluster1] "currentNumberScheduled": 3,
2021-07-17T12:16:17.1445182Z [cluster1] "desiredNumberScheduled": 3,
2021-07-17T12:16:17.1445731Z [cluster1] "numberAvailable": 3,
2021-07-17T12:16:17.1446256Z [cluster1] "numberMisscheduled": 0,
2021-07-17T12:16:17.1446737Z [cluster1] "numberReady": 3,
2021-07-17T12:16:17.1447235Z [cluster1] "observedGeneration": 1,
2021-07-17T12:16:17.1447815Z [cluster1] "updatedNumberScheduled": 3
2021-07-17T12:16:17.1448302Z [cluster1] }
2021-07-17T12:16:17.1448616Z [cluster1] },
2021-07-17T12:16:17.1449008Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-17T12:16:17.1449392Z [cluster1] }
2021-07-17T12:16:17.1449695Z [cluster1] }
2021-07-17T12:16:17.1450632Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-17T12:16:17.1451877Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-17T12:16:17.1454112Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-17T12:16:17.1455765Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T12:16:17.1457347Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T12:16:17.1465790Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-17T12:16:17.1466884Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-17T12:16:17.1467814Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-17T12:16:17.1468815Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-17T12:16:17.1470039Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-17T12:16:17.1471022Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-17T12:16:17.1472124Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-17T12:16:17.1473287Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-17T12:16:17.1474406Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-17T12:16:17.1475652Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-17T12:16:17.1662993Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T12:16:17.1817851Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T12:16:17.1819614Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-17T12:16:17.2366621Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-17T12:16:17.3313338Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekV5TURZek0xb1hEVE14TURjeE5URXlNRFl6TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS2h4CmhLRlA5SHZQSkk0OTZhU2RvSW1NRW1jT2pzQXhrS2ZVUXBkMXJFYnV6YldVam5NVnhCM1NMY0VkaDdDMllDVlMKR1phM0pvbFZDQzBIMWo1WmpsVnJFYm44a2dnTWtWQXhVbWdLSjM1YmlKSi91OVVFQ21LdDhzN3d0YXBzeXlMawpJNHpWbHBQQ1lWWENsVGIxSVZNMDBCRm1jUEpISVlaWWdnbWxYOGZ3ZTUwQ2dBaFVNcFpNck1BREU1MTJMZXBpCmtTc1A5cms5U0pvVC9mYjRScDJQbDhVMXJMUTgvb3RqZDFHM3o2bk5MN0NtTFltVnBvZmtCMHhlSnQ1TmJ6WGEKVVIwZ1lEeGNHUEt0S3lNNHdvbWFIeVgrNDlQTmphN1FXelJYWVMwcW5TMno2c1cxZGh3U1g1ZXVjYkoyWUhFQQpaUldleTZTN3BUeEEyTDJwMFI4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJM3o3QjEyY3M3MGVFYXF0eEVUSHVmZm9ISERNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCdWViazBVU2NkTThlSTJqcEVqTUxVY0NuZDF0Z0YyTkkrN2RJU3NZWUpZQ0N5N2V6MApEdHBzL05CMGRLMkJCMGNwU0dUNmlGL0FJTTlWazQ5Q0pGZlBrWmZaOU5CRStzUEdYSHRZMVpDRVRDejRkWENMCk5pZ0MvVVdqSVRnOW1jNE1PcEt6RGhSWWtUUDRwTUUwUG5oVXBpMjY3RjVuRzhNL2R1NVVDK1IvWEZ2ekltS0gKM2NBemF6dkRuVkhKUzRiNXRrSG5yUVMzZi9zZTR2cU1CNjlpTS8wQ3ZJK0RPQW9aZ25XMlRpeEIvbkpGem9SYgppUVdIZHdRMDR3VzdhSFVhNDZXRHdPb0JGVEd1ZjQrL2NBcytmbzBXNWtibE50RFEvOHpWL1VYcDFCTEF3dXB2CnVKbVlGRkx6VG9pVTN6T1VtRUJGTVBEdThFMEV0QVZvS3NhSwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-17T12:16:17.3827695Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-17T12:16:17.3829352Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-17T12:16:17.3830897Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-17T12:16:18.0394022Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-17T12:16:18.0395763Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-17T12:16:18.0396992Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-17T12:16:18.0398884Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-17T12:16:18.0400638Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-17T12:16:18.0402120Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-17T12:16:18.0403533Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-17T12:16:18.0405613Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-17T12:16:18.0406725Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-17T12:16:18.0407966Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-17T12:16:18.0409698Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-17T12:16:18.0410869Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-17T12:16:18.0412245Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-17T12:16:18.0413380Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-17T12:16:18.0414663Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-17T12:16:18.0415858Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-17T12:16:18.0417273Z [submariner-operator]$ [cluster1] valid
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment