Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 19, 2021 22:23
Show Gist options
  • Save dfarrell07/32a1d0669ff0e478aeb955176bcaab5f to your computer and use it in GitHub Desktop.
Save dfarrell07/32a1d0669ff0e478aeb955176bcaab5f to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210717-2
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-17T14:04:36.2527390Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-17T14:04:36.2527447Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-17T14:04:44.7320101Z Current runner version: '2.278.0'
2021-07-17T14:04:44.7348824Z ##[group]Operating System
2021-07-17T14:04:44.7349800Z Ubuntu
2021-07-17T14:04:44.7350314Z 20.04.2
2021-07-17T14:04:44.7350767Z LTS
2021-07-17T14:04:44.7351340Z ##[endgroup]
2021-07-17T14:04:44.7351944Z ##[group]Virtual Environment
2021-07-17T14:04:44.7352675Z Environment: ubuntu-20.04
2021-07-17T14:04:44.7353268Z Version: 20210712.0
2021-07-17T14:04:44.7354457Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-17T14:04:44.7355976Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-17T14:04:44.7356999Z ##[endgroup]
2021-07-17T14:04:44.7359149Z ##[group]GITHUB_TOKEN Permissions
2021-07-17T14:04:44.7360538Z Actions: write
2021-07-17T14:04:44.7361105Z Checks: write
2021-07-17T14:04:44.7361723Z Contents: write
2021-07-17T14:04:44.7362287Z Deployments: write
2021-07-17T14:04:44.7363013Z Discussions: write
2021-07-17T14:04:44.7363632Z Issues: write
2021-07-17T14:04:44.7364241Z Metadata: read
2021-07-17T14:04:44.7364786Z Packages: write
2021-07-17T14:04:44.7365421Z PullRequests: write
2021-07-17T14:04:44.7366097Z RepositoryProjects: write
2021-07-17T14:04:44.7366832Z SecurityEvents: write
2021-07-17T14:04:44.7367450Z Statuses: write
2021-07-17T14:04:44.7368134Z ##[endgroup]
2021-07-17T14:04:44.7371386Z Prepare workflow directory
2021-07-17T14:04:44.8060691Z Prepare all required actions
2021-07-17T14:04:44.8073116Z Getting action download info
2021-07-17T14:04:44.9510054Z Download action repository 'actions/checkout@v2'
2021-07-17T14:04:46.8016276Z Download action repository 'submariner-io/shipyard@devel'
2021-07-17T14:04:47.1664341Z ##[group]Run actions/checkout@v2
2021-07-17T14:04:47.1665069Z with:
2021-07-17T14:04:47.1665768Z repository: submariner-io/submariner-operator
2021-07-17T14:04:47.1666963Z token: ***
2021-07-17T14:04:47.1667471Z ssh-strict: true
2021-07-17T14:04:47.1668258Z persist-credentials: true
2021-07-17T14:04:47.1668876Z clean: true
2021-07-17T14:04:47.1669369Z fetch-depth: 1
2021-07-17T14:04:47.1669865Z lfs: false
2021-07-17T14:04:47.1670354Z submodules: false
2021-07-17T14:04:47.1670875Z ##[endgroup]
2021-07-17T14:04:47.7890953Z Syncing repository: submariner-io/submariner-operator
2021-07-17T14:04:47.7892156Z ##[group]Getting Git version info
2021-07-17T14:04:47.7893500Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-17T14:04:47.7894499Z [command]/usr/bin/git version
2021-07-17T14:04:47.7895071Z git version 2.32.0
2021-07-17T14:04:47.7901031Z ##[endgroup]
2021-07-17T14:04:47.7902641Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-17T14:04:47.7905079Z ##[group]Initializing the repository
2021-07-17T14:04:47.7906306Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-17T14:04:47.7907741Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-17T14:04:47.7915779Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-17T14:04:47.7916866Z hint: of your new repositories, which will suppress this warning, call:
2021-07-17T14:04:47.7917882Z hint:
2021-07-17T14:04:47.7918971Z hint: git config --global init.defaultBranch <name>
2021-07-17T14:04:47.7919744Z hint:
2021-07-17T14:04:47.7926032Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-17T14:04:47.7927389Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-17T14:04:47.7928112Z hint:
2021-07-17T14:04:47.7928763Z hint: git branch -m <name>
2021-07-17T14:04:47.7930191Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-17T14:04:47.7931816Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-17T14:04:47.7932803Z ##[endgroup]
2021-07-17T14:04:47.7933460Z ##[group]Disabling automatic garbage collection
2021-07-17T14:04:47.7934696Z [command]/usr/bin/git config --local gc.auto 0
2021-07-17T14:04:47.7935299Z ##[endgroup]
2021-07-17T14:04:47.7936987Z ##[group]Setting up auth
2021-07-17T14:04:47.7938053Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-17T14:04:47.7939691Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-17T14:04:47.7941357Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-17T14:04:47.7943735Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-17T14:04:47.7952552Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-17T14:04:47.7953696Z ##[endgroup]
2021-07-17T14:04:47.7954306Z ##[group]Fetching the repository
2021-07-17T14:04:47.7972210Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-17T14:04:47.7973630Z remote: Enumerating objects: 486, done.
2021-07-17T14:04:47.7974323Z remote: Counting objects: 0% (1/486)
2021-07-17T14:04:47.7974971Z remote: Counting objects: 1% (5/486)
2021-07-17T14:04:47.7990469Z remote: Counting objects: 2% (10/486)
2021-07-17T14:04:47.7991166Z remote: Counting objects: 3% (15/486)
2021-07-17T14:04:47.7992061Z remote: Counting objects: 4% (20/486)
2021-07-17T14:04:47.7992712Z remote: Counting objects: 5% (25/486)
2021-07-17T14:04:47.7993366Z remote: Counting objects: 6% (30/486)
2021-07-17T14:04:47.8005056Z remote: Counting objects: 7% (35/486)
2021-07-17T14:04:47.8005773Z remote: Counting objects: 8% (39/486)
2021-07-17T14:04:47.8006416Z remote: Counting objects: 9% (44/486)
2021-07-17T14:04:47.8007068Z remote: Counting objects: 10% (49/486)
2021-07-17T14:04:47.8007709Z remote: Counting objects: 11% (54/486)
2021-07-17T14:04:47.8008361Z remote: Counting objects: 12% (59/486)
2021-07-17T14:04:47.8009011Z remote: Counting objects: 13% (64/486)
2021-07-17T14:04:47.8009642Z remote: Counting objects: 14% (69/486)
2021-07-17T14:04:47.8010294Z remote: Counting objects: 15% (73/486)
2021-07-17T14:04:47.8010925Z remote: Counting objects: 16% (78/486)
2021-07-17T14:04:47.8011576Z remote: Counting objects: 17% (83/486)
2021-07-17T14:04:47.8012536Z remote: Counting objects: 18% (88/486)
2021-07-17T14:04:47.8013237Z remote: Counting objects: 19% (93/486)
2021-07-17T14:04:47.8013870Z remote: Counting objects: 20% (98/486)
2021-07-17T14:04:47.8014519Z remote: Counting objects: 21% (103/486)
2021-07-17T14:04:47.8015186Z remote: Counting objects: 22% (107/486)
2021-07-17T14:04:47.8015822Z remote: Counting objects: 23% (112/486)
2021-07-17T14:04:47.8016478Z remote: Counting objects: 24% (117/486)
2021-07-17T14:04:47.8017113Z remote: Counting objects: 25% (122/486)
2021-07-17T14:04:47.8017766Z remote: Counting objects: 26% (127/486)
2021-07-17T14:04:47.8018401Z remote: Counting objects: 27% (132/486)
2021-07-17T14:04:47.8019053Z remote: Counting objects: 28% (137/486)
2021-07-17T14:04:47.8019694Z remote: Counting objects: 29% (141/486)
2021-07-17T14:04:47.8020352Z remote: Counting objects: 30% (146/486)
2021-07-17T14:04:47.8021105Z remote: Counting objects: 31% (151/486)
2021-07-17T14:04:47.8021991Z remote: Counting objects: 32% (156/486)
2021-07-17T14:04:47.8022648Z remote: Counting objects: 33% (161/486)
2021-07-17T14:04:47.8023284Z remote: Counting objects: 34% (166/486)
2021-07-17T14:04:47.8024116Z remote: Counting objects: 35% (171/486)
2021-07-17T14:04:47.8024753Z remote: Counting objects: 36% (175/486)
2021-07-17T14:04:47.8025407Z remote: Counting objects: 37% (180/486)
2021-07-17T14:04:47.8026044Z remote: Counting objects: 38% (185/486)
2021-07-17T14:04:47.8026729Z remote: Counting objects: 39% (190/486)
2021-07-17T14:04:47.8027360Z remote: Counting objects: 40% (195/486)
2021-07-17T14:04:47.8028127Z remote: Counting objects: 41% (200/486)
2021-07-17T14:04:47.8028783Z remote: Counting objects: 42% (205/486)
2021-07-17T14:04:47.8029427Z remote: Counting objects: 43% (209/486)
2021-07-17T14:04:47.8030079Z remote: Counting objects: 44% (214/486)
2021-07-17T14:04:47.8030715Z remote: Counting objects: 45% (219/486)
2021-07-17T14:04:47.8070631Z remote: Counting objects: 46% (224/486)
2021-07-17T14:04:47.8071395Z remote: Counting objects: 47% (229/486)
2021-07-17T14:04:47.8072081Z remote: Counting objects: 48% (234/486)
2021-07-17T14:04:47.8072715Z remote: Counting objects: 49% (239/486)
2021-07-17T14:04:47.8073365Z remote: Counting objects: 50% (243/486)
2021-07-17T14:04:47.8074022Z remote: Counting objects: 51% (248/486)
2021-07-17T14:04:47.8074654Z remote: Counting objects: 52% (253/486)
2021-07-17T14:04:47.8075303Z remote: Counting objects: 53% (258/486)
2021-07-17T14:04:47.8075934Z remote: Counting objects: 54% (263/486)
2021-07-17T14:04:47.8076576Z remote: Counting objects: 55% (268/486)
2021-07-17T14:04:47.8077326Z remote: Counting objects: 56% (273/486)
2021-07-17T14:04:47.8078228Z remote: Counting objects: 57% (278/486)
2021-07-17T14:04:47.8078868Z remote: Counting objects: 58% (282/486)
2021-07-17T14:04:47.8079566Z remote: Counting objects: 59% (287/486)
2021-07-17T14:04:47.8080391Z remote: Counting objects: 60% (292/486)
2021-07-17T14:04:47.8081192Z remote: Counting objects: 61% (297/486)
2021-07-17T14:04:47.8081867Z remote: Counting objects: 62% (302/486)
2021-07-17T14:04:47.8082495Z remote: Counting objects: 63% (307/486)
2021-07-17T14:04:47.8083143Z remote: Counting objects: 64% (312/486)
2021-07-17T14:04:47.8083784Z remote: Counting objects: 65% (316/486)
2021-07-17T14:04:47.8084419Z remote: Counting objects: 66% (321/486)
2021-07-17T14:04:47.8085064Z remote: Counting objects: 67% (326/486)
2021-07-17T14:04:47.8085693Z remote: Counting objects: 68% (331/486)
2021-07-17T14:04:47.8086337Z remote: Counting objects: 69% (336/486)
2021-07-17T14:04:47.8086973Z remote: Counting objects: 70% (341/486)
2021-07-17T14:04:47.8087615Z remote: Counting objects: 71% (346/486)
2021-07-17T14:04:47.8088248Z remote: Counting objects: 72% (350/486)
2021-07-17T14:04:47.8088890Z remote: Counting objects: 73% (355/486)
2021-07-17T14:04:47.8089823Z remote: Counting objects: 74% (360/486)
2021-07-17T14:04:47.8090461Z remote: Counting objects: 75% (365/486)
2021-07-17T14:04:47.8091102Z remote: Counting objects: 76% (370/486)
2021-07-17T14:04:47.8091738Z remote: Counting objects: 77% (375/486)
2021-07-17T14:04:47.8092387Z remote: Counting objects: 78% (380/486)
2021-07-17T14:04:47.8093014Z remote: Counting objects: 79% (384/486)
2021-07-17T14:04:47.8093651Z remote: Counting objects: 80% (389/486)
2021-07-17T14:04:47.8094284Z remote: Counting objects: 81% (394/486)
2021-07-17T14:04:47.8094933Z remote: Counting objects: 82% (399/486)
2021-07-17T14:04:47.8095567Z remote: Counting objects: 83% (404/486)
2021-07-17T14:04:47.8096210Z remote: Counting objects: 84% (409/486)
2021-07-17T14:04:47.8096852Z remote: Counting objects: 85% (414/486)
2021-07-17T14:04:47.8097479Z remote: Counting objects: 86% (418/486)
2021-07-17T14:04:47.8098252Z remote: Counting objects: 87% (423/486)
2021-07-17T14:04:47.8098880Z remote: Counting objects: 88% (428/486)
2021-07-17T14:04:47.8099520Z remote: Counting objects: 89% (433/486)
2021-07-17T14:04:47.8100150Z remote: Counting objects: 90% (438/486)
2021-07-17T14:04:47.8100795Z remote: Counting objects: 91% (443/486)
2021-07-17T14:04:47.8101431Z remote: Counting objects: 92% (448/486)
2021-07-17T14:04:47.8102077Z remote: Counting objects: 93% (452/486)
2021-07-17T14:04:47.8102720Z remote: Counting objects: 94% (457/486)
2021-07-17T14:04:47.8103346Z remote: Counting objects: 95% (462/486)
2021-07-17T14:04:47.8103994Z remote: Counting objects: 96% (467/486)
2021-07-17T14:04:47.8104628Z remote: Counting objects: 97% (472/486)
2021-07-17T14:04:47.8105271Z remote: Counting objects: 98% (477/486)
2021-07-17T14:04:47.8105897Z remote: Counting objects: 99% (482/486)
2021-07-17T14:04:47.8106535Z remote: Counting objects: 100% (486/486)
2021-07-17T14:04:47.8107196Z remote: Counting objects: 100% (486/486), done.
2021-07-17T14:04:47.8108062Z remote: Compressing objects: 0% (1/352)
2021-07-17T14:04:47.8108765Z remote: Compressing objects: 1% (4/352)
2021-07-17T14:04:47.8109441Z remote: Compressing objects: 2% (8/352)
2021-07-17T14:04:47.8110132Z remote: Compressing objects: 3% (11/352)
2021-07-17T14:04:47.8110812Z remote: Compressing objects: 4% (15/352)
2021-07-17T14:04:47.8111509Z remote: Compressing objects: 5% (18/352)
2021-07-17T14:04:47.8112190Z remote: Compressing objects: 6% (22/352)
2021-07-17T14:04:47.8112968Z remote: Compressing objects: 7% (25/352)
2021-07-17T14:04:47.8113655Z remote: Compressing objects: 8% (29/352)
2021-07-17T14:04:47.8114348Z remote: Compressing objects: 9% (32/352)
2021-07-17T14:04:47.8115038Z remote: Compressing objects: 10% (36/352)
2021-07-17T14:04:47.8115727Z remote: Compressing objects: 11% (39/352)
2021-07-17T14:04:47.8116416Z remote: Compressing objects: 12% (43/352)
2021-07-17T14:04:47.8117096Z remote: Compressing objects: 13% (46/352)
2021-07-17T14:04:47.8117784Z remote: Compressing objects: 14% (50/352)
2021-07-17T14:04:47.8118460Z remote: Compressing objects: 15% (53/352)
2021-07-17T14:04:47.8119155Z remote: Compressing objects: 16% (57/352)
2021-07-17T14:04:47.8119830Z remote: Compressing objects: 17% (60/352)
2021-07-17T14:04:47.8120514Z remote: Compressing objects: 18% (64/352)
2021-07-17T14:04:47.8121203Z remote: Compressing objects: 19% (67/352)
2021-07-17T14:04:47.8121876Z remote: Compressing objects: 20% (71/352)
2021-07-17T14:04:47.8122603Z remote: Compressing objects: 21% (74/352)
2021-07-17T14:04:47.8123278Z remote: Compressing objects: 22% (78/352)
2021-07-17T14:04:47.8123968Z remote: Compressing objects: 23% (81/352)
2021-07-17T14:04:47.8124648Z remote: Compressing objects: 24% (85/352)
2021-07-17T14:04:47.8125338Z remote: Compressing objects: 25% (88/352)
2021-07-17T14:04:47.8126018Z remote: Compressing objects: 26% (92/352)
2021-07-17T14:04:47.8126703Z remote: Compressing objects: 27% (96/352)
2021-07-17T14:04:47.8127388Z remote: Compressing objects: 28% (99/352)
2021-07-17T14:04:47.8128065Z remote: Compressing objects: 29% (103/352)
2021-07-17T14:04:47.8128755Z remote: Compressing objects: 30% (106/352)
2021-07-17T14:04:47.8129437Z remote: Compressing objects: 31% (110/352)
2021-07-17T14:04:47.8130139Z remote: Compressing objects: 32% (113/352)
2021-07-17T14:04:47.8130818Z remote: Compressing objects: 33% (117/352)
2021-07-17T14:04:47.8131506Z remote: Compressing objects: 34% (120/352)
2021-07-17T14:04:47.8132181Z remote: Compressing objects: 35% (124/352)
2021-07-17T14:04:47.8132875Z remote: Compressing objects: 36% (127/352)
2021-07-17T14:04:47.8133657Z remote: Compressing objects: 37% (131/352)
2021-07-17T14:04:47.8134334Z remote: Compressing objects: 38% (134/352)
2021-07-17T14:04:47.8135023Z remote: Compressing objects: 39% (138/352)
2021-07-17T14:04:47.8135697Z remote: Compressing objects: 40% (141/352)
2021-07-17T14:04:47.8136388Z remote: Compressing objects: 41% (145/352)
2021-07-17T14:04:47.8137069Z remote: Compressing objects: 42% (148/352)
2021-07-17T14:04:47.8137754Z remote: Compressing objects: 43% (152/352)
2021-07-17T14:04:47.8138427Z remote: Compressing objects: 44% (155/352)
2021-07-17T14:04:47.8139124Z remote: Compressing objects: 45% (159/352)
2021-07-17T14:04:47.8139813Z remote: Compressing objects: 46% (162/352)
2021-07-17T14:04:47.8140637Z remote: Compressing objects: 47% (166/352)
2021-07-17T14:04:47.8141332Z remote: Compressing objects: 48% (169/352)
2021-07-17T14:04:47.8142018Z remote: Compressing objects: 49% (173/352)
2021-07-17T14:04:47.8142708Z remote: Compressing objects: 50% (176/352)
2021-07-17T14:04:47.8143383Z remote: Compressing objects: 51% (180/352)
2021-07-17T14:04:47.8144078Z remote: Compressing objects: 52% (184/352)
2021-07-17T14:04:47.8144759Z remote: Compressing objects: 53% (187/352)
2021-07-17T14:04:47.8145448Z remote: Compressing objects: 54% (191/352)
2021-07-17T14:04:47.8146136Z remote: Compressing objects: 55% (194/352)
2021-07-17T14:04:47.8146809Z remote: Compressing objects: 56% (198/352)
2021-07-17T14:04:47.8147505Z remote: Compressing objects: 57% (201/352)
2021-07-17T14:04:47.8268997Z remote: Compressing objects: 58% (205/352)
2021-07-17T14:04:47.8269776Z remote: Compressing objects: 59% (208/352)
2021-07-17T14:04:47.8270464Z remote: Compressing objects: 60% (212/352)
2021-07-17T14:04:47.8271165Z remote: Compressing objects: 61% (215/352)
2021-07-17T14:04:47.8271855Z remote: Compressing objects: 62% (219/352)
2021-07-17T14:04:47.8272551Z remote: Compressing objects: 63% (222/352)
2021-07-17T14:04:47.8273247Z remote: Compressing objects: 64% (226/352)
2021-07-17T14:04:47.8273926Z remote: Compressing objects: 65% (229/352)
2021-07-17T14:04:47.8274623Z remote: Compressing objects: 66% (233/352)
2021-07-17T14:04:47.8275301Z remote: Compressing objects: 67% (236/352)
2021-07-17T14:04:47.8275991Z remote: Compressing objects: 68% (240/352)
2021-07-17T14:04:47.8276670Z remote: Compressing objects: 69% (243/352)
2021-07-17T14:04:47.8277371Z remote: Compressing objects: 70% (247/352)
2021-07-17T14:04:47.8278056Z remote: Compressing objects: 71% (250/352)
2021-07-17T14:04:47.8278746Z remote: Compressing objects: 72% (254/352)
2021-07-17T14:04:47.8279437Z remote: Compressing objects: 73% (257/352)
2021-07-17T14:04:47.8280115Z remote: Compressing objects: 74% (261/352)
2021-07-17T14:04:47.8280817Z remote: Compressing objects: 75% (264/352)
2021-07-17T14:04:47.8281502Z remote: Compressing objects: 76% (268/352)
2021-07-17T14:04:47.8282188Z remote: Compressing objects: 77% (272/352)
2021-07-17T14:04:47.8282865Z remote: Compressing objects: 78% (275/352)
2021-07-17T14:04:47.8283551Z remote: Compressing objects: 79% (279/352)
2021-07-17T14:04:47.8284226Z remote: Compressing objects: 80% (282/352)
2021-07-17T14:04:47.8284920Z remote: Compressing objects: 81% (286/352)
2021-07-17T14:04:47.8285610Z remote: Compressing objects: 82% (289/352)
2021-07-17T14:04:47.8286294Z remote: Compressing objects: 83% (293/352)
2021-07-17T14:04:47.8286981Z remote: Compressing objects: 84% (296/352)
2021-07-17T14:04:47.8287658Z remote: Compressing objects: 85% (300/352)
2021-07-17T14:04:47.8288353Z remote: Compressing objects: 86% (303/352)
2021-07-17T14:04:47.8289110Z remote: Compressing objects: 87% (307/352)
2021-07-17T14:04:47.8289825Z remote: Compressing objects: 88% (310/352)
2021-07-17T14:04:47.8290512Z remote: Compressing objects: 89% (314/352)
2021-07-17T14:04:47.8291206Z remote: Compressing objects: 90% (317/352)
2021-07-17T14:04:47.8291883Z remote: Compressing objects: 91% (321/352)
2021-07-17T14:04:47.8292575Z remote: Compressing objects: 92% (324/352)
2021-07-17T14:04:47.8293250Z remote: Compressing objects: 93% (328/352)
2021-07-17T14:04:47.8293941Z remote: Compressing objects: 94% (331/352)
2021-07-17T14:04:47.8294624Z remote: Compressing objects: 95% (335/352)
2021-07-17T14:04:47.8295323Z remote: Compressing objects: 96% (338/352)
2021-07-17T14:04:47.8296000Z remote: Compressing objects: 97% (342/352)
2021-07-17T14:04:47.8296687Z remote: Compressing objects: 98% (345/352)
2021-07-17T14:04:47.8297375Z remote: Compressing objects: 99% (349/352)
2021-07-17T14:04:47.8298059Z remote: Compressing objects: 100% (352/352)
2021-07-17T14:04:47.8298786Z remote: Compressing objects: 100% (352/352), done.
2021-07-17T14:04:47.8299581Z Receiving objects: 0% (1/486)
2021-07-17T14:04:47.8300171Z Receiving objects: 1% (5/486)
2021-07-17T14:04:47.8300764Z Receiving objects: 2% (10/486)
2021-07-17T14:04:47.8301341Z Receiving objects: 3% (15/486)
2021-07-17T14:04:47.8301939Z Receiving objects: 4% (20/486)
2021-07-17T14:04:47.8302516Z Receiving objects: 5% (25/486)
2021-07-17T14:04:47.8303102Z Receiving objects: 6% (30/486)
2021-07-17T14:04:47.8303676Z Receiving objects: 7% (35/486)
2021-07-17T14:04:47.8304333Z Receiving objects: 8% (39/486)
2021-07-17T14:04:47.8304919Z Receiving objects: 9% (44/486)
2021-07-17T14:04:47.8305509Z Receiving objects: 10% (49/486)
2021-07-17T14:04:47.8306085Z Receiving objects: 11% (54/486)
2021-07-17T14:04:47.8306677Z Receiving objects: 12% (59/486)
2021-07-17T14:04:47.8307265Z Receiving objects: 13% (64/486)
2021-07-17T14:04:47.8308019Z Receiving objects: 14% (69/486)
2021-07-17T14:04:47.8308624Z Receiving objects: 15% (73/486)
2021-07-17T14:04:47.8309196Z Receiving objects: 16% (78/486)
2021-07-17T14:04:47.8309783Z Receiving objects: 17% (83/486)
2021-07-17T14:04:47.8310359Z Receiving objects: 18% (88/486)
2021-07-17T14:04:47.8310950Z Receiving objects: 19% (93/486)
2021-07-17T14:04:47.8311530Z Receiving objects: 20% (98/486)
2021-07-17T14:04:47.8312122Z Receiving objects: 21% (103/486)
2021-07-17T14:04:47.8312703Z Receiving objects: 22% (107/486)
2021-07-17T14:04:47.8313295Z Receiving objects: 23% (112/486)
2021-07-17T14:04:47.8313878Z Receiving objects: 24% (117/486)
2021-07-17T14:04:47.8314474Z Receiving objects: 25% (122/486)
2021-07-17T14:04:47.8315064Z Receiving objects: 26% (127/486)
2021-07-17T14:04:47.8315642Z Receiving objects: 27% (132/486)
2021-07-17T14:04:47.8316273Z Receiving objects: 28% (137/486)
2021-07-17T14:04:47.8316894Z Receiving objects: 29% (141/486)
2021-07-17T14:04:47.8317512Z Receiving objects: 30% (146/486)
2021-07-17T14:04:47.8318109Z Receiving objects: 31% (151/486)
2021-07-17T14:04:47.8318718Z Receiving objects: 32% (156/486)
2021-07-17T14:04:47.8319297Z Receiving objects: 33% (161/486)
2021-07-17T14:04:47.8320059Z Receiving objects: 34% (166/486)
2021-07-17T14:04:47.8320643Z Receiving objects: 35% (171/486)
2021-07-17T14:04:47.8321243Z Receiving objects: 36% (175/486)
2021-07-17T14:04:47.8321820Z Receiving objects: 37% (180/486)
2021-07-17T14:04:47.8322417Z Receiving objects: 38% (185/486)
2021-07-17T14:04:47.8323010Z Receiving objects: 39% (190/486)
2021-07-17T14:04:47.8323591Z Receiving objects: 40% (195/486)
2021-07-17T14:04:47.8324191Z Receiving objects: 41% (200/486)
2021-07-17T14:04:47.8324771Z Receiving objects: 42% (205/486)
2021-07-17T14:04:47.8325360Z Receiving objects: 43% (209/486)
2021-07-17T14:04:47.8325937Z Receiving objects: 44% (214/486)
2021-07-17T14:04:47.8326530Z Receiving objects: 45% (219/486)
2021-07-17T14:04:47.8327235Z Receiving objects: 46% (224/486)
2021-07-17T14:04:47.8327819Z Receiving objects: 47% (229/486)
2021-07-17T14:04:47.8328395Z Receiving objects: 48% (234/486)
2021-07-17T14:04:47.8328983Z Receiving objects: 49% (239/486)
2021-07-17T14:04:47.8329565Z Receiving objects: 50% (243/486)
2021-07-17T14:04:47.8330154Z Receiving objects: 51% (248/486)
2021-07-17T14:04:47.8330742Z Receiving objects: 52% (253/486)
2021-07-17T14:04:47.8331316Z Receiving objects: 53% (258/486)
2021-07-17T14:04:47.8331906Z Receiving objects: 54% (263/486)
2021-07-17T14:04:47.8332484Z Receiving objects: 55% (268/486)
2021-07-17T14:04:47.8333070Z Receiving objects: 56% (273/486)
2021-07-17T14:04:47.8333654Z Receiving objects: 57% (278/486)
2021-07-17T14:04:47.8334244Z Receiving objects: 58% (282/486)
2021-07-17T14:04:47.8334823Z Receiving objects: 59% (287/486)
2021-07-17T14:04:47.8335412Z Receiving objects: 60% (292/486)
2021-07-17T14:04:47.8335994Z Receiving objects: 61% (297/486)
2021-07-17T14:04:47.8336590Z Receiving objects: 62% (302/486)
2021-07-17T14:04:47.8337185Z Receiving objects: 63% (307/486)
2021-07-17T14:04:47.8337760Z Receiving objects: 64% (312/486)
2021-07-17T14:04:47.8338351Z Receiving objects: 65% (316/486)
2021-07-17T14:04:47.8338938Z Receiving objects: 66% (321/486)
2021-07-17T14:04:47.8339528Z Receiving objects: 67% (326/486)
2021-07-17T14:04:47.8340105Z Receiving objects: 68% (331/486)
2021-07-17T14:04:47.8340694Z Receiving objects: 69% (336/486)
2021-07-17T14:04:47.8341266Z Receiving objects: 70% (341/486)
2021-07-17T14:04:47.8341863Z Receiving objects: 71% (346/486)
2021-07-17T14:04:47.8342441Z Receiving objects: 72% (350/486)
2021-07-17T14:04:47.8343141Z Receiving objects: 73% (355/486)
2021-07-17T14:04:47.8343743Z Receiving objects: 74% (360/486)
2021-07-17T14:04:47.8344318Z Receiving objects: 75% (365/486)
2021-07-17T14:04:47.8344910Z Receiving objects: 76% (370/486)
2021-07-17T14:04:47.8345489Z Receiving objects: 77% (375/486)
2021-07-17T14:04:47.8346079Z Receiving objects: 78% (380/486)
2021-07-17T14:04:47.8346665Z Receiving objects: 79% (384/486)
2021-07-17T14:04:47.8347254Z Receiving objects: 80% (389/486)
2021-07-17T14:04:47.8349045Z Receiving objects: 81% (394/486)
2021-07-17T14:04:47.8349711Z Receiving objects: 82% (399/486)
2021-07-17T14:04:47.8350289Z Receiving objects: 83% (404/486)
2021-07-17T14:04:47.8350877Z Receiving objects: 84% (409/486)
2021-07-17T14:04:47.8351450Z Receiving objects: 85% (414/486)
2021-07-17T14:04:47.8352047Z Receiving objects: 86% (418/486)
2021-07-17T14:04:47.8352642Z Receiving objects: 87% (423/486)
2021-07-17T14:04:47.8353930Z remote: Total 486 (delta 155), reused 305 (delta 88), pack-reused 0
2021-07-17T14:04:47.8354663Z Receiving objects: 88% (428/486)
2021-07-17T14:04:47.8355245Z Receiving objects: 89% (433/486)
2021-07-17T14:04:47.8355835Z Receiving objects: 90% (438/486)
2021-07-17T14:04:47.8356415Z Receiving objects: 91% (443/486)
2021-07-17T14:04:47.8357003Z Receiving objects: 92% (448/486)
2021-07-17T14:04:47.8357588Z Receiving objects: 93% (452/486)
2021-07-17T14:04:47.8358174Z Receiving objects: 94% (457/486)
2021-07-17T14:04:47.8358747Z Receiving objects: 95% (462/486)
2021-07-17T14:04:47.8359338Z Receiving objects: 96% (467/486)
2021-07-17T14:04:47.8359924Z Receiving objects: 97% (472/486)
2021-07-17T14:04:47.8360499Z Receiving objects: 98% (477/486)
2021-07-17T14:04:47.8361083Z Receiving objects: 99% (482/486)
2021-07-17T14:04:47.8361653Z Receiving objects: 100% (486/486)
2021-07-17T14:04:47.8362324Z Receiving objects: 100% (486/486), 349.04 KiB | 10.91 MiB/s, done.
2021-07-17T14:04:47.8363044Z Resolving deltas: 0% (0/155)
2021-07-17T14:04:47.8363621Z Resolving deltas: 1% (2/155)
2021-07-17T14:04:47.8364189Z Resolving deltas: 2% (4/155)
2021-07-17T14:04:47.8364763Z Resolving deltas: 3% (5/155)
2021-07-17T14:04:47.8365341Z Resolving deltas: 4% (7/155)
2021-07-17T14:04:47.8366598Z Resolving deltas: 5% (8/155)
2021-07-17T14:04:47.8425146Z Resolving deltas: 6% (10/155)
2021-07-17T14:04:47.8425746Z Resolving deltas: 7% (11/155)
2021-07-17T14:04:47.8426547Z Resolving deltas: 8% (13/155)
2021-07-17T14:04:47.8427104Z Resolving deltas: 9% (14/155)
2021-07-17T14:04:47.8427678Z Resolving deltas: 10% (16/155)
2021-07-17T14:04:47.8428542Z Resolving deltas: 11% (18/155)
2021-07-17T14:04:47.8429115Z Resolving deltas: 12% (19/155)
2021-07-17T14:04:47.8429676Z Resolving deltas: 13% (21/155)
2021-07-17T14:04:47.8430244Z Resolving deltas: 14% (22/155)
2021-07-17T14:04:47.8430812Z Resolving deltas: 15% (24/155)
2021-07-17T14:04:47.8431371Z Resolving deltas: 16% (25/155)
2021-07-17T14:04:47.8431945Z Resolving deltas: 17% (27/155)
2021-07-17T14:04:47.8432555Z Resolving deltas: 18% (28/155)
2021-07-17T14:04:47.8433125Z Resolving deltas: 19% (30/155)
2021-07-17T14:04:47.8433682Z Resolving deltas: 20% (31/155)
2021-07-17T14:04:47.8434254Z Resolving deltas: 21% (33/155)
2021-07-17T14:04:47.8434817Z Resolving deltas: 22% (35/155)
2021-07-17T14:04:47.8435385Z Resolving deltas: 23% (36/155)
2021-07-17T14:04:47.8435947Z Resolving deltas: 24% (38/155)
2021-07-17T14:04:47.8436516Z Resolving deltas: 25% (39/155)
2021-07-17T14:04:47.8437090Z Resolving deltas: 26% (41/155)
2021-07-17T14:04:47.8437650Z Resolving deltas: 27% (42/155)
2021-07-17T14:04:47.8438220Z Resolving deltas: 28% (44/155)
2021-07-17T14:04:47.8438779Z Resolving deltas: 29% (45/155)
2021-07-17T14:04:47.8439350Z Resolving deltas: 30% (47/155)
2021-07-17T14:04:47.8439940Z Resolving deltas: 31% (49/155)
2021-07-17T14:04:47.8440513Z Resolving deltas: 32% (50/155)
2021-07-17T14:04:47.8441069Z Resolving deltas: 33% (52/155)
2021-07-17T14:04:47.8441639Z Resolving deltas: 34% (53/155)
2021-07-17T14:04:47.8442295Z Resolving deltas: 35% (55/155)
2021-07-17T14:04:47.8442878Z Resolving deltas: 36% (56/155)
2021-07-17T14:04:47.8443453Z Resolving deltas: 37% (58/155)
2021-07-17T14:04:47.8444011Z Resolving deltas: 38% (59/155)
2021-07-17T14:04:47.8444603Z Resolving deltas: 39% (61/155)
2021-07-17T14:04:47.8445163Z Resolving deltas: 40% (62/155)
2021-07-17T14:04:47.8445948Z Resolving deltas: 41% (64/155)
2021-07-17T14:04:47.8447778Z Resolving deltas: 42% (66/155)
2021-07-17T14:04:47.8449698Z Resolving deltas: 43% (67/155)
2021-07-17T14:04:47.8461042Z Resolving deltas: 44% (69/155)
2021-07-17T14:04:47.8461681Z Resolving deltas: 45% (70/155)
2021-07-17T14:04:47.8462270Z Resolving deltas: 46% (72/155)
2021-07-17T14:04:47.8462840Z Resolving deltas: 47% (73/155)
2021-07-17T14:04:47.8463418Z Resolving deltas: 48% (75/155)
2021-07-17T14:04:47.8463978Z Resolving deltas: 49% (76/155)
2021-07-17T14:04:47.8464553Z Resolving deltas: 50% (78/155)
2021-07-17T14:04:47.8465115Z Resolving deltas: 51% (80/155)
2021-07-17T14:04:47.8465720Z Resolving deltas: 52% (81/155)
2021-07-17T14:04:47.8466283Z Resolving deltas: 53% (83/155)
2021-07-17T14:04:47.8466860Z Resolving deltas: 54% (84/155)
2021-07-17T14:04:47.8467434Z Resolving deltas: 55% (86/155)
2021-07-17T14:04:47.8468172Z Resolving deltas: 56% (87/155)
2021-07-17T14:04:47.8469881Z Resolving deltas: 57% (89/155)
2021-07-17T14:04:47.8470703Z Resolving deltas: 58% (90/155)
2021-07-17T14:04:47.8471292Z Resolving deltas: 59% (92/155)
2021-07-17T14:04:47.8471949Z Resolving deltas: 60% (93/155)
2021-07-17T14:04:47.8472531Z Resolving deltas: 61% (95/155)
2021-07-17T14:04:47.8473095Z Resolving deltas: 62% (97/155)
2021-07-17T14:04:47.8473673Z Resolving deltas: 63% (98/155)
2021-07-17T14:04:47.8474259Z Resolving deltas: 64% (100/155)
2021-07-17T14:04:47.8474830Z Resolving deltas: 65% (101/155)
2021-07-17T14:04:47.8475410Z Resolving deltas: 66% (103/155)
2021-07-17T14:04:47.8475979Z Resolving deltas: 67% (104/155)
2021-07-17T14:04:47.8476563Z Resolving deltas: 68% (106/155)
2021-07-17T14:04:47.8477143Z Resolving deltas: 69% (107/155)
2021-07-17T14:04:47.8477721Z Resolving deltas: 70% (109/155)
2021-07-17T14:04:47.8478287Z Resolving deltas: 71% (111/155)
2021-07-17T14:04:47.8478866Z Resolving deltas: 72% (112/155)
2021-07-17T14:04:47.8479434Z Resolving deltas: 73% (114/155)
2021-07-17T14:04:47.8480032Z Resolving deltas: 74% (115/155)
2021-07-17T14:04:47.8480847Z Resolving deltas: 75% (117/155)
2021-07-17T14:04:47.8481409Z Resolving deltas: 76% (118/155)
2021-07-17T14:04:47.8481983Z Resolving deltas: 77% (120/155)
2021-07-17T14:04:47.8484398Z Resolving deltas: 78% (121/155)
2021-07-17T14:04:47.8485601Z Resolving deltas: 79% (123/155)
2021-07-17T14:04:47.8489259Z Resolving deltas: 80% (124/155)
2021-07-17T14:04:47.8495976Z Resolving deltas: 81% (126/155)
2021-07-17T14:04:47.8496602Z Resolving deltas: 82% (128/155)
2021-07-17T14:04:47.8500100Z Resolving deltas: 83% (129/155)
2021-07-17T14:04:47.8503103Z Resolving deltas: 84% (131/155)
2021-07-17T14:04:47.8503743Z Resolving deltas: 85% (132/155)
2021-07-17T14:04:47.8504317Z Resolving deltas: 86% (134/155)
2021-07-17T14:04:47.8504961Z Resolving deltas: 87% (135/155)
2021-07-17T14:04:47.8505547Z Resolving deltas: 88% (137/155)
2021-07-17T14:04:47.8506122Z Resolving deltas: 89% (138/155)
2021-07-17T14:04:47.8506707Z Resolving deltas: 90% (140/155)
2021-07-17T14:04:47.8507293Z Resolving deltas: 91% (142/155)
2021-07-17T14:04:47.8508072Z Resolving deltas: 92% (143/155)
2021-07-17T14:04:47.8508657Z Resolving deltas: 93% (145/155)
2021-07-17T14:04:47.8509245Z Resolving deltas: 94% (146/155)
2021-07-17T14:04:47.8509816Z Resolving deltas: 95% (148/155)
2021-07-17T14:04:47.8510398Z Resolving deltas: 96% (149/155)
2021-07-17T14:04:47.8510967Z Resolving deltas: 97% (151/155)
2021-07-17T14:04:47.8511552Z Resolving deltas: 98% (152/155)
2021-07-17T14:04:47.8513977Z Resolving deltas: 99% (154/155)
2021-07-17T14:04:47.8518986Z Resolving deltas: 100% (155/155)
2021-07-17T14:04:47.8519743Z Resolving deltas: 100% (155/155), done.
2021-07-17T14:04:47.8621550Z From https://github.com/submariner-io/submariner-operator
2021-07-17T14:04:47.8645730Z * [new ref] 0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-17T14:04:47.8646627Z ##[endgroup]
2021-07-17T14:04:47.8647583Z ##[group]Determining the checkout info
2021-07-17T14:04:47.8648407Z ##[endgroup]
2021-07-17T14:04:47.8649152Z ##[group]Checking out the ref
2021-07-17T14:04:47.8653283Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-17T14:04:47.8924656Z Switched to a new branch 'devel'
2021-07-17T14:04:47.8926210Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-17T14:04:47.8933126Z ##[endgroup]
2021-07-17T14:04:47.8974794Z [command]/usr/bin/git log -1 --format='%H'
2021-07-17T14:04:47.9003822Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-17T14:04:47.9278118Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-17T14:04:47.9278828Z with:
2021-07-17T14:04:47.9279293Z k8s_version: 1.17
2021-07-17T14:04:47.9279862Z using: libreswan lighthouse
2021-07-17T14:04:47.9280479Z working-directory: .
2021-07-17T14:04:47.9281040Z target: e2e
2021-07-17T14:04:47.9281498Z focus: \[.*\]
2021-07-17T14:04:47.9282082Z skip: \[external-dataplane\]
2021-07-17T14:04:47.9282702Z testdir: test/e2e
2021-07-17T14:04:47.9283220Z ##[endgroup]
2021-07-17T14:04:47.9451981Z ##[group]Reclaiming free space
2021-07-17T14:05:01.9314289Z Filesystem Size Used Avail Use% Mounted on
2021-07-17T14:05:01.9322208Z /dev/root 84G 42G 43G 50% /
2021-07-17T14:05:01.9323947Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-17T14:05:01.9325523Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-17T14:05:01.9326958Z tmpfs 696M 1.1M 695M 1% /run
2021-07-17T14:05:01.9328494Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-17T14:05:01.9329974Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-17T14:05:01.9331260Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-17T14:05:01.9332646Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-17T14:05:01.9334024Z /dev/loop2 68M 68M 0 100% /snap/lxd/20326
2021-07-17T14:05:01.9335410Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-17T14:05:01.9336643Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-17T14:05:01.9338177Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-17T14:05:01.9339425Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-17T14:05:01.9341262Z ##[endgroup]
2021-07-17T14:05:01.9529181Z ##[group]Disable swap
2021-07-17T14:05:02.0404980Z ##[endgroup]
2021-07-17T14:05:02.0549151Z ##[group]Report available RAM
2021-07-17T14:05:02.0654148Z total used free shared buff/cache available
2021-07-17T14:05:02.0655057Z Mem: 6.8Gi 465Mi 5.3Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-17T14:05:02.0655639Z Swap: 0B 0B 0B
2021-07-17T14:05:02.0659685Z ##[endgroup]
2021-07-17T14:05:02.1487207Z Downloading Makefile.dapper
2021-07-17T14:05:02.2176131Z Downloading dapper
2021-07-17T14:05:02.3938218Z .dapper.tmp version v0.5.6
2021-07-17T14:05:02.4024240Z Downloading Dockerfile.dapper
2021-07-17T14:05:02.4305729Z docker network create -d bridge kind
2021-07-17T14:05:06.1031796Z 57f26702da267230e581a31d84d16c58f4c61cb5e2363e45f6fed0283dc38fc8
2021-07-17T14:05:06.1053043Z ./.dapper -m bind make --debug=b e2e
2021-07-17T14:05:06.3732248Z Sending build context to Docker daemon 7.517MB
2021-07-17T14:05:06.3732807Z
2021-07-17T14:05:06.3837012Z Step 1/8 : ARG BASE_BRANCH
2021-07-17T14:05:06.3839171Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-17T14:05:06.6868285Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-17T14:05:06.7048022Z b1495d80d526: Pulling fs layer
2021-07-17T14:05:06.7136572Z fb3037ce215d: Pulling fs layer
2021-07-17T14:05:06.7137259Z 95344349df1d: Pulling fs layer
2021-07-17T14:05:06.7137946Z a3e11b0fdbf6: Pulling fs layer
2021-07-17T14:05:06.7138624Z b2d0ef6cbe4f: Pulling fs layer
2021-07-17T14:05:06.7139235Z fa188fe30729: Pulling fs layer
2021-07-17T14:05:06.7139745Z 05ca4b0545ef: Pulling fs layer
2021-07-17T14:05:06.7140271Z b17ce80b21da: Pulling fs layer
2021-07-17T14:05:06.7140862Z a3e11b0fdbf6: Waiting
2021-07-17T14:05:06.7141341Z fa188fe30729: Waiting
2021-07-17T14:05:06.7141825Z 05ca4b0545ef: Waiting
2021-07-17T14:05:06.7142290Z b17ce80b21da: Waiting
2021-07-17T14:05:06.7142754Z b2d0ef6cbe4f: Waiting
2021-07-17T14:05:07.4909681Z 95344349df1d: Verifying Checksum
2021-07-17T14:05:07.4924776Z 95344349df1d: Download complete
2021-07-17T14:05:07.5414365Z a3e11b0fdbf6: Verifying Checksum
2021-07-17T14:05:07.5415907Z a3e11b0fdbf6: Download complete
2021-07-17T14:05:07.5849205Z b2d0ef6cbe4f: Verifying Checksum
2021-07-17T14:05:07.5885841Z b2d0ef6cbe4f: Download complete
2021-07-17T14:05:07.6849842Z b1495d80d526: Verifying Checksum
2021-07-17T14:05:07.6850585Z b1495d80d526: Download complete
2021-07-17T14:05:07.7508107Z fa188fe30729: Verifying Checksum
2021-07-17T14:05:07.7509041Z fa188fe30729: Download complete
2021-07-17T14:05:07.7821298Z 05ca4b0545ef: Verifying Checksum
2021-07-17T14:05:07.7821975Z 05ca4b0545ef: Download complete
2021-07-17T14:05:07.8221204Z b17ce80b21da: Verifying Checksum
2021-07-17T14:05:07.8222434Z b17ce80b21da: Download complete
2021-07-17T14:05:09.7685309Z fb3037ce215d: Verifying Checksum
2021-07-17T14:05:09.7685988Z fb3037ce215d: Download complete
2021-07-17T14:05:11.0069510Z b1495d80d526: Pull complete
2021-07-17T14:05:21.9962469Z fb3037ce215d: Pull complete
2021-07-17T14:05:23.4779737Z 95344349df1d: Pull complete
2021-07-17T14:05:23.5504602Z a3e11b0fdbf6: Pull complete
2021-07-17T14:05:23.6243459Z b2d0ef6cbe4f: Pull complete
2021-07-17T14:05:23.8071491Z fa188fe30729: Pull complete
2021-07-17T14:05:23.8819744Z 05ca4b0545ef: Pull complete
2021-07-17T14:05:23.9695411Z b17ce80b21da: Pull complete
2021-07-17T14:05:23.9740658Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-17T14:05:23.9836938Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-17T14:05:23.9857516Z ---> 92b726655a41
2021-07-17T14:05:23.9858022Z Step 3/8 : ARG PROJECT
2021-07-17T14:05:24.0034999Z ---> Running in 60ad0a8aa8b9
2021-07-17T14:05:25.0565987Z Removing intermediate container 60ad0a8aa8b9
2021-07-17T14:05:25.0567474Z ---> 31a51281e393
2021-07-17T14:05:25.0569130Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-17T14:05:25.0741021Z ---> Running in f3ad508b2edb
2021-07-17T14:05:26.0657194Z Removing intermediate container f3ad508b2edb
2021-07-17T14:05:26.0658424Z ---> e7b596c76dfc
2021-07-17T14:05:26.0659034Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-17T14:05:26.0870400Z ---> Running in 05e697a368e2
2021-07-17T14:05:27.0948522Z Removing intermediate container 05e697a368e2
2021-07-17T14:05:27.0949789Z ---> d77aeb517708
2021-07-17T14:05:27.0950291Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-17T14:05:27.1190692Z ---> Running in 8ea366334f84
2021-07-17T14:05:28.0946306Z Removing intermediate container 8ea366334f84
2021-07-17T14:05:28.0947538Z ---> 33b939b3ab54
2021-07-17T14:05:28.0948352Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-17T14:05:28.1183040Z ---> Running in fc31237a6f12
2021-07-17T14:05:29.1591912Z Removing intermediate container fc31237a6f12
2021-07-17T14:05:29.1593226Z ---> 68df54319fb7
2021-07-17T14:05:29.1593671Z Step 8/8 : CMD ["sh"]
2021-07-17T14:05:29.1757909Z ---> Running in a7e97d9ce1db
2021-07-17T14:05:30.1834534Z Removing intermediate container a7e97d9ce1db
2021-07-17T14:05:30.1839474Z ---> 0135307b8fcd
2021-07-17T14:05:30.1983058Z Successfully built 0135307b8fcd
2021-07-17T14:05:30.2014996Z Successfully tagged submariner-operator:devel
2021-07-17T14:05:31.7388930Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-17T14:05:31.7389968Z [submariner-operator]$ mkdir -p bin dist output
2021-07-17T14:05:31.7439079Z [submariner-operator]$ make --debug=b e2e
2021-07-17T14:05:31.7440460Z GNU Make 4.3
2021-07-17T14:05:31.7442564Z Built for x86_64-redhat-linux-gnu
2021-07-17T14:05:31.7444157Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-17T14:05:31.7446095Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-17T14:05:31.7447691Z This is free software: you are free to change and redistribute it.
2021-07-17T14:05:31.7449075Z There is NO WARRANTY, to the extent permitted by law.
2021-07-17T14:05:31.7465704Z Reading makefiles...
2021-07-17T14:05:31.8824784Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-17T14:05:31.8826115Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-17T14:05:32.1322725Z Updating makefiles....
2021-07-17T14:05:32.1335493Z Updating goal targets....
2021-07-17T14:05:32.1336611Z File 'e2e' does not exist.
2021-07-17T14:05:32.1337310Z File 'clusters' does not exist.
2021-07-17T14:05:32.1341940Z Must remake target 'clusters'.
2021-07-17T14:05:32.1343441Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.17" --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T14:05:32.1376456Z Downloading shflags 1.0.3
2021-07-17T14:05:32.1439783Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-17T14:05:32.1440613Z Dload Upload Total Spent Left Speed
2021-07-17T14:05:32.1441023Z
2021-07-17T14:05:32.1670592Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-17T14:05:32.1671483Z 100 31091 100 31091 0 0 1320k 0 --:--:-- --:--:-- --:--:-- 1320k
2021-07-17T14:05:32.2404193Z Running with: k8s_version=1.17.17, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-17T14:05:32.2432512Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T14:05:32.2441559Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:05:32.2454468Z [submariner-operator]$ script_name=utils
2021-07-17T14:05:32.2466576Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T14:05:32.2498894Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T14:05:32.2512624Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:05:32.2526084Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T14:05:32.2540536Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T14:05:32.2564836Z [submariner-operator]$ broker=cluster1
2021-07-17T14:05:32.2577666Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T14:05:32.2600520Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T14:05:32.2614000Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T14:05:32.2627452Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T14:05:32.2640807Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T14:05:32.2654123Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T14:05:32.2666973Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T14:05:32.2680420Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T14:05:32.2693245Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T14:05:32.2706512Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T14:05:32.2719705Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T14:05:32.2734072Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T14:05:32.2747756Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:05:32.2761733Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T14:05:32.2774818Z [submariner-operator]$ exec_name=clusters.sh
2021-07-17T14:05:32.2797708Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T14:05:32.2811061Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T14:05:32.2842707Z [submariner-operator]$ cat <<EOM
2021-07-17T14:05:32.2844086Z Cluster settings::
2021-07-17T14:05:32.2844722Z broker - ${broker@Q}
2021-07-17T14:05:32.2845345Z clusters - ${clusters[*]@Q}
2021-07-17T14:05:32.2846300Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-17T14:05:32.2847192Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-17T14:05:32.2848112Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-17T14:05:32.2848784Z EOM
2021-07-17T14:05:32.2871704Z [submariner-operator]$ typeset -p cluster_cni
2021-07-17T14:05:32.2886053Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T14:05:32.2917298Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-17T14:05:32.2931006Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T14:05:32.2960261Z [submariner-operator]$ typeset -p cluster_subm
2021-07-17T14:05:32.2975589Z [submariner-operator]$ cut -f 2- -d=
2021-07-17T14:05:32.2999255Z Cluster settings::
2021-07-17T14:05:32.3000059Z broker - 'cluster1'
2021-07-17T14:05:32.3000737Z clusters - 'cluster1' 'cluster2'
2021-07-17T14:05:32.3001513Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-17T14:05:32.3002884Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-17T14:05:32.3004217Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-17T14:05:32.3017199Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-17T14:05:32.3039989Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-17T14:05:32.3066229Z [submariner-operator]$ run_local_registry
2021-07-17T14:05:32.3080535Z [submariner-operator]$ run_local_registry
2021-07-17T14:05:32.3093583Z [submariner-operator]$ registry_running
2021-07-17T14:05:32.3106360Z [submariner-operator]$ registry_running
2021-07-17T14:05:32.3119480Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-17T14:05:32.3135083Z [submariner-operator]$ grep kind-registry
2021-07-17T14:05:32.6013579Z [submariner-operator]$ return 0
2021-07-17T14:05:32.6014663Z Deploying local registry kind-registry to serve images centrally.
2021-07-17T14:05:32.6029490Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-17T14:05:32.6040575Z [submariner-operator]$ selinuxenabled
2021-07-17T14:05:32.6065101Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-17T14:05:32.9094647Z Unable to find image 'registry:2' locally
2021-07-17T14:05:33.0781001Z 2: Pulling from library/registry
2021-07-17T14:05:33.1234603Z ddad3d7c1e96: Already exists
2021-07-17T14:05:33.1259176Z 6eda6749503f: Pulling fs layer
2021-07-17T14:05:33.1261871Z 363ab70c2143: Pulling fs layer
2021-07-17T14:05:33.1262704Z 5b94580856e6: Pulling fs layer
2021-07-17T14:05:33.1263471Z 12008541203a: Pulling fs layer
2021-07-17T14:05:33.1270450Z 12008541203a: Waiting
2021-07-17T14:05:33.1837888Z 5b94580856e6: Verifying Checksum
2021-07-17T14:05:33.1839516Z 5b94580856e6: Download complete
2021-07-17T14:05:33.2200586Z 6eda6749503f: Verifying Checksum
2021-07-17T14:05:33.2201225Z 6eda6749503f: Download complete
2021-07-17T14:05:33.2605872Z 12008541203a: Verifying Checksum
2021-07-17T14:05:33.2606488Z 12008541203a: Download complete
2021-07-17T14:05:33.2718096Z 363ab70c2143: Verifying Checksum
2021-07-17T14:05:33.2718693Z 363ab70c2143: Download complete
2021-07-17T14:05:33.4463750Z 6eda6749503f: Pull complete
2021-07-17T14:05:33.7873854Z 363ab70c2143: Pull complete
2021-07-17T14:05:33.8574861Z 5b94580856e6: Pull complete
2021-07-17T14:05:33.9284159Z 12008541203a: Pull complete
2021-07-17T14:05:33.9330146Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-17T14:05:33.9345563Z Status: Downloaded newer image for registry:2
2021-07-17T14:05:33.9637585Z 2b4681079132f85a2097036fa24ae7ed50fb482f0488f94f7fb615168e3bc100
2021-07-17T14:05:34.8328560Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-17T14:05:35.2631435Z [submariner-operator]$ declare_cidrs
2021-07-17T14:05:35.2646072Z [submariner-operator]$ declare_cidrs
2021-07-17T14:05:35.2660554Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T14:05:35.2661610Z [submariner-operator]$ i=1
2021-07-17T14:05:35.2674708Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T14:05:35.2686313Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T14:05:35.2702206Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T14:05:35.2703378Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T14:05:35.2709328Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T14:05:35.2723303Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T14:05:35.2735441Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T14:05:35.2745255Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T14:05:35.2756370Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T14:05:35.2773192Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T14:05:35.2778051Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-17T14:05:35.2790306Z [submariner-operator]$ [cluster2] wait 231
2021-07-17T14:05:35.2791498Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-17T14:05:35.2802289Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-17T14:05:35.2816776Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-17T14:05:35.2830800Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T14:05:35.2848539Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T14:05:35.2869069Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T14:05:35.2873451Z [submariner-operator]$ [cluster1] pids[cluster1]=240
2021-07-17T14:05:35.2884039Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-17T14:05:35.2899909Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T14:05:35.2909932Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T14:05:35.2914498Z [submariner-operator]$ [cluster2] pids[cluster2]=244
2021-07-17T14:05:35.2935799Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-17T14:05:35.2947070Z [submariner-operator]$ [cluster2] wait 244
2021-07-17T14:05:35.2958884Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T14:07:36.8599894Z [submariner-operator]$ [cluster1] with_retries
2021-07-17T14:07:36.8601153Z [submariner-operator]$ [cluster1] iteration=1
2021-07-17T14:07:36.8602117Z [submariner-operator]$ [cluster1] wait 260
2021-07-17T14:07:36.8603122Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-17T14:07:36.8604563Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-17T14:07:36.8606314Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:07:36.8608513Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:07:36.8610027Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-17T14:07:36.8611075Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-17T14:07:36.8612050Z [cluster1] No kind clusters found.
2021-07-17T14:07:36.8612658Z [cluster1] Creating KIND cluster...
2021-07-17T14:07:36.8613625Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-17T14:07:36.8614696Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-17T14:07:36.8615744Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-17T14:07:36.8616698Z [submariner-operator]$ [cluster1] nodes=
2021-07-17T14:07:36.8617547Z [cluster1] - role: control-plane
2021-07-17T14:07:36.8618395Z [submariner-operator]$ [cluster1] nodes=
2021-07-17T14:07:36.8619222Z [cluster1] - role: control-plane
2021-07-17T14:07:36.8619904Z [cluster1] - role: worker
2021-07-17T14:07:36.8620696Z [submariner-operator]$ [cluster1] nodes=
2021-07-17T14:07:36.8621514Z [cluster1] - role: control-plane
2021-07-17T14:07:36.8622182Z [cluster1] - role: worker
2021-07-17T14:07:36.8622819Z [cluster1] - role: worker
2021-07-17T14:07:36.8623403Z [cluster1] 
2021-07-17T14:07:36.8623955Z [cluster1] 
2021-07-17T14:07:36.8624806Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-17T14:07:36.8626169Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-17T14:07:36.8627716Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.17.17
2021-07-17T14:07:36.8629253Z [submariner-operator]$ [cluster1] kind version
2021-07-17T14:07:36.8629970Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-17T14:07:36.8631331Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-17T14:07:36.8632337Z [cluster1] ---
2021-07-17T14:07:36.8632786Z [cluster1] kind: Cluster
2021-07-17T14:07:36.8633561Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-17T14:07:36.8634174Z [cluster1] networking:
2021-07-17T14:07:36.8634787Z [cluster1] disableDefaultCNI: true
2021-07-17T14:07:36.8635396Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-17T14:07:36.8635976Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-17T14:07:36.8636676Z [cluster1] containerdConfigPatches:
2021-07-17T14:07:36.8637431Z [cluster1] - |-
2021-07-17T14:07:36.8638672Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-17T14:07:36.8639980Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-17T14:07:36.8640803Z [cluster1] kubeadmConfigPatches:
2021-07-17T14:07:36.8641502Z [cluster1] - |
2021-07-17T14:07:36.8642106Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-17T14:07:36.8642844Z [cluster1] kind: ClusterConfiguration
2021-07-17T14:07:36.8643458Z [cluster1] metadata:
2021-07-17T14:07:36.8643940Z [cluster1] name: config
2021-07-17T14:07:36.8644445Z [cluster1] networking:
2021-07-17T14:07:36.8644964Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-17T14:07:36.8645542Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-17T14:07:36.8646168Z [cluster1] dnsDomain: cluster1.local
2021-07-17T14:07:36.8646727Z [cluster1] nodes:
2021-07-17T14:07:36.8647401Z [cluster1] - role: control-plane
2021-07-17T14:07:36.8648073Z [cluster1] - role: worker
2021-07-17T14:07:36.8648695Z [cluster1] - role: worker
2021-07-17T14:07:36.8650161Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.17.17 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-17T14:07:36.8651576Z [cluster1] Creating cluster "cluster1" ...
2021-07-17T14:07:36.8653783Z [cluster1] • Ensuring node image (kindest/node:v1.17.17) 🖼 ...
2021-07-17T14:07:36.8654803Z [cluster1] ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-17T14:07:36.8655617Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-17T14:07:36.8656364Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-17T14:07:36.8657138Z [cluster1] • Writing configuration 📜 ...
2021-07-17T14:07:36.8657920Z [cluster1] ✓ Writing configuration 📜
2021-07-17T14:07:36.8658737Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-17T14:07:36.8659744Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-17T14:07:36.8660609Z [cluster1] • Installing StorageClass 💾 ...
2021-07-17T14:07:36.8661422Z [cluster1] ✓ Installing StorageClass 💾
2021-07-17T14:07:36.8664168Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-17T14:07:36.8665061Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-17T14:07:36.8665894Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-17T14:07:36.8666579Z [cluster1] You can now use your cluster with:
2021-07-17T14:07:36.8667128Z [cluster1]
2021-07-17T14:07:36.8676898Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-17T14:07:36.8677626Z [cluster1]
2021-07-17T14:07:36.8678515Z [cluster1] Thanks for using kind! 😊
2021-07-17T14:07:36.8681035Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-17T14:07:36.8682213Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-17T14:07:36.8684533Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-17T14:07:36.8686042Z [submariner-operator]$ [cluster1] head -n 1
2021-07-17T14:07:46.3010154Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/serve[submariner-operator]$ [cluster2] with_retries
2021-07-17T14:07:46.3011967Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T14:07:46.3013025Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-17T14:07:46.3014301Z [submariner-operator]$ [cluster2] wait 265
2021-07-17T14:07:46.3015477Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-17T14:07:46.3017186Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:07:46.3019472Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:07:46.3021036Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-17T14:07:46.3022076Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-17T14:07:46.3022808Z [cluster2] No kind clusters found.
2021-07-17T14:07:46.3023490Z [cluster2] Creating KIND cluster...
2021-07-17T14:07:46.3024455Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-17T14:07:46.3025532Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-17T14:07:46.3026718Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-17T14:07:46.3027695Z [submariner-operator]$ [cluster2] nodes=
2021-07-17T14:07:46.3029279Z [cluster2] - role: control-plane
2021-07-17T14:07:46.3030140Z [submariner-operator]$ [cluster2] nodes=
2021-07-17T14:07:46.3030960Z [cluster2] - role: control-plane
2021-07-17T14:07:46.3031658Z [cluster2] - role: worker
2021-07-17T14:07:46.3032441Z [submariner-operator]$ [cluster2] nodes=
2021-07-17T14:07:46.3033278Z [cluster2] - role: control-plane
2021-07-17T14:07:46.3033949Z [cluster2] - role: worker
2021-07-17T14:07:46.3034593Z [cluster2] - role: worker
2021-07-17T14:07:46.3035173Z [cluster2] 
2021-07-17T14:07:46.3035722Z [cluster2] 
2021-07-17T14:07:46.3039345Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-17T14:07:46.3040818Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-17T14:07:46.3042261Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.17.17
2021-07-17T14:07:46.3043352Z [submariner-operator]$ [cluster2] kind version
2021-07-17T14:07:46.3044064Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-17T14:07:46.3045221Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-17T14:07:46.3046220Z [cluster2] ---
2021-07-17T14:07:46.3046661Z [cluster2] kind: Cluster
2021-07-17T14:07:46.3047606Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-17T14:07:46.3048230Z [cluster2] networking:
2021-07-17T14:07:46.3048845Z [cluster2] disableDefaultCNI: true
2021-07-17T14:07:46.3049452Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-17T14:07:46.3050025Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-17T14:07:46.3050745Z [cluster2] containerdConfigPatches:
2021-07-17T14:07:46.3051499Z [cluster2] - |-
2021-07-17T14:07:46.3052362Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-17T14:07:46.3053622Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-17T14:07:46.3054445Z [cluster2] kubeadmConfigPatches:
2021-07-17T14:07:46.3055130Z [cluster2] - |
2021-07-17T14:07:46.3055722Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-17T14:07:46.3056460Z [cluster2] kind: ClusterConfiguration
2021-07-17T14:07:46.3057075Z [cluster2] metadata:
2021-07-17T14:07:46.3057555Z [cluster2] name: config
2021-07-17T14:07:46.3058059Z [cluster2] networking:
2021-07-17T14:07:46.3058593Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-17T14:07:46.3059158Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-17T14:07:46.3059795Z [cluster2] dnsDomain: cluster2.local
2021-07-17T14:07:46.3060341Z [cluster2] nodes:
2021-07-17T14:07:46.3061017Z [cluster2] - role: control-plane
2021-07-17T14:07:46.3061680Z [cluster2] - role: worker
2021-07-17T14:07:46.3062308Z [cluster2] - role: worker
2021-07-17T14:07:46.3063774Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.17.17 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-17T14:07:46.3065135Z [cluster2] Creating cluster "cluster2" ...
2021-07-17T14:07:46.3066180Z [cluster2] • Ensuring node image (kindest/node:v1.17.17) 🖼 ...
2021-07-17T14:07:46.3067148Z [cluster2] ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-17T14:07:46.3071220Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-17T14:07:46.3072267Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-17T14:07:46.3073730Z [cluster2] • Writing configuration 📜 ...
2021-07-17T14:07:46.3074523Z [cluster2] ✓ Writing configuration 📜
2021-07-17T14:07:46.3075391Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-17T14:07:46.3076198Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-17T14:07:46.3077023Z [cluster2] • Installing StorageClass 💾 ...
2021-07-17T14:07:46.3077845Z [cluster2] ✓ Installing StorageClass 💾
2021-07-17T14:07:46.3078617Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-17T14:07:46.3079380Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-17T14:07:46.3080187Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-17T14:07:46.3080877Z [cluster2] You can now use your cluster with:
2021-07-17T14:07:46.3081381Z [cluster2]
2021-07-17T14:07:46.3082167Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-17T14:07:46.3082779Z [cluster2]
2021-07-17T14:07:46.3083827Z [cluster2] Not sure what to do next? 😅 Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-17T14:07:46.3085066Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-17T14:07:46.3086097Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-17T14:07:46.3087723Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-17T14:07:46.3089197Z [submariner-operator]$ [cluster2] head -n 1
2021-07-17T14:08:12.6346410Z r: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:08:12.6349481Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:08:12.6351912Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:08:12.6354602Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:08:12.6357212Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:08:12.6359589Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-17T14:08:12.6361217Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-17T14:08:12.6362271Z [submariner-operator]$ [cluster1] wait 1456
2021-07-17T14:08:12.6363327Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-17T14:08:12.6364398Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-17T14:08:12.6365376Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-17T14:08:12.6366392Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-17T14:08:12.6367444Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-17T14:08:12.6368459Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-17T14:08:12.6369214Z [cluster1] Applying weave network...
2021-07-17T14:08:12.6370665Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-17T14:08:12.6372769Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-17T14:08:12.6374881Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-17T14:08:12.6376363Z [cluster1] serviceaccount/weave-net created
2021-07-17T14:08:12.6377644Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:12.6379403Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:12.6381026Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:12.6382470Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:12.6383723Z [cluster1] daemonset.apps/weave-net created
2021-07-17T14:08:12.6384633Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-17T14:08:12.6385954Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T14:08:12.6387593Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T14:08:12.6389842Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T14:08:12.6391209Z [cluster1] pod/weave-net-bvncn condition met
2021-07-17T14:08:12.6392101Z [cluster1] pod/weave-net-jgwfl condition met
2021-07-17T14:08:12.6393001Z [cluster1] pod/weave-net-xnvlf condition met
2021-07-17T14:08:12.6393935Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-17T14:08:12.6395173Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T14:08:12.6396660Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T14:08:12.6398275Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T14:08:12.6399598Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T14:08:12.6400731Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T14:08:12.6401805Z [cluster1] deployment "coredns" successfully rolled out
2021-07-17T14:08:12.6402805Z [submariner-operator]$ [cluster1] return 0
2021-07-17T14:08:17.9791880Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.7:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:08:17.9794359Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:08:17.9796782Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:08:17.9799207Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:08:17.9801770Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:08:17.9804140Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-17T14:08:17.9805632Z [submariner-operator]$ [cluster2] wait 1597
2021-07-17T14:08:17.9806718Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-17T14:08:17.9808167Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-17T14:08:17.9809226Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-17T14:08:17.9810326Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-17T14:08:17.9811361Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-17T14:08:17.9812413Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-17T14:08:17.9813444Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-17T14:08:17.9814179Z [cluster2] Applying weave network...
2021-07-17T14:08:17.9815651Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-17T14:08:17.9817609Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-17T14:08:17.9819708Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-17T14:08:17.9821196Z [cluster2] serviceaccount/weave-net created
2021-07-17T14:08:17.9822478Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:17.9824272Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:17.9825886Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:17.9827350Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-17T14:08:17.9831969Z [cluster2] daemonset.apps/weave-net created
2021-07-17T14:08:17.9832914Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-17T14:08:17.9834240Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T14:08:17.9836521Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T14:08:17.9838460Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-17T14:08:17.9839952Z [cluster2] pod/weave-net-7qf9x condition met
2021-07-17T14:08:17.9840860Z [cluster2] pod/weave-net-8vcdp condition met
2021-07-17T14:08:17.9841736Z [cluster2] pod/weave-net-vwz4x condition met
2021-07-17T14:08:17.9842869Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-17T14:08:17.9844142Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T14:08:17.9845638Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T14:08:17.9847284Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-17T14:08:17.9849420Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T14:08:17.9850608Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T14:08:17.9851562Z [cluster2] deployment "coredns" successfully rolled out
2021-07-17T14:08:17.9852610Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:08:17.9853649Z [submariner-operator]$ [cluster2] wait 240
2021-07-17T14:08:17.9854679Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-17T14:08:17.9855781Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-17T14:08:17.9899574Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-17T14:08:17.9900509Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-17T14:08:17.9901071Z
2021-07-17T14:08:17.9902051Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-17T14:08:17.9902892Z
2021-07-17T14:08:17.9903675Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-17T14:08:17.9904159Z
2021-07-17T14:08:17.9904859Z To clean everthing up, just run: make clean-clusters
2021-07-17T14:08:17.9905517Z EOM
2021-07-17T14:08:17.9916197Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-17T14:08:17.9916781Z
2021-07-17T14:08:17.9917923Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-17T14:08:17.9918583Z
2021-07-17T14:08:17.9919360Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-17T14:08:17.9919857Z
2021-07-17T14:08:17.9920548Z To clean everthing up, just run: make clean-clusters
2021-07-17T14:08:17.9925595Z Successfully remade target file 'clusters'.
2021-07-17T14:08:17.9926957Z File 'preload-images' does not exist.
2021-07-17T14:08:17.9927724Z File 'images' does not exist.
2021-07-17T14:08:17.9932341Z File 'package/.image.submariner-operator' does not exist.
2021-07-17T14:08:18.0145664Z find: 'bin/submariner-operator': No such file or directory
2021-07-17T14:08:18.3478584Z File 'bin/submariner-operator' does not exist.
2021-07-17T14:08:18.3479738Z File 'vendor/modules.txt' does not exist.
2021-07-17T14:08:18.3480587Z Must remake target 'vendor/modules.txt'.
2021-07-17T14:08:18.3481126Z go mod download
2021-07-17T14:09:11.6629450Z go mod vendor
2021-07-17T14:09:14.0963211Z go mod tidy
2021-07-17T14:09:15.6335740Z Successfully remade target file 'vendor/modules.txt'.
2021-07-17T14:09:15.6339261Z File 'generate-embeddedyamls' does not exist.
2021-07-17T14:09:15.6340893Z File 'generate' does not exist.
2021-07-17T14:09:15.6343040Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-17T14:09:15.6347578Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-17T14:09:15.6355867Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-17T14:09:15.6393597Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-17T14:09:36.5411114Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-17T14:09:36.5435330Z Must remake target 'generate'.
2021-07-17T14:09:36.5482593Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-17T14:09:50.4745959Z Successfully remade target file 'generate'.
2021-07-17T14:09:50.4747571Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-17T14:09:50.4751201Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-17T14:09:50.4756213Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-17T14:09:50.4759074Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-17T14:09:52.8246147Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-17T14:09:52.8254151Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-17T14:09:52.8256096Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-17T14:09:52.8258246Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-17T14:09:54.2502336Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-17T14:09:54.2607800Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-17T14:09:54.2608907Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-17T14:09:55.0427756Z Generating yamls.go
2021-07-17T14:09:55.0429055Z deploy/crds/submariner.io_brokers.yaml
2021-07-17T14:09:55.0434994Z deploy/crds/submariner.io_submariners.yaml
2021-07-17T14:09:55.0465761Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-17T14:09:55.0469683Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-17T14:09:55.0472290Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-17T14:09:55.0475245Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-17T14:09:55.0482217Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-17T14:09:55.0487212Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-17T14:09:55.0496342Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-17T14:09:55.0502305Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-17T14:09:55.0509711Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-17T14:09:55.0516749Z config/broker/broker-admin/service_account.yaml
2021-07-17T14:09:55.0524057Z config/broker/broker-admin/role.yaml
2021-07-17T14:09:55.0527410Z config/broker/broker-admin/role_binding.yaml
2021-07-17T14:09:55.0530511Z config/broker/broker-client/service_account.yaml
2021-07-17T14:09:55.0534012Z config/broker/broker-client/role.yaml
2021-07-17T14:09:55.0537560Z config/broker/broker-client/role_binding.yaml
2021-07-17T14:09:55.0544334Z config/rbac/submariner-operator/service_account.yaml
2021-07-17T14:09:55.0545950Z config/rbac/submariner-operator/role.yaml
2021-07-17T14:09:55.0551650Z config/rbac/submariner-operator/role_binding.yaml
2021-07-17T14:09:55.0555483Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-17T14:09:55.0561030Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-17T14:09:55.0563569Z config/rbac/submariner-gateway/service_account.yaml
2021-07-17T14:09:55.0568892Z config/rbac/submariner-gateway/role.yaml
2021-07-17T14:09:55.0572158Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-17T14:09:55.0578313Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-17T14:09:55.0588612Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-17T14:09:55.0593933Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-17T14:09:55.0597777Z config/rbac/submariner-route-agent/role.yaml
2021-07-17T14:09:55.0603109Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-17T14:09:55.0608095Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-17T14:09:55.0612786Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-17T14:09:55.0616665Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-17T14:09:55.0622635Z config/rbac/submariner-globalnet/role.yaml
2021-07-17T14:09:55.0626964Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-17T14:09:55.0633806Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-17T14:09:55.0641521Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-17T14:09:55.0646031Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-17T14:09:55.0649773Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-17T14:09:55.0656820Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-17T14:09:55.0660792Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-17T14:09:55.0664714Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-17T14:09:55.0674138Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-17T14:09:55.0678976Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-17T14:09:55.0682500Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-17T14:09:55.0684745Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-17T14:09:55.0687224Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-17T14:09:55.0713243Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-17T14:09:55.0727853Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-17T14:09:55.0729165Z Must remake target 'generate-embeddedyamls'.
2021-07-17T14:09:55.0730322Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-17T14:09:55.0731430Z Must remake target 'bin/submariner-operator'.
2021-07-17T14:09:55.0732158Z /opt/shipyard/scripts/compile.sh \
2021-07-17T14:09:55.0733397Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-17T14:09:55.0734579Z bin/submariner-operator main.go
2021-07-17T14:09:55.1527588Z [submariner-operator]$ mkdir -p bin
2021-07-17T14:09:55.1544871Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-17T14:09:55.1563952Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-17T14:09:55.1577885Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-17T14:11:31.8922690Z [submariner-operator]$ upx bin/submariner-operator
2021-07-17T14:11:37.7841985Z Ultimate Packer for eXecutables
2021-07-17T14:11:37.7843386Z Copyright (C) 1996 - 2020
2021-07-17T14:11:37.7848568Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-17T14:11:37.7849170Z
2021-07-17T14:11:37.7849624Z File size Ratio Format Name
2021-07-17T14:11:37.7850590Z -------------------- ------ ----------- -----------
2021-07-17T14:11:37.7851483Z 34459648 -> 9933112 28.83% linux/amd64 submariner-operator
2021-07-17T14:11:37.7851947Z
2021-07-17T14:11:37.7852331Z Packed 1 file.
2021-07-17T14:11:37.7853296Z Successfully remade target file 'bin/submariner-operator'.
2021-07-17T14:11:37.7854837Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-17T14:11:37.7856461Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-17T14:11:37.7857912Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-17T14:11:37.7859276Z File 'FORCE_IMAGE' does not exist.
2021-07-17T14:11:37.7860026Z Must remake target 'FORCE_IMAGE'.
2021-07-17T14:11:37.7860826Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-17T14:11:37.7861869Z Must remake target 'package/.image.submariner-operator'.
2021-07-17T14:11:37.7863722Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-17T14:11:37.8309832Z flags:WARN flag short name (h) already defined
2021-07-17T14:11:37.8886062Z [submariner-operator]$ set -e
2021-07-17T14:11:37.8901367Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:37.8913795Z [submariner-operator]$ cache_flag=
2021-07-17T14:11:37.8927110Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:37.8945740Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:38.1938549Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:38.7115687Z devel: Pulling from submariner/submariner-operator
2021-07-17T14:11:38.7123360Z 9aabc6bb514c: Pulling fs layer
2021-07-17T14:11:38.8724542Z 9aabc6bb514c: Verifying Checksum
2021-07-17T14:11:38.8725288Z 9aabc6bb514c: Download complete
2021-07-17T14:11:39.2755182Z 9aabc6bb514c: Pull complete
2021-07-17T14:11:39.2808452Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-17T14:11:39.2830163Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:39.2861052Z quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:39.2912772Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-17T14:11:39.2921273Z [submariner-operator]$ cut -f2 -d 
2021-07-17T14:11:39.2926873Z [submariner-operator]$ grep -v scratch
2021-07-17T14:11:39.2961069Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-17T14:11:39.2966238Z 
2021-07-17T14:11:40.2618673Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-17T14:11:41.0952234Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-17T14:11:41.1021218Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-17T14:11:41.9516426Z buildx_builder
2021-07-17T14:11:41.9570885Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-17T14:11:42.8354013Z #1 [internal] booting buildkit
2021-07-17T14:11:42.8355466Z #1 sha256:72868aaece0c0834fc432c537dd4c9d5bff6d94abc0b34783c51e91440fa8bba
2021-07-17T14:11:42.9857037Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-17T14:11:46.6063929Z #1 pulling image moby/buildkit:buildx-stable-1 3.7s done
2021-07-17T14:11:46.6070255Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-17T14:11:47.0075604Z #1 creating container buildx_buildkit_buildx_builder0 0.5s done
2021-07-17T14:11:47.1574797Z #1 DONE 4.2s
2021-07-17T14:11:47.2596106Z
2021-07-17T14:11:47.2601266Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-17T14:11:47.2602931Z #2 sha256:fa5f082241dcfbb652c6d0c59a0c02ca7f367ca8f15b55ba76e640e725c5f5f3
2021-07-17T14:11:47.2604145Z #2 transferring dockerfile: 230B done
2021-07-17T14:11:47.2604639Z #2 DONE 0.0s
2021-07-17T14:11:47.4099427Z
2021-07-17T14:11:47.4100260Z #3 [internal] load .dockerignore
2021-07-17T14:11:47.4101538Z #3 sha256:5c4cb20a41267bce05b77351dfd094157e934446353fc724ae5b0ca6170c51a2
2021-07-17T14:11:47.4102573Z #3 transferring context: 2B done
2021-07-17T14:11:47.4103039Z #3 DONE 0.0s
2021-07-17T14:11:47.4103294Z
2021-07-17T14:11:47.4103722Z #6 [internal] load build context
2021-07-17T14:11:47.4104677Z #6 sha256:423416f0921d03ea757c0a93e9e2e8881bfbfba101209d4a705b555fe791aaa8
2021-07-17T14:11:47.4105557Z #6 DONE 0.0s
2021-07-17T14:11:47.4105796Z
2021-07-17T14:11:47.4107126Z #4 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:47.4109133Z #4 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-17T14:11:47.6944249Z #4 DONE 0.3s
2021-07-17T14:11:47.6948324Z
2021-07-17T14:11:47.6948836Z #6 [internal] load build context
2021-07-17T14:11:47.6949809Z #6 sha256:423416f0921d03ea757c0a93e9e2e8881bfbfba101209d4a705b555fe791aaa8
2021-07-17T14:11:47.9051578Z #6 transferring context: 9.94MB 0.3s done
2021-07-17T14:11:47.9053201Z #6 DONE 0.3s
2021-07-17T14:11:47.9056899Z
2021-07-17T14:11:47.9058758Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-17T14:11:47.9061010Z #5 sha256:ef81c0efb40187f35d9e0c014a12fcf945473fa1223bbd635d36657044189245
2021-07-17T14:11:47.9062111Z #5 CACHED
2021-07-17T14:11:47.9062410Z
2021-07-17T14:11:47.9062872Z #7 exporting to oci image format
2021-07-17T14:11:47.9064039Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-17T14:11:47.9065162Z #7 exporting layers done
2021-07-17T14:11:47.9066632Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-17T14:11:47.9069080Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7
2021-07-17T14:11:48.0565676Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-17T14:11:48.1738044Z #7 ...
2021-07-17T14:11:48.1747556Z
2021-07-17T14:11:48.1749304Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-17T14:11:48.1750669Z #5 sha256:ef81c0efb40187f35d9e0c014a12fcf945473fa1223bbd635d36657044189245
2021-07-17T14:11:48.1752451Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.3s done
2021-07-17T14:11:48.1753650Z #5 CACHED
2021-07-17T14:11:48.3265352Z
2021-07-17T14:11:48.3270691Z #7 exporting to oci image format
2021-07-17T14:11:48.3271915Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-17T14:11:48.3273041Z #7 sending tarball
2021-07-17T14:11:48.4686714Z #7 sending tarball 0.3s done
2021-07-17T14:11:48.4687348Z #7 DONE 0.6s
2021-07-17T14:11:48.4687652Z
2021-07-17T14:11:48.4688142Z #9 exporting cache
2021-07-17T14:11:48.4689170Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-17T14:11:48.4690446Z #9 preparing build cache for export done
2021-07-17T14:11:48.4692779Z #9 DONE 0.0s
2021-07-17T14:11:48.4694173Z
2021-07-17T14:11:48.4694665Z #8 importing to docker
2021-07-17T14:11:48.4695616Z #8 sha256:2272b61c99a220840699c87ca560e23d75dafeed21201e06df5f98e616e867d5
2021-07-17T14:11:48.4696592Z #8 DONE 0.0s
2021-07-17T14:11:48.4811328Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-17T14:11:48.7765160Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-17T14:11:48.7766808Z File 'build' does not exist.
2021-07-17T14:11:48.7767511Z File 'bin/subctl' does not exist.
2021-07-17T14:11:48.7768732Z File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-17T14:11:48.7993472Z Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-17T14:11:48.7994484Z mkdir -p bin
2021-07-17T14:11:48.8019998Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-17T14:11:48.8020816Z target=${target%.exe}; \
2021-07-17T14:11:48.8021520Z components=($(echo ${target//-/ })); \
2021-07-17T14:11:48.8022177Z GOOS=${components[-2]}; \
2021-07-17T14:11:48.8022812Z GOARCH=${components[-1]}; \
2021-07-17T14:11:48.8023538Z export GOARCH GOOS; \
2021-07-17T14:11:48.8024102Z /opt/shipyard/scripts/compile.sh \
2021-07-17T14:11:48.8025329Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-17T14:11:48.8027441Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-17T14:11:48.8029888Z --noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-17T14:11:48.8616393Z [submariner-operator]$ mkdir -p bin
2021-07-17T14:11:48.8635567Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-17T14:11:48.8651862Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-17T14:11:48.8691598Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-17T14:12:24.8401940Z Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-17T14:12:24.8403325Z Must remake target 'bin/subctl'.
2021-07-17T14:12:24.8404299Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-17T14:12:24.8436714Z Successfully remade target file 'bin/subctl'.
2021-07-17T14:12:24.8437542Z Must remake target 'build'.
2021-07-17T14:12:24.8438288Z Successfully remade target file 'build'.
2021-07-17T14:12:24.8439035Z Must remake target 'images'.
2021-07-17T14:12:24.8439809Z Successfully remade target file 'images'.
2021-07-17T14:12:24.8440619Z Must remake target 'preload-images'.
2021-07-17T14:12:24.8441258Z set -e;\
2021-07-17T14:12:24.8441750Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-17T14:12:24.8442402Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-17T14:12:24.8443892Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-17T14:12:24.8445153Z import_image quay.io/submariner/${image};\
2021-07-17T14:12:24.8445667Z done
2021-07-17T14:12:24.8480427Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-17T14:12:24.8489299Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-17T14:12:24.8503322Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-17T14:12:25.1364080Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-17T14:12:25.4169514Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-17T14:12:25.4597559Z f9269f9cee12: Preparing
2021-07-17T14:12:26.0988594Z f9269f9cee12: Pushed
2021-07-17T14:12:26.1187268Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-17T14:12:26.1228823Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-17T14:12:26.1240428Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-17T14:12:26.1249345Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-17T14:12:26.4085846Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-17T14:12:26.4111409Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-17T14:12:26.9475473Z devel: Pulling from submariner/submariner-gateway
2021-07-17T14:12:26.9478843Z 8c741e919b67: Pulling fs layer
2021-07-17T14:12:26.9479389Z 13495efbbac4: Pulling fs layer
2021-07-17T14:12:26.9479916Z 6df6df193f2d: Pulling fs layer
2021-07-17T14:12:26.9480446Z 3afbe9ee7387: Pulling fs layer
2021-07-17T14:12:26.9483007Z 3afbe9ee7387: Waiting
2021-07-17T14:12:27.0309349Z 13495efbbac4: Download complete
2021-07-17T14:12:27.2877797Z 6df6df193f2d: Verifying Checksum
2021-07-17T14:12:27.2878443Z 6df6df193f2d: Download complete
2021-07-17T14:12:27.2884664Z 3afbe9ee7387: Verifying Checksum
2021-07-17T14:12:27.2885283Z 3afbe9ee7387: Download complete
2021-07-17T14:12:27.5357743Z 8c741e919b67: Verifying Checksum
2021-07-17T14:12:27.5358369Z 8c741e919b67: Download complete
2021-07-17T14:12:30.4639156Z 8c741e919b67: Pull complete
2021-07-17T14:12:31.5690069Z 13495efbbac4: Pull complete
2021-07-17T14:12:32.6663669Z 6df6df193f2d: Pull complete
2021-07-17T14:12:32.8430224Z 3afbe9ee7387: Pull complete
2021-07-17T14:12:32.8471133Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-17T14:12:32.8486014Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-17T14:12:32.8522713Z quay.io/submariner/submariner-gateway:devel
2021-07-17T14:12:32.8592408Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-17T14:12:33.1509467Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-17T14:12:33.4427620Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-17T14:12:33.7370708Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-17T14:12:33.7378904Z 71972a942ed4: Preparing
2021-07-17T14:12:33.7440227Z 3c7f2d60eacb: Preparing
2021-07-17T14:12:33.7444832Z 00c5f6897675: Preparing
2021-07-17T14:12:33.7445946Z b3b62c837788: Preparing
2021-07-17T14:12:34.4704778Z 00c5f6897675: Pushed
2021-07-17T14:12:34.5939573Z 71972a942ed4: Pushed
2021-07-17T14:12:38.0680691Z 3c7f2d60eacb: Pushed
2021-07-17T14:12:46.5581595Z b3b62c837788: Pushed
2021-07-17T14:12:46.5780996Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-17T14:12:46.5820793Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-17T14:12:46.5834218Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-17T14:12:46.5849898Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-17T14:12:46.8881617Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-17T14:12:46.8909912Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-17T14:12:47.3786590Z devel: Pulling from submariner/submariner-route-agent
2021-07-17T14:12:47.3787424Z 8c741e919b67: Already exists
2021-07-17T14:12:47.3798431Z 13495efbbac4: Already exists
2021-07-17T14:12:47.3827084Z 70cc6422093d: Pulling fs layer
2021-07-17T14:12:47.3827665Z 7ba74d821748: Pulling fs layer
2021-07-17T14:12:47.3831200Z 62b0802bcf90: Pulling fs layer
2021-07-17T14:12:47.3831734Z 3e9c83283ee4: Pulling fs layer
2021-07-17T14:12:47.3832256Z 3e9c83283ee4: Waiting
2021-07-17T14:12:47.4558249Z 62b0802bcf90: Verifying Checksum
2021-07-17T14:12:47.4558868Z 62b0802bcf90: Download complete
2021-07-17T14:12:47.5477668Z 7ba74d821748: Verifying Checksum
2021-07-17T14:12:47.5478350Z 7ba74d821748: Download complete
2021-07-17T14:12:47.5982282Z 3e9c83283ee4: Verifying Checksum
2021-07-17T14:12:47.5982921Z 3e9c83283ee4: Download complete
2021-07-17T14:12:47.7355691Z 70cc6422093d: Verifying Checksum
2021-07-17T14:12:47.7357338Z 70cc6422093d: Download complete
2021-07-17T14:12:49.2535859Z 70cc6422093d: Pull complete
2021-07-17T14:12:49.4760200Z 7ba74d821748: Pull complete
2021-07-17T14:12:49.5598783Z 62b0802bcf90: Pull complete
2021-07-17T14:12:49.6653721Z 3e9c83283ee4: Pull complete
2021-07-17T14:12:49.6690851Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-17T14:12:49.6706235Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-17T14:12:49.6730777Z quay.io/submariner/submariner-route-agent:devel
2021-07-17T14:12:49.6744566Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-17T14:12:49.9616519Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-17T14:12:50.2568822Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-17T14:12:50.5420713Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-17T14:12:50.5475244Z 1d810a4c0610: Preparing
2021-07-17T14:12:50.5475787Z 7a86b74623fc: Preparing
2021-07-17T14:12:50.5476284Z 26de773c4486: Preparing
2021-07-17T14:12:50.5476771Z 6931e591f8e2: Preparing
2021-07-17T14:12:50.5477236Z 00c5f6897675: Preparing
2021-07-17T14:12:50.5477710Z b3b62c837788: Preparing
2021-07-17T14:12:50.5510808Z b3b62c837788: Waiting
2021-07-17T14:12:50.6814117Z 00c5f6897675: Mounted from submariner-gateway
2021-07-17T14:12:51.2480223Z 1d810a4c0610: Pushed
2021-07-17T14:12:51.2582648Z 7a86b74623fc: Pushed
2021-07-17T14:12:51.2584625Z b3b62c837788: Mounted from submariner-gateway
2021-07-17T14:12:51.2688650Z 26de773c4486: Pushed
2021-07-17T14:12:55.4069043Z 6931e591f8e2: Pushed
2021-07-17T14:12:55.4372941Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-17T14:12:55.4411531Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-17T14:12:55.4426965Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-17T14:12:55.4440150Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-17T14:12:55.7268517Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-17T14:12:55.7288587Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-17T14:12:56.2184307Z devel: Pulling from submariner/lighthouse-agent
2021-07-17T14:12:56.2185048Z ecd69139dc76: Pulling fs layer
2021-07-17T14:12:56.2185573Z 8261c1767de3: Pulling fs layer
2021-07-17T14:12:56.2797485Z ecd69139dc76: Verifying Checksum
2021-07-17T14:12:56.2798239Z ecd69139dc76: Download complete
2021-07-17T14:12:56.3322421Z 8261c1767de3: Verifying Checksum
2021-07-17T14:12:56.3323148Z 8261c1767de3: Download complete
2021-07-17T14:12:56.3749157Z ecd69139dc76: Pull complete
2021-07-17T14:12:56.5519800Z 8261c1767de3: Pull complete
2021-07-17T14:12:56.5556422Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-17T14:12:56.5577965Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-17T14:12:56.5599492Z quay.io/submariner/lighthouse-agent:devel
2021-07-17T14:12:56.5710471Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-17T14:12:56.8868535Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-17T14:12:57.1767380Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-17T14:12:57.4749009Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-17T14:12:57.4790527Z 83c79e393e11: Preparing
2021-07-17T14:12:57.4791407Z 0026d2f62bbf: Preparing
2021-07-17T14:12:57.5499218Z 0026d2f62bbf: Pushed
2021-07-17T14:12:58.0625236Z 83c79e393e11: Pushed
2021-07-17T14:12:58.0824967Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-17T14:12:58.0871463Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-17T14:12:58.0895463Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-17T14:12:58.0910833Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-17T14:12:58.3711226Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-17T14:12:58.3738821Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-17T14:12:58.8529007Z devel: Pulling from submariner/lighthouse-coredns
2021-07-17T14:12:58.8529759Z 088e56360f76: Pulling fs layer
2021-07-17T14:12:58.8530313Z 18aed70882d2: Pulling fs layer
2021-07-17T14:12:58.9101003Z 088e56360f76: Verifying Checksum
2021-07-17T14:12:58.9102813Z 088e56360f76: Download complete
2021-07-17T14:12:59.0321822Z 088e56360f76: Pull complete
2021-07-17T14:12:59.0328789Z 18aed70882d2: Verifying Checksum
2021-07-17T14:12:59.0329431Z 18aed70882d2: Download complete
2021-07-17T14:12:59.2611261Z 18aed70882d2: Pull complete
2021-07-17T14:12:59.2693927Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-17T14:12:59.2712648Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-17T14:12:59.2734857Z quay.io/submariner/lighthouse-coredns:devel
2021-07-17T14:12:59.2749613Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-17T14:12:59.5809892Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-17T14:12:59.8734597Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-17T14:13:00.1591461Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-17T14:13:00.1655297Z 7fca351e51be: Preparing
2021-07-17T14:13:00.1655885Z 4fa0ece06e25: Preparing
2021-07-17T14:13:00.2277487Z 4fa0ece06e25: Pushed
2021-07-17T14:13:00.9696907Z 7fca351e51be: Pushed
2021-07-17T14:13:01.0003919Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-17T14:13:01.0037210Z Successfully remade target file 'preload-images'.
2021-07-17T14:13:01.0038261Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-17T14:13:01.0039319Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-17T14:13:01.0040366Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-17T14:13:01.0041147Z Must remake target 'deploy'.
2021-07-17T14:13:01.0043034Z /opt/shipyard/scripts/deploy.sh --cable_driver libreswan --service_discovery --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --deploytool_broker_args '--service-discovery'
2021-07-17T14:13:01.1203649Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='--service-discovery', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=true
2021-07-17T14:13:01.1235791Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T14:13:01.1260404Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:13:01.1276550Z [submariner-operator]$ script_name=utils
2021-07-17T14:13:01.1294192Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T14:13:01.1317803Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-17T14:13:01.1334906Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:13:01.1351051Z [submariner-operator]$ script_name=deploy_funcs
2021-07-17T14:13:01.1377773Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T14:13:01.1402019Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T14:13:01.1423431Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:13:01.1437075Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T14:13:01.1452867Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T14:13:01.1480036Z [submariner-operator]$ broker=cluster1
2021-07-17T14:13:01.1675277Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T14:13:01.1676752Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T14:13:01.1678065Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T14:13:01.1679339Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T14:13:01.1681440Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T14:13:01.1682670Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T14:13:01.1683721Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T14:13:01.1684729Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T14:13:01.1685867Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T14:13:01.1686917Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T14:13:01.1702569Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T14:13:01.1717587Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T14:13:01.1728490Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:13:01.1741307Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T14:13:01.1754687Z [submariner-operator]$ exec_name=deploy.sh
2021-07-17T14:13:01.1773375Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T14:13:01.1787282Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T14:13:01.1825009Z [submariner-operator]$ declare_cidrs
2021-07-17T14:13:01.1839116Z [submariner-operator]$ declare_cidrs
2021-07-17T14:13:01.1851261Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T14:13:01.1863890Z [submariner-operator]$ i=1
2021-07-17T14:13:01.1877642Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T14:13:01.1891593Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T14:13:01.1907730Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T14:13:01.1921698Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T14:13:01.1934784Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T14:13:01.1951581Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T14:13:01.1968783Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T14:13:01.1985121Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T14:13:01.1999232Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T14:13:01.2012264Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T14:13:01.2025667Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-17T14:13:01.2040904Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-17T14:13:01.2056551Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-17T14:13:01.2077455Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-17T14:13:01.2090178Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-17T14:13:01.2112319Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-17T14:13:01.2152346Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-17T14:13:01.3285394Z Installing subctl version devel
2021-07-17T14:13:01.3290316Z OS detected: linux
2021-07-17T14:13:01.3294790Z Architecture detected: amd64
2021-07-17T14:13:01.3300196Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-17T14:13:01.3306560Z
2021-07-17T14:13:01.3307128Z Downloading...
2021-07-17T14:13:02.4866906Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-17T14:13:02.5066373Z This provides subctl version: devel
2021-07-17T14:13:02.5087261Z
2021-07-17T14:13:02.5088064Z please update your path (and consider adding it to ~/.profile):
2021-07-17T14:13:02.5088716Z export PATH=$PATH:/go/bin
2021-07-17T14:13:02.5089138Z
2021-07-17T14:13:02.5204667Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-17T14:13:02.5221551Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-17T14:13:02.5233922Z Will deploy submariner using operator
2021-07-17T14:13:02.5262644Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-17T14:13:02.5280390Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:13:02.5293940Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-17T14:13:02.5310924Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-17T14:13:02.5333444Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-17T14:13:02.5349818Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-17T14:13:02.5365879Z 
2021-07-17T14:13:02.5380942Z [submariner-operator]$ [cluster2] subctl version
2021-07-17T14:13:02.5618153Z subctl version: devel-0105e4d
2021-07-17T14:13:02.5649266Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-17T14:13:02.5664548Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-17T14:13:02.5680028Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-17T14:13:02.5697359Z [submariner-operator]$ [cluster2] grep -q function
2021-07-17T14:13:02.5737739Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:13:02.5759332Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-17T14:13:02.5772342Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-17T14:13:02.5784975Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T14:13:02.5819440Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-17T14:13:02.5841828Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-17T14:13:02.5858870Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T14:13:02.5878614Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T14:13:02.5903319Z [submariner-operator]$ [cluster1] pids[cluster1]=7187
2021-07-17T14:13:02.5907287Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T14:13:02.5922640Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-17T14:13:02.5927535Z [submariner-operator]$ [cluster2] pids[cluster2]=7190
2021-07-17T14:13:02.5945355Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T14:13:02.5959208Z [submariner-operator]$ [cluster2] wait 7190
2021-07-17T14:13:02.6017793Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T14:13:02.6034924Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-17T14:13:02.6058986Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T14:13:03.0187142Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-17T14:13:03.0188735Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-17T14:13:03.0189801Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-17T14:13:03.0191260Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T14:13:03.0192932Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T14:13:03.0194781Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-17T14:13:03.0196112Z [cluster1] node/cluster1-worker labeled
2021-07-17T14:13:03.0244618Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-17T14:13:03.0246061Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-17T14:13:03.0247156Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-17T14:13:03.0248626Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T14:13:03.0250507Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T14:13:03.0252310Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-17T14:13:03.0253854Z [cluster2] node/cluster2-worker labeled
2021-07-17T14:13:03.0282137Z [submariner-operator]$ [cluster2] wait 7187
2021-07-17T14:13:03.0300387Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-17T14:13:03.0315294Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-17T14:13:03.0332659Z [submariner-operator]$ [cluster1] setup_broker
2021-07-17T14:13:03.0347046Z [submariner-operator]$ [cluster1] setup_broker
2021-07-17T14:13:03.0365128Z [submariner-operator]$ [cluster1] sd=--components service-discovery,connectivity
2021-07-17T14:13:03.0366694Z Installing broker...
2021-07-17T14:13:03.0381672Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-17T14:13:03.0395907Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-17T14:13:03.0417326Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-17T14:13:03.0437687Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local --components service-discovery,connectivity --service-discovery
2021-07-17T14:13:03.0638771Z Flag --service-discovery has been deprecated, please use --components instead
2021-07-17T14:13:03.0667634Z • Setting up broker RBAC ...
2021-07-17T14:13:03.1524767Z ✓ Setting up broker RBAC
2021-07-17T14:13:03.1525571Z • Deploying the Submariner operator ...
2021-07-17T14:13:14.4524399Z ✓ Deploying the Submariner operator
2021-07-17T14:13:14.4525192Z ✓ Created operator CRDs
2021-07-17T14:13:14.4526064Z ✓ Created operator namespace: submariner-operator
2021-07-17T14:13:14.4526982Z ✓ Created operator service account and role
2021-07-17T14:13:14.4527822Z ✓ Created lighthouse service account and role
2021-07-17T14:13:14.4528681Z ✓ Created Lighthouse service accounts and roles
2021-07-17T14:13:14.4529621Z ✓ Deployed the operator successfully
2021-07-17T14:13:14.4530334Z • Deploying the broker ...
2021-07-17T14:13:14.4605189Z ✓ Deploying the broker
2021-07-17T14:13:14.4605904Z ✓ The broker has been deployed
2021-07-17T14:13:14.4606673Z • Creating broker-info.subm file ...
2021-07-17T14:13:14.4737356Z ✓ Creating broker-info.subm file
2021-07-17T14:13:14.4741916Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-17T14:13:14.4795479Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-17T14:13:14.4807040Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-17T14:13:14.4818601Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-17T14:13:14.4829940Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-17T14:13:14.4841922Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T14:13:14.4874841Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-17T14:13:14.4886424Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-17T14:13:14.4898460Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T14:13:14.4915806Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T14:13:14.4935181Z [submariner-operator]$ [cluster1] pids[cluster1]=7252
2021-07-17T14:13:14.4970101Z [submariner-operator]$ [cluster2] pids[cluster2]=7254
2021-07-17T14:13:14.4981880Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T14:13:14.4999476Z [submariner-operator]$ [cluster2] wait 7254
2021-07-17T14:13:14.5003430Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T14:13:14.5015349Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-17T14:13:14.5030207Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-17T14:13:14.5046656Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T14:13:14.5066235Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T14:13:21.8984821Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-17T14:13:21.8986486Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-17T14:13:21.8988109Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-17T14:13:21.8989582Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-17T14:13:21.8992906Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-17T14:13:21.8996308Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-17T14:13:21.8997647Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-17T14:13:21.8998594Z [cluster1] - cluster1-worker
2021-07-17T14:13:21.8999576Z [cluster1] • Discovering network details ...
2021-07-17T14:13:21.9000536Z [cluster1] Network plugin: weave-net
2021-07-17T14:13:21.9001363Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-17T14:13:21.9002391Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-17T14:13:21.9003323Z [cluster1] ✓ Discovering network details
2021-07-17T14:13:21.9004333Z [cluster1] • Discovering multi cluster details ...
2021-07-17T14:13:21.9005384Z [cluster1] • Validating Globalnet configurations ...
2021-07-17T14:13:21.9006483Z [cluster1] ✓ Validating Globalnet configurations
2021-07-17T14:13:21.9007530Z [cluster1] ✓ Discovering multi cluster details
2021-07-17T14:13:21.9008990Z [cluster1] • Deploying the Submariner operator ...
2021-07-17T14:13:21.9009902Z [cluster1] ✓ Deploying the Submariner operator
2021-07-17T14:13:21.9011816Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-17T14:13:21.9012677Z [cluster1] • Creating SA for cluster ...
2021-07-17T14:13:21.9013436Z [cluster1] ✓ Creating SA for cluster
2021-07-17T14:13:21.9014176Z [cluster1] • Deploying Submariner ...
2021-07-17T14:13:21.9015179Z [cluster1] ✓ Deploying Submariner
2021-07-17T14:13:21.9015964Z [cluster1] ✓ Submariner is up and running
2021-07-17T14:13:27.3971947Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-17T14:13:27.3973157Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-17T14:13:27.3974446Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-17T14:13:27.3975678Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-17T14:13:27.3978881Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-17T14:13:27.3982137Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-17T14:13:27.3983333Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-17T14:13:27.3984152Z [cluster2] - cluster2-worker
2021-07-17T14:13:27.3984981Z [cluster2] • Discovering network details ...
2021-07-17T14:13:27.3985784Z [cluster2] Network plugin: weave-net
2021-07-17T14:13:27.3986397Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-17T14:13:27.3986953Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-17T14:13:27.3988209Z [cluster2] ✓ Discovering network details
2021-07-17T14:13:27.3989080Z [cluster2] • Discovering multi cluster details ...
2021-07-17T14:13:27.3990008Z [cluster2] • Validating Globalnet configurations ...
2021-07-17T14:13:27.3990934Z [cluster2] ✓ Validating Globalnet configurations
2021-07-17T14:13:27.3991832Z [cluster2] ✓ Discovering multi cluster details
2021-07-17T14:13:27.3992717Z [cluster2] • Deploying the Submariner operator ...
2021-07-17T14:13:27.3993616Z [cluster2] ✓ Deploying the Submariner operator
2021-07-17T14:13:27.3994423Z [cluster2] ✓ Created operator CRDs
2021-07-17T14:13:27.3995370Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-17T14:13:27.3996394Z [cluster2] ✓ Created operator service account and role
2021-07-17T14:13:27.3997320Z [cluster2] ✓ Created lighthouse service account and role
2021-07-17T14:13:27.3998285Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-17T14:13:27.3999200Z [cluster2] ✓ Deployed the operator successfully
2021-07-17T14:13:27.4000052Z [cluster2] • Creating SA for cluster ...
2021-07-17T14:13:27.4000792Z [cluster2] ✓ Creating SA for cluster
2021-07-17T14:13:27.4001531Z [cluster2] • Deploying Submariner ...
2021-07-17T14:13:27.4002291Z [cluster2] ✓ Deploying Submariner
2021-07-17T14:13:27.4003045Z [cluster2] ✓ Submariner is up and running
2021-07-17T14:13:27.4039847Z [submariner-operator]$ [cluster2] wait 7252
2021-07-17T14:13:27.4084215Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-17T14:13:27.4099892Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-17T14:13:27.4195920Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-17T14:13:27.4259939Z [submariner-operator]$ [cluster2] with_retries
2021-07-17T14:13:27.4287755Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T14:13:27.4330589Z [submariner-operator]$ [cluster2] wait 7296
2021-07-17T14:13:27.4348835Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:27.4364203Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:27.4378960Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:13:27.4394166Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:27.4412926Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:13:27.8595893Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:27.8637239Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:13:28.0753036Z • Showing Connections ...
2021-07-17T14:13:28.0839647Z ✗ Showing Connections
2021-07-17T14:13:28.0845218Z ✗ There are no gateways detected
2021-07-17T14:13:28.2517850Z • Showing Connections ...
2021-07-17T14:13:28.2600214Z panic: runtime error: invalid memory address or nil pointer dereference
2021-07-17T14:13:28.2619790Z [signal SIGSEGV: segmentation violation code=0x1 addr=0x60 pc=0x1a02ca9]
2021-07-17T14:13:28.2623979Z
2021-07-17T14:13:28.2632032Z goroutine 1 [running]:
2021-07-17T14:13:28.2664442Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.getConnectionsStatus(0xc0002dcdc0, 0xc000111450)
2021-07-17T14:13:28.2666104Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:65 +0x89
2021-07-17T14:13:28.2667741Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.showConnections(0xc0002dcdc0, 0xc00029bbf0)
2021-07-17T14:13:28.2669563Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:132 +0x3f
2021-07-17T14:13:28.2671229Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd.ExecuteMultiCluster(0x1fe2f30)
2021-07-17T14:13:28.2672743Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/execute.go:103 +0x1a7
2021-07-17T14:13:28.2674205Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.init.1.func1(0xc000606840, 0x30541c8, 0x0, 0x0)
2021-07-17T14:13:28.2675929Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:49 +0x2d
2021-07-17T14:13:28.2676994Z github.com/spf13/cobra.(*Command).execute(0xc000606840, 0x30541c8, 0x0, 0x0, 0xc000606840, 0x30541c8)
2021-07-17T14:13:28.2677789Z github.com/spf13/[email protected]/command.go:863 +0x2c2
2021-07-17T14:13:28.2678557Z github.com/spf13/cobra.(*Command).ExecuteC(0x2ff79a0, 0x30256c0, 0x0, 0xc000062778)
2021-07-17T14:13:28.2679329Z github.com/spf13/[email protected]/command.go:977 +0x375
2021-07-17T14:13:28.2680007Z github.com/spf13/cobra.(*Command).Execute(...)
2021-07-17T14:13:28.2680647Z github.com/spf13/[email protected]/command.go:905
2021-07-17T14:13:28.2681716Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd.Execute(...)
2021-07-17T14:13:28.2682969Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/root.go:58
2021-07-17T14:13:28.2683703Z main.main()
2021-07-17T14:13:28.2684436Z command-line-arguments/main.go:31 +0x32
2021-07-17T14:13:28.2694485Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-17T14:13:28.2711649Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T14:13:34.2787613Z [submariner-operator]$ [cluster2] return 1
2021-07-17T14:13:34.2888672Z [submariner-operator]$ [cluster2] wait 7323
2021-07-17T14:13:34.2902464Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:34.2918065Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:34.2933018Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:13:34.2960128Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:34.2979275Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:13:34.7337881Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:34.7353171Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:13:35.4655528Z • Showing Connections ...
2021-07-17T14:13:35.4807668Z ✗ Showing Connections
2021-07-17T14:13:35.4808565Z ✗ There are no gateways detected
2021-07-17T14:13:35.5620104Z • Showing Connections ...
2021-07-17T14:13:35.5943483Z ✗ Showing Connections
2021-07-17T14:13:35.5944319Z ✗ There are no gateways detected
2021-07-17T14:13:35.5965399Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-17T14:13:35.5981349Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T14:13:41.6010462Z [submariner-operator]$ [cluster2] return 1
2021-07-17T14:13:41.6076579Z [submariner-operator]$ [cluster2] wait 7351
2021-07-17T14:13:41.6083952Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:41.6186453Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:41.6234474Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:13:41.6375589Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:41.6400941Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:13:42.6333502Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:42.6349697Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:13:43.5313827Z • Showing Connections ...
2021-07-17T14:13:43.8695368Z ✗ Showing Connections
2021-07-17T14:13:43.8696125Z ✗ There are no gateways detected
2021-07-17T14:13:44.1494182Z • Showing Connections ...
2021-07-17T14:13:44.4233645Z ✗ Showing Connections
2021-07-17T14:13:44.4240528Z ✗ There are no gateways detected
2021-07-17T14:13:44.4269486Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-17T14:13:44.4283697Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T14:13:50.4311500Z [submariner-operator]$ [cluster2] return 1
2021-07-17T14:13:50.4374555Z [submariner-operator]$ [cluster2] wait 7378
2021-07-17T14:13:50.4386778Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:50.4412401Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:50.4588988Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:13:50.4613600Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:50.4629154Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:13:51.0603756Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:51.0648669Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:13:51.2837050Z • Showing Connections ...
2021-07-17T14:13:51.3153811Z ✗ Showing Connections
2021-07-17T14:13:51.3154558Z ✗ There are no gateways detected
2021-07-17T14:13:51.3801786Z • Showing Connections ...
2021-07-17T14:13:51.4002404Z ✗ Showing Connections
2021-07-17T14:13:51.4003151Z ✗ There are no gateways detected
2021-07-17T14:13:51.4024769Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-17T14:13:51.4039010Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T14:13:57.4098051Z [submariner-operator]$ [cluster2] return 1
2021-07-17T14:13:57.4212340Z [submariner-operator]$ [cluster2] wait 7405
2021-07-17T14:13:57.4247442Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:57.4275471Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:13:57.4314467Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:13:57.4351199Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:57.4385866Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:13:57.9680614Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:13:57.9693525Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:13:58.0476967Z • Showing Connections ...
2021-07-17T14:13:58.0528899Z ✗ Showing Connections
2021-07-17T14:13:58.0529612Z ✗ No connections found
2021-07-17T14:13:58.0842258Z • Showing Connections ...
2021-07-17T14:13:58.0864734Z ✗ Showing Connections
2021-07-17T14:13:58.0870305Z ✗ There are no gateways detected
2021-07-17T14:13:58.0908550Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-17T14:13:58.0925298Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T14:14:04.0955946Z [submariner-operator]$ [cluster2] return 1
2021-07-17T14:14:04.1014272Z [submariner-operator]$ [cluster2] wait 7432
2021-07-17T14:14:04.1022176Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:14:04.1033630Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:14:04.1080283Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:14:04.1114481Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:14:04.1143705Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:14:04.2714446Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:14:04.2746889Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:14:04.3993830Z • Showing Connections ...
2021-07-17T14:14:04.4135128Z ✗ Showing Connections
2021-07-17T14:14:04.4135910Z ✗ No connections found
2021-07-17T14:14:04.4167423Z • Showing Connections ...
2021-07-17T14:14:04.4217574Z ✗ Showing Connections
2021-07-17T14:14:04.4218348Z ✗ No connections found
2021-07-17T14:14:04.4247493Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-17T14:14:04.4263007Z [submariner-operator]$ [cluster2] sleep 6
2021-07-17T14:14:10.4291069Z [submariner-operator]$ [cluster2] return 1
2021-07-17T14:14:10.4333467Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:14:10.4339392Z [submariner-operator]$ [cluster2] wait 7459
2021-07-17T14:14:10.4348450Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-17T14:14:10.4361677Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-17T14:14:10.4376328Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:14:10.4391021Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-17T14:14:10.5009911Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-17T14:14:10.5023495Z [submariner-operator]$ [cluster2] grep connected
2021-07-17T14:14:10.5482389Z • Showing Connections ...
2021-07-17T14:14:10.5521247Z ✓ Showing Connections
2021-07-17T14:14:10.5614280Z • Showing Connections ...
2021-07-17T14:14:10.5643556Z ✓ Showing Connections
2021-07-17T14:14:10.5670154Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 201.414µs
2021-07-17T14:14:10.5671388Z cluster1-worker cluster1 172.18.0.4 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 0s
2021-07-17T14:14:10.5689791Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:10.5707422Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:10.5724704Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-17T14:14:10.5736763Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-17T14:14:10.5754527Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-17T14:14:10.5768793Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-17T14:14:10.5783081Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-17T14:14:10.5800931Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-17T14:14:10.5840702Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-17T14:14:10.5858604Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-17T14:14:10.8973683Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-17T14:14:10.9033622Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-17T14:14:11.4221918Z devel: Pulling from submariner/nettest
2021-07-17T14:14:11.4224457Z 5843afab3874: Already exists
2021-07-17T14:14:11.4245008Z 9565bb92f43f: Pulling fs layer
2021-07-17T14:14:11.4245953Z a31c0d5b4ad6: Pulling fs layer
2021-07-17T14:14:11.4250616Z dc3d13650205: Pulling fs layer
2021-07-17T14:14:11.4917635Z 9565bb92f43f: Download complete
2021-07-17T14:14:11.5059938Z dc3d13650205: Verifying Checksum
2021-07-17T14:14:11.5062157Z dc3d13650205: Download complete
2021-07-17T14:14:11.5467747Z a31c0d5b4ad6: Verifying Checksum
2021-07-17T14:14:11.5468966Z a31c0d5b4ad6: Download complete
2021-07-17T14:14:11.6886577Z 9565bb92f43f: Pull complete
2021-07-17T14:14:12.0216073Z a31c0d5b4ad6: Pull complete
2021-07-17T14:14:12.1089309Z dc3d13650205: Pull complete
2021-07-17T14:14:12.1127187Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-17T14:14:12.1142003Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-17T14:14:12.1209750Z quay.io/submariner/nettest:devel
2021-07-17T14:14:12.1279480Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-17T14:14:12.4328591Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-17T14:14:12.7577743Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-17T14:14:13.0814428Z The push refers to repository [localhost:5000/nettest]
2021-07-17T14:14:13.1032003Z 4f2cdf68c81d: Preparing
2021-07-17T14:14:13.1032942Z 1f803d62c8b3: Preparing
2021-07-17T14:14:13.1033457Z 80c9eaab4c9e: Preparing
2021-07-17T14:14:13.1033960Z 72e830a4dff5: Preparing
2021-07-17T14:14:13.7911158Z 80c9eaab4c9e: Pushed
2021-07-17T14:14:13.7911846Z 4f2cdf68c81d: Pushed
2021-07-17T14:14:13.8496829Z 72e830a4dff5: Pushed
2021-07-17T14:14:14.4507634Z 1f803d62c8b3: Pushed
2021-07-17T14:14:14.4702109Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-17T14:14:14.4789539Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:14.4803904Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:14.4818397Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-17T14:14:14.4839048Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-17T14:14:14.4866079Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:14.4883000Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:14.4898940Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:15.0149389Z deployment.apps/netshoot created
2021-07-17T14:14:15.0211051Z Waiting for netshoot pods to be ready.
2021-07-17T14:14:15.0233737Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-17T14:14:15.0252939Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-17T14:14:15.0269658Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-17T14:14:15.4126070Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-17T14:14:16.4535389Z deployment "netshoot" successfully rolled out
2021-07-17T14:14:16.4590311Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:16.4605637Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:16.4621385Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:16.4637769Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-17T14:14:16.4700411Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-17T14:14:16.4726724Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-17T14:14:16.4750730Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:16.4764588Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:16.4783327Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:17.3351343Z deployment.apps/nginx-demo created
2021-07-17T14:14:17.4013211Z service/nginx-demo created
2021-07-17T14:14:17.5124147Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-17T14:14:17.5202600Z Waiting for nginx-demo pods to be ready.
2021-07-17T14:14:17.5220465Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-17T14:14:17.5252269Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-17T14:14:17.5272328Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-17T14:14:17.9328427Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-17T14:14:24.0070491Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-17T14:14:24.4385311Z deployment "nginx-demo" successfully rolled out
2021-07-17T14:14:24.4438511Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-17T14:14:24.4466774Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-17T14:14:24.4522805Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-17T14:14:24.4564575Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-17T14:14:24.4581142Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-17T14:14:24.8432720Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-17T14:14:24.8449005Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-17T14:14:24.8466933Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-17T14:14:24.8485121Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-17T14:14:24.8499219Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-17T14:14:24.8517657Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-17T14:14:24.8537568Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T14:14:24.8557733Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T14:14:24.8563303Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-17T14:14:24.8586470Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-17T14:14:25.1707328Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-789f6cf54f-vtql8 100.1.74.255
2021-07-17T14:14:25.1720913Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-789f6cf54f-vtql8 100.1.74.255
2021-07-17T14:14:25.1738121Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T14:14:25.1777693Z [submariner-operator]$ [cluster2] wait 7612
2021-07-17T14:14:25.1779129Z [submariner-operator]$ [cluster2] test_connection netshoot-789f6cf54f-vtql8 100.1.74.255
2021-07-17T14:14:25.1791861Z [submariner-operator]$ [cluster2] test_connection
2021-07-17T14:14:25.1797335Z Attempting connectivity between clusters - netshoot-789f6cf54f-vtql8 --> 100.1.74.255
2021-07-17T14:14:25.1809657Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-17T14:14:25.1822877Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-17T14:14:25.1841987Z [submariner-operator]$ [cluster2] date +%s
2021-07-17T14:14:25.1888586Z [submariner-operator]$ [cluster2] kubectl exec netshoot-789f6cf54f-vtql8 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.74.255
2021-07-17T14:14:25.1901521Z [submariner-operator]$ [cluster2] kubectl exec netshoot-789f6cf54f-vtql8 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.74.255
2021-07-17T14:14:25.1915667Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-789f6cf54f-vtql8 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.74.255
2021-07-17T14:14:25.6542456Z Connection test was successful!
2021-07-17T14:14:25.6558261Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:25.6572015Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:25.6585041Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:25.6602522Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:25.6618256Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:25.6634787Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-17T14:14:26.0036420Z deployment.apps "netshoot" deleted
2021-07-17T14:14:26.0116941Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:26.0132194Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:26.0179592Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:26.0200749Z [submariner-operator]$ [cluster1] remove_resource
2021-07-17T14:14:26.0215080Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:26.0249063Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:26.0269185Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-17T14:14:26.3631384Z deployment.apps "nginx-demo" deleted
2021-07-17T14:14:26.5279735Z service "nginx-demo" deleted
2021-07-17T14:14:26.5541635Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-17T14:14:26.5786739Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-17T14:14:26.5803382Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-17T14:14:26.5826546Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-17T14:14:26.5900376Z [submariner-operator]$ [cluster2] grep -q function
2021-07-17T14:14:26.5950048Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:26.5957805Z Successfully remade target file 'deploy'.
2021-07-17T14:14:26.5959696Z Must remake target 'e2e'.
2021-07-17T14:14:26.5960423Z scripts/kind-e2e/e2e.sh
2021-07-17T14:14:26.6026707Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-17T14:14:26.6045726Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:14:26.6058947Z [submariner-operator]$ script_name=utils
2021-07-17T14:14:26.6072120Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T14:14:26.6093251Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-17T14:14:26.6106953Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:14:26.6120594Z [submariner-operator]$ script_name=deploy_funcs
2021-07-17T14:14:26.6133812Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T14:14:26.6171606Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-17T14:14:26.6318773Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:14:26.6334045Z [submariner-operator]$ script_name=deploy_operator
2021-07-17T14:14:26.6349607Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T14:14:26.6371795Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-17T14:14:26.6394685Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:14:26.6409625Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T14:14:26.6424935Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T14:14:26.6457127Z [submariner-operator]$ broker=cluster1
2021-07-17T14:14:26.6476976Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-17T14:14:26.6493063Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-17T14:14:26.6509400Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-17T14:14:26.6525564Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-17T14:14:26.6541476Z [submariner-operator]$ declare -gA cluster_subm
2021-07-17T14:14:26.6558255Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-17T14:14:26.6574351Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-17T14:14:26.6590064Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-17T14:14:26.6605067Z [submariner-operator]$ declare -gA cluster_cni
2021-07-17T14:14:26.6621451Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-17T14:14:26.6636888Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-17T14:14:26.6676379Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-17T14:14:26.6690636Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-17T14:14:26.6701537Z [submariner-operator]$ script_name=cluster_settings
2021-07-17T14:14:26.6714018Z [submariner-operator]$ exec_name=e2e.sh
2021-07-17T14:14:26.6735411Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-17T14:14:26.6751838Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-17T14:14:26.6792519Z [submariner-operator]$ lighthouse=true
2021-07-17T14:14:26.6809650Z [submariner-operator]$ timeout=2m
2021-07-17T14:14:26.6822188Z [submariner-operator]$ declare_kubeconfig
2021-07-17T14:14:26.6869207Z [submariner-operator]$ declare_kubeconfig
2021-07-17T14:14:26.6884776Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-17T14:14:26.6903474Z [submariner-operator]$ export KUBECONFIG
2021-07-17T14:14:26.6918404Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-17T14:14:26.6936942Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-17T14:14:26.6971055Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-17T14:14:26.7000040Z [submariner-operator]$ create_subm_vars
2021-07-17T14:14:26.7012981Z [submariner-operator]$ create_subm_vars
2021-07-17T14:14:26.7026543Z [submariner-operator]$ deployment_name=submariner
2021-07-17T14:14:26.7038564Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-17T14:14:26.7049069Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-17T14:14:26.7063657Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-17T14:14:26.7076479Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-17T14:14:26.7090855Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-17T14:14:26.7104769Z [submariner-operator]$ declare_cidrs
2021-07-17T14:14:26.7117512Z [submariner-operator]$ declare_cidrs
2021-07-17T14:14:26.7131302Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-17T14:14:26.7145200Z [submariner-operator]$ i=1
2021-07-17T14:14:26.7164318Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T14:14:26.7179201Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-17T14:14:26.7193652Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-17T14:14:26.7205114Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-17T14:14:26.7220239Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-17T14:14:26.7245130Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T14:14:26.7258826Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-17T14:14:26.7278369Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-17T14:14:26.7290109Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-17T14:14:26.7316005Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-17T14:14:26.7330572Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-17T14:14:26.7344604Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-17T14:14:26.7359820Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-17T14:14:26.7391709Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-17T14:14:26.7408782Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-17T14:14:26.7420000Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-17T14:14:26.7431202Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-17T14:14:26.7444933Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-17T14:14:26.7455676Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-17T14:14:26.7468852Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-17T14:14:26.7481778Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-17T14:14:26.7494050Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-17T14:14:26.7506219Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-17T14:14:26.7518556Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-17T14:14:26.7534276Z [submariner-operator]$ [cluster1] broker_vars
2021-07-17T14:14:26.7545816Z [submariner-operator]$ [cluster1] broker_vars
2021-07-17T14:14:26.7559020Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-17T14:14:26.7581920Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-17T14:14:26.7594056Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-17T14:14:26.7617477Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-17T14:14:27.2128609Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-17T14:14:27.2150240Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-17T14:14:27.2164894Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-17T14:14:27.2179274Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-17T14:14:27.5904770Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-17T14:14:27.5925008Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-17T14:14:27.5945162Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-17T14:14:27.5951523Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-17T14:14:27.5970730Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-17T14:14:27.9118648Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-17T14:14:27.9132906Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-17T14:14:27.9150532Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-17T14:14:27.9164975Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-17T14:14:27.9755252Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:28.0832192Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:28.1355663Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-17T14:14:28.1357116Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-17T14:14:28.1359262Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-17T14:14:28.1360505Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-17T14:14:28.1361772Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-17T14:14:28.1363333Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-17T14:14:28.3111574Z [submariner-operator]$ [cluster1] return
2021-07-17T14:14:28.3126053Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-17T14:14:28.3138307Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-17T14:14:28.3154162Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-17T14:14:28.6411063Z NAME TYPE DATA AGE
2021-07-17T14:14:28.6412827Z cluster-cluster1-token-m278t kubernetes.io/service-account-token 3 67s
2021-07-17T14:14:28.6414493Z cluster-cluster2-token-9cxwn kubernetes.io/service-account-token 3 62s
2021-07-17T14:14:28.6415984Z default-token-6mgrw kubernetes.io/service-account-token 3 85s
2021-07-17T14:14:28.6418148Z submariner-k8s-broker-admin-token-4p2kw kubernetes.io/service-account-token 3 85s
2021-07-17T14:14:28.6420654Z submariner-k8s-broker-client-token-zpr47 kubernetes.io/service-account-token 3 85s
2021-07-17T14:14:28.6463987Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-17T14:14:28.6477203Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-17T14:14:28.6506544Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-17T14:14:28.9581723Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:28.9608441Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-zpr47 -n submariner-k8s-broker -o json
2021-07-17T14:14:28.9616475Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:28.9649915Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-zpr47 -n submariner-k8s-broker -o json
2021-07-17T14:14:28.9669449Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-zpr47 -n submariner-k8s-broker -o json
2021-07-17T14:14:29.2561710Z {
2021-07-17T14:14:29.2562331Z "apiVersion": "v1",
2021-07-17T14:14:29.2562744Z "data": {
2021-07-17T14:14:29.3262872Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-17T14:14:29.3881921Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-17T14:14:29.4543741Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNkltTlJkMW8yVTNwVGFFaFBXWE5RVFUxRFNGWkJkVFpOTURaNE9HbENTVWxsUmt3d1lWaDFjMHBUY0hjaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxNmNISTBOeUlzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pTkRZMVlqTmpNV010Wm1abE9DMDBaVFUzTFRreE5qWXRPRGcwTnpneVpHRXhNVEpsSWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLmZSdTRUbDJpYmNkYkVpVzJvUE82N25SeUtabHkzVUMzcGVhSzg1SEJpdHJ6SWZzTHg2ejE2V3dhYkZIN0VFdmFXSWowd1hGRHVhTDJuZnk4dDVCY1lvd1BPMWFvaEg4ZjVmZ0w5ZVM5SHg1UHBVbVVqUVBpQy1ObWRfODROVDY1aXlFVG42ODJyMFppYjVfMkFVZVFRV1NBaGZQWTlqR3BJcE9GNE12QkJOZTNUOGFMSDN4QUZyLVZabTA4ODFhUHJ5QnlnYkdFRUd2QXl2RjFoa0xNa1MxRFVJNTR0dkttbEtyQ1JHNjdhcUdzcHBUNjBpSEd5RjRGRmI2OG5vQWcyUFdlWWRCZ1JrWDNEWHYya1RHdUI0b1hxdVVQX1dYZnQ0YkNPZFlJTjFMTTVGQi1mNTREWVZOb2VZVDE4alhGU0Q5LWIxNm9GZHZjMVR3V2lzR1Vrdw=="
2021-07-17T14:14:29.5170680Z },
2021-07-17T14:14:29.5171143Z "kind": "Secret",
2021-07-17T14:14:29.5171661Z "metadata": {
2021-07-17T14:14:29.5172116Z "annotations": {
2021-07-17T14:14:29.5173721Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-17T14:14:29.5175240Z "kubernetes.io/service-account.uid": "465b3c1c-ffe8-4e57-9166-884782da112e"
2021-07-17T14:14:29.5176002Z },
2021-07-17T14:14:29.5176721Z "creationTimestamp": "2021-07-17T14:13:03Z",
2021-07-17T14:14:29.5178204Z "name": "submariner-k8s-broker-client-token-zpr47",
2021-07-17T14:14:29.5179554Z "namespace": "submariner-k8s-broker",
2021-07-17T14:14:29.5180221Z "resourceVersion": "1604",
2021-07-17T14:14:29.5181715Z "selfLink": "/api/v1/namespaces/submariner-k8s-broker/secrets/submariner-k8s-broker-client-token-zpr47",
2021-07-17T14:14:29.5183259Z "uid": "84620f94-43e6-4cbe-aeec-f73ee5f6ad79"
2021-07-17T14:14:29.5183833Z },
2021-07-17T14:14:29.5184604Z "type": "kubernetes.io/service-account-token"
2021-07-17T14:14:29.5185200Z }
2021-07-17T14:14:29.5186140Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-17T14:14:29.5188044Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-17T14:14:29.5191137Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:29.5193853Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-17T14:14:29.5195493Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-17T14:14:29.5197682Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:29.5200160Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-zpr47
2021-07-17T14:14:29.5202394Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-zpr47
2021-07-17T14:14:29.5204921Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:29.5207163Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-17T14:14:29.5208845Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-17T14:14:29.5211174Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:29.5214042Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-zpr47.cluster1.json
2021-07-17T14:14:29.5296627Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-17T14:14:29.5328222Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-17T14:14:29.5332303Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-17T14:14:29.5346545Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-17T14:14:29.5397174Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-17T14:14:29.5412867Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-17T14:14:29.5429536Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-17T14:14:29.5451247Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-17T14:14:29.5477377Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-17T14:14:29.5478524Z [submariner-operator]$ [cluster1] pids[cluster1]=7860
2021-07-17T14:14:29.5490044Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-17T14:14:29.5509300Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-17T14:14:29.5542059Z [submariner-operator]$ [cluster2] pids[cluster2]=7864
2021-07-17T14:14:29.5626115Z [submariner-operator]$ [cluster2] wait 7864
2021-07-17T14:14:29.5678193Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-17T14:14:29.5704402Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-17T14:14:29.5764381Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-17T14:14:30.3714215Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-17T14:14:30.3715520Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-17T14:14:30.3716601Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-17T14:14:30.3717898Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T14:14:30.3719448Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T14:14:30.3720913Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-17T14:14:30.3722351Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-17T14:14:30.3724086Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-17T14:14:30.3725114Z [cluster1] NAME CREATED AT
2021-07-17T14:14:30.3726224Z [cluster1] endpoints.submariner.io 2021-07-17T14:13:12Z
2021-07-17T14:14:30.3727702Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:30.3729399Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-17T14:14:30.3731070Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:30.3732734Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-17T14:14:30.3734351Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-17T14:14:30.3735295Z [cluster1] {
2021-07-17T14:14:30.3735938Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T14:14:30.3736819Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-17T14:14:30.3737524Z [cluster1] "metadata": {
2021-07-17T14:14:30.3738035Z [cluster1] "annotations": {
2021-07-17T14:14:30.3739070Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T14:14:30.3739839Z [cluster1] },
2021-07-17T14:14:30.3740591Z [cluster1] "creationTimestamp": "2021-07-17T14:13:12Z",
2021-07-17T14:14:30.3741230Z [cluster1] "generation": 1,
2021-07-17T14:14:30.3741918Z [cluster1] "name": "endpoints.submariner.io",
2021-07-17T14:14:30.3742673Z [cluster1] "resourceVersion": "1729",
2021-07-17T14:14:30.3743863Z [cluster1] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-17T14:14:30.3745324Z [cluster1] "uid": "9650b988-6eb3-4d78-975c-d6ecc0a9c972"
2021-07-17T14:14:30.3745907Z [cluster1] },
2021-07-17T14:14:30.3746342Z [cluster1] "spec": {
2021-07-17T14:14:30.3746837Z [cluster1] "conversion": {
2021-07-17T14:14:30.3747368Z [cluster1] "strategy": "None"
2021-07-17T14:14:30.3747954Z [cluster1] },
2021-07-17T14:14:30.3748889Z [cluster1] "group": "submariner.io",
2021-07-17T14:14:30.3749441Z [cluster1] "names": {
2021-07-17T14:14:30.3749936Z [cluster1] "kind": "Endpoint",
2021-07-17T14:14:30.3750547Z [cluster1] "listKind": "EndpointList",
2021-07-17T14:14:30.3751169Z [cluster1] "plural": "endpoints",
2021-07-17T14:14:30.3751772Z [cluster1] "singular": "endpoint"
2021-07-17T14:14:30.3752268Z [cluster1] },
2021-07-17T14:14:30.3752914Z [cluster1] "scope": "Namespaced",
2021-07-17T14:14:30.3753467Z [cluster1] "versions": [
2021-07-17T14:14:30.3753929Z [cluster1] {
2021-07-17T14:14:30.3754383Z [cluster1] "name": "v1",
2021-07-17T14:14:30.3754857Z [cluster1] "schema": {
2021-07-17T14:14:30.3755439Z [cluster1] "openAPIV3Schema": {
2021-07-17T14:14:30.3756053Z [cluster1] "properties": {
2021-07-17T14:14:30.3756630Z [cluster1] "apiVersion": {
2021-07-17T14:14:30.3759125Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T14:14:30.3761053Z [cluster1] "type": "string"
2021-07-17T14:14:30.3761577Z [cluster1] },
2021-07-17T14:14:30.3762048Z [cluster1] "kind": {
2021-07-17T14:14:30.3764383Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T14:14:30.3766361Z [cluster1] "type": "string"
2021-07-17T14:14:30.3766863Z [cluster1] },
2021-07-17T14:14:30.3767363Z [cluster1] "metadata": {
2021-07-17T14:14:30.3767911Z [cluster1] "type": "object"
2021-07-17T14:14:30.3768413Z [cluster1] },
2021-07-17T14:14:30.3768888Z [cluster1] "spec": {
2021-07-17T14:14:30.3769428Z [cluster1] "properties": {
2021-07-17T14:14:30.3769997Z [cluster1] "backend": {
2021-07-17T14:14:30.3770544Z [cluster1] "type": "string"
2021-07-17T14:14:30.3771069Z [cluster1] },
2021-07-17T14:14:30.3771731Z [cluster1] "backend_config": {
2021-07-17T14:14:30.3772444Z [cluster1] "additionalProperties": {
2021-07-17T14:14:30.3773145Z [cluster1] "type": "string"
2021-07-17T14:14:30.3773676Z [cluster1] },
2021-07-17T14:14:30.3774206Z [cluster1] "type": "object"
2021-07-17T14:14:30.3774716Z [cluster1] },
2021-07-17T14:14:30.3775235Z [cluster1] "cable_name": {
2021-07-17T14:14:30.3775793Z [cluster1] "type": "string"
2021-07-17T14:14:30.3776313Z [cluster1] },
2021-07-17T14:14:30.3776817Z [cluster1] "cluster_id": {
2021-07-17T14:14:30.3777378Z [cluster1] "type": "string"
2021-07-17T14:14:30.3777896Z [cluster1] },
2021-07-17T14:14:30.3778451Z [cluster1] "healthCheckIP": {
2021-07-17T14:14:30.3779066Z [cluster1] "type": "string"
2021-07-17T14:14:30.3779572Z [cluster1] },
2021-07-17T14:14:30.3780084Z [cluster1] "hostname": {
2021-07-17T14:14:30.3780631Z [cluster1] "type": "string"
2021-07-17T14:14:30.3781150Z [cluster1] },
2021-07-17T14:14:30.3781654Z [cluster1] "nat_enabled": {
2021-07-17T14:14:30.3782307Z [cluster1] "type": "boolean"
2021-07-17T14:14:30.3782842Z [cluster1] },
2021-07-17T14:14:30.3783348Z [cluster1] "private_ip": {
2021-07-17T14:14:30.3783920Z [cluster1] "type": "string"
2021-07-17T14:14:30.3784424Z [cluster1] },
2021-07-17T14:14:30.3784935Z [cluster1] "public_ip": {
2021-07-17T14:14:30.3785486Z [cluster1] "type": "string"
2021-07-17T14:14:30.3786010Z [cluster1] },
2021-07-17T14:14:30.3786501Z [cluster1] "subnets": {
2021-07-17T14:14:30.3787034Z [cluster1] "items": {
2021-07-17T14:14:30.3787590Z [cluster1] "type": "string"
2021-07-17T14:14:30.3819425Z [cluster1] },
2021-07-17T14:14:30.3819992Z [cluster1] "type": "array"
2021-07-17T14:14:30.3820497Z [cluster1] }
2021-07-17T14:14:30.3820966Z [cluster1] },
2021-07-17T14:14:30.3821467Z [cluster1] "required": [
2021-07-17T14:14:30.3822009Z [cluster1] "backend",
2021-07-17T14:14:30.3822542Z [cluster1] "cable_name",
2021-07-17T14:14:30.3823304Z [cluster1] "cluster_id",
2021-07-17T14:14:30.3823857Z [cluster1] "hostname",
2021-07-17T14:14:30.3824404Z [cluster1] "nat_enabled",
2021-07-17T14:14:30.3824970Z [cluster1] "private_ip",
2021-07-17T14:14:30.3825514Z [cluster1] "public_ip",
2021-07-17T14:14:30.3826063Z [cluster1] "subnets"
2021-07-17T14:14:30.3826552Z [cluster1] ],
2021-07-17T14:14:30.3827066Z [cluster1] "type": "object"
2021-07-17T14:14:30.3827552Z [cluster1] }
2021-07-17T14:14:30.3829116Z [cluster1] },
2021-07-17T14:14:30.3829618Z [cluster1] "required": [
2021-07-17T14:14:30.3830118Z [cluster1] "spec"
2021-07-17T14:14:30.3830593Z [cluster1] ],
2021-07-17T14:14:30.3831081Z [cluster1] "type": "object"
2021-07-17T14:14:30.3831576Z [cluster1] }
2021-07-17T14:14:30.3831993Z [cluster1] },
2021-07-17T14:14:30.3832477Z [cluster1] "served": true,
2021-07-17T14:14:30.3832998Z [cluster1] "storage": true
2021-07-17T14:14:30.3833478Z [cluster1] }
2021-07-17T14:14:30.3833984Z [cluster1] ]
2021-07-17T14:14:30.3834399Z [cluster1] },
2021-07-17T14:14:30.3834822Z [cluster1] "status": {
2021-07-17T14:14:30.3835357Z [cluster1] "acceptedNames": {
2021-07-17T14:14:30.3835939Z [cluster1] "kind": "Endpoint",
2021-07-17T14:14:30.3836532Z [cluster1] "listKind": "EndpointList",
2021-07-17T14:14:30.3837251Z [cluster1] "plural": "endpoints",
2021-07-17T14:14:30.3837838Z [cluster1] "singular": "endpoint"
2021-07-17T14:14:30.3838347Z [cluster1] },
2021-07-17T14:14:30.3838810Z [cluster1] "conditions": [
2021-07-17T14:14:30.3839287Z [cluster1] {
2021-07-17T14:14:30.3840431Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:12Z",
2021-07-17T14:14:30.3841161Z [cluster1] "message": "no conflicts found",
2021-07-17T14:14:30.3841797Z [cluster1] "reason": "NoConflicts",
2021-07-17T14:14:30.3842377Z [cluster1] "status": "True",
2021-07-17T14:14:30.3843103Z [cluster1] "type": "NamesAccepted"
2021-07-17T14:14:30.3843641Z [cluster1] },
2021-07-17T14:14:30.3844071Z [cluster1] {
2021-07-17T14:14:30.3844872Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:12Z",
2021-07-17T14:14:30.3845672Z [cluster1] "message": "the initial names have been accepted",
2021-07-17T14:14:30.3846494Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-17T14:14:30.3847180Z [cluster1] "status": "True",
2021-07-17T14:14:30.3859803Z [cluster1] [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-17T14:14:30.3861077Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-17T14:14:30.3864107Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-17T14:14:30.3869214Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T14:14:30.3870757Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-17T14:14:30.3872253Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-17T14:14:30.3873685Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-17T14:14:30.3875281Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-17T14:14:30.3876309Z [cluster2] NAME CREATED AT
2021-07-17T14:14:30.3877517Z [cluster2] endpoints.submariner.io 2021-07-17T14:13:28Z
2021-07-17T14:14:30.3879033Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:30.3880716Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-17T14:14:30.3882285Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-17T14:14:30.3883914Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-17T14:14:30.3885722Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:30.3886767Z [cluster2] {
2021-07-17T14:14:30.3887403Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T14:14:30.3888300Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-17T14:14:30.3888993Z [cluster2] "metadata": {
2021-07-17T14:14:30.3889516Z [cluster2] "annotations": {
2021-07-17T14:14:30.3890535Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T14:14:30.3891301Z [cluster2] },
2021-07-17T14:14:30.3892062Z [cluster2] "creationTimestamp": "2021-07-17T14:13:28Z",
2021-07-17T14:14:30.3892690Z [cluster2] "generation": 1,
2021-07-17T14:14:30.3893393Z [cluster2] "name": "endpoints.submariner.io",
2021-07-17T14:14:30.3894134Z [cluster2] "resourceVersion": "1776",
2021-07-17T14:14:30.3895332Z [cluster2] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-17T14:14:30.3896787Z [cluster2] "uid": "a214547b-39ce-4bc1-b171-1749a48ab9e4"
2021-07-17T14:14:30.3897402Z [cluster2] },
2021-07-17T14:14:30.3897823Z [cluster2] "spec": {
2021-07-17T14:14:30.3898318Z [cluster2] "conversion": {
2021-07-17T14:14:30.3898859Z [cluster2] "strategy": "None"
2021-07-17T14:14:30.3899325Z [cluster2] },
2021-07-17T14:14:30.3899855Z [cluster2] "group": "submariner.io",
2021-07-17T14:14:30.3900392Z [cluster2] "names": {
2021-07-17T14:14:30.3900899Z [cluster2] "kind": "Endpoint",
2021-07-17T14:14:30.3901493Z [cluster2] "listKind": "EndpointList",
2021-07-17T14:14:30.3902125Z [cluster2] "plural": "endpoints",
2021-07-17T14:14:30.3902716Z [cluster2] "singular": "endpoint"
2021-07-17T14:14:30.3903227Z [cluster2] },
2021-07-17T14:14:30.3903831Z [cluster2] "scope": "Namespaced",
2021-07-17T14:14:30.3904392Z [cluster2] "versions": [
2021-07-17T14:14:30.3904843Z [cluster2] {
2021-07-17T14:14:30.3905295Z [cluster2] "name": "v1",
2021-07-17T14:14:30.3905780Z [cluster2] "schema": {
2021-07-17T14:14:30.3906351Z [cluster2] "openAPIV3Schema": {
2021-07-17T14:14:30.3906974Z [cluster2] "properties": {
2021-07-17T14:14:30.3907543Z [cluster2] "apiVersion": {
2021-07-17T14:14:30.3937610Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T14:14:30.3939575Z [cluster2] "type": "string"
2021-07-17T14:14:30.3940102Z [cluster2] },
2021-07-17T14:14:30.3940590Z [cluster2] "kind": {
2021-07-17T14:14:30.3942923Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T14:14:30.3945198Z [cluster2] "type": "string"
2021-07-17T14:14:30.3945717Z [cluster2] },
2021-07-17T14:14:30.3946215Z [cluster2] "metadata": {
2021-07-17T14:14:30.3946774Z [cluster2] "type": "object"
2021-07-17T14:14:30.3947267Z [cluster2] },
2021-07-17T14:14:30.3947788Z [cluster2] "spec": {
2021-07-17T14:14:30.3948729Z [cluster2] "properties": {
2021-07-17T14:14:30.3949292Z [cluster2] "backend": {
2021-07-17T14:14:30.3949852Z [cluster2] "type": "string"
2021-07-17T14:14:30.3950362Z [cluster2] },
2021-07-17T14:14:30.3951010Z [cluster2] "backend_config": {
2021-07-17T14:14:30.3951723Z [cluster2] "additionalProperties": {
2021-07-17T14:14:30.3952424Z [cluster2] "type": "string"
2021-07-17T14:14:30.3952962Z [cluster2] },
2021-07-17T14:14:30.3953582Z [cluster2] "type": "object"
2021-07-17T14:14:30.3954103Z [cluster2] },
2021-07-17T14:14:30.3954605Z [cluster2] "cable_name": {
2021-07-17T14:14:30.3955178Z [cluster2] "type": "string"
2021-07-17T14:14:30.3955706Z [cluster2] },
2021-07-17T14:14:30.3956208Z [cluster2] "cluster_id": {
2021-07-17T14:14:30.3956777Z [cluster2] "type": "string"
2021-07-17T14:14:30.3957286Z [cluster2] },
2021-07-17T14:14:30.3957852Z [cluster2] "healthCheckIP": {
2021-07-17T14:14:30.3958458Z [cluster2] "type": "string"
2021-07-17T14:14:30.3958979Z [cluster2] },
2021-07-17T14:14:30.3959490Z [cluster2] "hostname": {
2021-07-17T14:14:30.3960042Z [cluster2] "type": "string"
2021-07-17T14:14:30.3960555Z [cluster2] },
2021-07-17T14:14:30.3961060Z [cluster2] "nat_enabled": {
2021-07-17T14:14:30.3961749Z [cluster2] "type": "boolean"
2021-07-17T14:14:30.3962274Z [cluster2] },
2021-07-17T14:14:30.3962795Z [cluster2] "private_ip": {
2021-07-17T14:14:30.3963356Z [cluster2] "type": "string"
2021-07-17T14:14:30.3963874Z [cluster2] },
2021-07-17T14:14:30.3964388Z [cluster2] "public_ip": {
2021-07-17T14:14:30.3964943Z [cluster2] "type": "string"
2021-07-17T14:14:30.3965466Z [cluster2] },
2021-07-17T14:14:30.3965961Z [cluster2] "subnets": {
2021-07-17T14:14:30.3966499Z [cluster2] "items": {
2021-07-17T14:14:30.3967038Z [cluster2] "type": "string"
2021-07-17T14:14:30.3967571Z [cluster2] },
2021-07-17T14:14:30.3968081Z [cluster2] "type": "array"
2021-07-17T14:14:30.3968598Z [cluster2] }
2021-07-17T14:14:30.3969058Z [cluster2] },
2021-07-17T14:14:30.3969556Z [cluster2] "required": [
2021-07-17T14:14:30.3970102Z [cluster2] "backend",
2021-07-17T14:14:30.3970632Z [cluster2] "cable_name",
2021-07-17T14:14:30.3971256Z [cluster2] "cluster_id",
2021-07-17T14:14:30.3971795Z [cluster2] "hostname",
2021-07-17T14:14:30.3972349Z [cluster2] "nat_enabled",
2021-07-17T14:14:30.3973029Z [cluster2] "private_ip",
2021-07-17T14:14:30.3973589Z [cluster2] "public_ip",
2021-07-17T14:14:30.3974137Z [cluster2] "subnets"
2021-07-17T14:14:30.3974624Z [cluster2] ],
2021-07-17T14:14:30.3975141Z [cluster2] "type": "object"
2021-07-17T14:14:30.3975628Z [cluster2] }
2021-07-17T14:14:30.3976079Z [cluster2] },
2021-07-17T14:14:30.3976564Z [cluster2] "required": [
2021-07-17T14:14:30.3977076Z [cluster2] "spec"
2021-07-17T14:14:30.3977535Z [cluster2] ],
2021-07-17T14:14:30.3978036Z [cluster2] "type": "object"
2021-07-17T14:14:30.3978513Z [cluster2] }
2021-07-17T14:14:30.3978947Z [cluster2] },
2021-07-17T14:14:30.3979604Z [cluster2] "served": true,
2021-07-17T14:14:30.3980128Z [cluster2] "storage": true
2021-07-17T14:14:30.3980607Z [cluster2] }
2021-07-17T14:14:30.3981011Z [cluster2] ]
2021-07-17T14:14:30.3981426Z [cluster2] },
2021-07-17T14:14:30.3990281Z [cluster2] "status": {
2021-07-17T14:14:30.3990842Z [cluster2] "acceptedNames": {
2021-07-17T14:14:30.3991409Z [cluster2] "kind": "Endpoint",
2021-07-17T14:14:30.3992026Z [cluster2] "listKind": "EndpointList",
2021-07-17T14:14:30.3992649Z [cluster2] "plural": "endpoints",
2021-07-17T14:14:30.3993250Z [cluster2] "singular": "endpoint"
2021-07-17T14:14:30.3993773Z [cluster2] },
2021-07-17T14:14:30.3994234Z [cluster2] "conditions": [
2021-07-17T14:14:30.3994713Z [cluster2] {
2021-07-17T14:14:30.3995713Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:28Z",
2021-07-17T14:14:30.3996441Z [cluster2] "message": "no conflicts found",
2021-07-17T14:14:30.3997076Z [cluster2] "reason": "NoConflicts",
2021-07-17T14:14:30.3997657Z [cluster2] "status": "True",
2021-07-17T14:14:30.3998400Z [cluster2] "type": "NamesAccepted"
2021-07-17T14:14:30.3998953Z [cluster2] },
2021-07-17T14:14:30.3999365Z [cluster2] {
2021-07-17T14:14:30.4000181Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:28Z",
2021-07-17T14:14:30.4000982Z [cluster2] "message": "the initial names have been accepted",
2021-07-17T14:14:30.4007581Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-17T14:14:30.4008298Z [cluster2] "status": "True",
2021-07-17T14:14:31.3719221Z [cluster2] "type": "Established"
2021-07-17T14:14:31.3719912Z [cluster2] }
2021-07-17T14:14:31.3720343Z [cluster2] ],
2021-07-17T14:14:31.3720855Z [cluster2] "storedVersions": [
2021-07-17T14:14:31.3721389Z [cluster2] "v1"
2021-07-17T14:14:31.3721801Z [cluster2] ]
2021-07-17T14:14:31.3722218Z [cluster2] }
2021-07-17T14:14:31.3722611Z [cluster2] }
2021-07-17T14:14:31.3724329Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T14:14:31.3725967Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T14:14:31.3727840Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:31.3729641Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T14:14:31.3730934Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T14:14:31.3732826Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:31.3734482Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T14:14:31.3735820Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T14:14:31.3737500Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:31.3739166Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-17T14:14:31.3740506Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-17T14:14:31.3742232Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:31.3744086Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T14:14:31.3745687Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T14:14:31.3747692Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-17T14:14:31.3749634Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-17T14:14:31.3750691Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-17T14:14:31.3752081Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T14:14:31.3753540Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T14:14:31.3754972Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-17T14:14:31.3756371Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-17T14:14:31.3757918Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-17T14:14:31.3758932Z [cluster2] NAME CREATED AT
2021-07-17T14:14:31.3759877Z [cluster2] clusters.submariner.io 2021-07-17T14:13:27Z
2021-07-17T14:14:31.3761322Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:31.3762958Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-17T14:14:31.3764526Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-17T14:14:31.3766256Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-17T14:14:31.3768011Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:31.3769016Z [cluster2] {
2021-07-17T14:14:31.3769649Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T14:14:31.3770542Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-17T14:14:31.3771241Z [cluster2] "metadata": {
2021-07-17T14:14:31.3771768Z [cluster2] "annotations": {
2021-07-17T14:14:31.3772775Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T14:14:31.3773544Z [cluster2] },
2021-07-17T14:14:31.3774294Z [cluster2] "creationTimestamp": "2021-07-17T14:13:27Z",
2021-07-17T14:14:31.3774980Z [cluster2] "generation": 1,
2021-07-17T14:14:31.3775661Z [cluster2] "name": "clusters.submariner.io",
2021-07-17T14:14:31.3776401Z [cluster2] "resourceVersion": "1772",
2021-07-17T14:14:31.3777586Z [cluster2] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-17T14:14:31.3779197Z [cluster2] "uid": "2b3df2bc-6bbb-4dab-bae5-4c718ead1a71"
2021-07-17T14:14:31.3779936Z [cluster2] },
2021-07-17T14:14:31.3780366Z [cluster2] "spec": {
2021-07-17T14:14:31.3780865Z [cluster2] "conversion": {
2021-07-17T14:14:31.3781504Z [cluster2] "strategy": "None"
2021-07-17T14:14:31.3781988Z [cluster2] },
2021-07-17T14:14:31.3782505Z [cluster2] "group": "submariner.io",
2021-07-17T14:14:31.3783052Z [cluster2] "names": {
2021-07-17T14:14:31.3783539Z [cluster2] "kind": "Cluster",
2021-07-17T14:14:31.3784129Z [cluster2] "listKind": "ClusterList",
2021-07-17T14:14:31.3784738Z [cluster2] "plural": "clusters",
2021-07-17T14:14:31.3785309Z [cluster2] "singular": "cluster"
2021-07-17T14:14:31.3785807Z [cluster2] },
2021-07-17T14:14:31.3786301Z [cluster2] "scope": "Namespaced",
2021-07-17T14:14:31.3786855Z [cluster2] "versions": [
2021-07-17T14:14:31.3787303Z [cluster2] {
2021-07-17T14:14:31.3787757Z [cluster2] "name": "v1",
2021-07-17T14:14:31.3789341Z [cluster2] "schema": {
2021-07-17T14:14:31.3826562Z [cluster2] "openAPIV3Schema": {
2021-07-17T14:14:31.3827474Z [cluster2] "properties": {
2021-07-17T14:14:31.3828272Z [cluster2] "apiVersion": {
2021-07-17T14:14:31.3831080Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T14:14:31.3833123Z [cluster2] "type": "string"
2021-07-17T14:14:31.3833629Z [cluster2] },
2021-07-17T14:14:31.3834114Z [cluster2] "kind": {
2021-07-17T14:14:31.3836471Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T14:14:31.3838462Z [cluster2] "type": "string"
2021-07-17T14:14:31.3838973Z [cluster2] },
2021-07-17T14:14:31.3839464Z [cluster2] "metadata": {
2021-07-17T14:14:31.3840023Z [cluster2] "type": "object"
2021-07-17T14:14:31.3840735Z [cluster2] },
2021-07-17T14:14:31.3841215Z [cluster2] "spec": {
2021-07-17T14:14:31.3841773Z [cluster2] "properties": {
2021-07-17T14:14:31.3842344Z [cluster2] "cluster_cidr": {
2021-07-17T14:14:31.3842899Z [cluster2] "items": {
2021-07-17T14:14:31.3843449Z [cluster2] "type": "string"
2021-07-17T14:14:31.3843982Z [cluster2] },
2021-07-17T14:14:31.3844514Z [cluster2] "type": "array"
2021-07-17T14:14:31.3845016Z [cluster2] },
2021-07-17T14:14:31.3845536Z [cluster2] "cluster_id": {
2021-07-17T14:14:31.3846085Z [cluster2] "type": "string"
2021-07-17T14:14:31.3846606Z [cluster2] },
2021-07-17T14:14:31.3847112Z [cluster2] "color_codes": {
2021-07-17T14:14:31.3847656Z [cluster2] "items": {
2021-07-17T14:14:31.3848204Z [cluster2] "type": "string"
2021-07-17T14:14:31.3848744Z [cluster2] },
2021-07-17T14:14:31.3849268Z [cluster2] "type": "array"
2021-07-17T14:14:31.3849768Z [cluster2] },
2021-07-17T14:14:31.3850371Z [cluster2] "global_cidr": {
2021-07-17T14:14:31.3850900Z [cluster2] "items": {
2021-07-17T14:14:31.3851450Z [cluster2] "type": "string"
2021-07-17T14:14:31.3851965Z [cluster2] },
2021-07-17T14:14:31.3852486Z [cluster2] "type": "array"
2021-07-17T14:14:31.3852995Z [cluster2] },
2021-07-17T14:14:31.3853521Z [cluster2] "service_cidr": {
2021-07-17T14:14:31.3854080Z [cluster2] "items": {
2021-07-17T14:14:31.3854616Z [cluster2] "type": "string"
2021-07-17T14:14:31.3855146Z [cluster2] },
2021-07-17T14:14:31.3855656Z [cluster2] "type": "array"
2021-07-17T14:14:31.3856175Z [cluster2] }
2021-07-17T14:14:31.3856628Z [cluster2] },
2021-07-17T14:14:31.3857137Z [cluster2] "required": [
2021-07-17T14:14:31.3857689Z [cluster2] "cluster_cidr",
2021-07-17T14:14:31.3858256Z [cluster2] "cluster_id",
2021-07-17T14:14:31.3858810Z [cluster2] "color_codes",
2021-07-17T14:14:31.3859353Z [cluster2] "global_cidr",
2021-07-17T14:14:31.3859919Z [cluster2] "service_cidr"
2021-07-17T14:14:31.3860431Z [cluster2] ],
2021-07-17T14:14:31.3860949Z [cluster2] "type": "object"
2021-07-17T14:14:31.3861442Z [cluster2] }
2021-07-17T14:14:31.3861941Z [cluster2] },
2021-07-17T14:14:31.3862419Z [cluster2] "required": [
2021-07-17T14:14:31.3862937Z [cluster2] "spec"
2021-07-17T14:14:31.3863412Z [cluster2] ],
2021-07-17T14:14:31.3863904Z [cluster2] "type": "object"
2021-07-17T14:14:31.3864402Z [cluster2] }
2021-07-17T14:14:31.3864826Z [cluster2] },
2021-07-17T14:14:31.3865311Z [cluster2] "served": true,
2021-07-17T14:14:31.3865833Z [cluster2] "storage": true
2021-07-17T14:14:31.3866385Z [cluster2] }
2021-07-17T14:14:31.3866797Z [cluster2] ]
2021-07-17T14:14:31.3867211Z [cluster2] },
2021-07-17T14:14:31.3867634Z [cluster2] "status": {
2021-07-17T14:14:31.3870458Z [cluster2] "acceptedNames": {
2021-07-17T14:14:31.4352751Z [cluster2] "kin "type": "Established"
2021-07-17T14:14:31.4354762Z [cluster1] }
2021-07-17T14:14:31.4355183Z [cluster1] ],
2021-07-17T14:14:31.4355712Z [cluster1] "storedVersions": [
2021-07-17T14:14:31.4356255Z [cluster1] "v1"
2021-07-17T14:14:31.4356688Z [cluster1] ]
2021-07-17T14:14:31.4357087Z [cluster1] }
2021-07-17T14:14:31.4357495Z [cluster1] }
2021-07-17T14:14:31.4359044Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T14:14:31.4360712Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-17T14:14:31.4362599Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:31.4364267Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T14:14:31.4365561Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T14:14:31.4367397Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:31.4369090Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T14:14:31.4370674Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T14:14:31.4372347Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:31.4374009Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-17T14:14:31.4375373Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-17T14:14:31.4377106Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:31.4378952Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T14:14:31.4380544Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-17T14:14:31.4382543Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-17T14:14:31.4384221Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-17T14:14:31.4385272Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-17T14:14:31.4386533Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T14:14:31.4388230Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-17T14:14:31.4415524Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-17T14:14:31.4416955Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-17T14:14:31.4418514Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-17T14:14:31.4419506Z [cluster1] NAME CREATED AT
2021-07-17T14:14:31.4420381Z [cluster1] clusters.submariner.io 2021-07-17T14:13:12Z
2021-07-17T14:14:31.4421827Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:31.4423473Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-17T14:14:31.4424919Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-17T14:14:31.4426499Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-17T14:14:31.4428586Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:31.4429593Z [cluster1] {
2021-07-17T14:14:31.4430238Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T14:14:31.4431116Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-17T14:14:31.4431818Z [cluster1] "metadata": {
2021-07-17T14:14:31.4432331Z [cluster1] "annotations": {
2021-07-17T14:14:31.4433381Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T14:14:31.4434157Z [cluster1] },
2021-07-17T14:14:31.4434920Z [cluster1] "creationTimestamp": "2021-07-17T14:13:12Z",
2021-07-17T14:14:31.4435564Z [cluster1] "generation": 1,
2021-07-17T14:14:31.4436238Z [cluster1] "name": "clusters.submariner.io",
2021-07-17T14:14:31.4436980Z [cluster1] "resourceVersion": "1726",
2021-07-17T14:14:31.4438153Z [cluster1] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-17T14:14:31.4439691Z [cluster1] "uid": "dd67de4d-f545-4bec-b808-350d6deef6e1"
2021-07-17T14:14:31.4440369Z [cluster1] },
2021-07-17T14:14:31.4440807Z [cluster1] "spec": {
2021-07-17T14:14:31.4441302Z [cluster1] "conversion": {
2021-07-17T14:14:31.4441830Z [cluster1] "strategy": "None"
2021-07-17T14:14:31.4442315Z [cluster1] },
2021-07-17T14:14:31.4442835Z [cluster1] "group": "submariner.io",
2021-07-17T14:14:31.4443382Z [cluster1] "names": {
2021-07-17T14:14:31.4443969Z [cluster1] "kind": "Cluster",
2021-07-17T14:14:31.4444564Z [cluster1] "listKind": "ClusterList",
2021-07-17T14:14:31.4445162Z [cluster1] "plural": "clusters",
2021-07-17T14:14:31.4445740Z [cluster1] "singular": "cluster"
2021-07-17T14:14:31.4446218Z [cluster1] },
2021-07-17T14:14:31.4446724Z [cluster1] "scope": "Namespaced",
2021-07-17T14:14:31.4447262Z [cluster1] "versions": [
2021-07-17T14:14:31.4447729Z [cluster1] {
2021-07-17T14:14:31.4448183Z [cluster1] "name": "v1",
2021-07-17T14:14:31.4448657Z [cluster1] "schema": {
2021-07-17T14:14:31.4449241Z [cluster1] "openAPIV3Schema": {
2021-07-17T14:14:31.4449851Z [cluster1] "properties": {
2021-07-17T14:14:31.4450436Z [cluster1] "apiVersion": {
2021-07-17T14:14:31.4452852Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T14:14:31.4454780Z [cluster1] "type": "string"
2021-07-17T14:14:31.4455299Z [cluster1] },
2021-07-17T14:14:31.4455769Z [cluster1] "kind": {
2021-07-17T14:14:31.4458101Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T14:14:31.4459992Z [cluster1] "type": "string"
2021-07-17T14:14:31.4460495Z [cluster1] },
2021-07-17T14:14:31.4461004Z [cluster1] "metadata": {
2021-07-17T14:14:31.4461545Z [cluster1] "type": "object"
2021-07-17T14:14:31.4462055Z [cluster1] },
2021-07-17T14:14:31.4462534Z [cluster1] "spec": {
2021-07-17T14:14:31.4463070Z [cluster1] "properties": {
2021-07-17T14:14:31.4463736Z [cluster1] "cluster_cidr": {
2021-07-17T14:14:31.4464284Z [cluster1] "items": {
2021-07-17T14:14:31.4464842Z [cluster1] "type": "string"
2021-07-17T14:14:31.4465358Z [cluster1] },
2021-07-17T14:14:31.4465880Z [cluster1] "type": "array"
2021-07-17T14:14:31.4471744Z [cluster1] },
2021-07-17T14:14:31.4472305Z [cluster1] "cluster_id": {
2021-07-17T14:14:31.4472877Z [cluster1] "type": "string"
2021-07-17T14:14:31.4473388Z [cluster1] },
2021-07-17T14:14:31.4473906Z [cluster1] "color_codes": {
2021-07-17T14:14:31.4474440Z [cluster1] "items": {
2021-07-17T14:14:31.4475036Z [cluster1] "type": "string"
2021-07-17T14:14:31.4475553Z [cluster1] },
2021-07-17T14:14:31.4476077Z [cluster1] "type": "array"
2021-07-17T14:14:31.4476590Z [cluster1] },
2021-07-17T14:14:31.4477088Z [cluster1] "global_cidr": {
2021-07-17T14:14:31.4477630Z [cluster1] "items": {
2021-07-17T14:14:31.4478175Z [cluster1] "type": "string"
2021-07-17T14:14:31.4478875Z [cluster1] },
2021-07-17T14:14:31.4485106Z [cluster1] "type": "array"
2021-07-17T14:14:31.4485878Z [cluster1] },
2021-07-17T14:14:31.4486402Z [cluster1] "service_cidr": {
2021-07-17T14:14:31.4486965Z [cluster1] "items": {
2021-07-17T14:14:31.4487539Z [cluster1] "type": "string"
2021-07-17T14:14:31.4488063Z [cluster1] },
2021-07-17T14:14:31.4488583Z [cluster1] "type": "array"
2021-07-17T14:14:31.4489086Z [cluster1] }
2021-07-17T14:14:31.4489559Z [cluster1] },
2021-07-17T14:14:31.4490056Z [cluster1] "required": [
2021-07-17T14:14:31.4490632Z [cluster1] "cluster_cidr",
2021-07-17T14:14:31.4491178Z [cluster1] "cluster_id",
2021-07-17T14:14:31.4491739Z [cluster1] "color_codes",
2021-07-17T14:14:31.4492289Z [cluster1] "global_cidr",
2021-07-17T14:14:31.4492835Z [cluster1] "service_cidr"
2021-07-17T14:14:31.4493352Z [cluster1] ],
2021-07-17T14:14:31.4493861Z [cluster1] "type": "object"
2021-07-17T14:14:31.4494370Z [cluster1] }
2021-07-17T14:14:31.4494806Z [cluster1] },
2021-07-17T14:14:31.4495307Z [cluster1] "required": [
2021-07-17T14:14:31.4495803Z [cluster1] "spec"
2021-07-17T14:14:31.4496270Z [cluster1] ],
2021-07-17T14:14:31.4496754Z [cluster1] "type": "object"
2021-07-17T14:14:31.4497253Z [cluster1] }
2021-07-17T14:14:31.4497691Z [cluster1] },
2021-07-17T14:14:31.4498163Z [cluster1] "served": true,
2021-07-17T14:14:31.4498703Z [cluster1] "storage": true
2021-07-17T14:14:31.4499164Z [cluster1] }
2021-07-17T14:14:31.4499581Z [cluster1] ]
2021-07-17T14:14:31.4499982Z [cluster1] },
2021-07-17T14:14:31.4500418Z [cluster1] "status": {
2021-07-17T14:14:31.4501122Z [cluster1] "acceptedNames": {
2021-07-17T14:14:32.4063301Z [cluster1] "kind": "Cluster",
2021-07-17T14:14:32.4063952Z [cluster2] "listKind": "ClusterList",
2021-07-17T14:14:32.4064671Z [cluster2] "plural": "clusters",
2021-07-17T14:14:32.4065247Z [cluster2] "singular": "cluster"
2021-07-17T14:14:32.4065921Z [cluster2] },
2021-07-17T14:14:32.4066562Z [cluster2] "conditions": [
2021-07-17T14:14:32.4067030Z [cluster2] {
2021-07-17T14:14:32.4068420Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:27Z",
2021-07-17T14:14:32.4069288Z [cluster2] "message": "no conflicts found",
2021-07-17T14:14:32.4070084Z [cluster2] "reason": "NoConflicts",
2021-07-17T14:14:32.4070651Z [cluster2] "status": "True",
2021-07-17T14:14:32.4071259Z [cluster2] "type": "NamesAccepted"
2021-07-17T14:14:32.4073076Z [cluster2] },
2021-07-17T14:14:32.4073665Z [cluster2] {
2021-07-17T14:14:32.4074526Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:28Z",
2021-07-17T14:14:32.4075337Z [cluster2] "message": "the initial names have been accepted",
2021-07-17T14:14:32.4077991Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-17T14:14:32.4078678Z [cluster2] "status": "True",
2021-07-17T14:14:32.4079258Z [cluster2] "type": "Established"
2021-07-17T14:14:32.4079763Z [cluster2] }
2021-07-17T14:14:32.4081036Z [cluster2] ],
2021-07-17T14:14:32.4081690Z [cluster2] "storedVersions": [
2021-07-17T14:14:32.4082356Z [cluster2] "v1"
2021-07-17T14:14:32.4082788Z [cluster2] ]
2021-07-17T14:14:32.4083199Z [cluster2] }
2021-07-17T14:14:32.4083593Z [cluster2] }
2021-07-17T14:14:32.4085112Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-17T14:14:32.4086774Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-17T14:14:32.4088574Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:32.4090228Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.4091514Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.4093161Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:32.4094804Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T14:14:32.4096127Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T14:14:32.4097790Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:32.4099402Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-17T14:14:32.4100730Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-17T14:14:32.4102418Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:32.4104232Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T14:14:32.4105988Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T14:14:32.4108557Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-17T14:14:32.4110259Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-17T14:14:32.4111252Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-17T14:14:32.4112620Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T14:14:32.4114523Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T14:14:32.4116524Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T14:14:32.4118036Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T14:14:32.4119661Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-17T14:14:32.4120723Z [cluster2] NAME CREATED AT
2021-07-17T14:14:32.4121774Z [cluster2] submariners.submariner.io 2021-07-17T14:13:15Z
2021-07-17T14:14:32.4123353Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-17T14:14:32.4125128Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-17T14:14:32.4126867Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-17T14:14:32.4128618Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-17T14:14:32.4130294Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-17T14:14:32.4131283Z [cluster2] {
2021-07-17T14:14:32.4131919Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T14:14:32.4132818Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-17T14:14:32.4133527Z [cluster2] "metadata": {
2021-07-17T14:14:32.4134158Z [cluster2] "annotations": {
2021-07-17T14:14:32.4135197Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T14:14:32.4135951Z [cluster2] },
2021-07-17T14:14:32.4136722Z [cluster2] "creationTimestamp": "2021-07-17T14:13:15Z",
2021-07-17T14:14:32.4137350Z [cluster2] "generation": 1,
2021-07-17T14:14:32.4138297Z [cluster2] "name": "submariners.submariner.io",
2021-07-17T14:14:32.4139089Z [cluster2] "resourceVersion": "1650",
2021-07-17T14:14:32.4140306Z [cluster2] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-17T14:14:32.4141887Z [cluster2] "uid": "ea0e2c52-b48e-4e1c-ae25-8914de59f621"
2021-07-17T14:14:32.4172097Z [cluster2] },
2021-07-17T14:14:32.4172566Z [cluster2] "spec": {
2021-07-17T14:14:32.4173068Z [cluster2] "conversion": {
2021-07-17T14:14:32.4173601Z [cluster2] "strategy": "None"
2021-07-17T14:14:32.4174111Z [cluster2] },
2021-07-17T14:14:32.4174628Z [cluster2] "group": "submariner.io",
2021-07-17T14:14:32.4175183Z [cluster2] "names": {
2021-07-17T14:14:32.4175693Z [cluster2] "kind": "Submariner",
2021-07-17T14:14:32.4176341Z [cluster2] "listKind": "SubmarinerList",
2021-07-17T14:14:32.4176993Z [cluster2] "plural": "submariners",
2021-07-17T14:14:32.4177619Z [cluster2] "singular": "submariner"
2021-07-17T14:14:32.4178131Z [cluster2] },
2021-07-17T14:14:32.4178636Z [cluster2] "scope": "Namespaced",
2021-07-17T14:14:32.4179299Z [cluster2] "versions": [
2021-07-17T14:14:32.4179752Z [cluster2] {
2021-07-17T14:14:32.4180242Z [cluster2] "name": "v1alpha1",
2021-07-17T14:14:32.4180750Z [cluster2] "schema": {
2021-07-17T14:14:32.4181333Z [cluster2] "openAPIV3Schema": {
2021-07-17T14:14:32.4182154Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-17T14:14:32.4182945Z [cluster2] "properties": {
2021-07-17T14:14:32.4183512Z [cluster2] "apiVersion": {
2021-07-17T14:14:32.4186416Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T14:14:32.4225083Z [cluster2] "type": "string"
2021-07-17T14:14:32.4225613Z [cluster2] },
2021-07-17T14:14:32.4226107Z [cluster2] "kind": {
2021-07-17T14:14:32.4228883Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T14:14:32.4230777Z [cluster2] "type": "string"
2021-07-17T14:14:32.4231304Z [cluster2] },
2021-07-17T14:14:32.4231812Z [cluster2] "metadata": {
2021-07-17T14:14:32.4232358Z [cluster2] "type": "object"
2021-07-17T14:14:32.4232879Z [cluster2] },
2021-07-17T14:14:32.4233346Z [cluster2] "spec": {
2021-07-17T14:14:32.4234171Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-17T14:14:32.4235023Z [cluster2] "properties": {
2021-07-17T14:14:32.4235587Z [cluster2] "broker": {
2021-07-17T14:14:32.4236142Z [cluster2] "type": "string"
2021-07-17T14:14:32.4236866Z [cluster2] },
2021-07-17T14:14:32.4237489Z [cluster2] "brokerK8sApiServer": {
2021-07-17T14:14:32.4238148Z [cluster2] "type": "string"
2021-07-17T14:14:32.4238670Z [cluster2] },
2021-07-17T14:14:32.4239335Z [cluster2] "brokerK8sApiServerToken": {
2021-07-17T14:14:32.4240079Z [cluster2] "type": "string"
2021-07-17T14:14:32.4240599Z [cluster2] },
2021-07-17T14:14:32.4241125Z [cluster2] "brokerK8sCA": {
2021-07-17T14:14:32.4241717Z [cluster2] "type": "string"
2021-07-17T14:14:32.4242229Z [cluster2] },
2021-07-17T14:14:32.4242928Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-17T14:14:32.4243676Z [cluster2] "type": "string"
2021-07-17T14:14:32.4244199Z [cluster2] },
2021-07-17T14:14:32.4244722Z [cluster2] "cableDriver": {
2021-07-17T14:14:32.4245319Z [cluster2] "type": "string"
2021-07-17T14:14:32.4245847Z [cluster2] },
2021-07-17T14:14:32.4246394Z [cluster2] "ceIPSecDebug": {
2021-07-17T14:14:32.4247013Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4247529Z [cluster2] },
2021-07-17T14:14:32.4248200Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-17T14:14:32.4248913Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4249440Z [cluster2] },
2021-07-17T14:14:32.4250006Z [cluster2] "ceIPSecIKEPort": {
2021-07-17T14:14:32.4250648Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4266868Z [cluster2] },
2021-07-17T14:14:32.4267480Z [cluster2] "ceIPSecNATTPort": {
2021-07-17T14:14:32.4268401Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4269095Z [cluster2] },
2021-07-17T14:14:32.4269649Z [cluster2] "ceIPSecPSK": {
2021-07-17T14:14:32.4270235Z [cluster2] "type": "string"
2021-07-17T14:14:32.4270761Z [cluster2] },
2021-07-17T14:14:32.4271450Z [cluster2] "ceIPSecPreferredServer": {
2021-07-17T14:14:32.4272187Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4272726Z [cluster2] },
2021-07-17T14:14:32.4273254Z [cluster2] "clusterCIDR": {
2021-07-17T14:14:32.4273849Z [cluster2] "type": "string"
2021-07-17T14:14:32.4274358Z [cluster2] },
2021-07-17T14:14:32.4274886Z [cluster2] "clusterID": {
2021-07-17T14:14:32.4275453Z [cluster2] "type": "string"
2021-07-17T14:14:32.4275972Z [cluster2] },
2021-07-17T14:14:32.4276508Z [cluster2] "colorCodes": {
2021-07-17T14:14:32.4277075Z [cluster2] "type": "string"
2021-07-17T14:14:32.4277594Z [cluster2] },
2021-07-17T14:14:32.4278242Z [cluster2] "connectionHealthCheck": {
2021-07-17T14:14:32.4279061Z [cluster2] "properties": {
2021-07-17T14:14:32.4279639Z [cluster2] "enabled": {
2021-07-17T14:14:32.4280227Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4280756Z [cluster2] },
2021-07-17T14:14:32.4281350Z [cluster2] "intervalSeconds": {
2021-07-17T14:14:32.4282201Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-17T14:14:32.4282982Z [cluster2] "format": "int64",
2021-07-17T14:14:32.4283581Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4284115Z [cluster2] },
2021-07-17T14:14:32.4284748Z [cluster2] "maxPacketLossCount": {
2021-07-17T14:14:32.4285779Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-17T14:14:32.4286726Z [cluster2] "format": "int64",
2021-07-17T14:14:32.4287328Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4287856Z [cluster2] }
2021-07-17T14:14:32.4288344Z [cluster2] },
2021-07-17T14:14:32.4288867Z [cluster2] "type": "object"
2021-07-17T14:14:32.4289391Z [cluster2] },
2021-07-17T14:14:32.4290021Z [cluster2] "coreDNSCustomConfig": {
2021-07-17T14:14:32.4290699Z [cluster2] "properties": {
2021-07-17T14:14:32.4291336Z [cluster2] "configMapName": {
2021-07-17T14:14:32.4291955Z [cluster2] "type": "string"
2021-07-17T14:14:32.4292487Z [cluster2] },
2021-07-17T14:14:32.4293008Z [cluster2] "namespace": {
2021-07-17T14:14:32.4293600Z [cluster2] "type": "string"
2021-07-17T14:14:32.4294132Z [cluster2] }
2021-07-17T14:14:32.4294663Z [cluster2] },
2021-07-17T14:14:32.4295199Z [cluster2] "type": "object"
2021-07-17T14:14:32.4295707Z [cluster2] },
2021-07-17T14:14:32.4296265Z [cluster2] "customDomains": {
2021-07-17T14:14:32.4296833Z [cluster2] "items": {
2021-07-17T14:14:32.4297386Z [cluster2] "type": "string"
2021-07-17T14:14:32.4297905Z [cluster2] },
2021-07-17T14:14:32.4298432Z [cluster2] "type": "array",
2021-07-17T14:14:32.4299562Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-17T14:14:32.4300222Z [cluster2] },
2021-07-17T14:14:32.4300722Z [cluster2] "debug": {
2021-07-17T14:14:32.4301294Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4301823Z [cluster2] },
2021-07-17T14:14:32.4302336Z [cluster2] "globalCIDR": {
2021-07-17T14:14:32.4302913Z [cluster2] "type": "string"
2021-07-17T14:14:32.4303421Z [cluster2] },
2021-07-17T14:14:32.4303993Z [cluster2] "imageOverrides": {
2021-07-17T14:14:32.4304812Z [cluster2] "additionalProperties": {
2021-07-17T14:14:32.4305506Z [cluster2] "type": "string"
2021-07-17T14:14:32.4306037Z [cluster2] },
2021-07-17T14:14:32.4306550Z [cluster2] "type": "object"
2021-07-17T14:14:32.4307067Z [cluster2] },
2021-07-17T14:14:32.4307684Z [cluster2] "loadBalancerEnabled": {
2021-07-17T14:14:32.4340985Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4341544Z [cluster2] },
2021-07-17T14:14:32.4342065Z [cluster2] "namespace": {
2021-07-17T14:14:32.4342649Z [cluster2] "type": "string"
2021-07-17T14:14:32.4343164Z [cluster2] },
2021-07-17T14:14:32.4343713Z [cluster2] "natEnabled": {
2021-07-17T14:14:32.4344292Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4344823Z [cluster2] },
2021-07-17T14:14:32.4345337Z [cluster2] "repository": {
2021-07-17T14:14:32.4345916Z [cluster2] "type": "string"
2021-07-17T14:14:32.4346447Z [cluster2] },
2021-07-17T14:14:32.4346975Z [cluster2] "serviceCIDR": {
2021-07-17T14:14:32.4347571Z [cluster2] "type": "string"
2021-07-17T14:14:32.4348323Z [cluster2] },
2021-07-17T14:14:32.4349017Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-17T14:14:32.4349759Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4350293Z [cluster2] },
2021-07-17T14:14:32.4350784Z [cluster2] "version": {
2021-07-17T14:14:32.4351346Z [cluster2] "type": "string"
2021-07-17T14:14:32.4351896Z [cluster2] }
2021-07-17T14:14:32.4352349Z [cluster2] },
2021-07-17T14:14:32.4352856Z [cluster2] "required": [
2021-07-17T14:14:32.4353559Z [cluster2] "broker",
2021-07-17T14:14:32.4354205Z [cluster2] "brokerK8sApiServer",
2021-07-17T14:14:32.4355025Z [cluster2] "brokerK8sApiServerToken",
2021-07-17T14:14:32.4355779Z [cluster2] "brokerK8sCA",
2021-07-17T14:14:32.4356524Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-17T14:14:32.4357309Z [cluster2] "ceIPSecDebug",
2021-07-17T14:14:32.4357938Z [cluster2] "ceIPSecPSK",
2021-07-17T14:14:32.4358524Z [cluster2] "clusterCIDR",
2021-07-17T14:14:32.4359110Z [cluster2] "clusterID",
2021-07-17T14:14:32.4359636Z [cluster2] "debug",
2021-07-17T14:14:32.4360189Z [cluster2] "namespace",
2021-07-17T14:14:32.4360761Z [cluster2] "natEnabled",
2021-07-17T14:14:32.4361363Z [cluster2] "serviceCIDR"
2021-07-17T14:14:32.4361892Z [cluster2] ],
2021-07-17T14:14:32.4362394Z [cluster2] "type": "object"
2021-07-17T14:14:32.4362898Z [cluster2] },
2021-07-17T14:14:32.4363367Z [cluster2] "status": {
2021-07-17T14:14:32.4364217Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-17T14:14:32.4365171Z [cluster2] "properties": {
2021-07-17T14:14:32.4365773Z [cluster2] "clusterCIDR": {
2021-07-17T14:14:32.4366352Z [cluster2] "type": "string"
2021-07-17T14:14:32.4366871Z [cluster2] },
2021-07-17T14:14:32.4367398Z [cluster2] "clusterID": {
2021-07-17T14:14:32.4367962Z [cluster2] "type": "string"
2021-07-17T14:14:32.4368479Z [cluster2] },
2021-07-17T14:14:32.4368992Z [cluster2] "colorCodes": {
2021-07-17T14:14:32.4369569Z [cluster2] "type": "string"
2021-07-17T14:14:32.4370079Z [cluster2] },
2021-07-17T14:14:32.4370655Z [cluster2] "deploymentInfo": {
2021-07-17T14:14:32.4371281Z [cluster2] "properties": {
2021-07-17T14:14:32.4371918Z [cluster2] "cloudProvider": {
2021-07-17T14:14:32.4372542Z [cluster2] "type": "string"
2021-07-17T14:14:32.4373063Z [cluster2] },
2021-07-17T14:14:32.4373656Z [cluster2] "kubernetesType": {
2021-07-17T14:14:32.4374285Z [cluster2] "type": "string"
2021-07-17T14:14:32.4374830Z [cluster2] },
2021-07-17T14:14:32.4375488Z [cluster2] "kubernetesTypeVersion": {
2021-07-17T14:14:32.4376207Z [cluster2] "type": "string"
2021-07-17T14:14:32.4376746Z [cluster2] },
2021-07-17T14:14:32.4377356Z [cluster2] "kubernetesVersion": {
2021-07-17T14:14:32.4378025Z [cluster2] "type": "string"
2021-07-17T14:14:32.4378545Z [cluster2] }
2021-07-17T14:14:32.4379025Z [cluster2] },
2021-07-17T14:14:32.4379547Z [cluster2] "type": "object"
2021-07-17T14:14:32.4380124Z [cluster2] },
2021-07-17T14:14:32.4380792Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-17T14:14:32.4381535Z [cluster2] "properties": {
2021-07-17T14:14:32.4382241Z [cluster2] "lastResourceVersion": {
2021-07-17T14:14:32.4382921Z [cluster2] "type": "string"
2021-07-17T14:14:32.4383463Z [cluster2] },
2021-07-17T14:14:32.4384175Z [cluster2] "mismatchedContainerImages": {
2021-07-17T14:14:32.4384967Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4385499Z [cluster2] },
2021-07-17T14:14:32.4386205Z [cluster2] "nonReadyContainerStates": {
2021-07-17T14:14:32.4386934Z [cluster2] "items": {
2021-07-17T14:14:32.4388383Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T14:14:32.4389760Z [cluster2] "properties": {
2021-07-17T14:14:32.4390370Z [cluster2] "running": {
2021-07-17T14:14:32.4391204Z [cluster2] "description": "Details about a running container",
2021-07-17T14:14:32.4391978Z [cluster2] "properties": {
2021-07-17T14:14:32.4392600Z [cluster2] "startedAt": {
2021-07-17T14:14:32.4404255Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-17T14:14:32.4405523Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4406168Z [cluster2] "type": "string"
2021-07-17T14:14:32.4406739Z [cluster2] }
2021-07-17T14:14:32.4407245Z [cluster2] },
2021-07-17T14:14:32.4407821Z [cluster2] "type": "object"
2021-07-17T14:14:32.4408379Z [cluster2] },
2021-07-17T14:14:32.4408939Z [cluster2] "terminated": {
2021-07-17T14:14:32.4409742Z [cluster2] "description": "Details about a terminated container",
2021-07-17T14:14:32.4410527Z [cluster2] "properties": {
2021-07-17T14:14:32.4411176Z [cluster2] "containerID": {
2021-07-17T14:14:32.4412334Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T14:14:32.4413205Z [cluster2] "type": "string"
2021-07-17T14:14:32.4413786Z [cluster2] },
2021-07-17T14:14:32.4414341Z [cluster2] "exitCode": {
2021-07-17T14:14:32.4415179Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-17T14:14:32.4416158Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4416783Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4417362Z [cluster2] },
2021-07-17T14:14:32.4417928Z [cluster2] "finishedAt": {
2021-07-17T14:14:32.4419190Z [cluster2] "description": "Time at which the container last terminated",
2021-07-17T14:14:32.4420271Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4420907Z [cluster2] "type": "string"
2021-07-17T14:14:32.4421475Z [cluster2] },
2021-07-17T14:14:32.4422022Z [cluster2] "message": {
2021-07-17T14:14:32.4422881Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-17T14:14:32.4423746Z [cluster2] "type": "string"
2021-07-17T14:14:32.4424292Z [cluster2] },
2021-07-17T14:14:32.4424927Z [cluster2] "reason": {
2021-07-17T14:14:32.4425745Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-17T14:14:32.4426581Z [cluster2] "type": "string"
2021-07-17T14:14:32.4427141Z [cluster2] },
2021-07-17T14:14:32.4427679Z [cluster2] "signal": {
2021-07-17T14:14:32.4443870Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-17T14:14:32.4444690Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4445316Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4445902Z [cluster2] },
2021-07-17T14:14:32.4446455Z [cluster2] "startedAt": {
2021-07-17T14:14:32.4447322Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-17T14:14:32.4448516Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4449167Z [cluster2] "type": "string"
2021-07-17T14:14:32.4449726Z [cluster2] }
2021-07-17T14:14:32.4450246Z [cluster2] },
2021-07-17T14:14:32.4450803Z [cluster2] "required": [
2021-07-17T14:14:32.4451399Z [cluster2] "exitCode"
2021-07-17T14:14:32.4452003Z [cluster2] ],
2021-07-17T14:14:32.4452551Z [cluster2] "type": "object"
2021-07-17T14:14:32.4453105Z [cluster2] },
2021-07-17T14:14:32.4453751Z [cluster2] "waiting": {
2021-07-17T14:14:32.4454497Z [cluster2] "description": "Details about a waiting container",
2021-07-17T14:14:32.4455268Z [cluster2] "properties": {
2021-07-17T14:14:32.4455868Z [cluster2] "message": {
2021-07-17T14:14:32.4469022Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-17T14:14:32.4469888Z [cluster2] "type": "string"
2021-07-17T14:14:32.4470467Z [cluster2] },
2021-07-17T14:14:32.4471018Z [cluster2] "reason": {
2021-07-17T14:14:32.4471787Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-17T14:14:32.4472579Z [cluster2] "type": "string"
2021-07-17T14:14:32.4477011Z [cluster2] }
2021-07-17T14:14:32.4477553Z [cluster2] },
2021-07-17T14:14:32.4478102Z [cluster2] "type": "object"
2021-07-17T14:14:32.4478804Z [cluster2] }
2021-07-17T14:14:32.4479308Z [cluster2] },
2021-07-17T14:14:32.4482821Z [cluster2] "type": "object"
2021-07-17T14:14:32.4483379Z [cluster2] },
2021-07-17T14:14:32.4489553Z [cluster2] "type": "array"
2021-07-17T14:14:32.4490473Z [cluster2] },
2021-07-17T14:14:32.4490984Z [cluster2] "status": {
2021-07-17T14:14:32.4491863Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T14:14:32.4492771Z [cluster2] "properties": {
2021-07-17T14:14:32.4493413Z [cluster2] "collisionCount": {
2021-07-17T14:14:32.4494861Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T14:14:32.4496259Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4496863Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4497427Z [cluster2] },
2021-07-17T14:14:32.4497967Z [cluster2] "conditions": {
2021-07-17T14:14:32.4499367Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T14:14:32.4500294Z [cluster2] "items": {
2021-07-17T14:14:32.4501228Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T14:14:32.4502209Z [cluster2] "properties": {
2021-07-17T14:14:32.4502912Z [cluster2] "lastTransitionTime": {
2021-07-17T14:14:32.4504068Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T14:14:32.4505223Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4505853Z [cluster2] "type": "string"
2021-07-17T14:14:32.4533611Z [cluster2] },
2021-07-17T14:14:32.4534190Z [cluster2] "message": {
2021-07-17T14:14:32.4535095Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-17T14:14:32.4535999Z [cluster2] "type": "string"
2021-07-17T14:14:32.4536559Z [cluster2] },
2021-07-17T14:14:32.4537104Z [cluster2] "reason": {
2021-07-17T14:14:32.4538290Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-17T14:14:32.4539097Z [cluster2] "type": "string"
2021-07-17T14:14:32.4539845Z [cluster2] },
2021-07-17T14:14:32.4540375Z [cluster2] "status": {
2021-07-17T14:14:32.4541189Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T14:14:32.4542004Z [cluster2] "type": "string"
2021-07-17T14:14:32.4542575Z [cluster2] },
2021-07-17T14:14:32.4543106Z [cluster2] "type": {
2021-07-17T14:14:32.4543853Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-17T14:14:32.4544610Z [cluster2] "type": "string"
2021-07-17T14:14:32.4545163Z [cluster2] }
2021-07-17T14:14:32.4545679Z [cluster2] },
2021-07-17T14:14:32.4546222Z [cluster2] "required": [
2021-07-17T14:14:32.4546804Z [cluster2] "status",
2021-07-17T14:14:32.4547364Z [cluster2] "type"
2021-07-17T14:14:32.4548080Z [cluster2] ],
2021-07-17T14:14:32.4548733Z [cluster2] "type": "object"
2021-07-17T14:14:32.4549285Z [cluster2] },
2021-07-17T14:14:32.4549837Z [cluster2] "type": "array"
2021-07-17T14:14:32.4550367Z [cluster2] },
2021-07-17T14:14:32.4551067Z [cluster2] "currentNumberScheduled": {
2021-07-17T14:14:32.4552620Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.4554063Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4554689Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4555261Z [cluster2] },
2021-07-17T14:14:32.4555948Z [cluster2] "desiredNumberScheduled": {
2021-07-17T14:14:32.4557547Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.4558977Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4559577Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4560139Z [cluster2] },
2021-07-17T14:14:32.4560739Z [cluster2] "numberAvailable": {
2021-07-17T14:14:32.4562025Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.4563241Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4563900Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4564458Z [cluster2] },
2021-07-17T14:14:32.4565085Z [cluster2] "numberMisscheduled": {
2021-07-17T14:14:32.4566535Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.4567874Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4568473Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4569033Z [cluster2] },
2021-07-17T14:14:32.4569593Z [cluster2] "numberReady": {
2021-07-17T14:14:32.4570615Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T14:14:32.4571598Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4572197Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4572762Z [cluster2] },
2021-07-17T14:14:32.4573366Z [cluster2] "numberUnavailable": {
2021-07-17T14:14:32.4574658Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.4575859Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4576457Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4577009Z [cluster2] },
2021-07-17T14:14:32.4577634Z [cluster2] "observedGeneration": {
2021-07-17T14:14:32.4578667Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T14:14:32.4579536Z [cluster2] "format": "int64",
2021-07-17T14:14:32.4580138Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4587566Z [cluster2] },
2021-07-17T14:14:32.4588387Z [cluster2] "updatedNumberScheduled": {
2021-07-17T14:14:32.4589455Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T14:14:32.4590285Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4590894Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4591440Z [cluster2] }
2021-07-17T14:14:32.4591941Z [cluster2] },
2021-07-17T14:14:32.4592473Z [cluster2] "required": [
2021-07-17T14:14:32.4593193Z [cluster2] "currentNumberScheduled",
2021-07-17T14:14:32.4594081Z [cluster2] "desiredNumberScheduled",
2021-07-17T14:14:32.4594906Z [cluster2] "numberMisscheduled",
2021-07-17T14:14:32.4595761Z [cluster2] "numberReady"
2021-07-17T14:14:32.4596313Z [cluster2] ],
2021-07-17T14:14:32.4596860Z [cluster2] "type": "object"
2021-07-17T14:14:32.4597402Z [cluster2] }
2021-07-17T14:14:32.4597866Z [cluster2] },
2021-07-17T14:14:32.4598394Z [cluster2] "required": [
2021-07-17T14:14:32.4599153Z [cluster2] "mismatchedContainerImages"
2021-07-17T14:14:32.4599876Z [cluster2] ],
2021-07-17T14:14:32.4600397Z [cluster2] "type": "object"
2021-07-17T14:14:32.4600925Z [cluster2] },
2021-07-17T14:14:32.4601441Z [cluster2] "gateways": {
2021-07-17T14:14:32.4601973Z [cluster2] "items": {
2021-07-17T14:14:32.4602546Z [cluster2] "properties": {
2021-07-17T14:14:32.4603151Z [cluster2] "connections": {
2021-07-17T14:14:32.4603734Z [cluster2] "items": {
2021-07-17T14:14:32.4604308Z [cluster2] "properties": {
2021-07-17T14:14:32.4604928Z [cluster2] "endpoint": {
2021-07-17T14:14:32.4605541Z [cluster2] "properties": {
2021-07-17T14:14:32.4606160Z [cluster2] "backend": {
2021-07-17T14:14:32.4606771Z [cluster2] "type": "string"
2021-07-17T14:14:32.4607386Z [cluster2] },
2021-07-17T14:14:32.4607970Z [cluster2] "backend_config": {
2021-07-17T14:14:32.4608709Z [cluster2] "additionalProperties": {
2021-07-17T14:14:32.4609463Z [cluster2] "type": "string"
2021-07-17T14:14:32.4610107Z [cluster2] },
2021-07-17T14:14:32.4610680Z [cluster2] "type": "object"
2021-07-17T14:14:32.4611251Z [cluster2] },
2021-07-17T14:14:32.4611800Z [cluster2] "cable_name": {
2021-07-17T14:14:32.4612407Z [cluster2] "type": "string"
2021-07-17T14:14:32.4638746Z [cluster2] },
2021-07-17T14:14:32.4639551Z [cluster2] "cluster_id": {
2021-07-17T14:14:32.4640181Z [cluster2] "type": "string"
2021-07-17T14:14:32.4640758Z [cluster2] },
2021-07-17T14:14:32.4641390Z [cluster2] "healthCheckIP": {
2021-07-17T14:14:32.4642043Z [cluster2] "type": "string"
2021-07-17T14:14:32.4642617Z [cluster2] },
2021-07-17T14:14:32.4643184Z [cluster2] "hostname": {
2021-07-17T14:14:32.4643952Z [cluster2] "type": "string"
2021-07-17T14:14:32.4644524Z [cluster2] },
2021-07-17T14:14:32.4645084Z [cluster2] "nat_enabled": {
2021-07-17T14:14:32.4645716Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4646289Z [cluster2] },
2021-07-17T14:14:32.4646873Z [cluster2] "private_ip": {
2021-07-17T14:14:32.4647497Z [cluster2] "type": "string"
2021-07-17T14:14:32.4648052Z [cluster2] },
2021-07-17T14:14:32.4648609Z [cluster2] "public_ip": {
2021-07-17T14:14:32.4649211Z [cluster2] "type": "string"
2021-07-17T14:14:32.4649781Z [cluster2] },
2021-07-17T14:14:32.4650341Z [cluster2] "subnets": {
2021-07-17T14:14:32.4656061Z [cluster2] "items": {
2021-07-17T14:14:32.4656856Z [cluster2] "type": "string"
2021-07-17T14:14:32.4657431Z [cluster2] },
2021-07-17T14:14:32.4658003Z [cluster2] "type": "array"
2021-07-17T14:14:32.4658558Z [cluster2] }
2021-07-17T14:14:32.4659086Z [cluster2] },
2021-07-17T14:14:32.4659644Z [cluster2] "required": [
2021-07-17T14:14:32.4660226Z [cluster2] "backend",
2021-07-17T14:14:32.4660820Z [cluster2] "cable_name",
2021-07-17T14:14:32.4661558Z [cluster2] "cluster_id",
2021-07-17T14:14:32.4662166Z [cluster2] "hostname",
2021-07-17T14:14:32.4662755Z [cluster2] "nat_enabled",
2021-07-17T14:14:32.4663367Z [cluster2] "private_ip",
2021-07-17T14:14:32.4663973Z [cluster2] "public_ip",
2021-07-17T14:14:32.4664559Z [cluster2] "subnets"
2021-07-17T14:14:32.4665111Z [cluster2] ],
2021-07-17T14:14:32.4665666Z [cluster2] "type": "object"
2021-07-17T14:14:32.4666230Z [cluster2] },
2021-07-17T14:14:32.4666802Z [cluster2] "latencyRTT": {
2021-07-17T14:14:32.4668043Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-17T14:14:32.4669136Z [cluster2] "properties": {
2021-07-17T14:14:32.4669741Z [cluster2] "average": {
2021-07-17T14:14:32.4670433Z [cluster2] "type": "string"
2021-07-17T14:14:32.4671007Z [cluster2] },
2021-07-17T14:14:32.4671534Z [cluster2] "last": {
2021-07-17T14:14:32.4672131Z [cluster2] "type": "string"
2021-07-17T14:14:32.4672687Z [cluster2] },
2021-07-17T14:14:32.4673228Z [cluster2] "max": {
2021-07-17T14:14:32.4673804Z [cluster2] "type": "string"
2021-07-17T14:14:32.4674373Z [cluster2] },
2021-07-17T14:14:32.4675106Z [cluster2] "min": {
2021-07-17T14:14:32.4675680Z [cluster2] "type": "string"
2021-07-17T14:14:32.4676247Z [cluster2] },
2021-07-17T14:14:32.4676782Z [cluster2] "stdDev": {
2021-07-17T14:14:32.4677386Z [cluster2] "type": "string"
2021-07-17T14:14:32.4677939Z [cluster2] }
2021-07-17T14:14:32.4678453Z [cluster2] },
2021-07-17T14:14:32.4679022Z [cluster2] "type": "object"
2021-07-17T14:14:32.4680486Z [cluster2] },
2021-07-17T14:14:32.4681270Z [cluster2] "status": {
2021-07-17T14:14:32.4681861Z [cluster2] "type": "string"
2021-07-17T14:14:32.4682424Z [cluster2] },
2021-07-17T14:14:32.4683015Z [cluster2] "statusMessage": {
2021-07-17T14:14:32.4683989Z [cluster2] "type": "string"
2021-07-17T14:14:32.4684554Z [cluster2] },
2021-07-17T14:14:32.4685116Z [cluster2] "usingIP": {
2021-07-17T14:14:32.4685724Z [cluster2] "type": "string"
2021-07-17T14:14:32.4686273Z [cluster2] },
2021-07-17T14:14:32.4686840Z [cluster2] "usingNAT": {
2021-07-17T14:14:32.4687438Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4688008Z [cluster2] }
2021-07-17T14:14:32.4688506Z [cluster2] },
2021-07-17T14:14:32.4689064Z [cluster2] "required": [
2021-07-17T14:14:32.4689659Z [cluster2] "endpoint",
2021-07-17T14:14:32.4690229Z [cluster2] "status",
2021-07-17T14:14:32.4691417Z [cluster2] "statusMessage"
2021-07-17T14:14:32.4692004Z [cluster2] ],
2021-07-17T14:14:32.4692655Z [cluster2] "type": "object"
2021-07-17T14:14:32.4693198Z [cluster2] },
2021-07-17T14:14:32.4693745Z [cluster2] "type": "array"
2021-07-17T14:14:32.4694290Z [cluster2] },
2021-07-17T14:14:32.4694813Z [cluster2] "haStatus": {
2021-07-17T14:14:32.4695404Z [cluster2] "type": "string"
2021-07-17T14:14:32.4695938Z [cluster2] },
2021-07-17T14:14:32.4696510Z [cluster2] "localEndpoint": {
2021-07-17T14:14:32.4697145Z [cluster2] "properties": {
2021-07-17T14:14:32.4697750Z [cluster2] "backend": {
2021-07-17T14:14:32.4698353Z [cluster2] "type": "string"
2021-07-17T14:14:32.4698897Z [cluster2] },
2021-07-17T14:14:32.4699467Z [cluster2] "backend_config": {
2021-07-17T14:14:32.4700197Z [cluster2] "additionalProperties": {
2021-07-17T14:14:32.4700935Z [cluster2] "type": "string"
2021-07-17T14:14:32.4701484Z [cluster2] },
2021-07-17T14:14:32.4702048Z [cluster2] "type": "object"
2021-07-17T14:14:32.4702605Z [cluster2] },
2021-07-17T14:14:32.4703138Z [cluster2] "cable_name": {
2021-07-17T14:14:32.4703737Z [cluster2] "type": "string"
2021-07-17T14:14:32.4704284Z [cluster2] },
2021-07-17T14:14:32.4704831Z [cluster2] "cluster_id": {
2021-07-17T14:14:32.4705415Z [cluster2] "type": "string"
2021-07-17T14:14:32.4705967Z [cluster2] },
2021-07-17T14:14:32.4706614Z [cluster2] "healthCheckIP": {
2021-07-17T14:14:32.4707254Z [cluster2] "type": "string"
2021-07-17T14:14:32.4708050Z [cluster2] },
2021-07-17T14:14:32.4708594Z [cluster2] "hostname": {
2021-07-17T14:14:32.4709193Z [cluster2] "type": "string"
2021-07-17T14:14:32.4709740Z [cluster2] },
2021-07-17T14:14:32.4710301Z [cluster2] "nat_enabled": {
2021-07-17T14:14:32.4710917Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4711468Z [cluster2] },
2021-07-17T14:14:32.4712031Z [cluster2] "private_ip": {
2021-07-17T14:14:32.4712622Z [cluster2] "type": "string"
2021-07-17T14:14:32.4713180Z [cluster2] },
2021-07-17T14:14:32.4713707Z [cluster2] "public_ip": {
2021-07-17T14:14:32.4714299Z [cluster2] "type": "string"
2021-07-17T14:14:32.4714931Z [cluster2] },
2021-07-17T14:14:32.4715455Z [cluster2] "subnets": {
2021-07-17T14:14:32.4716019Z [cluster2] "items": {
2021-07-17T14:14:32.4716597Z [cluster2] "type": "string"
2021-07-17T14:14:32.4717161Z [cluster2] },
2021-07-17T14:14:32.4717705Z [cluster2] "type": "array"
2021-07-17T14:14:32.4718255Z [cluster2] }
2021-07-17T14:14:32.4718758Z [cluster2] },
2021-07-17T14:14:32.4719901Z [cluster2] "required": [
2021-07-17T14:14:32.4720496Z [cluster2] "backend",
2021-07-17T14:14:32.4721071Z [cluster2] "cable_name",
2021-07-17T14:14:32.4721654Z [cluster2] "cluster_id",
2021-07-17T14:14:32.4722231Z [cluster2] "hostname",
2021-07-17T14:14:32.4722828Z [cluster2] "nat_enabled",
2021-07-17T14:14:32.4723428Z [cluster2] "private_ip",
2021-07-17T14:14:32.4724006Z [cluster2] "public_ip",
2021-07-17T14:14:32.4724586Z [cluster2] "subnets"
2021-07-17T14:14:32.4725108Z [cluster2] ],
2021-07-17T14:14:32.4725654Z [cluster2] "type": "object"
2021-07-17T14:14:32.4726195Z [cluster2] },
2021-07-17T14:14:32.4726775Z [cluster2] "statusFailure": {
2021-07-17T14:14:32.4727402Z [cluster2] "type": "string"
2021-07-17T14:14:32.4727926Z [cluster2] },
2021-07-17T14:14:32.4728456Z [cluster2] "version": {
2021-07-17T14:14:32.4729137Z [cluster2] "type": "string"
2021-07-17T14:14:32.4729687Z [cluster2] }
2021-07-17T14:14:32.4730165Z [cluster2] },
2021-07-17T14:14:32.4730703Z [cluster2] "required": [
2021-07-17T14:14:32.4731305Z [cluster2] "connections",
2021-07-17T14:14:32.4731885Z [cluster2] "haStatus",
2021-07-17T14:14:32.4732503Z [cluster2] "localEndpoint",
2021-07-17T14:14:32.4733152Z [cluster2] "statusFailure",
2021-07-17T14:14:32.4733761Z [cluster2] "version"
2021-07-17T14:14:32.4734273Z [cluster2] ],
2021-07-17T14:14:32.4734815Z [cluster2] "type": "object"
2021-07-17T14:14:32.4735334Z [cluster2] },
2021-07-17T14:14:32.4735861Z [cluster2] "type": "array"
2021-07-17T14:14:32.4736376Z [cluster2] },
2021-07-17T14:14:32.4736899Z [cluster2] "globalCIDR": {
2021-07-17T14:14:32.4737483Z [cluster2] "type": "string"
2021-07-17T14:14:32.4738059Z [cluster2] },
2021-07-17T14:14:32.4738766Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-17T14:14:32.4739530Z [cluster2] "properties": {
2021-07-17T14:14:32.4740234Z [cluster2] "lastResourceVersion": {
2021-07-17T14:14:32.4740925Z [cluster2] "type": "string"
2021-07-17T14:14:32.4741456Z [cluster2] },
2021-07-17T14:14:32.4742189Z [cluster2] "mismatchedContainerImages": {
2021-07-17T14:14:32.4742967Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.4743511Z [cluster2] },
2021-07-17T14:14:32.4744198Z [cluster2] "nonReadyContainerStates": {
2021-07-17T14:14:32.4744924Z [cluster2] "items": {
2021-07-17T14:14:32.4746270Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T14:14:32.4747638Z [cluster2] "properties": {
2021-07-17T14:14:32.4755567Z [cluster2] "running": {
2021-07-17T14:14:32.4756333Z [cluster2] "description": "Details about a running container",
2021-07-17T14:14:32.4757385Z [cluster2] "properties": {
2021-07-17T14:14:32.4758201Z [cluster2] "startedAt": {
2021-07-17T14:14:32.4760789Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-17T14:14:32.4762062Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4769454Z [cluster2] "type": "string"
2021-07-17T14:14:32.4770642Z [cluster2] }
2021-07-17T14:14:32.4771329Z [cluster2] },
2021-07-17T14:14:32.4771906Z [cluster2] "type": "object"
2021-07-17T14:14:32.4772473Z [cluster2] },
2021-07-17T14:14:32.4773032Z [cluster2] "terminated": {
2021-07-17T14:14:32.4773827Z [cluster2] "description": "Details about a terminated container",
2021-07-17T14:14:32.4774620Z [cluster2] "properties": {
2021-07-17T14:14:32.4775274Z [cluster2] "containerID": {
2021-07-17T14:14:32.4776633Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T14:14:32.4777490Z [cluster2] "type": "string"
2021-07-17T14:14:32.4778106Z [cluster2] },
2021-07-17T14:14:32.4778752Z [cluster2] "exitCode": {
2021-07-17T14:14:32.4779980Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-17T14:14:32.4780921Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4781970Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4782637Z [cluster2] },
2021-07-17T14:14:32.4783240Z [cluster2] "finishedAt": {
2021-07-17T14:14:32.4784164Z [cluster2] "description": "Time at which the container last terminated",
2021-07-17T14:14:32.4785381Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4786054Z [cluster2] "type": "string"
2021-07-17T14:14:32.4786690Z [cluster2] },
2021-07-17T14:14:32.4787270Z [cluster2] "message": {
2021-07-17T14:14:32.4894690Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-17T14:14:32.4895703Z [cluster2] "type": "string"
2021-07-17T14:14:32.4896276Z [cluster2] },
2021-07-17T14:14:32.4896827Z [cluster2] "reason": {
2021-07-17T14:14:32.4897650Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-17T14:14:32.4898481Z [cluster2] "type": "string"
2021-07-17T14:14:32.4899030Z [cluster2] },
2021-07-17T14:14:32.4899571Z [cluster2] "signal": {
2021-07-17T14:14:32.4900366Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-17T14:14:32.4902702Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4903339Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4904114Z [cluster2] },
2021-07-17T14:14:32.4904679Z [cluster2] "startedAt": {
2021-07-17T14:14:32.4905536Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-17T14:14:32.4906931Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4907566Z [cluster2] "type": "string"
2021-07-17T14:14:32.4908424Z [cluster2] }
2021-07-17T14:14:32.4908924Z [cluster2] },
2021-07-17T14:14:32.4909463Z [cluster2] "required": [
2021-07-17T14:14:32.4910066Z [cluster2] "exitCode"
2021-07-17T14:14:32.4910607Z [cluster2] ],
2021-07-17T14:14:32.4911157Z [cluster2] "type": "object"
2021-07-17T14:14:32.4911698Z [cluster2] },
2021-07-17T14:14:32.4912230Z [cluster2] "waiting": {
2021-07-17T14:14:32.4913081Z [cluster2] "description": "Details about a waiting container",
2021-07-17T14:14:32.4913839Z [cluster2] "properties": {
2021-07-17T14:14:32.4914456Z [cluster2] "message": {
2021-07-17T14:14:32.4915292Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-17T14:14:32.4916138Z [cluster2] "type": "string"
2021-07-17T14:14:32.4916705Z [cluster2] },
2021-07-17T14:14:32.4917238Z [cluster2] "reason": {
2021-07-17T14:14:32.4918014Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-17T14:14:32.4918808Z [cluster2] "type": "string"
2021-07-17T14:14:32.4919368Z [cluster2] }
2021-07-17T14:14:32.4919861Z [cluster2] },
2021-07-17T14:14:32.4920422Z [cluster2] "type": "object"
2021-07-17T14:14:32.4920982Z [cluster2] }
2021-07-17T14:14:32.4921469Z [cluster2] },
2021-07-17T14:14:32.4922375Z [cluster2] "type": "object"
2021-07-17T14:14:32.4922911Z [cluster2] },
2021-07-17T14:14:32.4923444Z [cluster2] "type": "array"
2021-07-17T14:14:32.4923963Z [cluster2] },
2021-07-17T14:14:32.4924479Z [cluster2] "status": {
2021-07-17T14:14:32.4925350Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T14:14:32.4926236Z [cluster2] "properties": {
2021-07-17T14:14:32.4926976Z [cluster2] "collisionCount": {
2021-07-17T14:14:32.4928417Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T14:14:32.4929814Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4930424Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4930974Z [cluster2] },
2021-07-17T14:14:32.4931524Z [cluster2] "conditions": {
2021-07-17T14:14:32.4932826Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T14:14:32.4933756Z [cluster2] "items": {
2021-07-17T14:14:32.4934697Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T14:14:32.4935670Z [cluster2] "properties": {
2021-07-17T14:14:32.4936383Z [cluster2] "lastTransitionTime": {
2021-07-17T14:14:32.4937416Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T14:14:32.4938542Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.4939190Z [cluster2] "type": "string"
2021-07-17T14:14:32.4939742Z [cluster2] },
2021-07-17T14:14:32.4940297Z [cluster2] "message": {
2021-07-17T14:14:32.4941179Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-17T14:14:32.4942079Z [cluster2] "type": "string"
2021-07-17T14:14:32.4942643Z [cluster2] },
2021-07-17T14:14:32.4943177Z [cluster2] "reason": {
2021-07-17T14:14:32.4944227Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-17T14:14:32.4945022Z [cluster2] "type": "string"
2021-07-17T14:14:32.4945581Z [cluster2] },
2021-07-17T14:14:32.4946110Z [cluster2] "status": {
2021-07-17T14:14:32.4946922Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T14:14:32.4947740Z [cluster2] "type": "string"
2021-07-17T14:14:32.4948428Z [cluster2] },
2021-07-17T14:14:32.4948970Z [cluster2] "type": {
2021-07-17T14:14:32.4949685Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-17T14:14:32.4950442Z [cluster2] "type": "string"
2021-07-17T14:14:32.4951092Z [cluster2] }
2021-07-17T14:14:32.4951606Z [cluster2] },
2021-07-17T14:14:32.4952199Z [cluster2] "required": [
2021-07-17T14:14:32.4952767Z [cluster2] "status",
2021-07-17T14:14:32.4953325Z [cluster2] "type"
2021-07-17T14:14:32.4953853Z [cluster2] ],
2021-07-17T14:14:32.4954413Z [cluster2] "type": "object"
2021-07-17T14:14:32.4954974Z [cluster2] },
2021-07-17T14:14:32.4955509Z [cluster2] "type": "array"
2021-07-17T14:14:32.4956050Z [cluster2] },
2021-07-17T14:14:32.4956740Z [cluster2] "currentNumberScheduled": {
2021-07-17T14:14:32.4958265Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.4959622Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4960299Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4960859Z [cluster2] },
2021-07-17T14:14:32.4961546Z [cluster2] "desiredNumberScheduled": {
2021-07-17T14:14:32.4963143Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.4964580Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4965178Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4965735Z [cluster2] },
2021-07-17T14:14:32.4966321Z [cluster2] "numberAvailable": {
2021-07-17T14:14:32.4967610Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.4968826Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4969419Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4971491Z [cluster2] },
2021-07-17T14:14:32.4972126Z [cluster2] "numberMisscheduled": {
2021-07-17T14:14:32.4973576Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.4974929Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4975524Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4976082Z [cluster2] },
2021-07-17T14:14:32.4976640Z [cluster2] "numberReady": {
2021-07-17T14:14:32.4977757Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T14:14:32.4978728Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4979336Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4979893Z [cluster2] },
2021-07-17T14:14:32.4980504Z [cluster2] "numberUnavailable": {
2021-07-17T14:14:32.4981797Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.4982980Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4983590Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4984144Z [cluster2] },
2021-07-17T14:14:32.4984765Z [cluster2] "observedGeneration": {
2021-07-17T14:14:32.4985740Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T14:14:32.4986667Z [cluster2] "format": "int64",
2021-07-17T14:14:32.4987269Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4988107Z [cluster2] },
2021-07-17T14:14:32.4988805Z [cluster2] "updatedNumberScheduled": {
2021-07-17T14:14:32.4989797Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T14:14:32.4990607Z [cluster2] "format": "int32",
2021-07-17T14:14:32.4991213Z [cluster2] "type": "integer"
2021-07-17T14:14:32.4991752Z [cluster2] }
2021-07-17T14:14:32.4992252Z [cluster2] },
2021-07-17T14:14:32.4992793Z [cluster2] "required": [
2021-07-17T14:14:32.4993523Z [cluster2] "currentNumberScheduled",
2021-07-17T14:14:32.4994416Z [cluster2] "desiredNumberScheduled",
2021-07-17T14:14:32.4995241Z [cluster2] "numberMisscheduled",
2021-07-17T14:14:32.4995945Z [cluster2] "numberReady"
2021-07-17T14:14:32.4996491Z [cluster2] ],
2021-07-17T14:14:32.4997031Z [cluster2] "type": "object"
2021-07-17T14:14:32.4997571Z [cluster2] }
2021-07-17T14:14:32.4998040Z [cluster2] },
2021-07-17T14:14:32.4998567Z [cluster2] "required": [
2021-07-17T14:14:32.4999328Z [cluster2] "mismatchedContainerImages"
2021-07-17T14:14:32.5000052Z [cluster2] ],
2021-07-17T14:14:32.5000567Z [cluster2] "type": "object"
2021-07-17T14:14:32.5001091Z [cluster2] },
2021-07-17T14:14:32.5001704Z [cluster2] "loadBalancerStatus": {
2021-07-17T14:14:32.5002451Z [cluster2] "properties": {
2021-07-17T14:14:32.5003035Z [cluster2] "status": {
2021-07-17T14:14:32.5004378Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-17T14:14:32.5005331Z [cluster2] "properties": {
2021-07-17T14:14:32.5005919Z [cluster2] "ingress": {
2021-07-17T14:14:32.5007418Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-17T14:14:32.5008547Z [cluster2] "items": {
2021-07-17T14:14:32.5010127Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-17T14:14:32.5012218Z [cluster2] "properties": {
2021-07-17T14:14:32.5012831Z [cluster2] "hostname": {
2021-07-17T14:14:32.5014242Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-17T14:14:32.5015401Z [cluster2] "type": "string"
2021-07-17T14:14:32.5015953Z [cluster2] },
2021-07-17T14:14:32.5016480Z [cluster2] "ip": {
2021-07-17T14:14:32.5017841Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-17T14:14:32.5018898Z [cluster2] "type": "string"
2021-07-17T14:14:32.5019462Z [cluster2] }
2021-07-17T14:14:32.5019967Z [cluster2] },
2021-07-17T14:14:32.5020530Z [cluster2] "type": "object"
2021-07-17T14:14:32.5021080Z [cluster2] },
2021-07-17T14:14:32.5021630Z [cluster2] "type": "array"
2021-07-17T14:14:32.5022178Z [cluster2] }
2021-07-17T14:14:32.5022658Z [cluster2] },
2021-07-17T14:14:32.5023202Z [cluster2] "type": "object"
2021-07-17T14:14:32.5023727Z [cluster2] }
2021-07-17T14:14:32.5024209Z [cluster2] },
2021-07-17T14:14:32.5024723Z [cluster2] "type": "object"
2021-07-17T14:14:32.5025251Z [cluster2] },
2021-07-17T14:14:32.5025770Z [cluster2] "natEnabled": {
2021-07-17T14:14:32.5026368Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.5026894Z [cluster2] },
2021-07-17T14:14:32.5027434Z [cluster2] "networkPlugin": {
2021-07-17T14:14:32.5028214Z [cluster2] "type": "string"
2021-07-17T14:14:32.5028722Z [cluster2] },
2021-07-17T14:14:32.5029534Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-17T14:14:32.5030317Z [cluster2] "properties": {
2021-07-17T14:14:32.5031024Z [cluster2] "lastResourceVersion": {
2021-07-17T14:14:32.5031728Z [cluster2] "type": "string"
2021-07-17T14:14:32.5032252Z [cluster2] },
2021-07-17T14:14:32.5032981Z [cluster2] "mismatchedContainerImages": {
2021-07-17T14:14:32.5033758Z [cluster2] "type": "boolean"
2021-07-17T14:14:32.5034304Z [cluster2] },
2021-07-17T14:14:32.5034992Z [cluster2] "nonReadyContainerStates": {
2021-07-17T14:14:32.5035712Z [cluster2] "items": {
2021-07-17T14:14:32.5037059Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T14:14:32.5038424Z [cluster2] "properties": {
2021-07-17T14:14:32.5039023Z [cluster2] "running": {
2021-07-17T14:14:32.5039759Z [cluster2] "description": "Details about a running container",
2021-07-17T14:14:32.5040604Z [cluster2] "properties": {
2021-07-17T14:14:32.5041216Z [cluster2] "startedAt": {
2021-07-17T14:14:32.5042329Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-17T14:14:32.5043381Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.5044018Z [cluster2] "type": "string"
2021-07-17T14:14:32.5044584Z [cluster2] }
2021-07-17T14:14:32.5045084Z [cluster2] },
2021-07-17T14:14:32.5045646Z [cluster2] "type": "object"
2021-07-17T14:14:32.5046247Z [cluster2] },
2021-07-17T14:14:32.5046799Z [cluster2] "terminated": {
2021-07-17T14:14:32.5047594Z [cluster2] "description": "Details about a terminated container",
2021-07-17T14:14:32.5048380Z [cluster2] "properties": {
2021-07-17T14:14:32.5049029Z [cluster2] "containerID": {
2021-07-17T14:14:32.5050200Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T14:14:32.5051044Z [cluster2] "type": "string"
2021-07-17T14:14:32.5051609Z [cluster2] },
2021-07-17T14:14:32.5052210Z [cluster2] "exitCode": {
2021-07-17T14:14:32.5053051Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-17T14:14:32.5053870Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5054580Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5055163Z [cluster2] },
2021-07-17T14:14:32.5055724Z [cluster2] "finishedAt": {
2021-07-17T14:14:32.5056543Z [cluster2] "description": "Time at which the container last terminated",
2021-07-17T14:14:32.5057592Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.5058244Z [cluster2] "type": "string"
2021-07-17T14:14:32.5058811Z [cluster2] },
2021-07-17T14:14:32.5059355Z [cluster2] "message": {
2021-07-17T14:14:32.5060216Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-17T14:14:32.5061064Z [cluster2] "type": "string"
2021-07-17T14:14:32.5061635Z [cluster2] },
2021-07-17T14:14:32.5062184Z [cluster2] "reason": {
2021-07-17T14:14:32.5063000Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-17T14:14:32.5063915Z [cluster2] "type": "string"
2021-07-17T14:14:32.5064461Z [cluster2] },
2021-07-17T14:14:32.5065000Z [cluster2] "signal": {
2021-07-17T14:14:32.5065793Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-17T14:14:32.5066612Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5067235Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5075236Z [cluster2] },
2021-07-17T14:14:32.5075996Z [cluster2] "startedAt": {
2021-07-17T14:14:32.5076862Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-17T14:14:32.5078172Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.5078833Z [cluster2] "type": "string"
2021-07-17T14:14:32.5079390Z [cluster2] }
2021-07-17T14:14:32.5079912Z [cluster2] },
2021-07-17T14:14:32.5080461Z [cluster2] "required": [
2021-07-17T14:14:32.5081065Z [cluster2] "exitCode"
2021-07-17T14:14:32.5081608Z [cluster2] ],
2021-07-17T14:14:32.5082180Z [cluster2] "type": "object"
2021-07-17T14:14:32.5082739Z [cluster2] },
2021-07-17T14:14:32.5083265Z [cluster2] "waiting": {
2021-07-17T14:14:32.5084236Z [cluster2] "description": "Details about a waiting container",
2021-07-17T14:14:32.5085005Z [cluster2] "properties": {
2021-07-17T14:14:32.5085624Z [cluster2] "message": {
2021-07-17T14:14:32.5086468Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-17T14:14:32.5087297Z [cluster2] "type": "string"
2021-07-17T14:14:32.5087874Z [cluster2] },
2021-07-17T14:14:32.5088411Z [cluster2] "reason": {
2021-07-17T14:14:32.5089197Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-17T14:14:32.5089999Z [cluster2] "type": "string"
2021-07-17T14:14:32.5090556Z [cluster2] }
2021-07-17T14:14:32.5091067Z [cluster2] },
2021-07-17T14:14:32.5091612Z [cluster2] "type": "object"
2021-07-17T14:14:32.5092172Z [cluster2] }
2021-07-17T14:14:32.5092733Z [cluster2] },
2021-07-17T14:14:32.5093279Z [cluster2] "type": "object"
2021-07-17T14:14:32.5093812Z [cluster2] },
2021-07-17T14:14:32.5094354Z [cluster2] "type": "array"
2021-07-17T14:14:32.5096396Z [cluster2] },
2021-07-17T14:14:32.5096905Z [cluster2] "status": {
2021-07-17T14:14:32.5097788Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T14:14:32.5098675Z [cluster2] "properties": {
2021-07-17T14:14:32.5099328Z [cluster2] "collisionCount": {
2021-07-17T14:14:32.5100781Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T14:14:32.5102164Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5102782Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5103336Z [cluster2] },
2021-07-17T14:14:32.5103894Z [cluster2] "conditions": {
2021-07-17T14:14:32.5105236Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T14:14:32.5106140Z [cluster2] "items": {
2021-07-17T14:14:32.5107079Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T14:14:32.5108470Z [cluster2] "properties": {
2021-07-17T14:14:32.5109195Z [cluster2] "lastTransitionTime": {
2021-07-17T14:14:32.5110459Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T14:14:32.5112016Z [cluster2] "format": "date-time",
2021-07-17T14:14:32.5112674Z [cluster2] "type": "string"
2021-07-17T14:14:32.5113230Z [cluster2] },
2021-07-17T14:14:32.5113783Z [cluster2] "message": {
2021-07-17T14:14:32.5114667Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-17T14:14:32.5115569Z [cluster2] "type": "string"
2021-07-17T14:14:32.5116136Z [cluster2] },
2021-07-17T14:14:32.5116674Z [cluster2] "reason": {
2021-07-17T14:14:32.5117727Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-17T14:14:32.5118526Z [cluster2] "type": "string"
2021-07-17T14:14:32.5119092Z [cluster2] },
2021-07-17T14:14:32.5119631Z [cluster2] "status": {
2021-07-17T14:14:32.5120521Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T14:14:32.5121342Z [cluster2] "type": "string"
2021-07-17T14:14:32.5122414Z [cluster2] },
2021-07-17T14:14:32.5123043Z [cluster2] "type": {
2021-07-17T14:14:32.5123778Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-17T14:14:32.5124519Z [cluster2] "type": "string"
2021-07-17T14:14:32.5125082Z [cluster2] }
2021-07-17T14:14:32.5125585Z [cluster2] },
2021-07-17T14:14:32.5126145Z [cluster2] "required": [
2021-07-17T14:14:32.5126711Z [cluster2] "status",
2021-07-17T14:14:32.5127276Z [cluster2] "type"
2021-07-17T14:14:32.5127808Z [cluster2] ],
2021-07-17T14:14:32.5128357Z [cluster2] "type": "object"
2021-07-17T14:14:32.5128918Z [cluster2] },
2021-07-17T14:14:32.5129454Z [cluster2] "type": "array"
2021-07-17T14:14:32.5129994Z [cluster2] },
2021-07-17T14:14:32.5130677Z [cluster2] "currentNumberScheduled": {
2021-07-17T14:14:32.5132212Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5133793Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5134397Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5135041Z [cluster2] },
2021-07-17T14:14:32.5135738Z [cluster2] "desiredNumberScheduled": {
2021-07-17T14:14:32.5137335Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5138774Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5139373Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5139939Z [cluster2] },
2021-07-17T14:14:32.5140539Z [cluster2] "numberAvailable": {
2021-07-17T14:14:32.5141839Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.5143057Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5143652Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5144213Z [cluster2] },
2021-07-17T14:14:32.5144901Z [cluster2] "numberMisscheduled": {
2021-07-17T14:14:32.5146349Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5147698Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5148704Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5149432Z [cluster2] },
2021-07-17T14:14:32.5149990Z [cluster2] "numberReady": {
2021-07-17T14:14:32.5151014Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T14:14:32.5153879Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5154662Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5155237Z [cluster2] },
2021-07-17T14:14:32.5155849Z [cluster2] "numberUnavailable": {
2021-07-17T14:14:32.5158094Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.5159459Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5160200Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5160778Z [cluster2] },
2021-07-17T14:14:32.5161408Z [cluster2] "observedGeneration": {
2021-07-17T14:14:32.5163173Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T14:14:32.5164326Z [cluster2] "format": "int64",
2021-07-17T14:14:32.5165193Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5165759Z [cluster2] },
2021-07-17T14:14:32.5166448Z [cluster2] "updatedNumberScheduled": {
2021-07-17T14:14:32.5168296Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T14:14:32.5169144Z [cluster2] "format": "int32",
2021-07-17T14:14:32.5169737Z [cluster2] "type": "integer"
2021-07-17T14:14:32.5171273Z [cluster2] }
2021-07-17T14:14:32.5171777Z [cluster2] },
2021-07-17T14:14:32.5172745Z [cluster2] "required": [
2021-07-17T14:14:32.5173486Z [cluster2] "currentNumberScheduled",
2021-07-17T14:14:32.5174388Z [cluster2] "desiredNumberScheduled",
2021-07-17T14:14:32.5175229Z [cluster2] "numberMisscheduled",
2021-07-17T14:14:32.5175923Z [cluster2] "numberReady"
2021-07-17T14:14:32.5176490Z [cluster2] ],
2021-07-17T14:14:32.5177137Z [cluster2] "type": "object"
2021-07-17T14:14:32.5177680Z [cluster2] }
2021-07-17T14:14:32.5178144Z [cluster2] },
2021-07-17T14:14:32.5178666Z [cluster2] "required": [
2021-07-17T14:14:32.5179422Z [cluster2] "mismatchedContainerImages"
2021-07-17T14:14:32.5180145Z [cluster2] ],
2021-07-17T14:14:32.5180685Z [cluster2] "type": "object"
2021-07-17T14:14:32.5181197Z [cluster2] },
2021-07-17T14:14:32.5181741Z [cluster2] "serviceCIDR": {
2021-07-17T14:14:32.5182324Z [cluster2] "type": "string"
2021-07-17T14:14:32.5182846Z [cluster2] }
2021-07-17T14:14:32.5183305Z [cluster2] },
2021-07-17T14:14:32.5183811Z [cluster2] "required": [
2021-07-17T14:14:32.5184362Z [cluster2] "clusterID",
2021-07-17T14:14:32.5184951Z [cluster2] "natEnabled"
2021-07-17T14:14:32.5185473Z [cluster2] ],
2021-07-17T14:14:32.5185973Z [cluster2] "type": "object"
2021-07-17T14:14:32.5186483Z [cluster2] }
2021-07-17T14:14:32.5186921Z [cluster2] },
2021-07-17T14:14:32.5187421Z [cluster2] "type": "object"
2021-07-17T14:14:32.5188021Z [cluster2] }
2021-07-17T14:14:32.5188461Z [cluster2] },
2021-07-17T14:14:32.5188939Z [cluster2] "served": true,
2021-07-17T14:14:32.5189485Z [cluster2] "storage": true,
2021-07-17T14:14:32.5190052Z [cluster2] "subresources": {
2021-07-17T14:14:32.5190585Z [cluster2] "status": {}
2021-07-17T14:14:32.5191048Z [cluster2] }
2021-07-17T14:14:32.5191462Z [cluster2] }
2021-07-17T14:14:32.5191882Z [cluster2] ]
2021-07-17T14:14:32.5192279Z [cluster2] },
2021-07-17T14:14:32.5192717Z [cluster2] "status": {
2021-07-17T14:14:32.5193237Z [cluster2] "acceptedNames": {
2021-07-17T14:14:32.5195848Z [cluster2] "kind": "Submariner",
2021-07-17T14:14:32.5196802Z [cluster2] "listKind": "SubmarinerList",
2021-07-17T14:14:32.5197651Z [cluster2] "plural": "submariners",
2021-07-17T14:14:32.5198413Z [cluster2] "singular": "submariner"
2021-07-17T14:14:32.5199091Z [cluster2] },
2021-07-17T14:14:32.5199583Z [cluster2] "conditions": [
2021-07-17T14:14:32.5200202Z [cluster2] {
2021-07-17T14:14:32.5209834Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:15Z",
2021-07-17T14:14:32.5210600Z [cluster2] "message": "no conflicts found",
2021-07-17T14:14:32.5211251Z [cluster2] "reason": "NoConflicts",
2021-07-17T14:14:32.5211819Z [cluster2] "status": "True",
2021-07-17T14:14:32.5212416Z [cluster2] "type": "NamesAccepted"
2021-07-17T14:14:32.5213299Z [cluster2] },
2021-07-17T14:14:32.5213730Z [cluster2] {
2021-07-17T14:14:32.5214579Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:15Z",
2021-07-17T14:14:32.5215384Z [cluster2] "message": "the initial names have been accepted",
2021-07-17T14:14:32.5216214Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-17T14:14:32.5216891Z [cluster2] "status": "True",
2021-07-17T14:14:32.5217467Z [cluster2] "type": "Established"
2021-07-17T14:14:32.5217968Z [cluster2] }
2021-07-17T14:14:32.5218385Z [cluster2] ],
2021-07-17T14:14:32.5218893Z [cluster2] "storedVersions": [
2021-07-17T14:14:32.5219599Z [cluster2] "v1alpha1"
2021-07-17T14:14:32.5220041Z [cluster2] ]
2021-07-17T14:14:32.5220453Z [cluster2] }
2021-07-17T14:14:32.5220843Z [cluster2] }
2021-07-17T14:14:32.5222032Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-17T14:14:32.5223727Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-17T14:14:32.5226883Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-17T14:14:32.5228950Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.5230237Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.5231534Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submarind": "Cluster",
2021-07-17T14:14:32.5232390Z [cluster1] "listKind": "ClusterList",
2021-07-17T14:14:32.5233011Z [cluster1] "plural": "clusters",
2021-07-17T14:14:32.5233596Z [cluster1] "singular": "cluster"
2021-07-17T14:14:32.5234078Z [cluster1] },
2021-07-17T14:14:32.5234554Z [cluster1] "conditions": [
2021-07-17T14:14:32.5235015Z [cluster1] {
2021-07-17T14:14:32.5235812Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:12Z",
2021-07-17T14:14:32.5236527Z [cluster1] "message": "no conflicts found",
2021-07-17T14:14:32.5237169Z [cluster1] "reason": "NoConflicts",
2021-07-17T14:14:32.5237732Z [cluster1] "status": "True",
2021-07-17T14:14:32.5238330Z [cluster1] "type": "NamesAccepted"
2021-07-17T14:14:32.5238858Z [cluster1] },
2021-07-17T14:14:32.5239282Z [cluster1] {
2021-07-17T14:14:32.5240075Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:12Z",
2021-07-17T14:14:32.5240859Z [cluster1] "message": "the initial names have been accepted",
2021-07-17T14:14:32.5241690Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-17T14:14:32.5242758Z [cluster1] "status": "True",
2021-07-17T14:14:32.5243335Z [cluster1] "type": "Established"
2021-07-17T14:14:32.5243833Z [cluster1] }
2021-07-17T14:14:32.5244253Z [cluster1] ],
2021-07-17T14:14:32.5244757Z [cluster1] "storedVersions": [
2021-07-17T14:14:32.5245423Z [cluster1] "v1"
2021-07-17T14:14:32.5245843Z [cluster1] ]
2021-07-17T14:14:32.5246253Z [cluster1] }
2021-07-17T14:14:32.5246641Z [cluster1] }
2021-07-17T14:14:32.5247791Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-17T14:14:32.5249602Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-17T14:14:32.5252000Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:32.5253672Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.5254949Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.5256590Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:32.5258230Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T14:14:32.5259552Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T14:14:32.5262571Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:32.5264229Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-17T14:14:32.5265558Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-17T14:14:32.5267242Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:32.5269325Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T14:14:32.5270917Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-17T14:14:32.5273772Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-17T14:14:32.5275469Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-17T14:14:32.5276461Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-17T14:14:32.5277825Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T14:14:32.5279484Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-17T14:14:32.5281054Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T14:14:32.5283013Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T14:14:32.5317685Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-17T14:14:32.5318771Z [cluster1] NAME CREATED AT
2021-07-17T14:14:32.5319699Z [cluster1] submariners.submariner.io 2021-07-17T14:13:03Z
2021-07-17T14:14:32.5321286Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-17T14:14:32.5323064Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-17T14:14:32.5324804Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-17T14:14:32.5326548Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-17T14:14:32.5328216Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-17T14:14:32.5329215Z [cluster1] {
2021-07-17T14:14:32.5329849Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-17T14:14:32.5330744Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-17T14:14:32.5331435Z [cluster1] "metadata": {
2021-07-17T14:14:32.5331958Z [cluster1] "annotations": {
2021-07-17T14:14:32.5332979Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-17T14:14:32.5333937Z [cluster1] },
2021-07-17T14:14:32.5334729Z [cluster1] "creationTimestamp": "2021-07-17T14:13:03Z",
2021-07-17T14:14:32.5335356Z [cluster1] "generation": 1,
2021-07-17T14:14:32.5336085Z [cluster1] "name": "submariners.submariner.io",
2021-07-17T14:14:32.5336853Z [cluster1] "resourceVersion": "1613",
2021-07-17T14:14:32.5338074Z [cluster1] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-17T14:14:32.5339545Z [cluster1] "uid": "b55366f8-eb73-458e-8121-5718f8c95112"
2021-07-17T14:14:32.5340137Z [cluster1] },
2021-07-17T14:14:32.5340571Z [cluster1] "spec": {
2021-07-17T14:14:32.5341051Z [cluster1] "conversion": {
2021-07-17T14:14:32.5341592Z [cluster1] "strategy": "None"
2021-07-17T14:14:32.5342059Z [cluster1] },
2021-07-17T14:14:32.5342591Z [cluster1] "group": "submariner.io",
2021-07-17T14:14:32.5343125Z [cluster1] "names": {
2021-07-17T14:14:32.5343654Z [cluster1] "kind": "Submariner",
2021-07-17T14:14:32.5344284Z [cluster1] "listKind": "SubmarinerList",
2021-07-17T14:14:32.5344949Z [cluster1] "plural": "submariners",
2021-07-17T14:14:32.5345562Z [cluster1] "singular": "submariner"
2021-07-17T14:14:32.5346076Z [cluster1] },
2021-07-17T14:14:32.5346571Z [cluster1] "scope": "Namespaced",
2021-07-17T14:14:32.5347119Z [cluster1] "versions": [
2021-07-17T14:14:32.5347683Z [cluster1] {
2021-07-17T14:14:32.5348385Z [cluster1] "name": "v1alpha1",
2021-07-17T14:14:32.5348907Z [cluster1] "schema": {
2021-07-17T14:14:32.5349481Z [cluster1] "openAPIV3Schema": {
2021-07-17T14:14:32.5350309Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-17T14:14:32.5351076Z [cluster1] "properties": {
2021-07-17T14:14:32.5351659Z [cluster1] "apiVersion": {
2021-07-17T14:14:32.5354147Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-17T14:14:32.5356082Z [cluster1] "type": "string"
2021-07-17T14:14:32.5356600Z [cluster1] },
2021-07-17T14:14:32.5357072Z [cluster1] "kind": {
2021-07-17T14:14:32.5364515Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-17T14:14:32.5366442Z [cluster1] "type": "string"
2021-07-17T14:14:32.5366950Z [cluster1] },
2021-07-17T14:14:32.5367462Z [cluster1] "metadata": {
2021-07-17T14:14:32.5368018Z [cluster1] "type": "object"
2021-07-17T14:14:32.5368512Z [cluster1] },
2021-07-17T14:14:32.5368993Z [cluster1] "spec": {
2021-07-17T14:14:32.5369803Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-17T14:14:32.5371120Z [cluster1] "properties": {
2021-07-17T14:14:32.5371685Z [cluster1] "broker": {
2021-07-17T14:14:32.5372244Z [cluster1] "type": "string"
2021-07-17T14:14:32.5372767Z [cluster1] },
2021-07-17T14:14:32.5373537Z [cluster1] "brokerK8sApiServer": {
2021-07-17T14:14:32.5374221Z [cluster1] "type": "string"
2021-07-17T14:14:32.5374730Z [cluster1] },
2021-07-17T14:14:32.5375416Z [cluster1] "brokerK8sApiServerToken": {
2021-07-17T14:14:32.5376140Z [cluster1] "type": "string"
2021-07-17T14:14:32.5376663Z [cluster1] },
2021-07-17T14:14:32.5377194Z [cluster1] "brokerK8sCA": {
2021-07-17T14:14:32.5377784Z [cluster1] "type": "string"
2021-07-17T14:14:32.5378303Z [cluster1] },
2021-07-17T14:14:32.5378993Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-17T14:14:32.5379745Z [cluster1] "type": "string"
2021-07-17T14:14:32.5380255Z [cluster1] },
2021-07-17T14:14:32.5380794Z [cluster1] "cableDriver": {
2021-07-17T14:14:32.5381373Z [cluster1] "type": "string"
2021-07-17T14:14:32.5382358Z [cluster1] },
2021-07-17T14:14:32.5383206Z [cluster1] "ceIPSecDebug": {
2021-07-17T14:14:32.5383816Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5384456Z [cluster1] },
2021-07-17T14:14:32.5385112Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-17T14:14:32.5385841Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5386359Z [cluster1] },
2021-07-17T14:14:32.5386935Z [cluster1] "ceIPSecIKEPort": {
2021-07-17T14:14:32.5387563Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5388292Z [cluster1] },
2021-07-17T14:14:32.5388880Z [cluster1] "ceIPSecNATTPort": {
2021-07-17T14:14:32.5389513Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5390041Z [cluster1] },
2021-07-17T14:14:32.5390567Z [cluster1] "ceIPSecPSK": {
2021-07-17T14:14:32.5391162Z [cluster1] "type": "string"
2021-07-17T14:14:32.5391667Z [cluster1] },
2021-07-17T14:14:32.5392356Z [cluster1] "ceIPSecPreferredServer": {
2021-07-17T14:14:32.5393092Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5393620Z [cluster1] },
2021-07-17T14:14:32.5394161Z [cluster1] "clusterCIDR": {
2021-07-17T14:14:32.5394737Z [cluster1] "type": "string"
2021-07-17T14:14:32.5395254Z [cluster1] },
2021-07-17T14:14:32.5395760Z [cluster1] "clusterID": {
2021-07-17T14:14:32.5396328Z [cluster1] "type": "string"
2021-07-17T14:14:32.5396831Z [cluster1] },
2021-07-17T14:14:32.5397362Z [cluster1] "colorCodes": {
2021-07-17T14:14:32.5397931Z [cluster1] "type": "string"
2021-07-17T14:14:32.5398450Z [cluster1] },
2021-07-17T14:14:32.5399108Z [cluster1] "connectionHealthCheck": {
2021-07-17T14:14:32.5399819Z [cluster1] "properties": {
2021-07-17T14:14:32.5400406Z [cluster1] "enabled": {
2021-07-17T14:14:32.5401069Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5401626Z [cluster1] },
2021-07-17T14:14:32.5402201Z [cluster1] "intervalSeconds": {
2021-07-17T14:14:32.5403049Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-17T14:14:32.5403838Z [cluster1] "format": "int64",
2021-07-17T14:14:32.5404429Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5404978Z [cluster1] },
2021-07-17T14:14:32.5405595Z [cluster1] "maxPacketLossCount": {
2021-07-17T14:14:32.5406639Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-17T14:14:32.5407580Z [cluster1] "format": "int64",
2021-07-17T14:14:32.5408174Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5408719Z [cluster1] }
2021-07-17T14:14:32.5409182Z [cluster1] },
2021-07-17T14:14:32.5409711Z [cluster1] "type": "object"
2021-07-17T14:14:32.5410321Z [cluster1] },
2021-07-17T14:14:32.5410951Z [cluster1] "coreDNSCustomConfig": {
2021-07-17T14:14:32.5411644Z [cluster1] "properties": {
2021-07-17T14:14:32.5412264Z [cluster1] "configMapName": {
2021-07-17T14:14:32.5412891Z [cluster1] "type": "string"
2021-07-17T14:14:32.5413416Z [cluster1] },
2021-07-17T14:14:32.5413954Z [cluster1] "namespace": {
2021-07-17T14:14:32.5414528Z [cluster1] "type": "string"
2021-07-17T14:14:32.5415061Z [cluster1] }
2021-07-17T14:14:32.5415524Z [cluster1] },
2021-07-17T14:14:32.5416060Z [cluster1] "type": "object"
2021-07-17T14:14:32.5416586Z [cluster1] },
2021-07-17T14:14:32.5417121Z [cluster1] "customDomains": {
2021-07-17T14:14:32.5417698Z [cluster1] "items": {
2021-07-17T14:14:32.5418235Z [cluster1] "type": "string"
2021-07-17T14:14:32.5418759Z [cluster1] },
2021-07-17T14:14:32.5419273Z [cluster1] "type": "array",
2021-07-17T14:14:32.5420338Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-17T14:14:32.5421011Z [cluster1] },
2021-07-17T14:14:32.5421493Z [cluster1] "debug": {
2021-07-17T14:14:32.5422051Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5422569Z [cluster1] },
2021-07-17T14:14:32.5423104Z [cluster1] "globalCIDR": {
2021-07-17T14:14:32.5423674Z [cluster1] "type": "string"
2021-07-17T14:14:32.5424195Z [cluster1] },
2021-07-17T14:14:32.5424755Z [cluster1] "imageOverrides": {
2021-07-17T14:14:32.5425498Z [cluster1] "additionalProperties": {
2021-07-17T14:14:32.5426274Z [cluster1] "type": "string"
2021-07-17T14:14:32.5426793Z [cluster1] },
2021-07-17T14:14:32.5427323Z [cluster1] "type": "object"
2021-07-17T14:14:32.5435383Z [cluster1] },
2021-07-17T14:14:32.5436131Z [cluster1] "loadBalancerEnabled": {
2021-07-17T14:14:32.5436823Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5437372Z [cluster1] },
2021-07-17T14:14:32.5437892Z [cluster1] "namespace": {
2021-07-17T14:14:32.5438476Z [cluster1] "type": "string"
2021-07-17T14:14:32.5438997Z [cluster1] },
2021-07-17T14:14:32.5439515Z [cluster1] "natEnabled": {
2021-07-17T14:14:32.5440114Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5440631Z [cluster1] },
2021-07-17T14:14:32.5441163Z [cluster1] "repository": {
2021-07-17T14:14:32.5441731Z [cluster1] "type": "string"
2021-07-17T14:14:32.5442252Z [cluster1] },
2021-07-17T14:14:32.5442794Z [cluster1] "serviceCIDR": {
2021-07-17T14:14:32.5443375Z [cluster1] "type": "string"
2021-07-17T14:14:32.5444063Z [cluster1] },
2021-07-17T14:14:32.5444732Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-17T14:14:32.5445486Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5446006Z [cluster1] },
2021-07-17T14:14:32.5446517Z [cluster1] "version": {
2021-07-17T14:14:32.5447069Z [cluster1] "type": "string"
2021-07-17T14:14:32.5447589Z [cluster1] }
2021-07-17T14:14:32.5448057Z [cluster1] },
2021-07-17T14:14:32.5448557Z [cluster1] "required": [
2021-07-17T14:14:32.5449102Z [cluster1] "broker",
2021-07-17T14:14:32.5449738Z [cluster1] "brokerK8sApiServer",
2021-07-17T14:14:32.5450565Z [cluster1] "brokerK8sApiServerToken",
2021-07-17T14:14:32.5451303Z [cluster1] "brokerK8sCA",
2021-07-17T14:14:32.5461045Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-17T14:14:32.5461841Z [cluster1] "ceIPSecDebug",
2021-07-17T14:14:32.5462467Z [cluster1] "ceIPSecPSK",
2021-07-17T14:14:32.5463088Z [cluster1] "clusterCIDR",
2021-07-17T14:14:32.5463657Z [cluster1] "clusterID",
2021-07-17T14:14:32.5464200Z [cluster1] "debug",
2021-07-17T14:14:32.5464737Z [cluster1] "namespace",
2021-07-17T14:14:32.5465320Z [cluster1] "natEnabled",
2021-07-17T14:14:32.5465908Z [cluster1] "serviceCIDR"
2021-07-17T14:14:32.5466449Z [cluster1] ],
2021-07-17T14:14:32.5466955Z [cluster1] "type": "object"
2021-07-17T14:14:32.5467461Z [cluster1] },
2021-07-17T14:14:32.5468177Z [cluster1] "status": {
2021-07-17T14:14:32.5469017Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-17T14:14:32.5470060Z [cluster1] "properties": {
2021-07-17T14:14:32.5470662Z [cluster1] "clusterCIDR": {
2021-07-17T14:14:32.5471253Z [cluster1] "type": "string"
2021-07-17T14:14:32.5471766Z [cluster1] },
2021-07-17T14:14:32.5472291Z [cluster1] "clusterID": {
2021-07-17T14:14:32.5472849Z [cluster1] "type": "string"
2021-07-17T14:14:32.5473380Z [cluster1] },
2021-07-17T14:14:32.5473912Z [cluster1] "colorCodes": {
2021-07-17T14:14:32.5474482Z [cluster1] "type": "string"
2021-07-17T14:14:32.5475004Z [cluster1] },
2021-07-17T14:14:32.5475565Z [cluster1] "deploymentInfo": {
2021-07-17T14:14:32.5476205Z [cluster1] "properties": {
2021-07-17T14:14:32.5476826Z [cluster1] "cloudProvider": {
2021-07-17T14:14:32.5477452Z [cluster1] "type": "string"
2021-07-17T14:14:32.5477991Z [cluster1] },
2021-07-17T14:14:32.5478562Z [cluster1] "kubernetesType": {
2021-07-17T14:14:32.5479210Z [cluster1] "type": "string"
2021-07-17T14:14:32.5479795Z [cluster1] },
2021-07-17T14:14:32.5481073Z [cluster1] "kubernetesTypeVersion": {
2021-07-17T14:14:32.5481785Z [cluster1] "type": "string"
2021-07-17T14:14:32.5482322Z [cluster1] },
2021-07-17T14:14:32.5482942Z [cluster1] "kubernetesVersion": {
2021-07-17T14:14:32.5483597Z [cluster1] "type": "string"
2021-07-17T14:14:32.5484138Z [cluster1] }
2021-07-17T14:14:32.5484605Z [cluster1] },
2021-07-17T14:14:32.5485135Z [cluster1] "type": "object"
2021-07-17T14:14:32.5485645Z [cluster1] },
2021-07-17T14:14:32.5486314Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-17T14:14:32.5487043Z [cluster1] "properties": {
2021-07-17T14:14:32.5487745Z [cluster1] "lastResourceVersion": {
2021-07-17T14:14:32.5488438Z [cluster1] "type": "string"
2021-07-17T14:14:32.5488960Z [cluster1] },
2021-07-17T14:14:32.5489685Z [cluster1] "mismatchedContainerImages": {
2021-07-17T14:14:32.5490469Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5491009Z [cluster1] },
2021-07-17T14:14:32.5491688Z [cluster1] "nonReadyContainerStates": {
2021-07-17T14:14:32.5492417Z [cluster1] "items": {
2021-07-17T14:14:32.5493754Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T14:14:32.5495132Z [cluster1] "properties": {
2021-07-17T14:14:32.5495734Z [cluster1] "running": {
2021-07-17T14:14:32.5496531Z [cluster1] "description": "Details about a running container",
2021-07-17T14:14:32.5497295Z [cluster1] "properties": {
2021-07-17T14:14:32.5497919Z [cluster1] "startedAt": {
2021-07-17T14:14:32.5499204Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-17T14:14:32.5500238Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5500893Z [cluster1] "type": "string"
2021-07-17T14:14:32.5501446Z [cluster1] }
2021-07-17T14:14:32.5501960Z [cluster1] },
2021-07-17T14:14:32.5502503Z [cluster1] "type": "object"
2021-07-17T14:14:32.5503069Z [cluster1] },
2021-07-17T14:14:32.5503637Z [cluster1] "terminated": {
2021-07-17T14:14:32.5504412Z [cluster1] "description": "Details about a terminated container",
2021-07-17T14:14:32.5505205Z [cluster1] "properties": {
2021-07-17T14:14:32.5505906Z [cluster1] "containerID": {
2021-07-17T14:14:32.5507078Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T14:14:32.5508336Z [cluster1] "type": "string"
2021-07-17T14:14:32.5508910Z [cluster1] },
2021-07-17T14:14:32.5509489Z [cluster1] "exitCode": {
2021-07-17T14:14:32.5510315Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-17T14:14:32.5511934Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5512579Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5513152Z [cluster1] },
2021-07-17T14:14:32.5513727Z [cluster1] "finishedAt": {
2021-07-17T14:14:32.5514522Z [cluster1] "description": "Time at which the container last terminated",
2021-07-17T14:14:32.5515649Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5516299Z [cluster1] "type": "string"
2021-07-17T14:14:32.5516853Z [cluster1] },
2021-07-17T14:14:32.5517410Z [cluster1] "message": {
2021-07-17T14:14:32.5518253Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-17T14:14:32.5519123Z [cluster1] "type": "string"
2021-07-17T14:14:32.5519692Z [cluster1] },
2021-07-17T14:14:32.5520225Z [cluster1] "reason": {
2021-07-17T14:14:32.5521170Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-17T14:14:32.5522004Z [cluster1] "type": "string"
2021-07-17T14:14:32.5522568Z [cluster1] },
2021-07-17T14:14:32.5523112Z [cluster1] "signal": {
2021-07-17T14:14:32.5523898Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-17T14:14:32.5524718Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5525334Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5525908Z [cluster1] },
2021-07-17T14:14:32.5526469Z [cluster1] "startedAt": {
2021-07-17T14:14:32.5527333Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-17T14:14:32.5528452Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5529085Z [cluster1] "type": "string"
2021-07-17T14:14:32.5529727Z [cluster1] }
2021-07-17T14:14:32.5530230Z [cluster1] },
2021-07-17T14:14:32.5530781Z [cluster1] "required": [
2021-07-17T14:14:32.5531381Z [cluster1] "exitCode"
2021-07-17T14:14:32.5531926Z [cluster1] ],
2021-07-17T14:14:32.5532487Z [cluster1] "type": "object"
2021-07-17T14:14:32.5533028Z [cluster1] },
2021-07-17T14:14:32.5533566Z [cluster1] "waiting": {
2021-07-17T14:14:32.5534292Z [cluster1] "description": "Details about a waiting container",
2021-07-17T14:14:32.5535067Z [cluster1] "properties": {
2021-07-17T14:14:32.5535674Z [cluster1] "message": {
2021-07-17T14:14:32.5536493Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-17T14:14:32.5537336Z [cluster1] "type": "string"
2021-07-17T14:14:32.5537883Z [cluster1] },
2021-07-17T14:14:32.5538430Z [cluster1] "reason": {
2021-07-17T14:14:32.5539206Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-17T14:14:32.5539986Z [cluster1] "type": "string"
2021-07-17T14:14:32.5540555Z [cluster1] }
2021-07-17T14:14:32.5541054Z [cluster1] },
2021-07-17T14:14:32.5541610Z [cluster1] "type": "object"
2021-07-17T14:14:32.5542156Z [cluster1] }
2021-07-17T14:14:32.5542710Z [cluster1] },
2021-07-17T14:14:32.5543264Z [cluster1] "type": "object"
2021-07-17T14:14:32.5543796Z [cluster1] },
2021-07-17T14:14:32.5544603Z [cluster1] "type": "array"
2021-07-17T14:14:32.5545123Z [cluster1] },
2021-07-17T14:14:32.5545635Z [cluster1] "status": {
2021-07-17T14:14:32.5546498Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T14:14:32.5547410Z [cluster1] "properties": {
2021-07-17T14:14:32.5548216Z [cluster1] "collisionCount": {
2021-07-17T14:14:32.5549653Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T14:14:32.5551040Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5551653Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5552237Z [cluster1] },
2021-07-17T14:14:32.5552865Z [cluster1] "conditions": {
2021-07-17T14:14:32.5554151Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T14:14:32.5555071Z [cluster1] "items": {
2021-07-17T14:14:32.5556022Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T14:14:32.5556991Z [cluster1] "properties": {
2021-07-17T14:14:32.5557710Z [cluster1] "lastTransitionTime": {
2021-07-17T14:14:32.5558663Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T14:14:32.5559789Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5560428Z [cluster1] "type": "string"
2021-07-17T14:14:32.5560974Z [cluster1] },
2021-07-17T14:14:32.5561528Z [cluster1] "message": {
2021-07-17T14:14:32.5562413Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-17T14:14:32.5563554Z [cluster1] "type": "string"
2021-07-17T14:14:32.5564120Z [cluster1] },
2021-07-17T14:14:32.5564649Z [cluster1] "reason": {
2021-07-17T14:14:32.5565731Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-17T14:14:32.5566528Z [cluster1] "type": "string"
2021-07-17T14:14:32.5567096Z [cluster1] },
2021-07-17T14:14:32.5567727Z [cluster1] "status": {
2021-07-17T14:14:32.5568521Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T14:14:32.5569338Z [cluster1] "type": "string"
2021-07-17T14:14:32.5570087Z [cluster1] },
2021-07-17T14:14:32.5570630Z [cluster1] "type": {
2021-07-17T14:14:32.5571360Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-17T14:14:32.5572117Z [cluster1] "type": "string"
2021-07-17T14:14:32.5572683Z [cluster1] }
2021-07-17T14:14:32.5573188Z [cluster1] },
2021-07-17T14:14:32.5573743Z [cluster1] "required": [
2021-07-17T14:14:32.5574313Z [cluster1] "status",
2021-07-17T14:14:32.5574880Z [cluster1] "type"
2021-07-17T14:14:32.5575397Z [cluster1] ],
2021-07-17T14:14:32.5575959Z [cluster1] "type": "object"
2021-07-17T14:14:32.5576575Z [cluster1] },
2021-07-17T14:14:32.5577105Z [cluster1] "type": "array"
2021-07-17T14:14:32.5577648Z [cluster1] },
2021-07-17T14:14:32.5578328Z [cluster1] "currentNumberScheduled": {
2021-07-17T14:14:32.5579857Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5581225Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5581835Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5582404Z [cluster1] },
2021-07-17T14:14:32.5583087Z [cluster1] "desiredNumberScheduled": {
2021-07-17T14:14:32.5584679Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5586118Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5586726Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5587274Z [cluster1] },
2021-07-17T14:14:32.5588077Z [cluster1] "numberAvailable": {
2021-07-17T14:14:32.5589367Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.5590596Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5591207Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5591827Z [cluster1] },
2021-07-17T14:14:32.5592478Z [cluster1] "numberMisscheduled": {
2021-07-17T14:14:32.5593906Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5595252Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5595863Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5596409Z [cluster1] },
2021-07-17T14:14:32.5596978Z [cluster1] "numberReady": {
2021-07-17T14:14:32.5597987Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T14:14:32.5598977Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5599585Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5600130Z [cluster1] },
2021-07-17T14:14:32.5600758Z [cluster1] "numberUnavailable": {
2021-07-17T14:14:32.5602100Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.5603302Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5603891Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5604457Z [cluster1] },
2021-07-17T14:14:32.5605288Z [cluster1] "observedGeneration": {
2021-07-17T14:14:32.5606261Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T14:14:32.5607146Z [cluster1] "format": "int64",
2021-07-17T14:14:32.5607740Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5608296Z [cluster1] },
2021-07-17T14:14:32.5609005Z [cluster1] "updatedNumberScheduled": {
2021-07-17T14:14:32.5609976Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T14:14:32.5610801Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5611399Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5611957Z [cluster1] }
2021-07-17T14:14:32.5612433Z [cluster1] },
2021-07-17T14:14:32.5613018Z [cluster1] "required": [
2021-07-17T14:14:32.5613755Z [cluster1] "currentNumberScheduled",
2021-07-17T14:14:32.5614636Z [cluster1] "desiredNumberScheduled",
2021-07-17T14:14:32.5615461Z [cluster1] "numberMisscheduled",
2021-07-17T14:14:32.5616148Z [cluster1] "numberReady"
2021-07-17T14:14:32.5616712Z [cluster1] ],
2021-07-17T14:14:32.5617300Z [cluster1] "type": "object"
2021-07-17T14:14:32.5617844Z [cluster1] }
2021-07-17T14:14:32.5618325Z [cluster1] },
2021-07-17T14:14:32.5618833Z [cluster1] "required": [
2021-07-17T14:14:32.5619594Z [cluster1] "mismatchedContainerImages"
2021-07-17T14:14:32.5620309Z [cluster1] ],
2021-07-17T14:14:32.5620837Z [cluster1] "type": "object"
2021-07-17T14:14:32.5621344Z [cluster1] },
2021-07-17T14:14:32.5621855Z [cluster1] "gateways": {
2021-07-17T14:14:32.5622381Z [cluster1] "items": {
2021-07-17T14:14:32.5622951Z [cluster1] "properties": {
2021-07-17T14:14:32.5623570Z [cluster1] "connections": {
2021-07-17T14:14:32.5624140Z [cluster1] "items": {
2021-07-17T14:14:32.5624729Z [cluster1] "properties": {
2021-07-17T14:14:32.5625330Z [cluster1] "endpoint": {
2021-07-17T14:14:32.5625957Z [cluster1] "properties": {
2021-07-17T14:14:32.5626622Z [cluster1] "backend": {
2021-07-17T14:14:32.5627233Z [cluster1] "type": "string"
2021-07-17T14:14:32.5628419Z [cluster1] },
2021-07-17T14:14:32.5629030Z [cluster1] "backend_config": {
2021-07-17T14:14:32.5629789Z [cluster1] "additionalProperties": {
2021-07-17T14:14:32.5630520Z [cluster1] "type": "string"
2021-07-17T14:14:32.5631102Z [cluster1] },
2021-07-17T14:14:32.5631687Z [cluster1] "type": "object"
2021-07-17T14:14:32.5632249Z [cluster1] },
2021-07-17T14:14:32.5632814Z [cluster1] "cable_name": {
2021-07-17T14:14:32.5633407Z [cluster1] "type": "string"
2021-07-17T14:14:32.5633977Z [cluster1] },
2021-07-17T14:14:32.5634530Z [cluster1] "cluster_id": {
2021-07-17T14:14:32.5635144Z [cluster1] "type": "string"
2021-07-17T14:14:32.5635951Z [cluster1] },
2021-07-17T14:14:32.5636552Z [cluster1] "healthCheckIP": {
2021-07-17T14:14:32.5637213Z [cluster1] "type": "string"
2021-07-17T14:14:32.5637775Z [cluster1] },
2021-07-17T14:14:32.5638340Z [cluster1] "hostname": {
2021-07-17T14:14:32.5638957Z [cluster1] "type": "string"
2021-07-17T14:14:32.5639628Z [cluster1] },
2021-07-17T14:14:32.5640207Z [cluster1] "nat_enabled": {
2021-07-17T14:14:32.5640822Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5641404Z [cluster1] },
2021-07-17T14:14:32.5641960Z [cluster1] "private_ip": {
2021-07-17T14:14:32.5642585Z [cluster1] "type": "string"
2021-07-17T14:14:32.5643156Z [cluster1] },
2021-07-17T14:14:32.5643693Z [cluster1] "public_ip": {
2021-07-17T14:14:32.5644305Z [cluster1] "type": "string"
2021-07-17T14:14:32.5644860Z [cluster1] },
2021-07-17T14:14:32.5645414Z [cluster1] "subnets": {
2021-07-17T14:14:32.5645993Z [cluster1] "items": {
2021-07-17T14:14:32.5646577Z [cluster1] "type": "string"
2021-07-17T14:14:32.5647225Z [cluster1] },
2021-07-17T14:14:32.5647989Z [cluster1] "type": "array"
2021-07-17T14:14:32.5648560Z [cluster1] }
2021-07-17T14:14:32.5649067Z [cluster1] },
2021-07-17T14:14:32.5649630Z [cluster1] "required": [
2021-07-17T14:14:32.5650232Z [cluster1] "backend",
2021-07-17T14:14:32.5650814Z [cluster1] "cable_name",
2021-07-17T14:14:32.5651411Z [cluster1] "cluster_id",
2021-07-17T14:14:32.5652038Z [cluster1] "hostname",
2021-07-17T14:14:32.5652647Z [cluster1] "nat_enabled",
2021-07-17T14:14:32.5653243Z [cluster1] "private_ip",
2021-07-17T14:14:32.5653848Z [cluster1] "public_ip",
2021-07-17T14:14:32.5654442Z [cluster1] "subnets"
2021-07-17T14:14:32.5654984Z [cluster1] ],
2021-07-17T14:14:32.5655546Z [cluster1] "type": "object"
2021-07-17T14:14:32.5656094Z [cluster1] },
2021-07-17T14:14:32.5656668Z [cluster1] "latencyRTT": {
2021-07-17T14:14:32.5657749Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-17T14:14:32.5658810Z [cluster1] "properties": {
2021-07-17T14:14:32.5659426Z [cluster1] "average": {
2021-07-17T14:14:32.5660097Z [cluster1] "type": "string"
2021-07-17T14:14:32.5660670Z [cluster1] },
2021-07-17T14:14:32.5661212Z [cluster1] "last": {
2021-07-17T14:14:32.5661787Z [cluster1] "type": "string"
2021-07-17T14:14:32.5662352Z [cluster1] },
2021-07-17T14:14:32.5662879Z [cluster1] "max": {
2021-07-17T14:14:32.5663464Z [cluster1] "type": "string"
2021-07-17T14:14:32.5664026Z [cluster1] },
2021-07-17T14:14:32.5664558Z [cluster1] "min": {
2021-07-17T14:14:32.5665153Z [cluster1] "type": "string"
2021-07-17T14:14:32.5665711Z [cluster1] },
2021-07-17T14:14:32.5666262Z [cluster1] "stdDev": {
2021-07-17T14:14:32.5666849Z [cluster1] "type": "string"
2021-07-17T14:14:32.5667416Z [cluster1] }
2021-07-17T14:14:32.5668207Z [cluster1] },
2021-07-17T14:14:32.5668786Z [cluster1] "type": "object"
2021-07-17T14:14:32.5669345Z [cluster1] },
2021-07-17T14:14:32.5669871Z [cluster1] "status": {
2021-07-17T14:14:32.5670462Z [cluster1] "type": "string"
2021-07-17T14:14:32.5671006Z [cluster1] },
2021-07-17T14:14:32.5671614Z [cluster1] "statusMessage": {
2021-07-17T14:14:32.5672246Z [cluster1] "type": "string"
2021-07-17T14:14:32.5672809Z [cluster1] },
2021-07-17T14:14:32.5673361Z [cluster1] "usingIP": {
2021-07-17T14:14:32.5673947Z [cluster1] "type": "string"
2021-07-17T14:14:32.5674505Z [cluster1] },
2021-07-17T14:14:32.5675039Z [cluster1] "usingNAT": {
2021-07-17T14:14:32.5675647Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5676210Z [cluster1] }
2021-07-17T14:14:32.5676702Z [cluster1] },
2021-07-17T14:14:32.5677247Z [cluster1] "required": [
2021-07-17T14:14:32.5677828Z [cluster1] "endpoint",
2021-07-17T14:14:32.5678406Z [cluster1] "status",
2021-07-17T14:14:32.5679012Z [cluster1] "statusMessage"
2021-07-17T14:14:32.5679602Z [cluster1] ],
2021-07-17T14:14:32.5680153Z [cluster1] "type": "object"
2021-07-17T14:14:32.5681437Z [cluster1] },
2021-07-17T14:14:32.5682089Z [cluster1] "type": "array"
2021-07-17T14:14:32.5682618Z [cluster1] },
2021-07-17T14:14:32.5683154Z [cluster1] "haStatus": {
2021-07-17T14:14:32.5683730Z [cluster1] "type": "string"
2021-07-17T14:14:32.5684312Z [cluster1] },
2021-07-17T14:14:32.5685064Z [cluster1] "localEndpoint": {
2021-07-17T14:14:32.5685713Z [cluster1] "properties": {
2021-07-17T14:14:32.5686317Z [cluster1] "backend": {
2021-07-17T14:14:32.5686887Z [cluster1] "type": "string"
2021-07-17T14:14:32.5687443Z [cluster1] },
2021-07-17T14:14:32.5688005Z [cluster1] "backend_config": {
2021-07-17T14:14:32.5688744Z [cluster1] "additionalProperties": {
2021-07-17T14:14:32.5689479Z [cluster1] "type": "string"
2021-07-17T14:14:32.5690024Z [cluster1] },
2021-07-17T14:14:32.5690664Z [cluster1] "type": "object"
2021-07-17T14:14:32.5691203Z [cluster1] },
2021-07-17T14:14:32.5691751Z [cluster1] "cable_name": {
2021-07-17T14:14:32.5692327Z [cluster1] "type": "string"
2021-07-17T14:14:32.5692887Z [cluster1] },
2021-07-17T14:14:32.5693433Z [cluster1] "cluster_id": {
2021-07-17T14:14:32.5694010Z [cluster1] "type": "string"
2021-07-17T14:14:32.5694569Z [cluster1] },
2021-07-17T14:14:32.5695145Z [cluster1] "healthCheckIP": {
2021-07-17T14:14:32.5695793Z [cluster1] "type": "string"
2021-07-17T14:14:32.5696336Z [cluster1] },
2021-07-17T14:14:32.5697062Z [cluster1] "hostname": {
2021-07-17T14:14:32.5697663Z [cluster1] "type": "string"
2021-07-17T14:14:32.5698199Z [cluster1] },
2021-07-17T14:14:32.5698756Z [cluster1] "nat_enabled": {
2021-07-17T14:14:32.5699353Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5699921Z [cluster1] },
2021-07-17T14:14:32.5700457Z [cluster1] "private_ip": {
2021-07-17T14:14:32.5701060Z [cluster1] "type": "string"
2021-07-17T14:14:32.5701620Z [cluster1] },
2021-07-17T14:14:32.5703561Z [cluster1] "public_ip": {
2021-07-17T14:14:32.5706086Z [cluster1] "type": "string"
2021-07-17T14:14:32.5706642Z [cluster1] },
2021-07-17T14:14:32.5707334Z [cluster1] "subnets": {
2021-07-17T14:14:32.5708209Z [cluster1] "items": {
2021-07-17T14:14:32.5708801Z [cluster1] "type": "string"
2021-07-17T14:14:32.5709369Z [cluster1] },
2021-07-17T14:14:32.5709911Z [cluster1] "type": "array"
2021-07-17T14:14:32.5710472Z [cluster1] }
2021-07-17T14:14:32.5710958Z [cluster1] },
2021-07-17T14:14:32.5711500Z [cluster1] "required": [
2021-07-17T14:14:32.5712070Z [cluster1] "backend",
2021-07-17T14:14:32.5712647Z [cluster1] "cable_name",
2021-07-17T14:14:32.5713238Z [cluster1] "cluster_id",
2021-07-17T14:14:32.5713808Z [cluster1] "hostname",
2021-07-17T14:14:32.5714394Z [cluster1] "nat_enabled",
2021-07-17T14:14:32.5714981Z [cluster1] "private_ip",
2021-07-17T14:14:32.5715569Z [cluster1] "public_ip",
2021-07-17T14:14:32.5716225Z [cluster1] "subnets"
2021-07-17T14:14:32.5716753Z [cluster1] ],
2021-07-17T14:14:32.5717296Z [cluster1] "type": "object"
2021-07-17T14:14:32.5717826Z [cluster1] },
2021-07-17T14:14:32.5718404Z [cluster1] "statusFailure": {
2021-07-17T14:14:32.5719021Z [cluster1] "type": "string"
2021-07-17T14:14:32.5719561Z [cluster1] },
2021-07-17T14:14:32.5720074Z [cluster1] "version": {
2021-07-17T14:14:32.5720654Z [cluster1] "type": "string"
2021-07-17T14:14:32.5721182Z [cluster1] }
2021-07-17T14:14:32.5721672Z [cluster1] },
2021-07-17T14:14:32.5722200Z [cluster1] "required": [
2021-07-17T14:14:32.5722785Z [cluster1] "connections",
2021-07-17T14:14:32.5723380Z [cluster1] "haStatus",
2021-07-17T14:14:32.5723987Z [cluster1] "localEndpoint",
2021-07-17T14:14:32.5724646Z [cluster1] "statusFailure",
2021-07-17T14:14:32.5725237Z [cluster1] "version"
2021-07-17T14:14:32.5725755Z [cluster1] ],
2021-07-17T14:14:32.5726294Z [cluster1] "type": "object"
2021-07-17T14:14:32.5726806Z [cluster1] },
2021-07-17T14:14:32.5727349Z [cluster1] "type": "array"
2021-07-17T14:14:32.5727853Z [cluster1] },
2021-07-17T14:14:32.5728387Z [cluster1] "globalCIDR": {
2021-07-17T14:14:32.5728954Z [cluster1] "type": "string"
2021-07-17T14:14:32.5729473Z [cluster1] },
2021-07-17T14:14:32.5730170Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-17T14:14:32.5731012Z [cluster1] "properties": {
2021-07-17T14:14:32.5731726Z [cluster1] "lastResourceVersion": {
2021-07-17T14:14:32.5732406Z [cluster1] "type": "string"
2021-07-17T14:14:32.5732941Z [cluster1] },
2021-07-17T14:14:32.5733653Z [cluster1] "mismatchedContainerImages": {
2021-07-17T14:14:32.5734449Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5734977Z [cluster1] },
2021-07-17T14:14:32.5735669Z [cluster1] "nonReadyContainerStates": {
2021-07-17T14:14:32.5736396Z [cluster1] "items": {
2021-07-17T14:14:32.5737723Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T14:14:32.5739100Z [cluster1] "properties": {
2021-07-17T14:14:32.5739686Z [cluster1] "running": {
2021-07-17T14:14:32.5746136Z [cluster1] "description": "Details about a running container",
2021-07-17T14:14:32.5747109Z [cluster1] "properties": {
2021-07-17T14:14:32.5747730Z [cluster1] "startedAt": {
2021-07-17T14:14:32.5749260Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-17T14:14:32.5750304Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5750954Z [cluster1] "type": "string"
2021-07-17T14:14:32.5751527Z [cluster1] }
2021-07-17T14:14:32.5752065Z [cluster1] },
2021-07-17T14:14:32.5752630Z [cluster1] "type": "object"
2021-07-17T14:14:32.5753185Z [cluster1] },
2021-07-17T14:14:32.5753752Z [cluster1] "terminated": {
2021-07-17T14:14:32.5754530Z [cluster1] "description": "Details about a terminated container",
2021-07-17T14:14:32.5755325Z [cluster1] "properties": {
2021-07-17T14:14:32.5755980Z [cluster1] "containerID": {
2021-07-17T14:14:32.5757143Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T14:14:32.5758000Z [cluster1] "type": "string"
2021-07-17T14:14:32.5758550Z [cluster1] },
2021-07-17T14:14:32.5759122Z [cluster1] "exitCode": {
2021-07-17T14:14:32.5759957Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-17T14:14:32.5760783Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5761506Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5762074Z [cluster1] },
2021-07-17T14:14:32.5762654Z [cluster1] "finishedAt": {
2021-07-17T14:14:32.5763451Z [cluster1] "description": "Time at which the container last terminated",
2021-07-17T14:14:32.5764516Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5765178Z [cluster1] "type": "string"
2021-07-17T14:14:32.5765731Z [cluster1] },
2021-07-17T14:14:32.5766289Z [cluster1] "message": {
2021-07-17T14:14:32.5767134Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-17T14:14:32.5767991Z [cluster1] "type": "string"
2021-07-17T14:14:32.5768553Z [cluster1] },
2021-07-17T14:14:32.5769087Z [cluster1] "reason": {
2021-07-17T14:14:32.5769919Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-17T14:14:32.5770823Z [cluster1] "type": "string"
2021-07-17T14:14:32.5771381Z [cluster1] },
2021-07-17T14:14:32.5771925Z [cluster1] "signal": {
2021-07-17T14:14:32.5772714Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-17T14:14:32.5773528Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5774141Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5774718Z [cluster1] },
2021-07-17T14:14:32.5775268Z [cluster1] "startedAt": {
2021-07-17T14:14:32.5776141Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-17T14:14:32.5777250Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5777884Z [cluster1] "type": "string"
2021-07-17T14:14:32.5778452Z [cluster1] }
2021-07-17T14:14:32.5778950Z [cluster1] },
2021-07-17T14:14:32.5779499Z [cluster1] "required": [
2021-07-17T14:14:32.5780105Z [cluster1] "exitCode"
2021-07-17T14:14:32.5780641Z [cluster1] ],
2021-07-17T14:14:32.5781208Z [cluster1] "type": "object"
2021-07-17T14:14:32.5781748Z [cluster1] },
2021-07-17T14:14:32.5782283Z [cluster1] "waiting": {
2021-07-17T14:14:32.5783008Z [cluster1] "description": "Details about a waiting container",
2021-07-17T14:14:32.5783845Z [cluster1] "properties": {
2021-07-17T14:14:32.5784463Z [cluster1] "message": {
2021-07-17T14:14:32.5785281Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-17T14:14:32.5786119Z [cluster1] "type": "string"
2021-07-17T14:14:32.5786673Z [cluster1] },
2021-07-17T14:14:32.5787218Z [cluster1] "reason": {
2021-07-17T14:14:32.5801072Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-17T14:14:32.5801940Z [cluster1] "type": "string"
2021-07-17T14:14:32.5802533Z [cluster1] }
2021-07-17T14:14:32.5803042Z [cluster1] },
2021-07-17T14:14:32.5803609Z [cluster1] "type": "object"
2021-07-17T14:14:32.5804158Z [cluster1] }
2021-07-17T14:14:32.5804664Z [cluster1] },
2021-07-17T14:14:32.5805374Z [cluster1] "type": "object"
2021-07-17T14:14:32.5805912Z [cluster1] },
2021-07-17T14:14:32.5806448Z [cluster1] "type": "array"
2021-07-17T14:14:32.5806963Z [cluster1] },
2021-07-17T14:14:32.5807472Z [cluster1] "status": {
2021-07-17T14:14:32.5808334Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T14:14:32.5809250Z [cluster1] "properties": {
2021-07-17T14:14:32.5809907Z [cluster1] "collisionCount": {
2021-07-17T14:14:32.5811337Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T14:14:32.5812726Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5813323Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5813877Z [cluster1] },
2021-07-17T14:14:32.5814435Z [cluster1] "conditions": {
2021-07-17T14:14:32.5815855Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T14:14:32.5818339Z [cluster1] "items": {
2021-07-17T14:14:32.5819482Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T14:14:32.5820771Z [cluster1] "properties": {
2021-07-17T14:14:32.5821637Z [cluster1] "lastTransitionTime": {
2021-07-17T14:14:32.5822874Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T14:14:32.5824515Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5825320Z [cluster1] "type": "string"
2021-07-17T14:14:32.5826039Z [cluster1] },
2021-07-17T14:14:32.5826744Z [cluster1] "message": {
2021-07-17T14:14:32.5827767Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-17T14:14:32.5836195Z [cluster1] "type": "string"
2021-07-17T14:14:32.5836772Z [cluster1] },
2021-07-17T14:14:32.5837328Z [cluster1] "reason": {
2021-07-17T14:14:32.5838571Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-17T14:14:32.5839376Z [cluster1] "type": "string"
2021-07-17T14:14:32.5839945Z [cluster1] },
2021-07-17T14:14:32.5840479Z [cluster1] "status": {
2021-07-17T14:14:32.5841449Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T14:14:32.5842264Z [cluster1] "type": "string"
2021-07-17T14:14:32.5842829Z [cluster1] },
2021-07-17T14:14:32.5843396Z [cluster1] "type": {
2021-07-17T14:14:32.5844123Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-17T14:14:32.5844890Z [cluster1] "type": "string"
2021-07-17T14:14:32.5845445Z [cluster1] }
2021-07-17T14:14:32.5845961Z [cluster1] },
2021-07-17T14:14:32.5846520Z [cluster1] "required": [
2021-07-17T14:14:32.5847096Z [cluster1] "status",
2021-07-17T14:14:32.5847659Z [cluster1] "type"
2021-07-17T14:14:32.5848177Z [cluster1] ],
2021-07-17T14:14:32.5848739Z [cluster1] "type": "object"
2021-07-17T14:14:32.5849281Z [cluster1] },
2021-07-17T14:14:32.5849831Z [cluster1] "type": "array"
2021-07-17T14:14:32.5850368Z [cluster1] },
2021-07-17T14:14:32.5851055Z [cluster1] "currentNumberScheduled": {
2021-07-17T14:14:32.5852635Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5853979Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5854590Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5855252Z [cluster1] },
2021-07-17T14:14:32.5855945Z [cluster1] "desiredNumberScheduled": {
2021-07-17T14:14:32.5857540Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5860319Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5860944Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5861515Z [cluster1] },
2021-07-17T14:14:32.5862108Z [cluster1] "numberAvailable": {
2021-07-17T14:14:32.5863412Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.5864622Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5865231Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5865794Z [cluster1] },
2021-07-17T14:14:32.5866526Z [cluster1] "numberMisscheduled": {
2021-07-17T14:14:32.5868230Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.5869565Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5870186Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5870751Z [cluster1] },
2021-07-17T14:14:32.5871304Z [cluster1] "numberReady": {
2021-07-17T14:14:32.5872325Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T14:14:32.5873309Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5873915Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5874463Z [cluster1] },
2021-07-17T14:14:32.5875091Z [cluster1] "numberUnavailable": {
2021-07-17T14:14:32.5876381Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.5877730Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5878340Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5878882Z [cluster1] },
2021-07-17T14:14:32.5879533Z [cluster1] "observedGeneration": {
2021-07-17T14:14:32.5880509Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T14:14:32.5881373Z [cluster1] "format": "int64",
2021-07-17T14:14:32.5882075Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5882626Z [cluster1] },
2021-07-17T14:14:32.5883322Z [cluster1] "updatedNumberScheduled": {
2021-07-17T14:14:32.5884309Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T14:14:32.5885120Z [cluster1] "format": "int32",
2021-07-17T14:14:32.5885729Z [cluster1] "type": "integer"
2021-07-17T14:14:32.5886277Z [cluster1] }
2021-07-17T14:14:32.5886772Z [cluster1] },
2021-07-17T14:14:32.5887296Z [cluster1] "required": [
2021-07-17T14:14:32.5888037Z [cluster1] "currentNumberScheduled",
2021-07-17T14:14:32.5888930Z [cluster1] "desiredNumberScheduled",
2021-07-17T14:14:32.5889751Z [cluster1] "numberMisscheduled",
2021-07-17T14:14:32.5890454Z [cluster1] "numberReady"
2021-07-17T14:14:32.5891009Z [cluster1] ],
2021-07-17T14:14:32.5891547Z [cluster1] "type": "object"
2021-07-17T14:14:32.5892139Z [cluster1] }
2021-07-17T14:14:32.5892618Z [cluster1] },
2021-07-17T14:14:32.5893137Z [cluster1] "required": [
2021-07-17T14:14:32.5893882Z [cluster1] "mismatchedContainerImages"
2021-07-17T14:14:32.5894606Z [cluster1] ],
2021-07-17T14:14:32.5895125Z [cluster1] "type": "object"
2021-07-17T14:14:32.5895651Z [cluster1] },
2021-07-17T14:14:32.5896251Z [cluster1] "loadBalancerStatus": {
2021-07-17T14:14:32.5896931Z [cluster1] "properties": {
2021-07-17T14:14:32.5897490Z [cluster1] "status": {
2021-07-17T14:14:32.5898823Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-17T14:14:32.5899776Z [cluster1] "properties": {
2021-07-17T14:14:32.5900362Z [cluster1] "ingress": {
2021-07-17T14:14:32.5901859Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-17T14:14:32.5948127Z [cluster1] "items": {
2021-07-17T14:14:32.5950023Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-17T14:14:32.5951316Z [cluster1] "properties": {
2021-07-17T14:14:32.5951978Z [cluster1] "hostname": {
2021-07-17T14:14:32.5953334Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-17T14:14:32.5954553Z [cluster1] "type": "string"
2021-07-17T14:14:32.5955120Z [cluster1] },
2021-07-17T14:14:32.5955660Z [cluster1] "ip": {
2021-07-17T14:14:32.5957007Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-17T14:14:32.5958064Z [cluster1] "type": "string"
2021-07-17T14:14:32.5958626Z [cluster1] }
2021-07-17T14:14:32.5959145Z [cluster1] },
2021-07-17T14:14:32.5959711Z [cluster1] "type": "object"
2021-07-17T14:14:32.5960257Z [cluster1] },
2021-07-17T14:14:32.5960808Z [cluster1] "type": "array"
2021-07-17T14:14:32.5961336Z [cluster1] }
2021-07-17T14:14:32.5961827Z [cluster1] },
2021-07-17T14:14:32.5962361Z [cluster1] "type": "object"
2021-07-17T14:14:32.5962900Z [cluster1] }
2021-07-17T14:14:32.5963466Z [cluster1] },
2021-07-17T14:14:32.5963983Z [cluster1] "type": "object"
2021-07-17T14:14:32.5964514Z [cluster1] },
2021-07-17T14:14:32.5965036Z [cluster1] "natEnabled": {
2021-07-17T14:14:32.5965630Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5966151Z [cluster1] },
2021-07-17T14:14:32.5966714Z [cluster1] "networkPlugin": {
2021-07-17T14:14:32.5967310Z [cluster1] "type": "string"
2021-07-17T14:14:32.5967838Z [cluster1] },
2021-07-17T14:14:32.5968559Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-17T14:14:32.5969333Z [cluster1] "properties": {
2021-07-17T14:14:32.5970039Z [cluster1] "lastResourceVersion": {
2021-07-17T14:14:32.5970723Z [cluster1] "type": "string"
2021-07-17T14:14:32.5971259Z [cluster1] },
2021-07-17T14:14:32.5971973Z [cluster1] "mismatchedContainerImages": {
2021-07-17T14:14:32.5972760Z [cluster1] "type": "boolean"
2021-07-17T14:14:32.5973304Z [cluster1] },
2021-07-17T14:14:32.5973988Z [cluster1] "nonReadyContainerStates": {
2021-07-17T14:14:32.5974717Z [cluster1] "items": {
2021-07-17T14:14:32.5976042Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-17T14:14:32.5977409Z [cluster1] "properties": {
2021-07-17T14:14:32.5978008Z [cluster1] "running": {
2021-07-17T14:14:32.5978733Z [cluster1] "description": "Details about a running container",
2021-07-17T14:14:32.5979503Z [cluster1] "properties": {
2021-07-17T14:14:32.5980175Z [cluster1] "startedAt": {
2021-07-17T14:14:32.5981277Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-17T14:14:32.5982323Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.5982954Z [cluster1] "type": "string"
2021-07-17T14:14:32.5983527Z [cluster1] }
2021-07-17T14:14:32.5984031Z [cluster1] },
2021-07-17T14:14:32.5984594Z [cluster1] "type": "object"
2021-07-17T14:14:32.5985147Z [cluster1] },
2021-07-17T14:14:32.5985710Z [cluster1] "terminated": {
2021-07-17T14:14:32.5986500Z [cluster1] "description": "Details about a terminated container",
2021-07-17T14:14:32.5987277Z [cluster1] "properties": {
2021-07-17T14:14:32.6001318Z [cluster1] "containerID": {
2021-07-17T14:14:32.6002597Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-17T14:14:32.6003614Z [cluster1] "type": "string"
2021-07-17T14:14:32.6004190Z [cluster1] },
2021-07-17T14:14:32.6004746Z [cluster1] "exitCode": {
2021-07-17T14:14:32.6005591Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-17T14:14:32.6006411Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6007035Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6007595Z [cluster1] },
2021-07-17T14:14:32.6008182Z [cluster1] "finishedAt": {
2021-07-17T14:14:32.6008997Z [cluster1] "description": "Time at which the container last terminated",
2021-07-17T14:14:32.6010050Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.6010700Z [cluster1] "type": "string"
2021-07-17T14:14:32.6011250Z [cluster1] },
2021-07-17T14:14:32.6011804Z [cluster1] "message": {
2021-07-17T14:14:32.6012662Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-17T14:14:32.6013508Z [cluster1] "type": "string"
2021-07-17T14:14:32.6014083Z [cluster1] },
2021-07-17T14:14:32.6014617Z [cluster1] "reason": {
2021-07-17T14:14:32.6015435Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-17T14:14:32.6016359Z [cluster1] "type": "string"
2021-07-17T14:14:32.6016916Z [cluster1] },
2021-07-17T14:14:32.6017455Z [cluster1] "signal": {
2021-07-17T14:14:32.6018247Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-17T14:14:32.6019068Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6019685Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6020267Z [cluster1] },
2021-07-17T14:14:32.6020832Z [cluster1] "startedAt": {
2021-07-17T14:14:32.6021684Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-17T14:14:32.6022805Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.6023438Z [cluster1] "type": "string"
2021-07-17T14:14:32.6024001Z [cluster1] }
2021-07-17T14:14:32.6024513Z [cluster1] },
2021-07-17T14:14:32.6025122Z [cluster1] "required": [
2021-07-17T14:14:32.6025722Z [cluster1] "exitCode"
2021-07-17T14:14:32.6026265Z [cluster1] ],
2021-07-17T14:14:32.6026829Z [cluster1] "type": "object"
2021-07-17T14:14:32.6027379Z [cluster1] },
2021-07-17T14:14:32.6068894Z [cluster1] "waiting": {
2021-07-17T14:14:32.6069725Z [cluster1] "description": "Details about a waiting container",
2021-07-17T14:14:32.6070521Z [cluster1] "properties": {
2021-07-17T14:14:32.6071126Z [cluster1] "message": {
2021-07-17T14:14:32.6071986Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-17T14:14:32.6072833Z [cluster1] "type": "string"
2021-07-17T14:14:32.6073390Z [cluster1] },
2021-07-17T14:14:32.6073946Z [cluster1] "reason": {
2021-07-17T14:14:32.6074720Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-17T14:14:32.6075523Z [cluster1] "type": "string"
2021-07-17T14:14:32.6076092Z [cluster1] }
2021-07-17T14:14:32.6076596Z [cluster1] },
2021-07-17T14:14:32.6077155Z [cluster1] "type": "object"
2021-07-17T14:14:32.6077700Z [cluster1] }
2021-07-17T14:14:32.6078204Z [cluster1] },
2021-07-17T14:14:32.6078737Z [cluster1] "type": "object"
2021-07-17T14:14:32.6079463Z [cluster1] },
2021-07-17T14:14:32.6080007Z [cluster1] "type": "array"
2021-07-17T14:14:32.6080524Z [cluster1] },
2021-07-17T14:14:32.6081044Z [cluster1] "status": {
2021-07-17T14:14:32.6081904Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-17T14:14:32.6082814Z [cluster1] "properties": {
2021-07-17T14:14:32.6083452Z [cluster1] "collisionCount": {
2021-07-17T14:14:32.6084908Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-17T14:14:32.6086305Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6086900Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6087464Z [cluster1] },
2021-07-17T14:14:32.6088000Z [cluster1] "conditions": {
2021-07-17T14:14:32.6089392Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-17T14:14:32.6090402Z [cluster1] "items": {
2021-07-17T14:14:32.6091333Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-17T14:14:32.6092324Z [cluster1] "properties": {
2021-07-17T14:14:32.6093027Z [cluster1] "lastTransitionTime": {
2021-07-17T14:14:32.6094001Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-17T14:14:32.6095143Z [cluster1] "format": "date-time",
2021-07-17T14:14:32.6095782Z [cluster1] "type": "string"
2021-07-17T14:14:32.6096353Z [cluster1] },
2021-07-17T14:14:32.6096892Z [cluster1] "message": {
2021-07-17T14:14:32.6097791Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-17T14:14:32.6098690Z [cluster1] "type": "string"
2021-07-17T14:14:32.6099237Z [cluster1] },
2021-07-17T14:14:32.6099780Z [cluster1] "reason": {
2021-07-17T14:14:32.6100819Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-17T14:14:32.6102096Z [cluster1] "type": "string"
2021-07-17T14:14:32.6102670Z [cluster1] },
2021-07-17T14:14:32.6103208Z [cluster1] "status": {
2021-07-17T14:14:32.6104118Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-17T14:14:32.6104931Z [cluster1] "type": "string"
2021-07-17T14:14:32.6105492Z [cluster1] },
2021-07-17T14:14:32.6122685Z [cluster1] "type": {
2021-07-17T14:14:32.6123429Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-17T14:14:32.6124207Z [cluster1] "type": "string"
2021-07-17T14:14:32.6124763Z [cluster1] }
2021-07-17T14:14:32.6125275Z [cluster1] },
2021-07-17T14:14:32.6125818Z [cluster1] "required": [
2021-07-17T14:14:32.6126410Z [cluster1] "status",
2021-07-17T14:14:32.6126979Z [cluster1] "type"
2021-07-17T14:14:32.6127497Z [cluster1] ],
2021-07-17T14:14:32.6128063Z [cluster1] "type": "object"
2021-07-17T14:14:32.6128604Z [cluster1] },
2021-07-17T14:14:32.6129283Z [cluster1] "type": "array"
2021-07-17T14:14:32.6129814Z [cluster1] },
2021-07-17T14:14:32.6130519Z [cluster1] "currentNumberScheduled": {
2021-07-17T14:14:32.6132058Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.6133396Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6134013Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6134558Z [cluster1] },
2021-07-17T14:14:32.6135258Z [cluster1] "desiredNumberScheduled": {
2021-07-17T14:14:32.6136852Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.6138274Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6138886Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6139434Z [cluster1] },
2021-07-17T14:14:32.6140041Z [cluster1] "numberAvailable": {
2021-07-17T14:14:32.6141333Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.6142542Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6143148Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6143698Z [cluster1] },
2021-07-17T14:14:32.6144337Z [cluster1] "numberMisscheduled": {
2021-07-17T14:14:32.6145851Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-17T14:14:32.6147186Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6170714Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6171341Z [cluster1] },
2021-07-17T14:14:32.6171916Z [cluster1] "numberReady": {
2021-07-17T14:14:32.6172946Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-17T14:14:32.6173929Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6174538Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6175084Z [cluster1] },
2021-07-17T14:14:32.6175709Z [cluster1] "numberUnavailable": {
2021-07-17T14:14:32.6176997Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-17T14:14:32.6178312Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6178919Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6179466Z [cluster1] },
2021-07-17T14:14:32.6180112Z [cluster1] "observedGeneration": {
2021-07-17T14:14:32.6181076Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-17T14:14:32.6181957Z [cluster1] "format": "int64",
2021-07-17T14:14:32.6182569Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6183114Z [cluster1] },
2021-07-17T14:14:32.6183817Z [cluster1] "updatedNumberScheduled": {
2021-07-17T14:14:32.6184920Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-17T14:14:32.6185734Z [cluster1] "format": "int32",
2021-07-17T14:14:32.6186347Z [cluster1] "type": "integer"
2021-07-17T14:14:32.6186898Z [cluster1] }
2021-07-17T14:14:32.6187396Z [cluster1] },
2021-07-17T14:14:32.6188090Z [cluster1] "required": [
2021-07-17T14:14:32.6188909Z [cluster1] "currentNumberScheduled",
2021-07-17T14:14:32.6189801Z [cluster1] "desiredNumberScheduled",
2021-07-17T14:14:32.6190631Z [cluster1] "numberMisscheduled",
2021-07-17T14:14:32.6191336Z [cluster1] "numberReady"
2021-07-17T14:14:32.6191889Z [cluster1] ],
2021-07-17T14:14:32.6214863Z [cluster1] "type": "object"
2021-07-17T14:14:32.6215620Z [cluster1] }
2021-07-17T14:14:32.6216103Z [cluster1] },
2021-07-17T14:14:32.6216630Z [cluster1] "required": [
2021-07-17T14:14:32.6217400Z [cluster1] "mismatchedContainerImages"
2021-07-17T14:14:32.6218117Z [cluster1] ],
2021-07-17T14:14:32.6218652Z [cluster1] "type": "object"
2021-07-17T14:14:32.6219171Z [cluster1] },
2021-07-17T14:14:32.6219717Z [cluster1] "serviceCIDR": {
2021-07-17T14:14:32.6220297Z [cluster1] "type": "string"
2021-07-17T14:14:32.6220811Z [cluster1] }
2021-07-17T14:14:32.6221260Z [cluster1] },
2021-07-17T14:14:32.6221769Z [cluster1] "required": [
2021-07-17T14:14:32.6222336Z [cluster1] "clusterID",
2021-07-17T14:14:32.6222903Z [cluster1] "natEnabled"
2021-07-17T14:14:32.6223420Z [cluster1] ],
2021-07-17T14:14:32.6223917Z [cluster1] "type": "object"
2021-07-17T14:14:32.6224425Z [cluster1] }
2021-07-17T14:14:32.6224860Z [cluster1] },
2021-07-17T14:14:32.6225358Z [cluster1] "type": "object"
2021-07-17T14:14:32.6225919Z [cluster1] }
2021-07-17T14:14:32.6226352Z [cluster1] },
2021-07-17T14:14:32.6226828Z [cluster1] "served": true,
2021-07-17T14:14:32.6227536Z [cluster1] "storage": true,
2021-07-17T14:14:32.6228954Z [cluster1] "subresources": {
2021-07-17T14:14:32.6229488Z [cluster1] "status": {}
2021-07-17T14:14:32.6229958Z [cluster1] }
2021-07-17T14:14:32.6230380Z [cluster1] }
2021-07-17T14:14:32.6230805Z [cluster1] ]
2021-07-17T14:14:32.6231203Z [cluster1] },
2021-07-17T14:14:32.6231639Z [cluster1] "status": {
2021-07-17T14:14:32.6232162Z [cluster1] "acceptedNames": {
2021-07-17T14:14:32.6232756Z [cluster1] "kind": "Submariner",
2021-07-17T14:14:32.6233384Z [cluster1] "listKind": "SubmarinerList",
2021-07-17T14:14:32.6234047Z [cluster1] "plural": "submariners",
2021-07-17T14:14:32.6234665Z [cluster1] "singular": "submariner"
2021-07-17T14:14:32.6235180Z [cluster1] },
2021-07-17T14:14:32.6235655Z [cluster1] "conditions": [
2021-07-17T14:14:32.6236117Z [cluster1] {
2021-07-17T14:14:32.6237138Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:03Z",
2021-07-17T14:14:32.6237852Z [cluster1] "message": "no conflicts found",
2021-07-17T14:14:32.6238495Z [cluster1] "reason": "NoConflicts",
2021-07-17T14:14:32.6239063Z [cluster1] "status": "True",
2021-07-17T14:14:32.6239661Z [cluster1] "type": "NamesAccepted"
2021-07-17T14:14:32.6240187Z [cluster1] },
2021-07-17T14:14:32.6240611Z [cluster1] {
2021-07-17T14:14:32.6241400Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:03Z",
2021-07-17T14:14:32.6242201Z [cluster1] "message": "the initial names have been accepted",
2021-07-17T14:14:32.6243036Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-17T14:14:32.6243714Z [cluster1] "status": "True",
2021-07-17T14:14:32.6244286Z [cluster1] "type": "Established"
2021-07-17T14:14:32.6244789Z [cluster1] }
2021-07-17T14:14:32.6245205Z [cluster1] ],
2021-07-17T14:14:32.6245709Z [cluster1] "storedVersions": [
2021-07-17T14:14:32.6246268Z [cluster1] "v1alpha1"
2021-07-17T14:14:32.6246709Z [cluster1] ]
2021-07-17T14:14:32.6247241Z [cluster1] }
2021-07-17T14:14:32.6247638Z [cluster1] }
2021-07-17T14:14:32.6248825Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-17T14:14:32.6250516Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-17T14:14:32.6252504Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-17T14:14:32.6254224Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T14:14:32.6255512Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-17T14:14:35.6196146Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-17T14:14:35.6197943Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T14:14:35.6199329Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-17T14:14:35.6201265Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-17T14:14:35.6203019Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-17T14:14:35.6204390Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-17T14:14:35.6206173Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-17T14:14:35.6208047Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-17T14:14:35.6209106Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-17T14:14:35.6210313Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-17T14:14:35.6211618Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-17T14:14:35.6213103Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-17T14:14:35.6214077Z [cluster2] NAME STATUS AGE
2021-07-17T14:14:35.6214888Z [cluster2] submariner-operator Active 78s
2021-07-17T14:14:35.6216261Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T14:14:35.6217745Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-17T14:14:35.6219394Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-17T14:14:35.6220441Z [cluster2] NAME CREATED AT
2021-07-17T14:14:35.6221362Z [cluster2] submariners.submariner.io 2021-07-17T14:13:15Z
2021-07-17T14:14:35.6222479Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-17T14:14:35.6223593Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-17T14:14:35.6224869Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-17T14:14:35.6226066Z [submariner-operator]$ [cluster2] grep submariners
2021-07-17T14:14:35.6227012Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-17T14:14:35.6228699Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6230482Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6232405Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6233561Z [cluster2] NAME SECRETS AGE
2021-07-17T14:14:35.6234376Z [cluster2] submariner-operator 1 79s
2021-07-17T14:14:35.6235743Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6237680Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6239642Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6240779Z [cluster2] NAME AGE
2021-07-17T14:14:35.6241542Z [cluster2] submariner-operator 79s
2021-07-17T14:14:35.6242956Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6244865Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6246904Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6248083Z [cluster2] NAME AGE
2021-07-17T14:14:35.6248837Z [cluster2] submariner-operator 79s
2021-07-17T14:14:35.6250253Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6252133Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6254296Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6255807Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-17T14:14:35.6256872Z [cluster2] submariner-operator 1/1 1 1 74s
2021-07-17T14:14:35.6257850Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-17T14:14:35.6258883Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-17T14:14:35.6260537Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T14:14:35.6262359Z [submariner-operator]$ [cluster2] kers.submariner.io.cluster1.json
2021-07-17T14:14:35.6263832Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T14:14:35.6265153Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-17T14:14:35.6266889Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-17T14:14:35.6280187Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-17T14:14:35.6281617Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-17T14:14:35.6283427Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-17T14:14:35.6285024Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-17T14:14:35.6286120Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-17T14:14:35.6287311Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-17T14:14:35.6288629Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-17T14:14:35.6290094Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-17T14:14:35.6291044Z [cluster1] NAME STATUS AGE
2021-07-17T14:14:35.6291872Z [cluster1] submariner-operator Active 90s
2021-07-17T14:14:35.6293107Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T14:14:35.6294607Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-17T14:14:35.6296236Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-17T14:14:35.6297287Z [cluster1] NAME CREATED AT
2021-07-17T14:14:35.6298384Z [cluster1] submariners.submariner.io 2021-07-17T14:13:03Z
2021-07-17T14:14:35.6299504Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-17T14:14:35.6300707Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-17T14:14:35.6301970Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-17T14:14:35.6305363Z [submariner-operator]$ [cluster1] grep submariners
2021-07-17T14:14:35.6307356Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-17T14:14:35.6310126Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6312334Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6315147Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6316339Z [cluster1] NAME SECRETS AGE
2021-07-17T14:14:35.6317150Z [cluster1] submariner-operator 1 91s
2021-07-17T14:14:35.6318531Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6320303Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6322236Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6323547Z [cluster1] NAME AGE
2021-07-17T14:14:35.6324304Z [cluster1] submariner-operator 91s
2021-07-17T14:14:35.6325735Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6369173Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6371263Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6372464Z [cluster1] NAME AGE
2021-07-17T14:14:35.6373206Z [cluster1] submariner-operator 92s
2021-07-17T14:14:35.6374729Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6376616Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6378640Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-17T14:14:35.6380148Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-17T14:14:35.6381080Z [cluster1] submariner-operator 1/1 1 1 86s
2021-07-17T14:14:35.6382087Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-17T14:14:35.6383106Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-17T14:14:35.6384857Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T14:14:36.4462318Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:36.4464770Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:36.4467198Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:36.4470096Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-762r6 --namespace=submariner-operator -o json
2021-07-17T14:14:36.4472450Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-762r6 --namespace=submariner-operator -o json
2021-07-17T14:14:36.4474926Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-56f895dd55-762r6 --namespace=submariner-operator -o json
2021-07-17T14:14:36.4476446Z [cluster2] {
2021-07-17T14:14:36.4476927Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:36.4477454Z [cluster2] "kind": "Pod",
2021-07-17T14:14:36.4477933Z [cluster2] "metadata": {
2021-07-17T14:14:36.4478763Z [cluster2] "creationTimestamp": "2021-07-17T14:13:21Z",
2021-07-17T14:14:36.4480007Z [cluster2] "generateName": "submariner-operator-56f895dd55-",
2021-07-17T14:14:36.4480866Z [cluster2] "labels": {
2021-07-17T14:14:36.4481653Z [cluster2] "name": "submariner-operator",
2021-07-17T14:14:36.4482580Z [cluster2] "pod-template-hash": "56f895dd55"
2021-07-17T14:14:36.4483142Z [cluster2] },
2021-07-17T14:14:36.4484168Z [cluster2] "name": "submariner-operator-56f895dd55-762r6",
2021-07-17T14:14:36.4485370Z [cluster2] "namespace": "submariner-operator",
2021-07-17T14:14:36.4486099Z [cluster2] "ownerReferences": [
2021-07-17T14:14:36.4486642Z [cluster2] {
2021-07-17T14:14:36.4487151Z [cluster2] "apiVersion": "apps/v1",
2021-07-17T14:14:36.4488007Z [cluster2] "blockOwnerDeletion": true,
2021-07-17T14:14:36.4488669Z [cluster2] "controller": true,
2021-07-17T14:14:36.4489260Z [cluster2] "kind": "ReplicaSet",
2021-07-17T14:14:36.4490290Z [cluster2] "name": "submariner-operator-56f895dd55",
2021-07-17T14:14:36.4491462Z [cluster2] "uid": "62241a68-dbc3-4f8f-858d-b85fad08b8b5"
2021-07-17T14:14:36.4492101Z [cluster2] }
2021-07-17T14:14:36.4492515Z [cluster2] ],
2021-07-17T14:14:36.4493057Z [cluster2] "resourceVersion": "1814",
2021-07-17T14:14:36.4494507Z [cluster2] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-56f895dd55-762r6",
2021-07-17T14:14:36.4495982Z [cluster2] "uid": "7bd9d267-1444-432a-a234-f1c7376d2075"
2021-07-17T14:14:36.4496556Z [cluster2] },
2021-07-17T14:14:36.4497109Z [cluster2] "spec": {
2021-07-17T14:14:36.4497598Z [cluster2] "containers": [
2021-07-17T14:14:36.4498083Z [cluster2] {
2021-07-17T14:14:36.4498536Z [cluster2] "command": [
2021-07-17T14:14:36.4499340Z [cluster2] "submariner-operator",
2021-07-17T14:14:36.4500284Z [cluster2] "-alsologtostderr",
2021-07-17T14:14:36.4500971Z [cluster2] "-v=1"
2021-07-17T14:14:36.4501417Z [cluster2] ],
2021-07-17T14:14:36.4501854Z [cluster2] "env": [
2021-07-17T14:14:36.4502310Z [cluster2] {
2021-07-17T14:14:36.4502850Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-17T14:14:36.4503449Z [cluster2] "valueFrom": {
2021-07-17T14:14:36.4503985Z [cluster2] "fieldRef": {
2021-07-17T14:14:36.4504565Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:36.4505274Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-17T14:14:36.4505926Z [cluster2] }
2021-07-17T14:14:36.4506466Z [cluster2] }
2021-07-17T14:14:36.4506899Z [cluster2] },
2021-07-17T14:14:36.4507333Z [cluster2] {
2021-07-17T14:14:36.4507972Z [cluster2] "name": "POD_NAME",
2021-07-17T14:14:36.4508568Z [cluster2] "valueFrom": {
2021-07-17T14:14:36.4509106Z [cluster2] "fieldRef": {
2021-07-17T14:14:36.4509804Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:36.4510471Z [cluster2] "fieldPath": "metadata.name"
2021-07-17T14:14:36.4511067Z [cluster2] }
2021-07-17T14:14:36.4511514Z [cluster2] }
2021-07-17T14:14:36.4511945Z [cluster2] },
2021-07-17T14:14:36.4512381Z [cluster2] {
2021-07-17T14:14:36.4512899Z [cluster2] "name": "OPERATOR_NAME",
2021-07-17T14:14:36.4513839Z [cluster2] "value": "submariner-operator"
2021-07-17T14:14:36.4514445Z [cluster2] }
2021-07-17T14:14:36.4514876Z [cluster2] ],
2021-07-17T14:14:36.4515746Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-17T14:14:36.4516625Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-17T14:14:36.4517583Z [cluster2] "name": "submariner-operator",
2021-07-17T14:14:36.4518252Z [cluster2] "resources": {},
2021-07-17T14:14:36.4519245Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-17T14:14:36.4520238Z [cluster2] "terminationMessagePolicy": "File",
2021-07-17T14:14:36.4520997Z [cluster2] "volumeMounts": [
2021-07-17T14:14:36.4521494Z [cluster2] {
2021-07-17T14:14:36.4522372Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-17T14:14:36.4523770Z [cluster2] "name": "submariner-operator-token-bff26",
2021-07-17T14:14:36.4524626Z [cluster2] "readOnly": true
2021-07-17T14:14:36.4525136Z [cluster2] }
2021-07-17T14:14:36.4525555Z [cluster2] ]
2021-07-17T14:14:36.4525985Z [cluster2] }
2021-07-17T14:14:36.4526394Z [cluster2] ],
2021-07-17T14:14:36.4526948Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-17T14:14:36.4527658Z [cluster2] "enableServiceLinks": true,
2021-07-17T14:14:36.4528571Z [cluster2] "nodeName": "cluster2-worker2",
2021-07-17T14:14:36.4529191Z [cluster2] "priority": 0,
2021-07-17T14:14:36.4529762Z [cluster2] "restartPolicy": "Always",
2021-07-17T14:14:36.4530679Z [cluster2] "schedulerName": "default-scheduler",
2021-07-17T14:14:36.4531411Z [cluster2] "securityContext": {},
2021-07-17T14:14:36.4532358Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-17T14:14:36.4533486Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-17T14:14:36.4534527Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-17T14:14:36.4535322Z [cluster2] "tolerations": [
2021-07-17T14:14:36.4535807Z [cluster2] {
2021-07-17T14:14:36.4536314Z [cluster2] "effect": "NoExecute",
2021-07-17T14:14:36.4537208Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-17T14:14:36.4537920Z [cluster2] "operator": "Exists",
2021-07-17T14:14:36.4538551Z [cluster2] "tolerationSeconds": 300
2021-07-17T14:14:36.4539110Z [cluster2] },
2021-07-17T14:14:36.4539522Z [cluster2] {
2021-07-17T14:14:36.4540037Z [cluster2] "effect": "NoExecute",
2021-07-17T14:14:36.4540760Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-17T14:14:36.4541481Z [cluster2] "operator": "Exists",
2021-07-17T14:14:36.4542104Z [cluster2] "tolerationSeconds": 300
2021-07-17T14:14:36.4542669Z [cluster2] }
2021-07-17T14:14:36.4543086Z [cluster2] ],
2021-07-17T14:14:36.4543525Z [cluster2] "volumes": [
2021-07-17T14:14:36.4543979Z [cluster2] {
2021-07-17T14:14:36.4544937Z [cluster2] "name": "submariner-operator-token-bff26",
2021-07-17T14:14:36.4545752Z [cluster2] "secret": {
2021-07-17T14:14:36.4546282Z [cluster2] "defaultMode": 420,
2021-07-17T14:14:36.4547453Z [cluster2] "secretName": "submariner-operator-token-bff26"
2021-07-17T14:14:36.4548420Z [cluster2] }
2021-07-17T14:14:36.4548853Z [cluster2] }
2021-07-17T14:14:36.4549261Z [cluster2] ]
2021-07-17T14:14:36.4549676Z [cluster2] },
2021-07-17T14:14:36.4550106Z [cluster2] "status": {
2021-07-17T14:14:36.4550612Z [cluster2] "conditions": [
2021-07-17T14:14:36.4551088Z [cluster2] {
2021-07-17T14:14:36.4551621Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:36.4552559Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:21Z",
2021-07-17T14:14:36.4553203Z [cluster2] "status": "True",
2021-07-17T14:14:36.4553775Z [cluster2] "type": "Initialized"
2021-07-17T14:14:36.4555222Z [cluster2] },
2021-07-17T14:14:36.4555801Z [cluster2] {
2021-07-17T14:14:36.4556333Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:36.4557317Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:36Z",
2021-07-17T14:14:36.4557956Z [cluster2] "status": "True",
2021-07-17T14:14:36.4558490Z [cluster2] "type": "Ready"
2021-07-17T14:14:36.4558963Z [cluster2] },
2021-07-17T14:14:36.4559376Z [cluster2] {
2021-07-17T14:14:36.4559912Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:36.4560803Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:36Z",
2021-07-17T14:14:36.4561596Z [cluster2] "status": "True",
2021-07-17T14:14:36.4562199Z [cluster2] "type": "ContainersReady"
2021-07-17T14:14:36.4562759Z [cluster2] },
2021-07-17T14:14:36.4563171Z [cluster2] {
2021-07-17T14:14:36.4563711Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:36.4564604Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:21Z",
2021-07-17T14:14:36.4565269Z [cluster2] "status": "True",
2021-07-17T14:14:36.4565859Z [cluster2] "type": "PodScheduled"
2021-07-17T14:14:36.4566377Z [cluster2] }
2021-07-17T14:14:36.4566791Z [cluster2] ],
2021-07-17T14:14:36.4567326Z [cluster2] "containerStatuses": [
2021-07-17T14:14:36.4567876Z [cluster2] {
2021-07-17T14:14:36.4569731Z [cluster2] "containerID": "containerd://7f411cd1e02e42a5487b93be73d61c4c58f873b5bb2a2deecfb882249964b28d",
2021-07-17T14:14:36.4572031Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-17T14:14:36.4573706Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-17T14:14:36.4589446Z [cluster2] "lastState": {
2021-07-17T14:14:36.4590027Z [cluster2] "terminated": {
2021-07-17T14:14:36.4592101Z [cluster2] "containerID": "containerd://18ec5cbb00298c1186e098445d57c53b4af20dbcfef28b9b077a87bedab7c517",
2021-07-17T14:14:36.4594029Z [cluster2] "exitCode": 1,
2021-07-17T14:14:36.4595052Z [cluster2] "finishedAt": "2021-07-17T14:13:32Z",
2021-07-17T14:14:36.4595657Z [cluster2] "reason": "Error",
2021-07-17T14:14:36.4596422Z [cluster2] "startedAt": "2021-07-17T14:13:23Z"
2021-07-17T14:14:36.4596948Z [cluster2] }
2021-07-17T14:14:36.4597388Z [cluster2] },
2021-07-17T14:14:36.4598167Z [cluster2] "name": "submariner-operator",
2021-07-17T14:14:36.4598817Z [cluster2] "ready": true,
2021-07-17T14:14:36.4599363Z [cluster2] "restartCount": 1,
2021-07-17T14:14:36.4599931Z [cluster2] "started": true,
2021-07-17T14:14:36.4600427Z [cluster2] "state": {
2021-07-17T14:14:36.4771328Z [cluster2] ubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:36.4773541Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:36.4775944Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:36.4778366Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator -o json
2021-07-17T14:14:36.4780724Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator -o json
2021-07-17T14:14:36.4783186Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator -o json
2021-07-17T14:14:36.4784537Z [cluster1] {
2021-07-17T14:14:36.4785011Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:36.4785533Z [cluster1] "kind": "Pod",
2021-07-17T14:14:36.4786009Z [cluster1] "metadata": {
2021-07-17T14:14:36.4786821Z [cluster1] "creationTimestamp": "2021-07-17T14:13:09Z",
2021-07-17T14:14:36.4788467Z [cluster1] "generateName": "submariner-operator-56f895dd55-",
2021-07-17T14:14:36.4789316Z [cluster1] "labels": {
2021-07-17T14:14:36.4790132Z [cluster1] "name": "submariner-operator",
2021-07-17T14:14:36.4791191Z [cluster1] "pod-template-hash": "56f895dd55"
2021-07-17T14:14:36.4791772Z [cluster1] },
2021-07-17T14:14:36.4792772Z [cluster1] "name": "submariner-operator-56f895dd55-fwtxk",
2021-07-17T14:14:36.4793970Z [cluster1] "namespace": "submariner-operator",
2021-07-17T14:14:36.4794695Z [cluster1] "ownerReferences": [
2021-07-17T14:14:36.4795229Z [cluster1] {
2021-07-17T14:14:36.4795741Z [cluster1] "apiVersion": "apps/v1",
2021-07-17T14:14:36.4796443Z [cluster1] "blockOwnerDeletion": true,
2021-07-17T14:14:36.4797122Z [cluster1] "controller": true,
2021-07-17T14:14:36.4797703Z [cluster1] "kind": "ReplicaSet",
2021-07-17T14:14:36.4798726Z [cluster1] "name": "submariner-operator-56f895dd55",
2021-07-17T14:14:36.4799847Z [cluster1] "uid": "344c8685-422e-4c4d-834e-f8ea45bd3d43"
2021-07-17T14:14:36.4800456Z [cluster1] }
2021-07-17T14:14:36.4800869Z [cluster1] ],
2021-07-17T14:14:36.4801409Z [cluster1] "resourceVersion": "1784",
2021-07-17T14:14:36.4802857Z [cluster1] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-56f895dd55-fwtxk",
2021-07-17T14:14:36.4804387Z [cluster1] "uid": "e716a6b4-2de8-4fe8-b826-c7b03a70b806"
2021-07-17T14:14:36.4805037Z [cluster1] },
2021-07-17T14:14:36.4805460Z [cluster1] "spec": {
2021-07-17T14:14:36.4805952Z [cluster1] "containers": [
2021-07-17T14:14:36.4806423Z [cluster1] {
2021-07-17T14:14:36.4806879Z [cluster1] "command": [
2021-07-17T14:14:36.4807654Z [cluster1] "submariner-operator",
2021-07-17T14:14:36.4808507Z [cluster1] "-alsologtostderr",
2021-07-17T14:14:36.4809187Z [cluster1] "-v=1"
2021-07-17T14:14:36.4809633Z [cluster1] ],
2021-07-17T14:14:36.4810072Z [cluster1] "env": [
2021-07-17T14:14:36.4810524Z [cluster1] {
2021-07-17T14:14:36.4811062Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-17T14:14:36.4811656Z [cluster1] "valueFrom": {
2021-07-17T14:14:36.4812204Z [cluster1] "fieldRef": {
2021-07-17T14:14:36.4812768Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:36.4813490Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-17T14:14:36.4814273Z [cluster1] }
2021-07-17T14:14:36.4814729Z [cluster1] }
2021-07-17T14:14:36.4815160Z [cluster1] },
2021-07-17T14:14:36.4815601Z [cluster1] {
2021-07-17T14:14:36.4816091Z [cluster1] "name": "POD_NAME",
2021-07-17T14:14:36.4816646Z [cluster1] "valueFrom": {
2021-07-17T14:14:36.4817196Z [cluster1] "fieldRef": {
2021-07-17T14:14:36.4817762Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:36.4818433Z [cluster1] "fieldPath": "metadata.name"
2021-07-17T14:14:36.4819011Z [cluster1] }
2021-07-17T14:14:36.4819462Z [cluster1] }
2021-07-17T14:14:36.4819888Z [cluster1] },
2021-07-17T14:14:36.4820326Z [cluster1] {
2021-07-17T14:14:36.4820843Z [cluster1] "name": "OPERATOR_NAME",
2021-07-17T14:14:36.4821750Z [cluster1] "value": "submariner-operator"
2021-07-17T14:14:36.4822350Z [cluster1] }
2021-07-17T14:14:36.4822784Z [cluster1] ],
2021-07-17T14:14:36.4823665Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-17T14:14:36.4824535Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-17T14:14:36.4825496Z [cluster1] "name": "submariner-operator",
2021-07-17T14:14:36.4826222Z [cluster1] "resources": {},
2021-07-17T14:14:36.4827223Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-17T14:14:36.4856091Z [cluster1] "terminationMessagePolicy": "File",
2021-07-17T14:14:36.4856898Z [cluster1] "volumeMounts": [
2021-07-17T14:14:36.4857406Z [cluster1] {
2021-07-17T14:14:36.4858264Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-17T14:14:36.4859803Z [cluster1] "name": "submariner-operator-token-jpx9g",
2021-07-17T14:14:36.4860663Z [cluster1] "readOnly": true
2021-07-17T14:14:36.4861172Z [cluster1] }
2021-07-17T14:14:36.4861617Z [cluster1] ]
2021-07-17T14:14:36.4862034Z [cluster1] }
2021-07-17T14:14:36.4862455Z [cluster1] ],
2021-07-17T14:14:36.4862990Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-17T14:14:36.4863714Z [cluster1] "enableServiceLinks": true,
2021-07-17T14:14:36.4864606Z [cluster1] "nodeName": "cluster1-worker",
2021-07-17T14:14:36.4865219Z [cluster1] "priority": 0,
2021-07-17T14:14:36.4865790Z [cluster1] "restartPolicy": "Always",
2021-07-17T14:14:36.4866705Z [cluster1] "schedulerName": "default-scheduler",
2021-07-17T14:14:36.4867436Z [cluster1] "securityContext": {},
2021-07-17T14:14:36.4869204Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-17T14:14:36.4870362Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-17T14:14:36.4871392Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-17T14:14:36.4872201Z [cluster1] "tolerations": [
2021-07-17T14:14:36.4872677Z [cluster1] {
2021-07-17T14:14:36.4873196Z [cluster1] "effect": "NoExecute",
2021-07-17T14:14:36.4874073Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-17T14:14:36.4874779Z [cluster1] "operator": "Exists",
2021-07-17T14:14:36.4875412Z [cluster1] "tolerationSeconds": 300
2021-07-17T14:14:36.4875971Z [cluster1] },
2021-07-17T14:14:36.4876380Z [cluster1] {
2021-07-17T14:14:36.4876897Z [cluster1] "effect": "NoExecute",
2021-07-17T14:14:36.4877635Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-17T14:14:36.4878343Z [cluster1] "operator": "Exists",
2021-07-17T14:14:36.4879168Z [cluster1] "tolerationSeconds": 300
2021-07-17T14:14:36.4879726Z [cluster1] }
2021-07-17T14:14:36.4880153Z [cluster1] ],
2021-07-17T14:14:36.4880596Z [cluster1] "volumes": [
2021-07-17T14:14:36.4881057Z [cluster1] {
2021-07-17T14:14:36.4882033Z [cluster1] "name": "submariner-operator-token-jpx9g",
2021-07-17T14:14:36.4882864Z [cluster1] "secret": {
2021-07-17T14:14:36.4883396Z [cluster1] "defaultMode": 420,
2021-07-17T14:14:36.4884498Z [cluster1] "secretName": "submariner-operator-token-jpx9g"
2021-07-17T14:14:36.4885333Z [cluster1] }
2021-07-17T14:14:36.4885745Z [cluster1] }
2021-07-17T14:14:36.4886162Z [cluster1] ]
2021-07-17T14:14:36.4886556Z [cluster1] },
2021-07-17T14:14:36.4886994Z [cluster1] "status": {
2021-07-17T14:14:36.4887477Z [cluster1] "conditions": [
2021-07-17T14:14:36.4887946Z [cluster1] {
2021-07-17T14:14:36.4888473Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:36.4889373Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:09Z",
2021-07-17T14:14:36.4890016Z [cluster1] "status": "True",
2021-07-17T14:14:36.4890584Z [cluster1] "type": "Initialized"
2021-07-17T14:14:36.4891094Z [cluster1] },
2021-07-17T14:14:36.4891506Z [cluster1] {
2021-07-17T14:14:36.4892040Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:36.4893030Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:17Z",
2021-07-17T14:14:36.4893680Z [cluster1] "status": "True",
2021-07-17T14:14:36.4894195Z [cluster1] "type": "Ready"
2021-07-17T14:14:36.4894665Z [cluster1] },
2021-07-17T14:14:36.4895072Z [cluster1] {
2021-07-17T14:14:36.4895609Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:36.4896501Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:17Z",
2021-07-17T14:14:36.4897161Z [cluster1] "status": "True",
2021-07-17T14:14:36.4897777Z [cluster1] "type": "ContainersReady"
2021-07-17T14:14:36.4898321Z [cluster1] },
2021-07-17T14:14:36.4898743Z [cluster1] {
2021-07-17T14:14:36.4899266Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:36.4900155Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:09Z",
2021-07-17T14:14:36.4900799Z [cluster1] "status": "True",
2021-07-17T14:14:36.4901390Z [cluster1] "type": "PodScheduled"
2021-07-17T14:14:36.4901906Z [cluster1] }
2021-07-17T14:14:36.4902322Z [cluster1] ],
2021-07-17T14:14:36.4902852Z [cluster1] "containerStatuses": [
2021-07-17T14:14:36.4903401Z [cluster1] {
2021-07-17T14:14:36.4905128Z [cluster1] "containerID": "containerd://bf4e57712c826c9a2e136296a50a28fa849777e491808a6c519509b06cfca89c",
2021-07-17T14:14:36.4907507Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-17T14:14:36.4933871Z [cluster1] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-17T14:14:36.4935082Z [cluster1] "lastState": {},
2021-07-17T14:14:36.4935924Z [cluster1] "name": "submariner-operator",
2021-07-17T14:14:36.4936563Z [cluster1] "ready": true,
2021-07-17T14:14:36.4937134Z [cluster1] "restartCount": 1,
2021-07-17T14:14:36.4937687Z [cluster1] "started": true,
2021-07-17T14:14:36.4938197Z [cluster1] "state": {
2021-07-17T14:14:36.4938690Z [cluster1] "running": {
2021-07-17T14:14:36.4939428Z [cluster1] "startedAt": "2021-07-17T14:13:17Z"
2021-07-17T14:14:36.4939952Z [cluster1] }
2021-07-17T14:14:36.4940371Z [cluster1] }
2021-07-17T14:14:36.4940954Z [cluster1] }
2021-07-17T14:14:36.4941367Z [cluster1] ],
2021-07-17T14:14:36.4941836Z [cluster1] "hostIP": "172.18.0.4",
2021-07-17T14:14:36.4942355Z [cluster1] "phase": "Running",
2021-07-17T14:14:36.4942877Z [cluster1] "podIP": "10.1.0.2",
2021-07-17T14:14:36.4943356Z [cluster1] "podIPs": [
2021-07-17T14:14:36.4943815Z [cluster1] {
2021-07-17T14:14:36.4944258Z [cluster1] "ip": "10.1.0.2"
2021-07-17T14:14:36.4944705Z [cluster1] }
2021-07-17T14:14:36.4945131Z [cluster1] ],
2021-07-17T14:14:37.2458249Z [cluste "running": {
2021-07-17T14:14:37.2459560Z [cluster2] "startedAt": "2021-07-17T14:13:35Z"
2021-07-17T14:14:37.2460099Z [cluster2] }
2021-07-17T14:14:37.2460523Z [cluster2] }
2021-07-17T14:14:37.2460953Z [cluster2] }
2021-07-17T14:14:37.2461365Z [cluster2] ],
2021-07-17T14:14:37.2461854Z [cluster2] "hostIP": "172.18.0.6",
2021-07-17T14:14:37.2462376Z [cluster2] "phase": "Running",
2021-07-17T14:14:37.2463062Z [cluster2] "podIP": "10.2.128.2",
2021-07-17T14:14:37.2463546Z [cluster2] "podIPs": [
2021-07-17T14:14:37.2464012Z [cluster2] {
2021-07-17T14:14:37.2464453Z [cluster2] "ip": "10.2.128.2"
2021-07-17T14:14:37.2464902Z [cluster2] }
2021-07-17T14:14:37.2465322Z [cluster2] ],
2021-07-17T14:14:37.2465830Z [cluster2] "qosClass": "BestEffort",
2021-07-17T14:14:37.2510390Z [cluster2] "startTime": "2021-07-17T14:13:21Z"
2021-07-17T14:14:37.2510904Z [cluster2] }
2021-07-17T14:14:37.2511317Z [cluster2] }
2021-07-17T14:14:37.2512979Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-762r6 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T14:14:37.2515573Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-762r6 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T14:14:37.2518281Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-56f895dd55-762r6 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T14:14:37.2520106Z [submariner-operator]$ [cluster2] grep Running
2021-07-17T14:14:37.2520759Z [cluster2] Running
2021-07-17T14:14:37.2522234Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-56f895dd55-762r6 --namespace=submariner-operator
2021-07-17T14:14:37.2524503Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-56f895dd55-762r6 --namespace=submariner-operator
2021-07-17T14:14:37.2526903Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-56f895dd55-762r6 --namespace=submariner-operator
2021-07-17T14:14:37.2528379Z [cluster2] I0717 14:13:35.940745 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-17T14:14:37.2529118Z [cluster2] I0717 14:13:35.940919 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-17T14:14:37.2530136Z [cluster2] I0717 14:13:35.940947 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-17T14:14:37.2531297Z [cluster2] I0717 14:13:35.940997 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-17T14:14:37.2532221Z [cluster2] I0717 14:13:35.943097 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-17T14:14:37.2533212Z [cluster2] I0717 14:13:36.366008 1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-17T14:14:37.2534188Z [cluster2] I0717 14:13:36.366036 1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-17T14:14:37.2535542Z [cluster2] I0717 14:13:36.768817 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-17T14:14:37.2537028Z [cluster2] I0717 14:13:36.769132 1 main.go:129] cmd "msg"="Registering Components."
2021-07-17T14:14:37.2537891Z [cluster2] I0717 14:13:36.769257 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-17T14:14:37.2539076Z [cluster2] I0717 14:13:39.629613 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2541031Z [cluster2] I0717 14:13:39.629649 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2542306Z [cluster2] I0717 14:13:39.629739 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-17T14:14:37.2543719Z [cluster2] I0717 14:13:39.630054 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-17T14:14:37.2546082Z [cluster2] I0717 14:13:39.630489 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-17T14:14:37.2552493Z [cluster2] I0717 14:13:39.630590 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T14:14:37.2562048Z [cluster2] I0717 14:13:39.630617 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T14:14:37.2569274Z [cluster2] I0717 14:13:39.630694 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T14:14:37.2574151Z [cluster2] I0717 14:13:39.630716 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T14:14:37.2577472Z [cluster2] I0717 14:13:39.731815 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.2579762Z [cluster2] I0717 14:13:39.733565 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-17T14:14:37.2583510Z [cluster2] I0717 14:13:39.733283 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-17T14:14:37.2587120Z [cluster2] I0717 14:13:39.733316 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T14:14:37.2631317Z [cluster2] I0717 14:13:39.733465 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T14:14:37.2635156Z [cluster2] I0717 14:13:39.733495 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T14:14:37.2638188Z [cluster2] I0717 14:13:39.834515 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-17T14:14:37.2640332Z [cluster2] I0717 14:13:39.840413 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-17T14:14:37.2642719Z [cluster2] I0717 14:13:39.840482 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T14:14:37.2645025Z [cluster2] I0717 14:13:39.840990 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-17T14:14:37.2648516Z [cluster2] I0717 14:13:39.840789 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-17T14:14:37.2651727Z [cluster2] I0717 14:13:39.841627 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2654220Z [cluster2] I0717 14:13:39.842228 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-17T14:14:37.2656578Z [cluster2] I0717 14:13:39.911351 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-17T14:14:37.2658424Z [cluster2] I0717 14:13:39.912972 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-17T14:14:37.2659942Z [cluster2] I0717 14:13:39.913086 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2661497Z [cluster2] I0717 14:13:39.913184 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2664042Z [cluster2] I0717 14:13:39.917465 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2672188Z [cluster2] E0717 14:13:39.918662 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T14:14:37.2675729Z [cluster2] I0717 14:13:39.924357 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2677468Z [cluster2] I0717 14:13:39.924526 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2715641Z [cluster2] I0717 14:13:39.924615 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2718494Z [cluster2] I0717 14:13:39.931521 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2721288Z [cluster2] I0717 14:13:39.943276 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-17T14:14:37.2723242Z [cluster2] I0717 14:13:39.943468 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-17T14:14:37.2725402Z [cluster2] I0717 14:13:39.943641 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2727140Z [cluster2] I0717 14:13:39.943824 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2728577Z [cluster2] I0717 14:13:39.943924 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2731285Z [cluster2] I0717 14:13:39.961752 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2734722Z [cluster2] I0717 14:13:40.013202 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2738119Z [cluster2] I0717 14:13:40.145426 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2741627Z [cluster2] I0717 14:13:40.415701 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2745012Z [cluster2] I0717 14:13:40.427059 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2775689Z [cluster2] E0717 14:13:40.427149 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: DaemonSet.apps \"submariner-routeagent\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-17T14:14:37.2779297Z [cluster2] I0717 14:13:40.427214 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2781090Z [cluster2] I0717 14:13:40.427338 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2782536Z [cluster2] I0717 14:13:40.427360 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2785112Z [cluster2] I0717 14:13:40.438767 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2788531Z [cluster2] I0717 14:13:40.549462 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2792080Z [cluster2] I0717 14:13:40.627149 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2795616Z [cluster2] I0717 14:13:40.880313 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2798916Z [cluster2] I0717 14:13:41.035933 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2801940Z [cluster2] I0717 14:13:41.159976 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2804791Z [cluster2] I0717 14:13:41.160416 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2807820Z [cluster2] I0717 14:13:41.174539 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-17T14:14:37.2811491Z [cluster2] I0717 14:13:41.293048 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.2814552Z [cluster2] I0717 14:13:41.383233 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2816278Z [cluster2] I0717 14:13:41.383275 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2817802Z [cluster2] I0717 14:13:41.383313 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2820417Z [cluster2] I0717 14:13:41.446568 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2824926Z [cluster2] E0717 14:13:41.653184 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T14:14:37.2871395Z [cluster2] I0717 14:13:41.658490 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2874771Z [cluster2] I0717 14:13:41.665586 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2878437Z [cluster2] I0717 14:13:41.979694 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2882923Z [cluster2] E0717 14:13:42.065437 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2886074Z [cluster2] I0717 14:13:42.065494 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2887811Z [cluster2] I0717 14:13:42.065526 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2889256Z [cluster2] I0717 14:13:42.065536 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2891872Z [cluster2] I0717 14:13:42.407085 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2895239Z [cluster2] I0717 14:13:42.715401 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2898852Z [cluster2] I0717 14:13:42.715778 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.2902706Z [cluster2] I0717 14:13:42.716196 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2906197Z [cluster2] I0717 14:13:43.103220 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2941823Z [cluster2] I0717 14:13:43.195962 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-17T14:14:37.2945701Z [cluster2] I0717 14:13:43.673084 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2949329Z [cluster2] I0717 14:13:43.891326 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2952998Z [cluster2] I0717 14:13:43.891944 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.2956586Z [cluster2] I0717 14:13:44.104197 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2960666Z [cluster2] I0717 14:13:44.176702 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2963789Z [cluster2] I0717 14:13:44.180683 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2965499Z [cluster2] I0717 14:13:44.180723 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.2966939Z [cluster2] I0717 14:13:44.180733 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.2970935Z [cluster2] I0717 14:13:44.582186 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.2975086Z [cluster2] I0717 14:13:44.758805 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2978702Z [cluster2] I0717 14:13:44.759253 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.2982317Z [cluster2] I0717 14:13:44.792708 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.2986387Z [cluster2] E0717 14:13:44.792771 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"
2021-07-17T14:14:37.2991060Z [cluster2] E0717 14:13:44.792820 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T14:14:37.2994872Z [cluster2] I0717 14:13:44.792896 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.2998320Z [cluster2] I0717 14:13:45.027841 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3002257Z [cluster2] I0717 14:13:45.028249 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3006313Z [cluster2] E0717 14:13:45.028859 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3009547Z [cluster2] I0717 14:13:45.028919 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3011261Z [cluster2] I0717 14:13:45.028947 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3012699Z [cluster2] I0717 14:13:45.028957 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3015305Z [cluster2] I0717 14:13:45.339291 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3018651Z [cluster2] I0717 14:13:45.339677 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3022002Z [cluster2] I0717 14:13:45.688538 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3025349Z [cluster2] I0717 14:13:45.770716 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3100036Z [cluster2] I0717 14:13:45.832364 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3104359Z [cluster2] I0717 14:13:45.841965 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3108582Z [cluster2] I0717 14:13:45.884262 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3112275Z [cluster2] I0717 14:13:46.103270 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3115601Z [cluster2] I0717 14:13:46.127071 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3119421Z [cluster2] I0717 14:13:46.252620 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3123589Z [cluster2] I0717 14:13:46.279044 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3127736Z [cluster2] I0717 14:13:46.312147 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3131643Z [cluster2] I0717 14:13:46.370582 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3134997Z [cluster2] I0717 14:13:46.459017 1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3139683Z [cluster2] I0717 14:13:46.459077 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.5.76\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n"
2021-07-17T14:14:37.3144001Z [cluster2] I0717 14:13:46.716837 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3147470Z [cluster2] I0717 14:13:46.731803 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3152143Z [cluster2] I0717 14:13:46.731852 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.5.76\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n"
2021-07-17T14:14:37.3156067Z [cluster2] I0717 14:13:46.754621 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3159458Z [cluster2] I0717 14:13:46.787824 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3163424Z [cluster2] I0717 14:13:46.929874 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3167210Z [cluster2] I0717 14:13:47.347353 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3181579Z [cluster2] I0717 14:13:47.355161 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3196463Z [cluster2] I0717 14:13:47.377558 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3200597Z [cluster2] I0717 14:13:47.780527 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3203908Z [cluster2] I0717 14:13:47.802673 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3208428Z [cluster2] I0717 14:13:47.802719 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.5.76\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n"
2021-07-17T14:14:37.3212077Z [cluster2] I0717 14:13:59.256990 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3213808Z [cluster2] I0717 14:13:59.257045 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3215447Z [cluster2] I0717 14:13:59.257055 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3218025Z [cluster2] I0717 14:13:59.289149 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3236071Z [cluster2] I0717 14:13:59.310814 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3239977Z [cluster2] I0717 14:13:59.713013 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3243457Z [cluster2] I0717 14:13:59.719057 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3246287Z [cluster2] I0717 14:13:59.724695 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3248211Z [cluster2] I0717 14:13:59.724732 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3249657Z [cluster2] I0717 14:13:59.724742 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3251714Z [cluster2] I0717 14:13:59.725510 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3253423Z [cluster2] I0717 14:13:59.725535 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3254869Z [cluster2] I0717 14:13:59.725544 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3257555Z [cluster2] I0717 14:13:59.743653 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3271449Z [cluster2] I0717 14:13:59.752098 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3274856Z [cluster2] I0717 14:13:59.763471 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3308911Z [cluster2] I0717 14:13:59.771201 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3312558Z [cluster2] I0717 14:14:00.179403 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3316021Z [cluster2] I0717 14:14:00.186462 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3319362Z [cluster2] I0717 14:14:00.187037 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3322914Z [cluster2] I0717 14:14:00.322656 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3325751Z [cluster2] I0717 14:14:00.718757 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3327469Z [cluster2] I0717 14:14:00.718825 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3328907Z [cluster2] I0717 14:14:00.718836 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3331472Z [cluster2] I0717 14:14:00.758487 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3334943Z [cluster2] I0717 14:14:00.833360 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3338415Z [cluster2] I0717 14:14:01.239499 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3341825Z [cluster2] I0717 14:14:01.270817 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3344639Z [cluster2] I0717 14:14:01.332667 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3346371Z [cluster2] I0717 14:14:01.332736 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3347929Z [cluster2] I0717 14:14:01.332748 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3349972Z [cluster2] I0717 14:14:01.348934 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3351693Z [cluster2] I0717 14:14:01.349005 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3353132Z [cluster2] I0717 14:14:01.349025 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3355764Z [cluster2] I0717 14:14:01.375836 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3359084Z [cluster2] I0717 14:14:01.376267 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3375813Z [cluster2] I0717 14:14:01.412046 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3379374Z [cluster2] I0717 14:14:01.416936 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3382776Z [cluster2] I0717 14:14:01.819298 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3386095Z [cluster2] I0717 14:14:01.860493 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3389852Z [cluster2] I0717 14:14:01.870707 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3417435Z [cluster2] I0717 14:14:01.918732 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3420567Z [cluster2] I0717 14:14:01.919659 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3422314Z [cluster2] I0717 14:14:01.919704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3423761Z [cluster2] I0717 14:14:01.919715 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3426336Z [cluster2] I0717 14:14:01.942438 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3429965Z [cluster2] I0717 14:14:01.981353 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3433792Z [cluster2] E0717 14:14:01.982555 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3436933Z [cluster2] I0717 14:14:01.982686 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3438829Z [cluster2] I0717 14:14:01.982722 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3440287Z [cluster2] I0717 14:14:01.982731 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3442869Z [cluster2] I0717 14:14:02.023271 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3446248Z [cluster2] I0717 14:14:02.034991 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3449584Z [cluster2] I0717 14:14:02.394280 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3452826Z [cluster2] I0717 14:14:02.451280 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3456233Z [cluster2] I0717 14:14:02.530433 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3459345Z [cluster2] I0717 14:14:02.530385 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3462456Z [cluster2] I0717 14:14:02.531413 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3466112Z [cluster2] I0717 14:14:02.595384 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3470247Z [cluster2] I0717 14:14:02.667567 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3474377Z [cluster2] E0717 14:14:02.667955 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3477488Z [cluster2] I0717 14:14:02.668004 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3479222Z [cluster2] I0717 14:14:02.668037 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3480790Z [cluster2] I0717 14:14:02.668049 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3483468Z [cluster2] I0717 14:14:02.704937 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3486848Z [cluster2] I0717 14:14:02.788053 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3490317Z [cluster2] I0717 14:14:03.070410 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3494083Z [cluster2] I0717 14:14:03.075060 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3509289Z [cluster2] I0717 14:14:03.089021 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3513363Z [cluster2] I0717 14:14:03.227024 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3516704Z [cluster2] I0717 14:14:03.483048 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3520172Z [cluster2] I0717 14:14:03.523176 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3523459Z [cluster2] I0717 14:14:03.551568 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3527875Z [cluster2] I0717 14:14:03.554108 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.5.76\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n"
2021-07-17T14:14:37.3542932Z [cluster2] I0717 14:14:04.417765 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3546410Z [cluster2] I0717 14:14:04.432687 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3552534Z [cluster2] I0717 14:14:04.442283 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3556474Z [cluster2] I0717 14:14:04.843868 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3560240Z [cluster2] I0717 14:14:04.856995 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3564297Z [cluster2] I0717 14:14:04.866914 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3567465Z [cluster2] I0717 14:14:04.892174 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3570132Z [cluster2] I0717 14:14:04.892225 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3571716Z [cluster2] I0717 14:14:04.892235 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3574342Z [cluster2] I0717 14:14:04.898415 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3577725Z [cluster2] I0717 14:14:04.906364 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3582868Z [cluster2] I0717 14:14:05.268592 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3586739Z [cluster2] I0717 14:14:05.274544 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3592476Z [cluster2] I0717 14:14:05.274774 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.5.76\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n"
2021-07-17T14:14:37.3597522Z [cluster2] I0717 14:14:05.313624 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3601948Z [cluster2] I0717 14:14:05.338295 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3605034Z [cluster2] I0717 14:14:05.350379 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3606890Z [cluster2] I0717 14:14:05.350595 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3608480Z [cluster2] I0717 14:14:05.350716 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3610674Z [cluster2] I0717 14:14:05.357155 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3612536Z [cluster2] I0717 14:14:05.357364 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3614112Z [cluster2] I0717 14:14:05.357440 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3616865Z [cluster2] I0717 14:14:05.388779 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3620837Z [cluster2] I0717 14:14:05.389863 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3624130Z [cluster2] I0717 14:14:05.406740 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3627789Z [cluster2] I0717 14:14:05.435052 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3636250Z [cluster2] I0717 14:14:05.449466 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3640281Z [cluster2] I0717 14:14:05.449932 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3644865Z [cluster2] I0717 14:14:05.497630 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3649424Z [cluster2] I0717 14:14:05.837312 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3653639Z [cluster2] I0717 14:14:05.840870 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3668739Z [cluster2] I0717 14:14:05.851559 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3670523Z [cluster2] I0717 14:14:05.851797 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3671970Z [cluster2] I0717 14:14:05.851902 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3678499Z [cluster2] I0717 14:14:05.851728 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3681916Z [cluster2] I0717 14:14:05.859657 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3685270Z [cluster2] I0717 14:14:05.859961 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3689024Z [cluster2] E0717 14:14:05.865894 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3692331Z [cluster2] I0717 14:14:05.865994 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3694076Z [cluster2] I0717 14:14:05.866068 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3698199Z [cluster2] I0717 14:14:05.866126 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3701178Z [cluster2] I0717 14:14:05.869309 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3704575Z [cluster2] I0717 14:14:05.870698 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3711899Z [cluster2] I0717 14:14:05.881506 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3715480Z [cluster2] I0717 14:14:05.899251 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3719254Z [cluster2] I0717 14:14:05.902212 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.3723430Z [cluster2] I0717 14:14:05.905395 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3727235Z [cluster2] I0717 14:14:06.271067 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3730558Z [cluster2] I0717 14:14:06.274080 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3733877Z [cluster2] I0717 14:14:06.282661 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3737153Z [cluster2] I0717 14:14:06.285147 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3758527Z [cluster2] I0717 14:14:06.306708 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3762488Z [cluster2] I0717 14:14:06.309451 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3767402Z [cluster2] I0717 14:14:06.309499 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.5.76\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n"
2021-07-17T14:14:37.3771419Z [cluster2] I0717 14:14:10.774515 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3778227Z [cluster2] I0717 14:14:10.774592 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3779699Z [cluster2] I0717 14:14:10.774603 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3782514Z [cluster2] I0717 14:14:10.782334 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3785901Z [cluster2] I0717 14:14:10.785852 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3789585Z [cluster2] I0717 14:14:11.187861 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3792950Z [cluster2] I0717 14:14:11.192583 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3796030Z [cluster2] I0717 14:14:11.203339 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3797757Z [cluster2] I0717 14:14:11.206153 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3799201Z [cluster2] I0717 14:14:11.206403 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3801263Z [cluster2] I0717 14:14:11.206094 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3802976Z [cluster2] I0717 14:14:11.207140 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3805395Z [cluster2] I0717 14:14:11.210050 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3812173Z [cluster2] I0717 14:14:11.236924 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3815661Z [cluster2] I0717 14:14:11.237543 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3819049Z [cluster2] I0717 14:14:11.240507 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3822879Z [cluster2] I0717 14:14:11.242326 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3828807Z [cluster2] I0717 14:14:11.642678 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3834806Z [cluster2] I0717 14:14:11.643933 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3838135Z [cluster2] I0717 14:14:11.659740 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3842236Z [cluster2] I0717 14:14:11.664843 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3845251Z [cluster2] I0717 14:14:15.819308 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3846980Z [cluster2] I0717 14:14:15.819354 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3848427Z [cluster2] I0717 14:14:15.819365 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3851006Z [cluster2] I0717 14:14:15.831983 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3854358Z [cluster2] I0717 14:14:15.844859 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3857684Z [cluster2] I0717 14:14:16.246819 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3861991Z [cluster2] I0717 14:14:16.249385 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3865002Z [cluster2] I0717 14:14:16.254910 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3866736Z [cluster2] I0717 14:14:16.254945 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3868326Z [cluster2] I0717 14:14:16.254954 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3870361Z [cluster2] I0717 14:14:16.256780 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3872098Z [cluster2] I0717 14:14:16.256819 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3873530Z [cluster2] I0717 14:14:16.256830 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3876075Z [cluster2] I0717 14:14:16.259362 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3879385Z [cluster2] I0717 14:14:16.260446 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3882788Z [cluster2] I0717 14:14:16.264359 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3886283Z [cluster2] I0717 14:14:16.264690 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3889635Z [cluster2] I0717 14:14:16.667027 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3892887Z [cluster2] I0717 14:14:16.667225 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3896185Z [cluster2] I0717 14:14:16.674280 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3899921Z [cluster2] I0717 14:14:16.690254 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3903055Z [cluster2] I0717 14:14:20.843145 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3904887Z [cluster2] I0717 14:14:20.843193 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3906310Z [cluster2] I0717 14:14:20.843204 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3909164Z [cluster2] I0717 14:14:20.890576 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3912543Z [cluster2] I0717 14:14:20.901077 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3915864Z [cluster2] I0717 14:14:21.303061 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3919168Z [cluster2] I0717 14:14:21.310581 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3921981Z [cluster2] I0717 14:14:21.321478 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3923693Z [cluster2] I0717 14:14:21.321529 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3925131Z [cluster2] I0717 14:14:21.321539 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3927168Z [cluster2] I0717 14:14:21.326884 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3928962Z [cluster2] I0717 14:14:21.327068 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3930394Z [cluster2] I0717 14:14:21.327152 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3935785Z [cluster2] I0717 14:14:21.337660 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3940530Z [cluster2] I0717 14:14:21.343829 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3944277Z [cluster2] I0717 14:14:21.349013 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3947717Z [cluster2] I0717 14:14:21.365896 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3951221Z [cluster2] I0717 14:14:21.751462 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3954700Z [cluster2] I0717 14:14:21.754562 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3958037Z [cluster2] I0717 14:14:21.767935 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3961341Z [cluster2] I0717 14:14:21.772579 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3964131Z [cluster2] I0717 14:14:25.867895 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3965866Z [cluster2] I0717 14:14:25.867970 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3967305Z [cluster2] I0717 14:14:25.867980 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3969846Z [cluster2] I0717 14:14:25.881253 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3973212Z [cluster2] I0717 14:14:25.888657 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.3976644Z [cluster2] I0717 14:14:26.290055 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.3980959Z [cluster2] I0717 14:14:26.293760 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3984567Z [cluster2] I0717 14:14:26.304282 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3986310Z [cluster2] I0717 14:14:26.304510 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3987736Z [cluster2] I0717 14:14:26.304621 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3989906Z [cluster2] I0717 14:14:26.304770 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.3991643Z [cluster2] I0717 14:14:26.304964 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.3993056Z [cluster2] I0717 14:14:26.304989 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.3995755Z [cluster2] I0717 14:14:26.310946 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.3999063Z [cluster2] I0717 14:14:26.313234 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4002498Z [cluster2] I0717 14:14:26.328923 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.4005917Z [cluster2] I0717 14:14:26.329208 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.4009272Z [cluster2] I0717 14:14:26.730499 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.4012501Z [cluster2] I0717 14:14:26.730992 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.4015789Z [cluster2] I0717 14:14:26.739424 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4019170Z [cluster2] I0717 14:14:26.739848 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4022067Z [cluster2] I0717 14:14:30.887573 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.4023778Z [cluster2] I0717 14:14:30.887637 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.4025213Z [cluster2] I0717 14:14:30.887648 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.4027780Z [cluster2] I0717 14:14:30.897588 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4031227Z [cluster2] I0717 14:14:30.902211 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.4034561Z [cluster2] I0717 14:14:31.306927 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.4037862Z [cluster2] I0717 14:14:31.312833 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4041329Z [cluster2] I0717 14:14:31.318944 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.4044166Z [cluster2] I0717 14:14:31.318987 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.4045639Z [cluster2] I0717 14:14:31.318999 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.4047723Z [cluster2] I0717 14:14:31.321525 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.4049448Z [cluster2] I0717 14:14:31.321677 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.4050875Z [cluster2] I0717 14:14:31.321806 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.4053869Z [cluster2] I0717 14:14:31.332692 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4057872Z [cluster2] I0717 14:14:31.335153 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4061847Z [cluster2] I0717 14:14:31.340583 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.4065394Z [cluster2] I0717 14:14:31.363150 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.4074438Z [cluster2] I0717 14:14:31.742936 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.4077794Z [cluster2] I0717 14:14:31.746865 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4081183Z [cluster2] I0717 14:14:31.764988 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.4084473Z [cluster2] I0717 14:14:31.767967 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4087287Z [cluster2] I0717 14:14:35.907854 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.4089015Z [cluster2] I0717 14:14:35.907909 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.4090534Z [cluster2] I0717 14:14:35.907919 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.4093119Z [cluster2] I0717 14:14:35.919258 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4110348Z [cluster2] I0717 14:14:35.947050 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.4113716Z [cluster2] I0717 14:14:36.349831 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.4117059Z [cluster2] I0717 14:14:36.358338 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.4120488Z [cluster2] I0717 14:14:36.366232 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.4122210Z [cluster2] I0717 14:14:36.366465 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.4123654Z [cluster2] I0717 14:14:36.366573 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:37.4125704Z [cluster2] I0717 14:14:36.366407 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5452430Z [cluster2] I0717 14:14:36.367272 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10r1] "qosClass": "BestEffort",
2021-07-17T14:14:37.5463383Z [cluster1] "startTime": "2021-07-17T14:13:09Z"
2021-07-17T14:14:37.5464078Z [cluster1] }
2021-07-17T14:14:37.5464480Z [cluster1] }
2021-07-17T14:14:37.5466188Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T14:14:37.5468783Z [submariner-operator]$ [cluster1] grep Running
2021-07-17T14:14:37.5478329Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T14:14:37.5481177Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-17T14:14:37.5482678Z [cluster1] Running
2021-07-17T14:14:37.5484296Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator
2021-07-17T14:14:37.5486583Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator
2021-07-17T14:14:37.5489001Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-56f895dd55-fwtxk --namespace=submariner-operator
2021-07-17T14:14:37.5490490Z [cluster1] I0717 14:13:17.254104 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-17T14:14:37.5491222Z [cluster1] I0717 14:13:17.254296 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-17T14:14:37.5492422Z [cluster1] I0717 14:13:17.254313 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-17T14:14:37.5493566Z [cluster1] I0717 14:13:17.254321 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-17T14:14:37.5494505Z [cluster1] I0717 14:13:17.254519 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-17T14:14:37.5495484Z [cluster1] I0717 14:13:17.661634 1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-17T14:14:37.5496466Z [cluster1] I0717 14:13:17.661657 1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-17T14:14:37.5497842Z [cluster1] I0717 14:13:18.066541 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-17T14:14:37.5498906Z [cluster1] I0717 14:13:18.066894 1 main.go:129] cmd "msg"="Registering Components."
2021-07-17T14:14:37.5499763Z [cluster1] I0717 14:13:18.067062 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-17T14:14:37.5500866Z [cluster1] I0717 14:13:20.579321 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5502796Z [cluster1] I0717 14:13:20.579354 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5504062Z [cluster1] I0717 14:13:20.579411 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-17T14:14:37.5505311Z [cluster1] I0717 14:13:20.579721 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-17T14:14:37.5507582Z [cluster1] I0717 14:13:20.580091 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-17T14:14:37.5512004Z [cluster1] I0717 14:13:20.580251 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T14:14:37.5516895Z [cluster1] I0717 14:13:20.580172 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-17T14:14:37.5523979Z [cluster1] I0717 14:13:20.580611 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T14:14:37.5533311Z [cluster1] I0717 14:13:20.580733 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-17T14:14:37.5539098Z [cluster1] I0717 14:13:20.681610 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T14:14:37.5541679Z [cluster1] I0717 14:13:20.681656 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-17T14:14:37.5544065Z [cluster1] I0717 14:13:20.681705 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5546268Z [cluster1] I0717 14:13:20.681725 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-17T14:14:37.5549533Z [cluster1] I0717 14:13:20.683685 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T14:14:37.5580207Z [cluster1] I0717 14:13:20.683822 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-17T14:14:37.5585015Z [cluster1] I0717 14:13:20.684069 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-17T14:14:37.5588239Z [cluster1] I0717 14:13:20.784362 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T14:14:37.5590615Z [cluster1] I0717 14:13:20.784754 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-17T14:14:37.5592788Z [cluster1] I0717 14:13:20.784561 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-17T14:14:37.5594931Z [cluster1] I0717 14:13:20.785115 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-17T14:14:37.5598189Z [cluster1] I0717 14:13:20.785064 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-17T14:14:37.5602059Z [cluster1] E0717 14:13:20.838114 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5605668Z [cluster1] E0717 14:13:20.881119 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5608297Z [cluster1] I0717 14:13:20.886448 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-17T14:14:37.5610218Z [cluster1] I0717 14:13:20.886496 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-17T14:14:37.5613015Z [cluster1] E0717 14:13:20.934683 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5616491Z [cluster1] E0717 14:13:21.008311 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5619947Z [cluster1] E0717 14:13:21.102458 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5623423Z [cluster1] E0717 14:13:21.395572 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5626960Z [cluster1] E0717 14:13:21.751035 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5661130Z [cluster1] I0717 14:13:21.891611 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5663488Z [cluster1] I0717 14:13:21.891632 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5665181Z [cluster1] I0717 14:13:21.955295 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-17T14:14:37.5666989Z [cluster1] I0717 14:13:21.955329 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-17T14:14:37.5668760Z [cluster1] I0717 14:13:21.955378 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5670243Z [cluster1] I0717 14:13:21.956063 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5671616Z [cluster1] I0717 14:13:21.956876 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-17T14:14:37.5673779Z [cluster1] I0717 14:13:21.956904 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-17T14:14:37.5675567Z [cluster1] I0717 14:13:21.956914 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5677094Z [cluster1] I0717 14:13:21.956975 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5679650Z [cluster1] I0717 14:13:21.963814 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5683576Z [cluster1] E0717 14:13:21.964014 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-17T14:14:37.5687858Z [cluster1] E0717 14:13:21.967287 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-17T14:14:37.5691015Z [cluster1] I0717 14:13:21.967377 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5692753Z [cluster1] I0717 14:13:21.967411 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5694191Z [cluster1] I0717 14:13:21.967455 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5696435Z [cluster1] I0717 14:13:21.969054 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5698176Z [cluster1] I0717 14:13:21.969090 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5699610Z [cluster1] I0717 14:13:21.969144 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5702194Z [cluster1] I0717 14:13:21.976977 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5705511Z [cluster1] I0717 14:13:21.981559 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5709001Z [cluster1] I0717 14:13:22.027696 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5712415Z [cluster1] I0717 14:13:22.099250 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5716026Z [cluster1] E0717 14:13:22.162399 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5719392Z [cluster1] I0717 14:13:22.430330 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5722682Z [cluster1] I0717 14:13:22.436352 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5726012Z [cluster1] I0717 14:13:22.512922 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5741999Z [cluster1] I0717 14:13:22.528926 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5745163Z [cluster1] I0717 14:13:22.571697 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5748196Z [cluster1] I0717 14:13:22.571869 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5751632Z [cluster1] I0717 14:13:22.573086 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-17T14:14:37.5756517Z [cluster1] E0717 14:13:22.721831 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error reconciling the Service Discovery CR: servicediscoveries.submariner.io \"service-discovery\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-17T14:14:37.5762346Z [cluster1] I0717 14:13:22.721870 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5764115Z [cluster1] I0717 14:13:22.721899 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5765562Z [cluster1] I0717 14:13:22.721909 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5768450Z [cluster1] I0717 14:13:22.759437 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.5772073Z [cluster1] I0717 14:13:22.759825 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5774852Z [cluster1] I0717 14:13:22.804431 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5776729Z [cluster1] I0717 14:13:22.804558 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5778156Z [cluster1] I0717 14:13:22.804570 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5781916Z [cluster1] E0717 14:13:22.811423 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T14:14:37.5785996Z [cluster1] I0717 14:13:22.814862 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5798243Z [cluster1] I0717 14:13:22.871843 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5811937Z [cluster1] I0717 14:13:22.961639 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5821485Z [cluster1] I0717 14:13:22.963168 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5827406Z [cluster1] E0717 14:13:22.963255 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T14:14:37.5831782Z [cluster1] I0717 14:13:22.963286 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5834958Z [cluster1] I0717 14:13:22.982694 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5841746Z [cluster1] I0717 14:13:23.310915 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.5845676Z [cluster1] I0717 14:13:23.311159 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.5849675Z [cluster1] I0717 14:13:23.356578 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5854584Z [cluster1] I0717 14:13:23.358745 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5858210Z [cluster1] I0717 14:13:23.372847 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5861515Z [cluster1] I0717 14:13:23.431529 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5866365Z [cluster1] I0717 14:13:23.431502 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5942396Z [cluster1] E0717 14:13:23.464570 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5945554Z [cluster1] I0717 14:13:23.464633 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5947291Z [cluster1] I0717 14:13:23.464663 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5949019Z [cluster1] I0717 14:13:23.464704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5951862Z [cluster1] I0717 14:13:23.504527 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5955364Z [cluster1] E0717 14:13:23.635349 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.5958350Z [cluster1] I0717 14:13:23.635903 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.5960070Z [cluster1] I0717 14:13:23.635932 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.5961499Z [cluster1] I0717 14:13:23.635942 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.5964065Z [cluster1] I0717 14:13:23.636286 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5967331Z [cluster1] I0717 14:13:23.644258 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.5970828Z [cluster1] I0717 14:13:23.647417 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5974396Z [cluster1] I0717 14:13:23.655248 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.5977969Z [cluster1] I0717 14:13:23.798630 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5981507Z [cluster1] I0717 14:13:23.800899 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.5985284Z [cluster1] I0717 14:13:23.991709 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-17T14:14:37.6025505Z [cluster1] E0717 14:13:24.049636 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-17T14:14:37.6031127Z [cluster1] E0717 14:13:24.049692 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T14:14:37.6035615Z [cluster1] I0717 14:13:24.053773 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6038672Z [cluster1] I0717 14:13:24.079697 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6042118Z [cluster1] I0717 14:13:24.080189 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6046257Z [cluster1] E0717 14:13:24.080219 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found"
2021-07-17T14:14:37.6050986Z [cluster1] E0717 14:13:24.080245 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T14:14:37.6054886Z [cluster1] I0717 14:13:24.080274 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6058058Z [cluster1] I0717 14:13:24.080691 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6061548Z [cluster1] I0717 14:13:24.104413 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6065363Z [cluster1] E0717 14:13:24.128573 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6089820Z [cluster1] I0717 14:13:24.128621 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6091640Z [cluster1] I0717 14:13:24.128654 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6093074Z [cluster1] I0717 14:13:24.128664 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6096136Z [cluster1] I0717 14:13:24.143871 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6100087Z [cluster1] I0717 14:13:24.144260 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6103889Z [cluster1] I0717 14:13:24.144554 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6107373Z [cluster1] I0717 14:13:24.201082 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6111221Z [cluster1] I0717 14:13:24.268872 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6114950Z [cluster1] I0717 14:13:24.282058 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6118676Z [cluster1] I0717 14:13:24.282348 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6122419Z [cluster1] I0717 14:13:24.673453 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6126297Z [cluster1] I0717 14:13:24.685365 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6130030Z [cluster1] I0717 14:13:24.689887 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6133635Z [cluster1] I0717 14:13:24.690543 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6170765Z [cluster1] I0717 14:13:24.712185 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6174806Z [cluster1] I0717 14:13:24.713218 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6178380Z [cluster1] I0717 14:13:24.798890 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6182309Z [cluster1] E0717 14:13:24.798948 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"
2021-07-17T14:14:37.6187247Z [cluster1] E0717 14:13:24.798985 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-17T14:14:37.6191407Z [cluster1] I0717 14:13:24.819242 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6194838Z [cluster1] I0717 14:13:24.865647 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6198785Z [cluster1] I0717 14:13:24.947594 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6202895Z [cluster1] E0717 14:13:25.112395 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists"
2021-07-17T14:14:37.6207941Z [cluster1] E0717 14:13:25.112437 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-17T14:14:37.6211777Z [cluster1] I0717 14:13:25.112467 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6215311Z [cluster1] I0717 14:13:25.129466 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6219304Z [cluster1] I0717 14:13:25.199710 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6223077Z [cluster1] E0717 14:13:25.330023 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.6226579Z [cluster1] I0717 14:13:25.377718 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6251686Z [cluster1] I0717 14:13:25.390430 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6256061Z [cluster1] I0717 14:13:25.436118 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6259964Z [cluster1] I0717 14:13:25.611069 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6263726Z [cluster1] I0717 14:13:25.636501 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6267756Z [cluster1] I0717 14:13:25.685768 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6271704Z [cluster1] I0717 14:13:25.891896 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6275036Z [cluster1] I0717 14:13:25.893873 1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6279594Z [cluster1] I0717 14:13:25.893899 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.94.136\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n"
2021-07-17T14:14:37.6283859Z [cluster1] I0717 14:13:26.101514 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6287132Z [cluster1] I0717 14:13:26.133757 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6291516Z [cluster1] I0717 14:13:26.133802 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.94.136\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n"
2021-07-17T14:14:37.6295425Z [cluster1] I0717 14:13:26.337527 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6298841Z [cluster1] I0717 14:13:26.398278 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6302881Z [cluster1] I0717 14:13:26.415414 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6361260Z [cluster1] I0717 14:13:26.818316 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6365062Z [cluster1] I0717 14:13:26.845514 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6369118Z [cluster1] I0717 14:13:26.852445 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6372995Z [cluster1] I0717 14:13:27.260201 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6376641Z [cluster1] I0717 14:13:27.268923 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6381057Z [cluster1] I0717 14:13:27.269005 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.94.136\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n"
2021-07-17T14:14:37.6385357Z [cluster1] E0717 14:13:28.149823 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.6411184Z [cluster1] E0717 14:13:33.441369 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.6414210Z [cluster1] I0717 14:13:40.284326 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6415937Z [cluster1] I0717 14:13:40.285453 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6417385Z [cluster1] I0717 14:13:40.285471 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6420192Z [cluster1] I0717 14:13:40.356877 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6423737Z [cluster1] I0717 14:13:40.387218 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6427107Z [cluster1] I0717 14:13:40.798303 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6431188Z [cluster1] I0717 14:13:40.945561 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6433987Z [cluster1] I0717 14:13:41.000115 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6435716Z [cluster1] I0717 14:13:41.000247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6437153Z [cluster1] I0717 14:13:41.000260 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6439295Z [cluster1] I0717 14:13:41.000509 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6441031Z [cluster1] I0717 14:13:41.000669 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6442454Z [cluster1] I0717 14:13:41.000680 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6445015Z [cluster1] I0717 14:13:41.103091 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6448308Z [cluster1] I0717 14:13:41.140511 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6451681Z [cluster1] I0717 14:13:41.267143 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6455085Z [cluster1] I0717 14:13:41.267421 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6458419Z [cluster1] I0717 14:13:41.669158 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6461659Z [cluster1] I0717 14:13:41.680167 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6466740Z [cluster1] I0717 14:13:41.879478 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6470498Z [cluster1] I0717 14:13:41.879903 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6474323Z [cluster1] E0717 14:13:41.924734 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6477469Z [cluster1] I0717 14:13:41.924773 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6479194Z [cluster1] I0717 14:13:41.924801 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6480638Z [cluster1] I0717 14:13:41.924812 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6483201Z [cluster1] I0717 14:13:41.944304 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6486674Z [cluster1] I0717 14:13:41.963105 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6489763Z [cluster1] I0717 14:13:42.487781 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6492836Z [cluster1] I0717 14:13:42.525781 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6496141Z [cluster1] I0717 14:13:42.603167 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6499805Z [cluster1] I0717 14:13:42.603723 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6503767Z [cluster1] I0717 14:13:42.917364 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6507534Z [cluster1] I0717 14:13:43.502558 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6511478Z [cluster1] I0717 14:13:44.046121 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6515535Z [cluster1] I0717 14:13:44.573734 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6519347Z [cluster1] E0717 14:13:44.762272 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.6522857Z [cluster1] I0717 14:13:44.978958 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6526131Z [cluster1] I0717 14:13:44.991990 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6530537Z [cluster1] I0717 14:13:44.992044 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.94.136\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n"
2021-07-17T14:14:37.6534520Z [cluster1] I0717 14:13:45.032513 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6537941Z [cluster1] I0717 14:13:45.173496 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6542297Z [cluster1] I0717 14:13:45.177936 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6546148Z [cluster1] I0717 14:13:45.592335 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6550000Z [cluster1] I0717 14:13:45.597317 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6554039Z [cluster1] I0717 14:13:45.603292 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6557910Z [cluster1] I0717 14:13:46.005264 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6561607Z [cluster1] I0717 14:13:46.020675 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6566014Z [cluster1] I0717 14:13:46.020724 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.94.136\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n"
2021-07-17T14:14:37.6569655Z [cluster1] I0717 14:13:47.902730 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6571610Z [cluster1] I0717 14:13:47.902777 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6573217Z [cluster1] I0717 14:13:47.902823 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6575922Z [cluster1] I0717 14:13:47.906129 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6579281Z [cluster1] I0717 14:13:47.917837 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6582622Z [cluster1] I0717 14:13:48.319594 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6585921Z [cluster1] I0717 14:13:48.381292 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6589650Z [cluster1] I0717 14:13:48.395167 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6591574Z [cluster1] I0717 14:13:48.395203 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6593014Z [cluster1] I0717 14:13:48.395214 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6595083Z [cluster1] I0717 14:13:48.404033 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6596810Z [cluster1] I0717 14:13:48.404074 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6598242Z [cluster1] I0717 14:13:48.404085 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6600890Z [cluster1] I0717 14:13:48.431305 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6604421Z [cluster1] I0717 14:13:48.431699 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6607788Z [cluster1] I0717 14:13:48.472814 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6611186Z [cluster1] I0717 14:13:48.473263 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6614506Z [cluster1] I0717 14:13:48.882199 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6627175Z [cluster1] I0717 14:13:48.882432 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6632983Z [cluster1] I0717 14:13:48.891025 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6638366Z [cluster1] I0717 14:13:48.913461 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6641226Z [cluster1] I0717 14:13:50.273616 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6642969Z [cluster1] I0717 14:13:50.273659 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6644414Z [cluster1] I0717 14:13:50.273669 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6646980Z [cluster1] I0717 14:13:50.286395 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6650338Z [cluster1] I0717 14:13:50.298098 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6654100Z [cluster1] I0717 14:13:50.700139 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6657745Z [cluster1] I0717 14:13:50.936183 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6660792Z [cluster1] I0717 14:13:50.953227 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6662521Z [cluster1] I0717 14:13:50.953346 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6663940Z [cluster1] I0717 14:13:50.953401 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6666353Z [cluster1] I0717 14:13:50.970586 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6668187Z [cluster1] I0717 14:13:50.970686 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6669606Z [cluster1] I0717 14:13:50.970717 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6672217Z [cluster1] I0717 14:13:51.021880 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6675671Z [cluster1] I0717 14:13:51.035375 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6679020Z [cluster1] I0717 14:13:51.037283 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6682428Z [cluster1] I0717 14:13:51.178635 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6686116Z [cluster1] I0717 14:13:51.440155 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6689446Z [cluster1] I0717 14:13:51.443551 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6692746Z [cluster1] I0717 14:13:51.581646 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6696048Z [cluster1] I0717 14:13:51.588350 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6699122Z [cluster1] I0717 14:13:52.339149 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6702617Z [cluster1] I0717 14:13:52.351879 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6706613Z [cluster1] I0717 14:13:52.366935 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6710606Z [cluster1] I0717 14:13:52.769360 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6715213Z [cluster1] I0717 14:13:52.784782 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-17T14:14:37.6719286Z [cluster1] I0717 14:13:52.824448 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6722824Z [cluster1] I0717 14:13:52.911694 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6724656Z [cluster1] I0717 14:13:52.911743 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6726095Z [cluster1] I0717 14:13:52.912039 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6729496Z [cluster1] I0717 14:13:52.937394 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6733609Z [cluster1] I0717 14:13:52.946999 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6737933Z [cluster1] I0717 14:13:53.228796 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6741955Z [cluster1] I0717 14:13:53.232812 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6747367Z [cluster1] I0717 14:13:53.234209 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.94.136\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n"
2021-07-17T14:14:37.6752712Z [cluster1] I0717 14:13:53.350656 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6756767Z [cluster1] I0717 14:13:53.362699 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6760744Z [cluster1] I0717 14:13:53.376171 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6762774Z [cluster1] I0717 14:13:53.376281 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6764218Z [cluster1] I0717 14:13:53.376341 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6766278Z [cluster1] I0717 14:13:53.376735 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6767998Z [cluster1] I0717 14:13:53.376863 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6769414Z [cluster1] I0717 14:13:53.376989 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6772343Z [cluster1] I0717 14:13:53.389618 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6775852Z [cluster1] I0717 14:13:53.390266 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6779195Z [cluster1] I0717 14:13:53.431768 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6782601Z [cluster1] I0717 14:13:53.432831 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6786277Z [cluster1] I0717 14:13:53.834246 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6789794Z [cluster1] I0717 14:13:53.834872 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6793085Z [cluster1] I0717 14:13:53.840521 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6796453Z [cluster1] I0717 14:13:53.840732 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6799391Z [cluster1] I0717 14:13:57.928674 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6801114Z [cluster1] I0717 14:13:57.928723 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6802554Z [cluster1] I0717 14:13:57.928746 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6805129Z [cluster1] I0717 14:13:57.959678 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6808466Z [cluster1] I0717 14:13:57.970931 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6811796Z [cluster1] I0717 14:13:58.375530 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6815081Z [cluster1] I0717 14:13:58.389065 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6817989Z [cluster1] I0717 14:13:58.401888 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6819704Z [cluster1] I0717 14:13:58.401992 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6821138Z [cluster1] I0717 14:13:58.402175 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6823157Z [cluster1] I0717 14:13:58.407643 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6824885Z [cluster1] I0717 14:13:58.407676 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6826309Z [cluster1] I0717 14:13:58.407754 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6829096Z [cluster1] I0717 14:13:58.570141 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6832405Z [cluster1] I0717 14:13:58.570447 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6835781Z [cluster1] I0717 14:13:58.589246 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6844210Z [cluster1] I0717 14:13:58.589516 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6847586Z [cluster1] I0717 14:13:58.991141 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6851746Z [cluster1] I0717 14:13:58.991386 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6855290Z [cluster1] I0717 14:13:58.995923 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6858879Z [cluster1] I0717 14:13:59.000189 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6862351Z [cluster1] E0717 14:14:05.334023 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-17T14:14:37.6865339Z [cluster1] I0717 14:14:07.980840 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6867475Z [cluster1] I0717 14:14:07.980894 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6869010Z [cluster1] I0717 14:14:07.980905 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6872742Z [cluster1] I0717 14:14:07.990026 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6876177Z [cluster1] I0717 14:14:07.993158 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6879533Z [cluster1] I0717 14:14:08.395312 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6882845Z [cluster1] I0717 14:14:08.398255 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6886021Z [cluster1] I0717 14:14:08.403981 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6887778Z [cluster1] I0717 14:14:08.404155 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6889221Z [cluster1] I0717 14:14:08.404246 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6891798Z [cluster1] I0717 14:14:08.405060 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6893736Z [cluster1] I0717 14:14:08.405220 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6895361Z [cluster1] I0717 14:14:08.405294 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6899862Z [cluster1] I0717 14:14:08.408675 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6904398Z [cluster1] I0717 14:14:08.409004 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6909472Z [cluster1] I0717 14:14:08.412203 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6912915Z [cluster1] I0717 14:14:08.412591 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6916428Z [cluster1] I0717 14:14:08.814093 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6919683Z [cluster1] I0717 14:14:08.814102 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6922990Z [cluster1] I0717 14:14:08.818212 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6926352Z [cluster1] I0717 14:14:08.818507 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6929173Z [cluster1] I0717 14:14:13.001882 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6931460Z [cluster1] I0717 14:14:13.002112 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6933193Z [cluster1] I0717 14:14:13.002202 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6936354Z [cluster1] I0717 14:14:13.009252 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6941032Z [cluster1] I0717 14:14:13.015283 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6944434Z [cluster1] I0717 14:14:13.416753 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6948661Z [cluster1] I0717 14:14:13.428881 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6951544Z [cluster1] I0717 14:14:13.444430 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6953273Z [cluster1] I0717 14:14:13.444480 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6954691Z [cluster1] I0717 14:14:13.444491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6956724Z [cluster1] I0717 14:14:13.446370 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6958539Z [cluster1] I0717 14:14:13.446412 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6959962Z [cluster1] I0717 14:14:13.446423 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6962542Z [cluster1] I0717 14:14:13.465315 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6965808Z [cluster1] I0717 14:14:13.465747 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6969170Z [cluster1] I0717 14:14:13.472935 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6972624Z [cluster1] I0717 14:14:13.473423 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.6976726Z [cluster1] I0717 14:14:13.875404 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6980332Z [cluster1] I0717 14:14:13.875432 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.6983648Z [cluster1] I0717 14:14:13.880243 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6987123Z [cluster1] I0717 14:14:13.880750 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6990041Z [cluster1] I0717 14:14:18.041583 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.6991767Z [cluster1] I0717 14:14:18.043001 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.6993202Z [cluster1] I0717 14:14:18.043141 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.6995749Z [cluster1] I0717 14:14:18.047435 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.6999995Z [cluster1] I0717 14:14:18.050135 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7003376Z [cluster1] I0717 14:14:18.452472 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7006806Z [cluster1] I0717 14:14:18.460591 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7009592Z [cluster1] I0717 14:14:18.468526 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7011328Z [cluster1] I0717 14:14:18.468566 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7013962Z [cluster1] I0717 14:14:18.468574 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7016082Z [cluster1] I0717 14:14:18.468576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7017820Z [cluster1] I0717 14:14:18.468632 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7019540Z [cluster1] I0717 14:14:18.468644 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7022136Z [cluster1] I0717 14:14:18.473489 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7025433Z [cluster1] I0717 14:14:18.474284 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7029093Z [cluster1] I0717 14:14:18.479659 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7032530Z [cluster1] I0717 14:14:18.479964 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7035883Z [cluster1] I0717 14:14:18.882024 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7040036Z [cluster1] I0717 14:14:18.882041 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7043582Z [cluster1] I0717 14:14:18.887820 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7046962Z [cluster1] I0717 14:14:18.901219 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7050131Z [cluster1] I0717 14:14:23.051961 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7052017Z [cluster1] I0717 14:14:23.052026 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7053462Z [cluster1] I0717 14:14:23.052039 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7056062Z [cluster1] I0717 14:14:23.066014 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7059762Z [cluster1] I0717 14:14:23.069596 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7064291Z [cluster1] I0717 14:14:23.472205 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7069806Z [cluster1] I0717 14:14:23.477827 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7075973Z [cluster1] I0717 14:14:23.483073 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7077725Z [cluster1] I0717 14:14:23.483124 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7079547Z [cluster1] I0717 14:14:23.483135 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7081947Z [cluster1] I0717 14:14:23.483709 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7083686Z [cluster1] I0717 14:14:23.483739 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7085115Z [cluster1] I0717 14:14:23.483749 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7088493Z [cluster1] I0717 14:14:23.576380 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7091832Z [cluster1] I0717 14:14:23.577292 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7095209Z [cluster1] I0717 14:14:23.589063 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7098617Z [cluster1] I0717 14:14:23.589323 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7102072Z [cluster1] I0717 14:14:24.012594 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7105335Z [cluster1] I0717 14:14:24.015868 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7108858Z [cluster1] I0717 14:14:24.017931 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7112245Z [cluster1] I0717 14:14:24.028977 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7115043Z [cluster1] I0717 14:14:28.108179 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7116771Z [cluster1] I0717 14:14:28.108235 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7118188Z [cluster1] I0717 14:14:28.108245 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7120742Z [cluster1] I0717 14:14:28.145429 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7124419Z [cluster1] I0717 14:14:28.149735 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7127996Z [cluster1] I0717 14:14:28.551961 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7131287Z [cluster1] I0717 14:14:28.556139 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7134097Z [cluster1] I0717 14:14:28.566758 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7135829Z [cluster1] I0717 14:14:28.566919 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7137253Z [cluster1] I0717 14:14:28.566932 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7140615Z [cluster1] I0717 14:14:28.571496 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7143741Z [cluster1] I0717 14:14:28.575428 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7145449Z [cluster1] I0717 14:14:28.575465 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7146887Z [cluster1] I0717 14:14:28.575653 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7149551Z [cluster1] I0717 14:14:28.580103 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7152909Z [cluster1] I0717 14:14:28.581916 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7156318Z [cluster1] I0717 14:14:28.612506 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7159652Z [cluster1] I0717 14:14:28.983125 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7162938Z [cluster1] I0717 14:14:28.986983 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7166663Z [cluster1] I0717 14:14:29.015437 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7170118Z [cluster1] I0717 14:14:29.020512 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7174028Z [cluster1] I0717 14:14:33.147041 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7175758Z [cluster1] I0717 14:14:33.147166 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7177445Z [cluster1] I0717 14:14:33.147212 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7180201Z [cluster1] I0717 14:14:33.150825 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7183545Z [cluster1] I0717 14:14:33.157251 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7186866Z [cluster1] I0717 14:14:33.559286 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:37.7191809Z [cluster1] I0717 14:14:33.562646 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7194890Z [cluster1] I0717 14:14:33.568752 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7196622Z [cluster1] I0717 14:14:33.568798 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7198060Z [cluster1] I0717 14:14:33.568809 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7200085Z [cluster1] I0717 14:14:33.570473 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-17T14:14:37.7201811Z [cluster1] I0717 14:14:33.570512 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-17T14:14:37.7203225Z [cluster1] I0717 14:14:33.570523 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-17T14:14:37.7205792Z [cluster1] I0717 14:14:33.575947 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7209295Z [cluster1] I0717 14:14:33.582642 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:37.7213151Z [cluster1] I0717 14:14:33.590707 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7216782Z [cluster1] I0717 14:14:33.611796 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:37.7220451Z [cluster1] I0717 14:14:33.992860 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:38.2700278Z [cluster1] I0717 14:14:34.004.2.0.0/16" "type"="Cluster"
2021-07-17T14:14:38.2701366Z [cluster2] I0717 14:14:36.367357 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-17T14:14:38.2704530Z [cluster2] I0717 14:14:36.372657 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:38.2708202Z [cluster2] I0717 14:14:36.377701 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:38.2711963Z [cluster2] I0717 14:14:36.381078 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:38.2715414Z [cluster2] I0717 14:14:36.390864 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-17T14:14:38.2718755Z [cluster2] I0717 14:14:36.792742 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:38.2721982Z [cluster2] I0717 14:14:36.792896 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:38.2725302Z [cluster2] I0717 14:14:36.799764 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:38.2728685Z [cluster2] I0717 14:14:36.800561 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:38.2730898Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-17T14:14:38.2731982Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-17T14:14:38.2733284Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-17T14:14:38.2734680Z [submariner-operator]$ [cluster2] grep submariner
2021-07-17T14:14:38.2735992Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-17T14:14:38.2737810Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-17T14:14:38.2738851Z [cluster2] submariner 70s
2021-07-17T14:14:38.2740095Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-17T14:14:38.2741699Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:38.2743413Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:38.2745382Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:38.2747033Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-17T14:14:38.2748045Z [cluster2] {
2021-07-17T14:14:38.2748722Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T14:14:38.2749398Z [cluster2] "kind": "Submariner",
2021-07-17T14:14:38.2749917Z [cluster2] "metadata": {
2021-07-17T14:14:38.2750757Z [cluster2] "creationTimestamp": "2021-07-17T14:13:27Z",
2021-07-17T14:14:38.2751395Z [cluster2] "generation": 1,
2021-07-17T14:14:38.2751955Z [cluster2] "name": "submariner",
2021-07-17T14:14:38.2752812Z [cluster2] "namespace": "submariner-operator",
2021-07-17T14:14:38.2753561Z [cluster2] "resourceVersion": "2196",
2021-07-17T14:14:38.2754838Z [cluster2] "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-17T14:14:38.2756113Z [cluster2] "uid": "4c75b2f6-80e4-4557-8363-003c9faf6649"
2021-07-17T14:14:38.2756825Z [cluster2] },
2021-07-17T14:14:38.2757249Z [cluster2] "spec": {
2021-07-17T14:14:38.2757728Z [cluster2] "broker": "k8s",
2021-07-17T14:14:38.2758345Z [cluster2] "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-17T14:14:38.3031219Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-17T14:14:38.3723291Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-17T14:14:38.4281923Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-17T14:14:38.4282927Z [cluster2] "cableDriver": "libreswan",
2021-07-17T14:14:38.4283601Z [cluster2] "ceIPSecDebug": false,
2021-07-17T14:14:38.4287051Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-17T14:14:38.4287876Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-17T14:14:38.4289775Z [cluster2] "ceIPSecPSK": "XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C",
2021-07-17T14:14:38.4294509Z [cluster2] "clusterCIDR": "",
2021-07-17T14:14:38.4295120Z [cluster2] "clusterID": "cluster2",
2021-07-17T14:14:38.4295723Z [cluster2] "colorCodes": "blue",
2021-07-17T14:14:38.4296701Z [cluster2] "connectionHealthCheck": {
2021-07-17T14:14:38.4297631Z [cluster2] "enabled": true,
2021-07-17T14:14:38.4298248Z [cluster2] "intervalSeconds": 1,
2021-07-17T14:14:38.4298921Z [cluster2] "maxPacketLossCount": 5
2021-07-17T14:14:38.4299490Z [cluster2] },
2021-07-17T14:14:38.4299951Z [cluster2] "debug": false,
2021-07-17T14:14:38.4301021Z [cluster2] "namespace": "submariner-operator",
2021-07-17T14:14:38.4301722Z [cluster2] "natEnabled": false,
2021-07-17T14:14:38.4302350Z [cluster2] "repository": "localhost:5000",
2021-07-17T14:14:38.4302946Z [cluster2] "serviceCIDR": "",
2021-07-17T14:14:38.4303887Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-17T14:14:38.4304609Z [cluster2] "version": "local"
2021-07-17T14:14:38.4305066Z [cluster2] },
2021-07-17T14:14:38.4305501Z [cluster2] "status": {
2021-07-17T14:14:38.4306020Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-17T14:14:38.4306623Z [cluster2] "clusterID": "cluster2",
2021-07-17T14:14:38.4307203Z [cluster2] "colorCodes": "blue",
2021-07-17T14:14:38.4308427Z [cluster2] "deploymentInfo": {},
2021-07-17T14:14:38.4309337Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-17T14:14:38.4310146Z [cluster2] "lastResourceVersion": "1972",
2021-07-17T14:14:38.4310998Z [cluster2] "mismatchedContainerImages": false,
2021-07-17T14:14:38.4311906Z [cluster2] "nonReadyContainerStates": [],
2021-07-17T14:14:38.4312734Z [cluster2] "status": {
2021-07-17T14:14:38.4313868Z [cluster2] "currentNumberScheduled": 1,
2021-07-17T14:14:38.4314879Z [cluster2] "desiredNumberScheduled": 1,
2021-07-17T14:14:38.4324147Z [cluster2] "numberAvailable": 1,
2021-07-17T14:14:38.4324866Z [cluster2] "numberMisscheduled": 0,
2021-07-17T14:14:38.4325511Z [cluster2] "numberReady": 1,
2021-07-17T14:14:38.4326182Z [cluster2] "observedGeneration": 1,
2021-07-17T14:14:38.4326960Z [cluster2] "updatedNumberScheduled": 1
2021-07-17T14:14:38.4327588Z [cluster2] }
2021-07-17T14:14:38.4328000Z [cluster2] },
2021-07-17T14:14:38.4328465Z [cluster2] "gateways": [
2021-07-17T14:14:38.4328924Z [cluster2] {
2021-07-17T14:14:38.4329405Z [cluster2] "connections": [
2021-07-17T14:14:38.4330528Z [cluster2] {
2021-07-17T14:14:38.4331018Z [cluster2] "endpoint": {
2021-07-17T14:14:38.4331621Z [cluster2] "backend": "libreswan",
2021-07-17T14:14:38.4332216Z [cluster2] "backend_config": {
2021-07-17T14:14:38.4333266Z [cluster2] "natt-discovery-port": "4490",
2021-07-17T14:14:38.4334208Z [cluster2] "preferred-server": "false"
2021-07-17T14:14:38.4334822Z [cluster2] },
2021-07-17T14:14:38.4335945Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-4",
2021-07-17T14:14:38.4337371Z [cluster2] "cluster_id": "cluster1",
2021-07-17T14:14:38.4338032Z [cluster2] "healthCheckIP": "10.1.0.1",
2021-07-17T14:14:38.4339829Z [cluster2] "hostname": "cluster1-worker",
2021-07-17T14:14:38.4340945Z [cluster2] "nat_enabled": false,
2021-07-17T14:14:38.4341681Z [cluster2] "private_ip": "172.18.0.4",
2021-07-17T14:14:38.4342264Z [cluster2] "public_ip": "20.85.247.59",
2021-07-17T14:14:38.4342806Z [cluster2] "subnets": [
2021-07-17T14:14:38.4343323Z [cluster2] "100.1.0.0/16",
2021-07-17T14:14:38.4343813Z [cluster2] "10.1.0.0/16"
2021-07-17T14:14:38.4344268Z [cluster2] ]
2021-07-17T14:14:38.4344898Z [cluster2] },
2021-07-17T14:14:38.4345905Z [cluster2] "latencyRTT": {
2021-07-17T14:14:38.4346922Z [cluster2] "average": "203.747µs",
2021-07-17T14:14:38.4348349Z [cluster2] "last": "187.813µs",
2021-07-17T14:14:38.4349297Z [cluster2] "max": "701.949µs",
2021-07-17T14:14:38.4349967Z [cluster2] "min": "132.81µs",
2021-07-17T14:14:38.4350672Z [cluster2] "stdDev": "107.322µs"
2021-07-17T14:14:38.4351190Z [cluster2] },
2021-07-17T14:14:38.4351713Z [cluster2] "status": "connected",
2021-07-17T14:14:38.4352335Z [cluster2] "statusMessage": "",
2021-07-17T14:14:38.4352920Z [cluster2] "usingIP": "172.18.0.4"
2021-07-17T14:14:38.4353410Z [cluster2] }
2021-07-17T14:14:38.4353833Z [cluster2] ],
2021-07-17T14:14:38.4354352Z [cluster2] "haStatus": "active",
2021-07-17T14:14:38.4354929Z [cluster2] "localEndpoint": {
2021-07-17T14:14:38.4355539Z [cluster2] "backend": "libreswan",
2021-07-17T14:14:38.4356114Z [cluster2] "backend_config": {
2021-07-17T14:14:38.4356961Z [cluster2] "natt-discovery-port": "4490",
2021-07-17T14:14:38.4357879Z [cluster2] "preferred-server": "false"
2021-07-17T14:14:38.4358783Z [cluster2] },
2021-07-17T14:14:38.4360111Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-5",
2021-07-17T14:14:38.4361084Z [cluster2] "cluster_id": "cluster2",
2021-07-17T14:14:38.4361723Z [cluster2] "healthCheckIP": "10.2.0.1",
2021-07-17T14:14:38.4362574Z [cluster2] "hostname": "cluster2-worker",
2021-07-17T14:14:38.4363238Z [cluster2] "nat_enabled": false,
2021-07-17T14:14:38.4363806Z [cluster2] "private_ip": "172.18.0.5",
2021-07-17T14:14:38.4364364Z [cluster2] "public_ip": "20.85.247.59",
2021-07-17T14:14:38.4364893Z [cluster2] "subnets": [
2021-07-17T14:14:38.4365370Z [cluster2] "100.2.0.0/16",
2021-07-17T14:14:38.4365836Z [cluster2] "10.2.0.0/16"
2021-07-17T14:14:38.4366278Z [cluster2] ]
2021-07-17T14:14:38.4366709Z [cluster2] },
2021-07-17T14:14:38.4367224Z [cluster2] "statusFailure": "",
2021-07-17T14:14:38.4368021Z [cluster2] "version": "devel-1441a80"
2021-07-17T14:14:38.4368533Z [cluster2] }
2021-07-17T14:14:38.4368950Z [cluster2] ],
2021-07-17T14:14:38.4369589Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-17T14:14:38.4370512Z [cluster2] "mismatchedContainerImages": false
2021-07-17T14:14:38.4371192Z [cluster2] },
2021-07-17T14:14:38.4371750Z [cluster2] "loadBalancerStatus": {},
2021-07-17T14:14:38.4372393Z [cluster2] "natEnabled": false,
2021-07-17T14:14:38.4373187Z [cluster2] "networkPlugin": "weave-net",
2021-07-17T14:14:38.4374003Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-17T14:14:38.4374824Z [cluster2] "lastResourceVersion": "2039",
2021-07-17T14:14:38.4375680Z [cluster2] "mismatchedContainerImages": false,
2021-07-17T14:14:38.4376584Z [cluster2] "nonReadyContainerStates": [],
2021-07-17T14:14:38.4377296Z [cluster2] "status": {
2021-07-17T14:14:38.4377958Z [cluster2] "currentNumberScheduled": 3,
2021-07-17T14:14:38.4378785Z [cluster2] "desiredNumberScheduled": 3,
2021-07-17T14:14:38.4379531Z [cluster2] "numberAvailable": 3,
2021-07-17T14:14:38.4380200Z [cluster2] "numberMisscheduled": 0,
2021-07-17T14:14:38.4380848Z [cluster2] "numberReady": 3,
2021-07-17T14:14:38.4381598Z [cluster2] "observedGeneration": 1,
2021-07-17T14:14:38.4808714Z [cluster2] "u370 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:38.4812137Z [cluster1] I0717 14:14:34.013130 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-17T14:14:38.4815498Z [cluster1] I0717 14:14:34.017929 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-17T14:14:38.4817580Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-17T14:14:38.4818576Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-17T14:14:38.4819877Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-17T14:14:38.4821417Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-17T14:14:38.4822690Z [submariner-operator]$ [cluster1] grep submariner
2021-07-17T14:14:38.4824136Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-17T14:14:38.4825357Z [cluster1] submariner 77s
2021-07-17T14:14:38.4826441Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-17T14:14:38.4828407Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:38.4829964Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-17T14:14:38.4831539Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:38.4833496Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:38.4834545Z [cluster1] {
2021-07-17T14:14:38.4835148Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-17T14:14:38.4835806Z [cluster1] "kind": "Submariner",
2021-07-17T14:14:38.4836436Z [cluster1] "metadata": {
2021-07-17T14:14:38.4837246Z [cluster1] "creationTimestamp": "2021-07-17T14:13:21Z",
2021-07-17T14:14:38.4837896Z [cluster1] "generation": 1,
2021-07-17T14:14:38.4838456Z [cluster1] "name": "submariner",
2021-07-17T14:14:38.4839312Z [cluster1] "namespace": "submariner-operator",
2021-07-17T14:14:38.4840066Z [cluster1] "resourceVersion": "2275",
2021-07-17T14:14:38.4841340Z [cluster1] "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-17T14:14:38.4842665Z [cluster1] "uid": "a42ab01f-a82e-4622-9493-d7810899f1db"
2021-07-17T14:14:38.4843272Z [cluster1] },
2021-07-17T14:14:38.4843706Z [cluster1] "spec": {
2021-07-17T14:14:38.4844173Z [cluster1] "broker": "k8s",
2021-07-17T14:14:38.4844802Z [cluster1] "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-17T14:14:38.5014308Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-17T14:14:38.5569004Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-17T14:14:38.6218435Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-17T14:14:38.6219456Z [cluster1] "cableDriver": "libreswan",
2021-07-17T14:14:38.6220108Z [cluster1] "ceIPSecDebug": false,
2021-07-17T14:14:38.6220746Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-17T14:14:38.6221374Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-17T14:14:38.6223000Z [cluster1] "ceIPSecPSK": "XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C",
2021-07-17T14:14:38.6224575Z [cluster1] "clusterCIDR": "",
2021-07-17T14:14:38.6225441Z [cluster1] "clusterID": "cluster1",
2021-07-17T14:14:38.6226037Z [cluster1] "colorCodes": "blue",
2021-07-17T14:14:38.6226711Z [cluster1] "connectionHealthCheck": {
2021-07-17T14:14:38.6227380Z [cluster1] "enabled": true,
2021-07-17T14:14:38.6228052Z [cluster1] "intervalSeconds": 1,
2021-07-17T14:14:38.6228736Z [cluster1] "maxPacketLossCount": 5
2021-07-17T14:14:38.6229285Z [cluster1] },
2021-07-17T14:14:38.6229757Z [cluster1] "debug": false,
2021-07-17T14:14:38.6230647Z [cluster1] "namespace": "submariner-operator",
2021-07-17T14:14:38.6231357Z [cluster1] "natEnabled": false,
2021-07-17T14:14:38.6231971Z [cluster1] "repository": "localhost:5000",
2021-07-17T14:14:38.6232839Z [cluster1] "serviceCIDR": "",
2021-07-17T14:14:38.6234148Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-17T14:14:38.6235106Z [cluster1] "version": "local"
2021-07-17T14:14:38.6235659Z [cluster1] },
2021-07-17T14:14:38.6236090Z [cluster1] "status": {
2021-07-17T14:14:38.6236610Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-17T14:14:38.6237190Z [cluster1] "clusterID": "cluster1",
2021-07-17T14:14:38.6237779Z [cluster1] "colorCodes": "blue",
2021-07-17T14:14:38.6238370Z [cluster1] "deploymentInfo": {},
2021-07-17T14:14:38.6239095Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-17T14:14:38.6239886Z [cluster1] "lastResourceVersion": "1962",
2021-07-17T14:14:38.6240736Z [cluster1] "mismatchedContainerImages": false,
2021-07-17T14:14:38.6241650Z [cluster1] "nonReadyContainerStates": [],
2021-07-17T14:14:38.6242306Z [cluster1] "status": {
2021-07-17T14:14:38.6242969Z [cluster1] "currentNumberScheduled": 1,
2021-07-17T14:14:38.6243789Z [cluster1] "desiredNumberScheduled": 1,
2021-07-17T14:14:38.6244532Z [cluster1] "numberAvailable": 1,
2021-07-17T14:14:38.6245207Z [cluster1] "numberMisscheduled": 0,
2021-07-17T14:14:38.6245849Z [cluster1] "numberReady": 1,
2021-07-17T14:14:38.6246485Z [cluster1] "observedGeneration": 1,
2021-07-17T14:14:38.6247267Z [cluster1] "updatedNumberScheduled": 1
2021-07-17T14:14:38.6247894Z [cluster1] }
2021-07-17T14:14:38.6248300Z [cluster1] },
2021-07-17T14:14:38.6248759Z [cluster1] "gateways": [
2021-07-17T14:14:38.6249205Z [cluster1] {
2021-07-17T14:14:38.6249845Z [cluster1] "connections": [
2021-07-17T14:14:38.6250340Z [cluster1] {
2021-07-17T14:14:38.6250835Z [cluster1] "endpoint": {
2021-07-17T14:14:38.6251409Z [cluster1] "backend": "libreswan",
2021-07-17T14:14:38.6252012Z [cluster1] "backend_config": {
2021-07-17T14:14:38.6253029Z [cluster1] "natt-discovery-port": "4490",
2021-07-17T14:14:38.6253997Z [cluster1] "preferred-server": "false"
2021-07-17T14:14:38.6254610Z [cluster1] },
2021-07-17T14:14:38.6255710Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-5",
2021-07-17T14:14:38.6256706Z [cluster1] "cluster_id": "cluster2",
2021-07-17T14:14:38.6257337Z [cluster1] "healthCheckIP": "10.2.0.1",
2021-07-17T14:14:38.6258227Z [cluster1] "hostname": "cluster2-worker",
2021-07-17T14:14:38.6258894Z [cluster1] "nat_enabled": false,
2021-07-17T14:14:38.6259490Z [cluster1] "private_ip": "172.18.0.5",
2021-07-17T14:14:38.6260059Z [cluster1] "public_ip": "20.85.247.59",
2021-07-17T14:14:38.6260589Z [cluster1] "subnets": [
2021-07-17T14:14:38.6261099Z [cluster1] "100.2.0.0/16",
2021-07-17T14:14:38.6261670Z [cluster1] "10.2.0.0/16"
2021-07-17T14:14:38.6262142Z [cluster1] ]
2021-07-17T14:14:38.6262575Z [cluster1] },
2021-07-17T14:14:38.6263084Z [cluster1] "latencyRTT": {
2021-07-17T14:14:38.6263845Z [cluster1] "average": "180.84µs",
2021-07-17T14:14:38.7695601Z [cluspdatedNumberScheduled": 3
2021-07-17T14:14:38.7696270Z [cluster2] }
2021-07-17T14:14:38.7696724Z [cluster2] },
2021-07-17T14:14:38.7697222Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-17T14:14:38.7697723Z [cluster2] }
2021-07-17T14:14:38.7698118Z [cluster2] }
2021-07-17T14:14:38.7699666Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-17T14:14:38.7701319Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-17T14:14:38.7703014Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-17T14:14:38.7704700Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T14:14:38.7706142Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T14:14:38.7707628Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-17T14:14:38.7709086Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-17T14:14:38.7710283Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-17T14:14:38.7711834Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-17T14:14:38.7713251Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-17T14:14:38.7714587Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-17T14:14:38.7716046Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-17T14:14:38.7717718Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-17T14:14:38.7719227Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-17T14:14:38.7720909Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-17T14:14:38.7952922Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T14:14:38.8151561Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T14:14:38.8153920Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-17T14:14:38.8291948Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVter1] "last": "159.511µs",
2021-07-17T14:14:38.8311178Z [cluster1] "max": "367.525µs",
2021-07-17T14:14:38.8311884Z [cluster1] "min": "114.408µs",
2021-07-17T14:14:38.8312594Z [cluster1] "stdDev": "56.905µs"
2021-07-17T14:14:38.8313098Z [cluster1] },
2021-07-17T14:14:38.8313647Z [cluster1] "status": "connected",
2021-07-17T14:14:38.8314270Z [cluster1] "statusMessage": "",
2021-07-17T14:14:38.8314853Z [cluster1] "usingIP": "172.18.0.5"
2021-07-17T14:14:38.8315341Z [cluster1] }
2021-07-17T14:14:38.8315762Z [cluster1] ],
2021-07-17T14:14:38.8316266Z [cluster1] "haStatus": "active",
2021-07-17T14:14:38.8316844Z [cluster1] "localEndpoint": {
2021-07-17T14:14:38.8317732Z [cluster1] "backend": "libreswan",
2021-07-17T14:14:38.8318325Z [cluster1] "backend_config": {
2021-07-17T14:14:38.8319186Z [cluster1] "natt-discovery-port": "4490",
2021-07-17T14:14:38.8320110Z [cluster1] "preferred-server": "false"
2021-07-17T14:14:38.8320687Z [cluster1] },
2021-07-17T14:14:38.8321782Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-4",
2021-07-17T14:14:38.8322762Z [cluster1] "cluster_id": "cluster1",
2021-07-17T14:14:38.8323397Z [cluster1] "healthCheckIP": "10.1.0.1",
2021-07-17T14:14:38.8324248Z [cluster1] "hostname": "cluster1-worker",
2021-07-17T14:14:38.8324906Z [cluster1] "nat_enabled": false,
2021-07-17T14:14:38.8325479Z [cluster1] "private_ip": "172.18.0.4",
2021-07-17T14:14:38.8326020Z [cluster1] "public_ip": "20.85.247.59",
2021-07-17T14:14:38.8326555Z [cluster1] "subnets": [
2021-07-17T14:14:38.8327038Z [cluster1] "100.1.0.0/16",
2021-07-17T14:14:38.8327507Z [cluster1] "10.1.0.0/16"
2021-07-17T14:14:38.8327942Z [cluster1] ]
2021-07-17T14:14:38.8328372Z [cluster1] },
2021-07-17T14:14:38.8328881Z [cluster1] "statusFailure": "",
2021-07-17T14:14:38.8329685Z [cluster1] "version": "devel-1441a80"
2021-07-17T14:14:38.8330203Z [cluster1] }
2021-07-17T14:14:38.8330622Z [cluster1] ],
2021-07-17T14:14:38.8331275Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-17T14:14:38.8332181Z [cluster1] "mismatchedContainerImages": false
2021-07-17T14:14:38.8332862Z [cluster1] },
2021-07-17T14:14:38.8333413Z [cluster1] "loadBalancerStatus": {},
2021-07-17T14:14:38.8334055Z [cluster1] "natEnabled": false,
2021-07-17T14:14:38.8335012Z [cluster1] "networkPlugin": "weave-net",
2021-07-17T14:14:38.8335830Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-17T14:14:38.8336655Z [cluster1] "lastResourceVersion": "2021",
2021-07-17T14:14:38.8337513Z [cluster1] "mismatchedContainerImages": false,
2021-07-17T14:14:38.8338408Z [cluster1] "nonReadyContainerStates": [],
2021-07-17T14:14:38.8339079Z [cluster1] "status": {
2021-07-17T14:14:38.8339874Z [cluster1] "currentNumberScheduled": 3,
2021-07-17T14:14:38.8340708Z [cluster1] "desiredNumberScheduled": 3,
2021-07-17T14:14:38.8341458Z [cluster1] "numberAvailable": 3,
2021-07-17T14:14:38.8342130Z [cluster1] "numberMisscheduled": 0,
2021-07-17T14:14:38.8342779Z [cluster1] "numberReady": 3,
2021-07-17T14:14:38.8343530Z [cluster1] "observedGeneration": 1,
2021-07-17T14:14:38.8344323Z [cluster1] "updatedNumberScheduled": 3
2021-07-17T14:14:38.8344948Z [cluster1] }
2021-07-17T14:14:38.8345372Z [cluster1] },
2021-07-17T14:14:38.8345863Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-17T14:14:38.8346358Z [cluster1] }
2021-07-17T14:14:38.8346762Z [cluster1] }
2021-07-17T14:14:38.8350828Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-17T14:14:38.8352618Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-17T14:14:38.8354310Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-17T14:14:38.8356007Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T14:14:38.8357429Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-17T14:14:38.8358919Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-17T14:14:38.8360582Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-17T14:14:38.8361769Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-17T14:14:38.8363102Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-17T14:14:38.8364580Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-17T14:14:38.8365931Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-17T14:14:38.8367390Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-17T14:14:38.8368955Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-17T14:14:38.8370477Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-17T14:14:38.8372154Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-17T14:14:38.9047693Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T14:14:38.9291528Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-17T14:14:38.9293931Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-17T14:14:38.9917870Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:39.1879010Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:39.3267211Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:39.3897814Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-17T14:14:39.3899780Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-17T14:14:39.3902551Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-17T14:14:39.3904684Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-17T14:14:39.3906660Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-17T14:14:39.3908178Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-17T14:14:39.3910654Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-17T14:14:39.3912293Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-17T14:14:39.3914148Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-17T14:14:39.3916303Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-17T14:14:39.3917910Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-17T14:14:39.3919735Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-17T14:14:39.3921364Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-17T14:14:39.3922945Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-17T14:14:39.7984840Z [submariner-operator]$ [cluster2] validate_equals .spec.reposVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:39.8542262Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8544187Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-17T14:14:39.8546533Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-17T14:14:39.8549271Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8550993Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-17T14:14:39.8552416Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-17T14:14:39.8553966Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8555505Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-17T14:14:39.8556915Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-17T14:14:39.8558503Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8560106Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-17T14:14:39.8561521Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-17T14:14:39.8563128Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8564701Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-17T14:14:39.8566388Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-17T14:14:39.8613746Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8615260Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-17T14:14:39.8616493Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-17T14:14:39.8618079Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8619495Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-17T14:14:39.8620690Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-17T14:14:39.8622129Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8623742Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8624812Z [cluster1] Generated cluster id: cluster1
2021-07-17T14:14:39.8625886Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-17T14:14:39.8627198Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-17T14:14:39.8628875Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8630291Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-17T14:14:39.8631758Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-17T14:14:39.8633174Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-17T14:14:39.8634733Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-17T14:14:39.8636272Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-17T14:14:39.8637911Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-17T14:14:40.1136797Z [submarineritory localhost:5000
2021-07-17T14:14:40.1138242Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1139696Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-17T14:14:40.1140973Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-17T14:14:40.1142458Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1143895Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-17T14:14:40.1145111Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-17T14:14:40.1146535Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1148276Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1149349Z [cluster2] Generated cluster id: cluster2
2021-07-17T14:14:40.1150474Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-17T14:14:40.1151782Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-17T14:14:40.1153289Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1154737Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-17T14:14:40.1155954Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-17T14:14:40.1157384Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1159011Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-17T14:14:40.1160849Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-17T14:14:40.1162638Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1164265Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-17T14:14:40.1165615Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-17T14:14:40.1167116Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1168553Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-17T14:14:40.1169749Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-17T14:14:40.1171055Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-17T14:14:40.1172243Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-17T14:14:40.1173356Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T14:14:40.1174357Z [submariner-operator]$ [cluster2] wait 8531
2021-07-17T14:14:40.1175394Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-17T14:14:40.1176452Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-17T14:14:40.1177525Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-17T14:14:40.1178597Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-17T14:14:40.1179870Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-17T14:14:40.1181021Z [cluster2] 
2021-07-17T14:14:40.1181581Z [cluster2] 
2021-07-17T14:14:40.1182976Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:40.1184649Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-17T14:14:40.1186074Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-17T14:14:40.1187617Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1189415Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-17T14:14:40.1191013Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-17T14:14:40.1192601Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-17T14:14:40.1193926Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:40.1194896Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:40.1195987Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-17T14:14:40.1197175Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-17T14:14:40.1198584Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-17T14:14:40.1200211Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-17T14:14:40.1201740Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-17T14:14:40.1203103Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-17T14:14:40.1204402Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-17T14:14:41.5027206Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_crea-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-17T14:14:41.5035252Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-17T14:14:41.5037263Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-17T14:14:41.5038693Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-17T14:14:41.5040153Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-17T14:14:41.5041502Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-17T14:14:41.5042736Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-17T14:14:41.5043820Z [submariner-operator]$ [cluster1] iteration=1
2021-07-17T14:14:41.5044818Z [submariner-operator]$ [cluster1] wait 8564
2021-07-17T14:14:41.5045933Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-17T14:14:41.5046985Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-17T14:14:41.5048075Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-17T14:14:41.5049112Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-17T14:14:41.5050371Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-17T14:14:41.5051338Z [cluster1] 
2021-07-17T14:14:41.5051881Z [cluster1] 
2021-07-17T14:14:41.5053218Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-17T14:14:41.5054852Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-17T14:14:41.5056222Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-17T14:14:41.5057746Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-17T14:14:41.5059417Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-17T14:14:41.5060774Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-17T14:14:41.5062293Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-17T14:14:41.5063624Z [submariner-operator]$ [cluster1] return 0
2021-07-17T14:14:41.5064565Z [submariner-operator]$ [cluster1] return 0
2021-07-17T14:14:41.5065671Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-17T14:14:41.5066831Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-17T14:14:41.5068441Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-17T14:14:41.5070107Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-17T14:14:41.5071552Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-17T14:14:41.5072872Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-17T14:14:41.5074112Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-17T14:14:41.5075308Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-17T14:14:41.5076393Z [submariner-operator]$ [cluster1] iteration=1
2021-07-17T14:14:41.5077457Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-17T14:14:41.5078572Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-17T14:14:41.5079553Z [submariner-operator]$ [cluster1] wait 8632
2021-07-17T14:14:41.5080296Z [cluster1] 
2021-07-17T14:14:41.5081046Z [submariner-operator]$ [cluster1] return 0
2021-07-17T14:14:41.5082166Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-17T14:14:41.5083375Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-17T14:14:41.5084483Z [submariner-operator]$ [cluster1] iteration=1
2021-07-17T14:14:41.5085451Z [submariner-operator]$ [cluster1] wait 8668
2021-07-17T14:14:41.5086458Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-17T14:14:41.5087564Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-17T14:14:41.5089391Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-17T14:14:41.5091652Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-17T14:14:41.5093952Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-17T14:14:41.5096245Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-17T14:14:41.5098159Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-17T14:14:41.5100175Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-17T14:14:41.5101646Z [submariner-operator]$ [cluster1] return 0
2021-07-17T14:14:42.5198796Z ed
2021-07-17T14:14:42.5199869Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T14:14:42.5200859Z [submariner-operator]$ [cluster2] wait 8604
2021-07-17T14:14:42.5201862Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-17T14:14:42.5202970Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-17T14:14:42.5203742Z [cluster2] 
2021-07-17T14:14:42.5204513Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:42.5205937Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-17T14:14:42.5207308Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-17T14:14:42.5208420Z [submariner-operator]$ [cluster2] iteration=1
2021-07-17T14:14:42.5209368Z [submariner-operator]$ [cluster2] wait 8649
2021-07-17T14:14:42.5210414Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-17T14:14:42.5211507Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-17T14:14:42.5213197Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-17T14:14:42.5215390Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-17T14:14:42.5217701Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-17T14:14:42.5219830Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-17T14:14:42.5221664Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-17T14:14:42.5223652Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-17T14:14:42.5225142Z [submariner-operator]$ [cluster2] return 0
2021-07-17T14:14:42.5226343Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-17T14:14:42.5227452Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-17T14:14:42.5229781Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-17T14:14:42.5231921Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-17T14:14:42.5234178Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-17T14:14:42.5235924Z [cluster2] pod/submariner-gateway-q2xkr condition met
2021-07-17T14:14:42.5237850Z [submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T14:14:42.5241250Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:42.5243701Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:42.5246403Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:42.5248650Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:42.5251021Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-q2xkr --namespace=submariner-operator -o json
2021-07-17T14:14:42.5253295Z [submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:42.5255282Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-q2xkr --namespace=submariner-operator -o json
2021-07-17T14:14:42.5257622Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-gateway-q2xkr --namespace=submariner-operator -o json
2021-07-17T14:14:42.5258814Z [cluster2] {
2021-07-17T14:14:42.5259419Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:42.5259946Z [cluster2] "kind": "Pod",
2021-07-17T14:14:42.5260422Z [cluster2] "metadata": {
2021-07-17T14:14:42.5261292Z [cluster2] "creationTimestamp": "2021-07-17T14:13:39Z",
2021-07-17T14:14:42.5262281Z [cluster2] "generateName": "submariner-gateway-",
2021-07-17T14:14:42.5262955Z [cluster2] "labels": {
2021-07-17T14:14:42.5263723Z [cluster2] "app": "submariner-gateway",
2021-07-17T14:14:42.5264744Z [cluster2] "controller-revision-hash": "696bcc8464",
2021-07-17T14:14:42.5265919Z [cluster2] "gateway.submariner.io/node": "cluster2-worker",
2021-07-17T14:14:42.5266851Z [cluster2] "gateway.submariner.io/status": "active",
2021-07-17T14:14:42.5308243Z [cluster2] "pod-template-generation": "1"
2021-07-17T14:14:42.5308994Z [cluster2] },
2021-07-17T14:14:42.5310090Z [cluster2] "name": "submariner-gateway-q2xkr",
2021-07-17T14:14:42.5311136Z [cluster2] "namespace": "submariner-operator",
2021-07-17T14:14:42.5311894Z [cluster2] "ownerReferences": [
2021-07-17T14:14:42.5312586Z [cluster2] {
2021-07-17T14:14:42.5313101Z [cluster2] "apiVersion": "apps/v1",
2021-07-17T14:14:42.5313798Z [cluster2] "blockOwnerDeletion": true,
2021-07-17T14:14:42.5314460Z [cluster2] "controller": true,
2021-07-17T14:14:42.5315046Z [cluster2] "kind": "DaemonSet",
2021-07-17T14:14:42.5315893Z [cluster2] "name": "submariner-gateway",
2021-07-17T14:14:42.5316918Z [cluster2] "uid": "0c40802f-b5f0-4ea0-afb8-9d035846de8b"
2021-07-17T14:14:42.5317555Z [cluster2] }
2021-07-17T14:14:42.5317978Z [cluster2] ],
2021-07-17T14:14:42.5318514Z [cluster2] "resourceVersion": "2001",
2021-07-17T14:14:42.5319763Z [cluster2] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-q2xkr",
2021-07-17T14:14:42.5321163Z [cluster2] "uid": "6b3aee70-ddf4-4ec9-be58-0b9158a66b12"
2021-07-17T14:14:42.5321854Z [cluster2] },
2021-07-17T14:14:42.5322311Z [cluster2] "spec": {
2021-07-17T14:14:42.5322795Z [cluster2] "affinity": {
2021-07-17T14:14:42.5323334Z [cluster2] "nodeAffinity": {
2021-07-17T14:14:42.5324536Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-17T14:14:42.5325837Z [cluster2] "nodeSelectorTerms": [
2021-07-17T14:14:42.5326605Z [cluster2] {
2021-07-17T14:14:42.5327126Z [cluster2] "matchFields": [
2021-07-17T14:14:42.5327662Z [cluster2] {
2021-07-17T14:14:42.5328220Z [cluster2] "key": "metadata.name",
2021-07-17T14:14:42.5328847Z [cluster2] "operator": "In",
2021-07-17T14:14:42.5329391Z [cluster2] "values": [
2021-07-17T14:14:42.5330249Z [cluster2] "cluster2-worker"
2021-07-17T14:14:42.5330820Z [cluster2] ]
2021-07-17T14:14:42.5331288Z [cluster2] }
2021-07-17T14:14:42.5331746Z [cluster2] ]
2021-07-17T14:14:42.5332181Z [cluster2] }
2021-07-17T14:14:42.5332622Z [cluster2] ]
2021-07-17T14:14:42.5333039Z [cluster2] }
2021-07-17T14:14:42.5333475Z [cluster2] },
2021-07-17T14:14:42.5334022Z [cluster2] "podAntiAffinity": {
2021-07-17T14:14:42.5335263Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-17T14:14:42.5336391Z [cluster2] {
2021-07-17T14:14:42.5336926Z [cluster2] "labelSelector": {
2021-07-17T14:14:42.5337520Z [cluster2] "matchLabels": {
2021-07-17T14:14:42.5338390Z [cluster2] "app": "submariner-gateway"
2021-07-17T14:14:42.5339096Z [cluster2] }
2021-07-17T14:14:42.5339558Z [cluster2] },
2021-07-17T14:14:42.5340211Z [cluster2] "topologyKey": "kubernetes.io/hostname"
2021-07-17T14:14:42.5340834Z [cluster2] }
2021-07-17T14:14:42.5341273Z [cluster2] ]
2021-07-17T14:14:42.5341687Z [cluster2] }
2021-07-17T14:14:42.5342112Z [cluster2] },
2021-07-17T14:14:42.5342578Z [cluster2] "containers": [
2021-07-17T14:14:42.5343057Z [cluster2] {
2021-07-17T14:14:42.5343503Z [cluster2] "command": [
2021-07-17T14:14:42.5344055Z [cluster2] "submariner.sh"
2021-07-17T14:14:42.5344577Z [cluster2] ],
2021-07-17T14:14:42.5345031Z [cluster2] "env": [
2021-07-17T14:14:42.5345482Z [cluster2] {
2021-07-17T14:14:42.5346043Z [cluster2] "name": "SUBMARINER_NAMESPACE",
2021-07-17T14:14:42.5347001Z [cluster2] "value": "submariner-operator"
2021-07-17T14:14:42.5347602Z [cluster2] },
2021-07-17T14:14:42.5348205Z [cluster2] {
2021-07-17T14:14:42.5348782Z [cluster2] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-17T14:14:42.5349410Z [cluster2] "value": "10.2.0.0/16"
2021-07-17T14:14:42.5349876Z [cluster2] },
2021-07-17T14:14:42.5350320Z [cluster2] {
2021-07-17T14:14:42.5350896Z [cluster2] "name": "SUBMARINER_SERVICECIDR",
2021-07-17T14:14:42.5351551Z [cluster2] "value": "100.2.0.0/16"
2021-07-17T14:14:42.5352051Z [cluster2] },
2021-07-17T14:14:42.5352480Z [cluster2] {
2021-07-17T14:14:42.5353051Z [cluster2] "name": "SUBMARINER_GLOBALCIDR"
2021-07-17T14:14:42.5353629Z [cluster2] },
2021-07-17T14:14:42.5354069Z [cluster2] {
2021-07-17T14:14:42.5354626Z [cluster2] "name": "SUBMARINER_CLUSTERID",
2021-07-17T14:14:42.5355259Z [cluster2] "value": "cluster2"
2021-07-17T14:14:42.5355751Z [cluster2] },
2021-07-17T14:14:42.5356185Z [cluster2] {
2021-07-17T14:14:42.5356768Z [cluster2] "name": "SUBMARINER_COLORCODES",
2021-07-17T14:14:42.5357486Z [cluster2] "value": "blue"
2021-07-17T14:14:42.5358067Z [cluster2] },
2021-07-17T14:14:42.5358496Z [cluster2] {
2021-07-17T14:14:42.5359065Z [cluster2] "name": "SUBMARINER_DEBUG",
2021-07-17T14:14:42.5359644Z [cluster2] "value": "false"
2021-07-17T14:14:42.5360143Z [cluster2] },
2021-07-17T14:14:42.5360568Z [cluster2] {
2021-07-17T14:14:42.5361144Z [cluster2] "name": "SUBMARINER_NATENABLED",
2021-07-17T14:14:42.5361781Z [cluster2] "value": "false"
2021-07-17T14:14:42.5362271Z [cluster2] },
2021-07-17T14:14:42.5362712Z [cluster2] {
2021-07-17T14:14:42.5363244Z [cluster2] "name": "SUBMARINER_BROKER",
2021-07-17T14:14:42.5364007Z [cluster2] "value": "k8s"
2021-07-17T14:14:42.5364485Z [cluster2] },
2021-07-17T14:14:42.5364911Z [cluster2] {
2021-07-17T14:14:42.5365504Z [cluster2] "name": "SUBMARINER_CABLEDRIVER",
2021-07-17T14:14:42.5366154Z [cluster2] "value": "libreswan"
2021-07-17T14:14:42.5366672Z [cluster2] },
2021-07-17T14:14:42.5367098Z [cluster2] {
2021-07-17T14:14:42.5367775Z [cluster2] "name": "BROKER_K8S_APISERVER",
2021-07-17T14:14:42.5368381Z [cluster2] "value": "172.18.0.9:6443"
2021-07-17T14:14:42.5368924Z [cluster2] },
2021-07-17T14:14:42.5369366Z [cluster2] {
2021-07-17T14:14:42.5369947Z [cluster2] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-17T14:14:42.5586251Z [cluster2] "value": "***"
2021-07-17T14:14:42.5586875Z [cluster2] },
2021-07-17T14:14:42.5587332Z [cluster2] {
2021-07-17T14:14:42.5588061Z [cluster2] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-17T14:14:42.5589358Z [cluster2] "value": "submariner-k8s-broker"
2021-07-17T14:14:42.5590006Z [cluster2] },
2021-07-17T14:14:42.5590432Z [cluster2] {
2021-07-17T14:14:42.5590951Z [cluster2] "name": "BROKER_K8S_CA",
2021-07-17T14:14:42.6265239Z [cluster2] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-17T14:14:42.6794936Z [cluster2] },
2021-07-17T14:14:42.6795457Z [cluster2] {
2021-07-17T14:14:42.6796009Z [cluster2] "name": "CE_IPSEC_PSK",
2021-07-17T14:14:42.6797916Z [cluster2] "value": "XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C"
2021-07-17T14:14:42.6799421Z [cluster2] },
2021-07-17T14:14:42.6799873Z [cluster2] {
2021-07-17T14:14:42.6800404Z [cluster2] "name": "CE_IPSEC_DEBUG",
2021-07-17T14:14:42.6800988Z [cluster2] "value": "false"
2021-07-17T14:14:42.6801485Z [cluster2] },
2021-07-17T14:14:42.6801910Z [cluster2] {
2021-07-17T14:14:42.6802598Z [cluster2] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-17T14:14:42.6803304Z [cluster2] "value": "true"
2021-07-17T14:14:42.6803813Z [cluster2] },
2021-07-17T14:14:42.6804289Z [cluster2] {
2021-07-17T14:14:42.6804941Z [cluster2] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-17T14:14:42.6805635Z [cluster2] "value": "1"
2021-07-17T14:14:42.6806090Z [cluster2] },
2021-07-17T14:14:42.6806530Z [cluster2] {
2021-07-17T14:14:42.6807371Z [cluster2] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-17T14:14:42.6808239Z [cluster2] "value": "5"
2021-07-17T14:14:42.6808696Z [cluster2] },
2021-07-17T14:14:42.6809130Z [cluster2] {
2021-07-17T14:14:42.6809648Z [cluster2] "name": "NODE_NAME",
2021-07-17T14:14:42.6810351Z [cluster2] "valueFrom": {
2021-07-17T14:14:42.6810902Z [cluster2] "fieldRef": {
2021-07-17T14:14:42.6811475Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:42.6812168Z [cluster2] "fieldPath": "spec.nodeName"
2021-07-17T14:14:42.6812787Z [cluster2] }
2021-07-17T14:14:42.6813237Z [cluster2] }
2021-07-17T14:14:42.6813668Z [cluster2] },
2021-07-17T14:14:42.6814125Z [cluster2] {
2021-07-17T14:14:42.6814610Z [cluster2] "name": "POD_NAME",
2021-07-17T14:14:42.6815162Z [cluster2] "valueFrom": {
2021-07-17T14:14:42.6815710Z [cluster2] "fieldRef": {
2021-07-17T14:14:42.6816272Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:42.6816958Z [cluster2] "fieldPath": "metadata.name"
2021-07-17T14:14:42.6817556Z [cluster2] }
2021-07-17T14:14:42.6818005Z [cluster2] }
2021-07-17T14:14:42.6818433Z [cluster2] },
2021-07-17T14:14:42.6818868Z [cluster2] {
2021-07-17T14:14:42.6819392Z [cluster2] "name": "CE_IPSEC_IKEPORT",
2021-07-17T14:14:42.6819954Z [cluster2] "value": "500"
2021-07-17T14:14:42.6820410Z [cluster2] },
2021-07-17T14:14:42.6820854Z [cluster2] {
2021-07-17T14:14:42.6821399Z [cluster2] "name": "CE_IPSEC_NATTPORT",
2021-07-17T14:14:42.6821953Z [cluster2] "value": "4500"
2021-07-17T14:14:42.6822420Z [cluster2] },
2021-07-17T14:14:42.6830968Z [cluster2] {
2021-07-17T14:14:42.6831817Z [cluster2] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-17T14:14:42.6832467Z [cluster2] "value": "false"
2021-07-17T14:14:42.6832990Z [cluster2] },
2021-07-17T14:14:42.6833437Z [cluster2] {
2021-07-17T14:14:42.6834002Z [cluster2] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-17T14:14:42.6834629Z [cluster2] "value": "false"
2021-07-17T14:14:42.6842959Z [cluster2] }
2021-07-17T14:14:42.6843471Z [cluster2] ],
2021-07-17T14:14:42.6844921Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-17T14:14:42.6845789Z [cluster2] "imagePullPolicy": "Always",
2021-07-17T14:14:42.6846710Z [cluster2] "name": "submariner-gateway",
2021-07-17T14:14:42.6847326Z [cluster2] "ports": [
2021-07-17T14:14:42.6847805Z [cluster2] {
2021-07-17T14:14:42.6848354Z [cluster2] "containerPort": 4500,
2021-07-17T14:14:42.6848979Z [cluster2] "hostPort": 4500,
2021-07-17T14:14:42.6849752Z [cluster2] "name": "cable-encaps",
2021-07-17T14:14:42.6850369Z [cluster2] "protocol": "UDP"
2021-07-17T14:14:42.6850880Z [cluster2] },
2021-07-17T14:14:42.6851304Z [cluster2] {
2021-07-17T14:14:42.6851846Z [cluster2] "containerPort": 4490,
2021-07-17T14:14:42.6852449Z [cluster2] "hostPort": 4490,
2021-07-17T14:14:42.6853261Z [cluster2] "name": "natt-discovery",
2021-07-17T14:14:42.6853868Z [cluster2] "protocol": "UDP"
2021-07-17T14:14:42.6862489Z [cluster2] }
2021-07-17T14:14:42.6862935Z [cluster2] ],
2021-07-17T14:14:42.6863457Z [cluster2] "resources": {},
2021-07-17T14:14:42.6864058Z [cluster2] "securityContext": {
2021-07-17T14:14:42.6864864Z [cluster2] "allowPrivilegeEscalation": true,
2021-07-17T14:14:42.6867090Z [cluster2] "capabilities": {
2021-07-17T14:14:42.6867652Z [cluster2] "add": [
2021-07-17T14:14:42.6868259Z [cluster2] "net_admin"
2021-07-17T14:14:42.6868759Z [cluster2] ],
2021-07-17T14:14:42.6869252Z [cluster2] "drop": [
2021-07-17T14:14:42.6869763Z [cluster2] "all"
2021-07-17T14:14:42.6870227Z [cluster2] ]
2021-07-17T14:14:42.6870665Z [cluster2] },
2021-07-17T14:14:42.6871212Z [cluster2] "privileged": true,
2021-07-17T14:14:42.6871963Z [cluster2] "readOnlyRootFilesystem": false,
2021-07-17T14:14:42.6872743Z [cluster2] "runAsNonRoot": false
2021-07-17T14:14:42.6873308Z [cluster2] },
2021-07-17T14:14:42.6874515Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-17T14:14:42.6875529Z [cluster2] "terminationMessagePolicy": "File",
2021-07-17T14:14:42.6876311Z [cluster2] "volumeMounts": [
2021-07-17T14:14:42.6876843Z [cluster2] {
2021-07-17T14:14:42.6877402Z [cluster2] "mountPath": "/etc/ipsec.d",
2021-07-17T14:14:42.6878014Z [cluster2] "name": "ipsecd"
2021-07-17T14:14:42.6878519Z [cluster2] },
2021-07-17T14:14:42.6878982Z [cluster2] {
2021-07-17T14:14:42.6879551Z [cluster2] "mountPath": "/var/lib/ipsec/nss",
2021-07-17T14:14:42.6880165Z [cluster2] "name": "ipsecnss"
2021-07-17T14:14:42.6880673Z [cluster2] },
2021-07-17T14:14:42.6881117Z [cluster2] {
2021-07-17T14:14:42.6881899Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-17T14:14:42.6883204Z [cluster2] "name": "submariner-gateway-token-dlccq",
2021-07-17T14:14:42.6884058Z [cluster2] "readOnly": true
2021-07-17T14:14:42.6884547Z [cluster2] }
2021-07-17T14:14:42.6884984Z [cluster2] ]
2021-07-17T14:14:42.6885412Z [cluster2] }
2021-07-17T14:14:42.6885835Z [cluster2] ],
2021-07-17T14:14:42.6886407Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-17T14:14:42.6887129Z [cluster2] "enableServiceLinks": true,
2021-07-17T14:14:42.6887804Z [cluster2] "hostNetwork": true,
2021-07-17T14:14:42.6888758Z [cluster2] "nodeName": "cluster2-worker",
2021-07-17T14:14:42.6889417Z [cluster2] "nodeSelector": {
2021-07-17T14:14:42.6890046Z [cluster2] "submariner.io/gateway": "true"
2021-07-17T14:14:42.6890604Z [cluster2] },
2021-07-17T14:14:42.6891080Z [cluster2] "priority": 0,
2021-07-17T14:14:42.6891662Z [cluster2] "restartPolicy": "Always",
2021-07-17T14:14:42.6892639Z [cluster2] "schedulerName": "default-scheduler",
2021-07-17T14:14:42.6893396Z [cluster2] "securityContext": {},
2021-07-17T14:14:42.6894354Z [cluster2] "serviceAccount": "submariner-gateway",
2021-07-17T14:14:42.6895446Z [cluster2] "serviceAccountName": "submariner-gateway",
2021-07-17T14:14:42.6896496Z [cluster2] "terminationGracePeriodSeconds": 1,
2021-07-17T14:14:42.6897283Z [cluster2] "tolerations": [
2021-07-17T14:14:42.6897770Z [cluster2] {
2021-07-17T14:14:42.6898264Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6898768Z [cluster2] },
2021-07-17T14:14:42.6899177Z [cluster2] {
2021-07-17T14:14:42.6899694Z [cluster2] "effect": "NoExecute",
2021-07-17T14:14:42.6900590Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-17T14:14:42.6901283Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6901782Z [cluster2] },
2021-07-17T14:14:42.6902193Z [cluster2] {
2021-07-17T14:14:42.6902809Z [cluster2] "effect": "NoExecute",
2021-07-17T14:14:42.6903534Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-17T14:14:42.6904255Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6904765Z [cluster2] },
2021-07-17T14:14:42.6905206Z [cluster2] {
2021-07-17T14:14:42.6905720Z [cluster2] "effect": "NoSchedule",
2021-07-17T14:14:42.6906684Z [cluster2] "key": "node.kubernetes.io/disk-pressure",
2021-07-17T14:14:42.6907438Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6908096Z [cluster2] },
2021-07-17T14:14:42.6908522Z [cluster2] {
2021-07-17T14:14:42.6909035Z [cluster2] "effect": "NoSchedule",
2021-07-17T14:14:42.6910023Z [cluster2] "key": "node.kubernetes.io/memory-pressure",
2021-07-17T14:14:42.6910778Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6911280Z [cluster2] },
2021-07-17T14:14:42.6911697Z [cluster2] {
2021-07-17T14:14:42.6912224Z [cluster2] "effect": "NoSchedule",
2021-07-17T14:14:42.6913173Z [cluster2] "key": "node.kubernetes.io/pid-pressure",
2021-07-17T14:14:42.6913948Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6914469Z [cluster2] },
2021-07-17T14:14:42.6914896Z [cluster2] {
2021-07-17T14:14:42.6915439Z [cluster2] "effect": "NoSchedule",
2021-07-17T14:14:42.6916211Z [cluster2] "key": "node.kubernetes.io/unschedulable",
2021-07-17T14:14:42.6916988Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6917473Z [cluster2] },
2021-07-17T14:14:42.6917896Z [cluster2] {
2021-07-17T14:14:42.6918424Z [cluster2] "effect": "NoSchedule",
2021-07-17T14:14:42.6919481Z [cluster2] "key": "node.kubernetes.io/network-unavailable",
2021-07-17T14:14:42.6920276Z [cluster2] "operator": "Exists"
2021-07-17T14:14:42.6920781Z [cluster2] }
2021-07-17T14:14:42.6921219Z [cluster2] ],
2021-07-17T14:14:42.6921695Z [cluster2] "volumes": [
2021-07-17T14:14:42.6922166Z [cluster2] {
2021-07-17T14:14:42.6922635Z [cluster2] "emptyDir": {},
2021-07-17T14:14:42.6923172Z [cluster2] "name": "ipsecd"
2021-07-17T14:14:42.6923651Z [cluster2] },
2021-07-17T14:14:42.6924444Z [cluster2] {
2021-07-17T14:14:42.6925038Z [cluster2] "emptyDir": {},
2021-07-17T14:14:42.6925652Z [cluster2] "name": "ipsecnss"
2021-07-17T14:14:42.6926151Z [cluster2] },
2021-07-17T14:14:42.6926575Z [cluster2] {
2021-07-17T14:14:42.6927585Z [cluster2] "name": "submariner-gateway-token-dlccq",
2021-07-17T14:14:42.6928387Z [cluster2] "secret": {
2021-07-17T14:14:42.6928936Z [cluster2] "defaultMode": 420,
2021-07-17T14:14:42.6930023Z [cluster2] "secretName": "submariner-gateway-token-dlccq"
2021-07-17T14:14:42.6930878Z [cluster2] }
2021-07-17T14:14:42.6931290Z [cluster2] }
2021-07-17T14:14:42.6931729Z [cluster2] ]
2021-07-17T14:14:42.6932136Z [cluster2] },
2021-07-17T14:14:42.6932594Z [cluster2] "status": {
2021-07-17T14:14:42.6933101Z [cluster2] "conditions": [
2021-07-17T14:14:42.6933578Z [cluster2] {
2021-07-17T14:14:42.6934104Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:42.6935038Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:40Z",
2021-07-17T14:14:42.6935701Z [cluster2] "status": "True",
2021-07-17T14:14:42.6936279Z [cluster2] "type": "Initialized"
2021-07-17T14:14:42.6936810Z [cluster2] },
2021-07-17T14:14:42.6937237Z [cluster2] {
2021-07-17T14:14:42.6937792Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:42.6938717Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:59Z",
2021-07-17T14:14:42.6939500Z [cluster2] "status": "True",
2021-07-17T14:14:42.6940017Z [cluster2] "type": "Ready"
2021-07-17T14:14:42.6940493Z [cluster2] },
2021-07-17T14:14:42.6940918Z [cluster2] {
2021-07-17T14:14:42.6941455Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:42.6942397Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:59Z",
2021-07-17T14:14:42.6943056Z [cluster2] "status": "True",
2021-07-17T14:14:42.7398458Z [cluster2] "ty6m[submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-17T14:14:42.7400143Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-17T14:14:42.7401897Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-17T14:14:42.7404106Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-17T14:14:42.7406471Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-17T14:14:42.7408320Z [cluster1] pod/submariner-gateway-5775j condition met
2021-07-17T14:14:42.7410089Z [submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T14:14:42.7412353Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:42.7414712Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:42.7417138Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:42.7419397Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:42.7421407Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-5775j --namespace=submariner-operator -o json
2021-07-17T14:14:42.7423692Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-5775j --namespace=submariner-operator -o json
2021-07-17T14:14:42.7425962Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-gateway-5775j --namespace=submariner-operator -o json
2021-07-17T14:14:42.7428493Z [submariner-operator]$ [cluster1] tee /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:42.7429625Z [cluster1] {
2021-07-17T14:14:42.7430131Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:42.7430720Z [cluster1] "kind": "Pod",
2021-07-17T14:14:42.7431294Z [cluster1] "metadata": {
2021-07-17T14:14:42.7432156Z [cluster1] "creationTimestamp": "2021-07-17T14:13:21Z",
2021-07-17T14:14:42.7433229Z [cluster1] "generateName": "submariner-gateway-",
2021-07-17T14:14:42.7433961Z [cluster1] "labels": {
2021-07-17T14:14:42.7434825Z [cluster1] "app": "submariner-gateway",
2021-07-17T14:14:42.7435860Z [cluster1] "controller-revision-hash": "7cb69665d5",
2021-07-17T14:14:42.7437081Z [cluster1] "gateway.submariner.io/node": "cluster1-worker",
2021-07-17T14:14:42.7438044Z [cluster1] "gateway.submariner.io/status": "active",
2021-07-17T14:14:42.7439159Z [cluster1] "pod-template-generation": "1"
2021-07-17T14:14:42.7439868Z [cluster1] },
2021-07-17T14:14:42.7440713Z [cluster1] "name": "submariner-gateway-5775j",
2021-07-17T14:14:42.7441804Z [cluster1] "namespace": "submariner-operator",
2021-07-17T14:14:42.7442712Z [cluster1] "ownerReferences": [
2021-07-17T14:14:42.7443329Z [cluster1] {
2021-07-17T14:14:42.7443887Z [cluster1] "apiVersion": "apps/v1",
2021-07-17T14:14:42.7444637Z [cluster1] "blockOwnerDeletion": true,
2021-07-17T14:14:42.7445325Z [cluster1] "controller": true,
2021-07-17T14:14:42.7445968Z [cluster1] "kind": "DaemonSet",
2021-07-17T14:14:42.7446866Z [cluster1] "name": "submariner-gateway",
2021-07-17T14:14:42.7447909Z [cluster1] "uid": "372f90be-64a5-4985-9356-d3e7764d5813"
2021-07-17T14:14:42.7448568Z [cluster1] }
2021-07-17T14:14:42.7461049Z [cluster1] ],
2021-07-17T14:14:42.7461608Z [cluster1] "resourceVersion": "2051",
2021-07-17T14:14:42.7463116Z [cluster1] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-5775j",
2021-07-17T14:14:42.7464452Z [cluster1] "uid": "df738e70-53b5-4b04-9ae4-bdb5939601d1"
2021-07-17T14:14:42.7465101Z [cluster1] },
2021-07-17T14:14:42.7465527Z [cluster1] "spec": {
2021-07-17T14:14:42.7466009Z [cluster1] "affinity": {
2021-07-17T14:14:42.7466566Z [cluster1] "nodeAffinity": {
2021-07-17T14:14:42.7474347Z [cluster1] "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-17T14:14:42.7475869Z [cluster1] "nodeSelectorTerms": [
2021-07-17T14:14:42.7476485Z [cluster1] {
2021-07-17T14:14:42.7477052Z [cluster1] "matchFields": [
2021-07-17T14:14:42.7477599Z [cluster1] {
2021-07-17T14:14:42.7478170Z [cluster1] "key": "metadata.name",
2021-07-17T14:14:42.7478788Z [cluster1] "operator": "In",
2021-07-17T14:14:42.7479362Z [cluster1] "values": [
2021-07-17T14:14:42.7480478Z [cluster1] "cluster1-worker"
2021-07-17T14:14:42.7481077Z [cluster1] ]
2021-07-17T14:14:42.7481531Z [cluster1] }
2021-07-17T14:14:42.7481989Z [cluster1] ]
2021-07-17T14:14:42.7482456Z [cluster1] }
2021-07-17T14:14:42.7482883Z [cluster1] ]
2021-07-17T14:14:42.7483319Z [cluster1] }
2021-07-17T14:14:42.7483753Z [cluster1] },
2021-07-17T14:14:42.7484511Z [cluster1] "podAntiAffinity": {
2021-07-17T14:14:42.7485751Z [cluster1] "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-17T14:14:42.7486922Z [cluster1] {
2021-07-17T14:14:42.7487482Z [cluster1] "labelSelector": {
2021-07-17T14:14:42.7488114Z [cluster1] "matchLabels": {
2021-07-17T14:14:42.7489014Z [cluster1] "app": "submariner-gateway"
2021-07-17T14:14:42.7489633Z [cluster1] }
2021-07-17T14:14:42.7490093Z [cluster1] },
2021-07-17T14:14:42.7490730Z [cluster1] "topologyKey": "kubernetes.io/hostname"
2021-07-17T14:14:42.7491388Z [cluster1] }
2021-07-17T14:14:42.7491809Z [cluster1] ]
2021-07-17T14:14:42.7492238Z [cluster1] }
2021-07-17T14:14:42.7492647Z [cluster1] },
2021-07-17T14:14:42.7493141Z [cluster1] "containers": [
2021-07-17T14:14:42.7493613Z [cluster1] {
2021-07-17T14:14:42.7494077Z [cluster1] "command": [
2021-07-17T14:14:42.7494611Z [cluster1] "submariner.sh"
2021-07-17T14:14:42.7495127Z [cluster1] ],
2021-07-17T14:14:42.7495562Z [cluster1] "env": [
2021-07-17T14:14:42.7496015Z [cluster1] {
2021-07-17T14:14:42.7496577Z [cluster1] "name": "SUBMARINER_NAMESPACE",
2021-07-17T14:14:42.7497518Z [cluster1] "value": "submariner-operator"
2021-07-17T14:14:42.7498260Z [cluster1] },
2021-07-17T14:14:42.7498705Z [cluster1] {
2021-07-17T14:14:42.7499309Z [cluster1] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-17T14:14:42.7499937Z [cluster1] "value": "10.1.0.0/16"
2021-07-17T14:14:42.7500416Z [cluster1] },
2021-07-17T14:14:42.7500861Z [cluster1] {
2021-07-17T14:14:42.7501450Z [cluster1] "name": "SUBMARINER_SERVICECIDR",
2021-07-17T14:14:42.7502063Z [cluster1] "value": "100.1.0.0/16"
2021-07-17T14:14:42.7502556Z [cluster1] },
2021-07-17T14:14:42.7502999Z [cluster1] {
2021-07-17T14:14:42.7503573Z [cluster1] "name": "SUBMARINER_GLOBALCIDR"
2021-07-17T14:14:42.7504144Z [cluster1] },
2021-07-17T14:14:42.7504563Z [cluster1] {
2021-07-17T14:14:42.7505153Z [cluster1] "name": "SUBMARINER_CLUSTERID",
2021-07-17T14:14:42.7505795Z [cluster1] "value": "cluster1"
2021-07-17T14:14:42.7506303Z [cluster1] },
2021-07-17T14:14:42.7523402Z [cluster1] {
2021-07-17T14:14:42.7524062Z [cluster1] "name": "SUBMARINER_COLORCODES",
2021-07-17T14:14:42.7524702Z [cluster1] "value": "blue"
2021-07-17T14:14:42.7525223Z [cluster1] },
2021-07-17T14:14:42.7525648Z [cluster1] {
2021-07-17T14:14:42.7526197Z [cluster1] "name": "SUBMARINER_DEBUG",
2021-07-17T14:14:42.7526791Z [cluster1] "value": "false"
2021-07-17T14:14:42.7527269Z [cluster1] },
2021-07-17T14:14:42.7527707Z [cluster1] {
2021-07-17T14:14:42.7528286Z [cluster1] "name": "SUBMARINER_NATENABLED",
2021-07-17T14:14:42.7528947Z [cluster1] "value": "false"
2021-07-17T14:14:42.7529432Z [cluster1] },
2021-07-17T14:14:42.7529890Z [cluster1] {
2021-07-17T14:14:42.7530446Z [cluster1] "name": "SUBMARINER_BROKER",
2021-07-17T14:14:42.7531053Z [cluster1] "value": "k8s"
2021-07-17T14:14:42.7531530Z [cluster1] },
2021-07-17T14:14:42.7531971Z [cluster1] {
2021-07-17T14:14:42.7532739Z [cluster1] "name": "SUBMARINER_CABLEDRIVER",
2021-07-17T14:14:42.7533432Z [cluster1] "value": "libreswan"
2021-07-17T14:14:42.7533948Z [cluster1] },
2021-07-17T14:14:42.7534392Z [cluster1] {
2021-07-17T14:14:42.7534948Z [cluster1] "name": "BROKER_K8S_APISERVER",
2021-07-17T14:14:42.7535570Z [cluster1] "value": "172.18.0.9:6443"
2021-07-17T14:14:42.7536049Z [cluster1] },
2021-07-17T14:14:42.7536513Z [cluster1] {
2021-07-17T14:14:42.7537110Z [cluster1] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-17T14:14:42.7700622Z [cluster1] "value": "***"
2021-07-17T14:14:42.7701176Z [cluster1] },
2021-07-17T14:14:42.7701625Z [cluster1] {
2021-07-17T14:14:42.7702254Z [cluster1] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-17T14:14:42.7703547Z [cluster1] "value": "submariner-k8s-broker"
2021-07-17T14:14:42.7704177Z [cluster1] },
2021-07-17T14:14:42.7704655Z [cluster1] {
2021-07-17T14:14:42.7705190Z [cluster1] "name": "BROKER_K8S_CA",
2021-07-17T14:14:42.8301489Z [cluster1] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-17T14:14:42.8870905Z [cluster1] },
2021-07-17T14:14:42.8871466Z [cluster1] {
2021-07-17T14:14:42.8872007Z [cluster1] "name": "CE_IPSEC_PSK",
2021-07-17T14:14:42.8873633Z [cluster1] "value": "XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C"
2021-07-17T14:14:42.8875105Z [cluster1] },
2021-07-17T14:14:42.8875548Z [cluster1] {
2021-07-17T14:14:42.8876064Z [cluster1] "name": "CE_IPSEC_DEBUG",
2021-07-17T14:14:42.8876657Z [cluster1] "value": "false"
2021-07-17T14:14:42.8877154Z [cluster1] },
2021-07-17T14:14:42.8877616Z [cluster1] {
2021-07-17T14:14:42.8878290Z [cluster1] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-17T14:14:42.8879019Z [cluster1] "value": "true"
2021-07-17T14:14:42.8879501Z [cluster1] },
2021-07-17T14:14:42.8879923Z [cluster1] {
2021-07-17T14:14:42.8880587Z [cluster1] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-17T14:14:42.8881303Z [cluster1] "value": "1"
2021-07-17T14:14:42.8881774Z [cluster1] },
2021-07-17T14:14:42.8882557Z [cluster1] {
2021-07-17T14:14:42.8883425Z [cluster1] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-17T14:14:42.8884293Z [cluster1] "value": "5"
2021-07-17T14:14:42.8884765Z [cluster1] },
2021-07-17T14:14:42.8885203Z [cluster1] {
2021-07-17T14:14:42.8885708Z [cluster1] "name": "NODE_NAME",
2021-07-17T14:14:42.8886265Z [cluster1] "valueFrom": {
2021-07-17T14:14:42.8886806Z [cluster1] "fieldRef": {
2021-07-17T14:14:42.8887387Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:42.8888064Z [cluster1] "fieldPath": "spec.nodeName"
2021-07-17T14:14:42.8888659Z [cluster1] }
2021-07-17T14:14:42.8889143Z [cluster1] }
2021-07-17T14:14:42.8889591Z [cluster1] },
2021-07-17T14:14:42.8890067Z [cluster1] {
2021-07-17T14:14:42.8890554Z [cluster1] "name": "POD_NAME",
2021-07-17T14:14:42.8891107Z [cluster1] "valueFrom": {
2021-07-17T14:14:42.8891642Z [cluster1] "fieldRef": {
2021-07-17T14:14:42.8892218Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:42.8892867Z [cluster1] "fieldPath": "metadata.name"
2021-07-17T14:14:42.8893454Z [cluster1] }
2021-07-17T14:14:42.8893989Z [cluster1] }
2021-07-17T14:14:42.8894430Z [cluster1] },
2021-07-17T14:14:42.8894867Z [cluster1] {
2021-07-17T14:14:42.8895391Z [cluster1] "name": "CE_IPSEC_IKEPORT",
2021-07-17T14:14:42.8895957Z [cluster1] "value": "500"
2021-07-17T14:14:42.8896413Z [cluster1] },
2021-07-17T14:14:42.8896869Z [cluster1] {
2021-07-17T14:14:42.8897401Z [cluster1] "name": "CE_IPSEC_NATTPORT",
2021-07-17T14:14:42.8897968Z [cluster1] "value": "4500"
2021-07-17T14:14:42.8898440Z [cluster1] },
2021-07-17T14:14:42.8898878Z [cluster1] {
2021-07-17T14:14:42.8899467Z [cluster1] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-17T14:14:42.8900117Z [cluster1] "value": "false"
2021-07-17T14:14:42.8900604Z [cluster1] },
2021-07-17T14:14:42.8901030Z [cluster1] {
2021-07-17T14:14:42.8901590Z [cluster1] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-17T14:14:42.8902208Z [cluster1] "value": "false"
2021-07-17T14:14:42.8902712Z [cluster1] }
2021-07-17T14:14:42.8903129Z [cluster1] ],
2021-07-17T14:14:42.8904457Z [cluster1] "image": "localhost:5000/submariner-gateway:local",
2021-07-17T14:14:42.8905271Z [cluster1] "imagePullPolicy": "Always",
2021-07-17T14:14:42.8906206Z [cluster1] "name": "submariner-gateway",
2021-07-17T14:14:42.8906846Z [cluster1] "ports": [
2021-07-17T14:14:42.8907295Z [cluster1] {
2021-07-17T14:14:42.8907995Z [cluster1] "containerPort": 4500,
2021-07-17T14:14:42.8908579Z [cluster1] "hostPort": 4500,
2021-07-17T14:14:42.8909367Z [cluster1] "name": "cable-encaps",
2021-07-17T14:14:42.8909973Z [cluster1] "protocol": "UDP"
2021-07-17T14:14:42.8910473Z [cluster1] },
2021-07-17T14:14:42.8910896Z [cluster1] {
2021-07-17T14:14:42.8911435Z [cluster1] "containerPort": 4490,
2021-07-17T14:14:42.8912011Z [cluster1] "hostPort": 4490,
2021-07-17T14:14:42.8913629Z [cluster1] "name": "natt-discovery",
2021-07-17T14:14:42.8914786Z [cluster1] "protocol": "UDP"
2021-07-17T14:14:42.8915307Z [cluster1] }
2021-07-17T14:14:42.8915898Z [cluster1] ],
2021-07-17T14:14:42.8916525Z [cluster1] "resources": {},
2021-07-17T14:14:42.8917303Z [cluster1] "securityContext": {
2021-07-17T14:14:42.8918231Z [cluster1] "allowPrivilegeEscalation": true,
2021-07-17T14:14:42.8919163Z [cluster1] "capabilities": {
2021-07-17T14:14:42.8919848Z [cluster1] "add": [
2021-07-17T14:14:42.8920512Z [cluster1] "net_admin"
2021-07-17T14:14:42.8921132Z [cluster1] ],
2021-07-17T14:14:42.8921609Z [cluster1] "drop": [
2021-07-17T14:14:42.8922089Z [cluster1] "all"
2021-07-17T14:14:42.8922530Z [cluster1] ]
2021-07-17T14:14:42.8922973Z [cluster1] },
2021-07-17T14:14:42.8923490Z [cluster1] "privileged": true,
2021-07-17T14:14:42.8924236Z [cluster1] "readOnlyRootFilesystem": false,
2021-07-17T14:14:42.8924985Z [cluster1] "runAsNonRoot": false
2021-07-17T14:14:42.8925513Z [cluster1] },
2021-07-17T14:14:42.8926529Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-17T14:14:42.8927541Z [cluster1] "terminationMessagePolicy": "File",
2021-07-17T14:14:42.8928416Z [cluster1] "volumeMounts": [
2021-07-17T14:14:42.8928915Z [cluster1] {
2021-07-17T14:14:42.8929470Z [cluster1] "mountPath": "/etc/ipsec.d",
2021-07-17T14:14:42.8930064Z [cluster1] "name": "ipsecd"
2021-07-17T14:14:42.8930556Z [cluster1] },
2021-07-17T14:14:42.8930981Z [cluster1] {
2021-07-17T14:14:42.8931546Z [cluster1] "mountPath": "/var/lib/ipsec/nss",
2021-07-17T14:14:42.8932165Z [cluster1] "name": "ipsecnss"
2021-07-17T14:14:42.8932671Z [cluster1] },
2021-07-17T14:14:42.8933095Z [cluster1] {
2021-07-17T14:14:42.8933831Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-17T14:14:42.8935113Z [cluster1] "name": "submariner-gateway-token-z2jw6",
2021-07-17T14:14:42.8935942Z [cluster1] "readOnly": true
2021-07-17T14:14:42.8936450Z [cluster1] }
2021-07-17T14:14:42.8936867Z [cluster1] ]
2021-07-17T14:14:42.8937323Z [cluster1] }
2021-07-17T14:14:42.8937749Z [cluster1] ],
2021-07-17T14:14:42.8938335Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-17T14:14:42.8939059Z [cluster1] "enableServiceLinks": true,
2021-07-17T14:14:42.8939732Z [cluster1] "hostNetwork": true,
2021-07-17T14:14:42.8940571Z [cluster1] "nodeName": "cluster1-worker",
2021-07-17T14:14:42.8941221Z [cluster1] "nodeSelector": {
2021-07-17T14:14:42.8941888Z [cluster1] "submariner.io/gateway": "true"
2021-07-17T14:14:42.8942432Z [cluster1] },
2021-07-17T14:14:42.8942915Z [cluster1] "priority": 0,
2021-07-17T14:14:42.8943517Z [cluster1] "restartPolicy": "Always",
2021-07-17T14:14:42.8944460Z [cluster1] "schedulerName": "default-scheduler",
2021-07-17T14:14:42.8945228Z [cluster1] "securityContext": {},
2021-07-17T14:14:42.8946229Z [cluster1] "serviceAccount": "submariner-gateway",
2021-07-17T14:14:42.8947350Z [cluster1] "serviceAccountName": "submariner-gateway",
2021-07-17T14:14:42.8948572Z [cluster1] "terminationGracePeriodSeconds": 1,
2021-07-17T14:14:42.8949381Z [cluster1] "tolerations": [
2021-07-17T14:14:42.8949858Z [cluster1] {
2021-07-17T14:14:42.8950368Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8950851Z [cluster1] },
2021-07-17T14:14:42.8951380Z [cluster1] {
2021-07-17T14:14:42.8951891Z [cluster1] "effect": "NoExecute",
2021-07-17T14:14:42.8952865Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-17T14:14:42.8953592Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8954092Z [cluster1] },
2021-07-17T14:14:42.8954501Z [cluster1] {
2021-07-17T14:14:42.8955018Z [cluster1] "effect": "NoExecute",
2021-07-17T14:14:42.8955789Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-17T14:14:42.8956513Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8957025Z [cluster1] },
2021-07-17T14:14:42.8957455Z [cluster1] {
2021-07-17T14:14:42.8958016Z [cluster1] "effect": "NoSchedule",
2021-07-17T14:14:42.8958977Z [cluster1] "key": "node.kubernetes.io/disk-pressure",
2021-07-17T14:14:42.8959765Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8960254Z [cluster1] },
2021-07-17T14:14:42.8960674Z [cluster1] {
2021-07-17T14:14:42.8961203Z [cluster1] "effect": "NoSchedule",
2021-07-17T14:14:42.8962175Z [cluster1] "key": "node.kubernetes.io/memory-pressure",
2021-07-17T14:14:42.8962949Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8963472Z [cluster1] },
2021-07-17T14:14:42.8963893Z [cluster1] {
2021-07-17T14:14:42.8964491Z [cluster1] "effect": "NoSchedule",
2021-07-17T14:14:42.8965457Z [cluster1] "key": "node.kubernetes.io/pid-pressure",
2021-07-17T14:14:42.8966194Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8966721Z [cluster1] },
2021-07-17T14:14:42.8967131Z [cluster1] {
2021-07-17T14:14:42.8967653Z [cluster1] "effect": "NoSchedule",
2021-07-17T14:14:42.8978039Z [cluster1] "key": "node.kubernetes.io/unschedulable",
2021-07-17T14:14:42.8978877Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8979369Z [cluster1] },
2021-07-17T14:14:42.8979798Z [cluster1] {
2021-07-17T14:14:42.8980347Z [cluster1] "effect": "NoSchedule",
2021-07-17T14:14:42.8982333Z [cluster1] "key": "node.kubernetes.io/network-unavailable",
2021-07-17T14:14:42.8983374Z [cluster1] "operator": "Exists"
2021-07-17T14:14:42.8983869Z [cluster1] }
2021-07-17T14:14:42.8984306Z [cluster1] ],
2021-07-17T14:14:42.8984744Z [cluster1] "volumes": [
2021-07-17T14:14:42.8985202Z [cluster1] {
2021-07-17T14:14:42.8985697Z [cluster1] "emptyDir": {},
2021-07-17T14:14:42.8986249Z [cluster1] "name": "ipsecd"
2021-07-17T14:14:42.8986730Z [cluster1] },
2021-07-17T14:14:42.8987151Z [cluster1] {
2021-07-17T14:14:42.8987644Z [cluster1] "emptyDir": {},
2021-07-17T14:14:42.8988306Z [cluster1] "name": "ipsecnss"
2021-07-17T14:14:42.8988815Z [cluster1] },
2021-07-17T14:14:42.8989223Z [cluster1] {
2021-07-17T14:14:42.8990273Z [cluster1] "name": "submariner-gateway-token-z2jw6",
2021-07-17T14:14:42.8991839Z [cluster1] "secret": {
2021-07-17T14:14:42.8992405Z [cluster1] "defaultMode": 420,
2021-07-17T14:14:42.8993524Z [cluster1] "secretName": "submariner-gateway-token-z2jw6"
2021-07-17T14:14:42.8994340Z [cluster1] }
2021-07-17T14:14:42.8994755Z [cluster1] }
2021-07-17T14:14:42.8995172Z [cluster1] ]
2021-07-17T14:14:42.8995609Z [cluster1] },
2021-07-17T14:14:42.8996065Z [cluster1] "status": {
2021-07-17T14:14:42.8996562Z [cluster1] "conditions": [
2021-07-17T14:14:42.8997019Z [cluster1] {
2021-07-17T14:14:42.8997576Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:42.8998701Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:21Z",
2021-07-17T14:14:42.8999410Z [cluster1] "status": "True",
2021-07-17T14:14:42.8999969Z [cluster1] "type": "Initialized"
2021-07-17T14:14:42.9000479Z [cluster1] },
2021-07-17T14:14:42.9000910Z [cluster1] {
2021-07-17T14:14:42.9001462Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:42.9003419Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:40Z",
2021-07-17T14:14:42.9004329Z [cluster1] "status": "True",
2021-07-17T14:14:42.9004881Z [cluster1] "type": "Ready"
2021-07-17T14:14:42.9005356Z [cluster1] },
2021-07-17T14:14:42.9005781Z [cluster1] {
2021-07-17T14:14:42.9006323Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:42.9007293Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:40Z",
2021-07-17T14:14:42.9007953Z [cluster1] "status": "True",
2021-07-17T14:14:42.9008575Z [cluster1] "type": "ContainersReady"
2021-07-17T14:14:42.9009133Z [cluster1] },
2021-07-17T14:14:42.9009576Z [cluster1] {
2021-07-17T14:14:42.9010105Z [cluster1] "lastProbeTime": null,
2021-07-17T14:14:42.9011008Z [cluster1] "lastTransitionTime": "2021-07-17T14:13:21Z",
2021-07-17T14:14:42.9011683Z [cluster1] "status": "True",
2021-07-17T14:14:42.9012254Z [cluster1] "type": "PodScheduled"
2021-07-17T14:14:42.9012935Z [cluster1] }
2021-07-17T14:14:42.9013341Z [cluster1] ],
2021-07-17T14:14:42.9013905Z [cluster1] "containerStatuses": [
2021-07-17T14:14:42.9014439Z [cluster1] {
2021-07-17T14:14:42.9016245Z [cluster1] "containerID": "containerd://f4d87f13600b85ce56b14879c4f8c23e54426785693a5913af7aa49a0f9a0411",
2021-07-17T14:14:42.9018464Z [cluster1] "image": "localhost:5000/submariner-gateway:local",
2021-07-17T14:14:42.9020248Z [cluster1] "imageID": "localhost:5000/submariner-gateway@sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895",
2021-07-17T14:14:42.9021552Z [cluster1] "lastState": {},
2021-07-17T14:14:42.9022375Z [cluster1] "name": "submariner-gateway",
2021-07-17T14:14:42.9023013Z [cluster1] "ready": true,
2021-07-17T14:14:42.9024145Z [cluster1] "restartCount": 0,
2021-07-17T14:14:42.9024892Z [cluster1] "started": true,
2021-07-17T14:14:42.9026007Z [cluster1] "state": {
2021-07-17T14:14:42.9026545Z [cluster1] "running": {
2021-07-17T14:14:42.9027563Z [cluster1] "startedAt": "2021-07-17T14:13:39Z"
2021-07-17T14:14:42.9028485Z [cluster1] }
2021-07-17T14:14:42.9029079Z [cluster1] }
2021-07-17T14:14:42.9029518Z [cluster1] }
2021-07-17T14:14:42.9029945Z [cluster1] ],
2021-07-17T14:14:42.9030425Z [cluster1] "hostIP": "172.18.0.4",
2021-07-17T14:14:42.9030974Z [cluster1] "phase": "Running",
2021-07-17T14:14:42.9031489Z [cluster1] "podIP": "172.18.0.4",
2021-07-17T14:14:42.9031982Z [cluster1] "podIPs": [
2021-07-17T14:14:42.9032441Z [cluster1] {
2021-07-17T14:14:42.9032907Z [cluster1] "ip": "172.18.0.4"
2021-07-17T14:14:42.9033359Z [cluster1] }
2021-07-17T14:14:42.9033779Z [cluster1] ],
2021-07-17T14:14:42.9034300Z [cluster1] "qosClass": "BestEffort",
2021-07-17T14:14:42.9048053Z [clustepe": "ContainersReady"
2021-07-17T14:14:42.9048725Z [cluster2] },
2021-07-17T14:14:42.9049474Z [cluster2] {
2021-07-17T14:14:42.9050907Z [cluster2] "lastProbeTime": null,
2021-07-17T14:14:42.9056554Z [cluster2] "lastTransitionTime": "2021-07-17T14:13:40Z",
2021-07-17T14:14:42.9057624Z [cluster2] "status": "True",
2021-07-17T14:14:42.9058718Z [cluster2] "type": "PodScheduled"
2021-07-17T14:14:42.9059286Z [cluster2] }
2021-07-17T14:14:42.9059782Z [cluster2] ],
2021-07-17T14:14:42.9060356Z [cluster2] "containerStatuses": [
2021-07-17T14:14:42.9061027Z [cluster2] {
2021-07-17T14:14:42.9063077Z [cluster2] "containerID": "containerd://f726e95e70ffdaea3bf9f77f045a05875aec8c84714f89c789549782406f5bac",
2021-07-17T14:14:42.9065601Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-17T14:14:42.9067522Z [cluster2] "imageID": "localhost:5000/submariner-gateway@sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895",
2021-07-17T14:14:42.9069742Z [cluster2] "lastState": {},
2021-07-17T14:14:42.9070721Z [cluster2] "name": "submariner-gateway",
2021-07-17T14:14:42.9071466Z [cluster2] "ready": true,
2021-07-17T14:14:42.9072125Z [cluster2] "restartCount": 0,
2021-07-17T14:14:42.9072787Z [cluster2] "started": true,
2021-07-17T14:14:42.9073358Z [cluster2] "state": {
2021-07-17T14:14:42.9075527Z [cluster2] "running": {
2021-07-17T14:14:42.9076397Z [cluster2] "startedAt": "2021-07-17T14:13:59Z"
2021-07-17T14:14:42.9077041Z [cluster2] }
2021-07-17T14:14:42.9077573Z [cluster2] }
2021-07-17T14:14:42.9078035Z [cluster2] }
2021-07-17T14:14:42.9079232Z [cluster2] ],
2021-07-17T14:14:42.9079861Z [cluster2] "hostIP": "172.18.0.5",
2021-07-17T14:14:42.9080514Z [cluster2] "phase": "Running",
2021-07-17T14:14:42.9081134Z [cluster2] "podIP": "172.18.0.5",
2021-07-17T14:14:42.9081645Z [cluster2] "podIPs": [
2021-07-17T14:14:42.9086942Z [cluster2] {
2021-07-17T14:14:42.9087613Z [cluster2] "ip": "172.18.0.5"
2021-07-17T14:14:42.9088174Z [cluster2] }
2021-07-17T14:14:42.9088705Z [cluster2] ],
2021-07-17T14:14:42.9089339Z [cluster2] "qosClass": "BestEffort",
2021-07-17T14:14:42.9090541Z [cluster2] "startTime": "2021-07-17T14:13:40Z"
2021-07-17T14:14:42.9091148Z [cluster2] }
2021-07-17T14:14:42.9091638Z [cluster2] }
2021-07-17T14:14:42.9092942Z [submariner-operator]$ [cluster2] validate_pod_container_equals image localhost:5000/submariner-gateway:local
2021-07-17T14:14:42.9094726Z [submariner-operator]$ [cluster2] validate_pod_container_equals image localhost:5000/submariner-gateway:local
2021-07-17T14:14:42.9096573Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[].image localhost:5000/submariner-gateway:local
2021-07-17T14:14:42.9098570Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].image localhost:5000/submariner-gateway:local
2021-07-17T14:14:42.9100753Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].image /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:42.9102942Z [submariner-operator]$ [cluster2] validate_pod_container_has securityContext.capabilities.add net_admin
2021-07-17T14:14:42.9104998Z [submariner-operator]$ [cluster2] validate_pod_container_has securityContext.capabilities.add net_admin
2021-07-17T14:14:42.9107538Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.capabilities.add /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:42.9157316Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:42.9164661Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:42.9167176Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:42.9180181Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:42.9183396Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.allowPrivilegeEscalation /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:42.9186009Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.privileged true
2021-07-17T14:14:42.9187927Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.privileged true
2021-07-17T14:14:42.9192232Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.privileged true
2021-07-17T14:14:42.9194259Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.privileged true
2021-07-17T14:14:42.9196694Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.privileged /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:42.9199373Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.0312632Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.0314978Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.0317431Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.0320622Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.readOnlyRootFilesystem /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.0323075Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.runAsNonRoot false
2021-07-17T14:14:43.0324903Z [submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.runAsNonRoot false
2021-07-17T14:14:43.0326751Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.runAsNonRoot false
2021-07-17T14:14:43.0328778Z [submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.runAsNonRoot false
2021-07-17T14:14:43.0331196Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.runAsNonRoot /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.0333194Z [submariner-operator]$ [cluster2] validate_pod_container_has command submariner.sh
2021-07-17T14:14:43.0334576Z [submariner-operator]$ [cluster2] validate_pod_container_has command submariner.sh
2021-07-17T14:14:43.0336368Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].command /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.0338539Z [submariner-operator]$ [cluster2] jq -r .spec.containers[].env /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.0339706Z [cluster2] [
2021-07-17T14:14:43.0340100Z [cluster2] {
2021-07-17T14:14:43.0340652Z [cluster2] "name": "SUBMARINER_NAMESPACE",
2021-07-17T14:14:43.0341515Z [cluster2] "value": "submariner-operator"
2021-07-17T14:14:43.0342105Z [cluster2] },
2021-07-17T14:14:43.0342494Z [cluster2] {
2021-07-17T14:14:43.0343041Z [cluster2] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-17T14:14:43.0343617Z [cluster2] "value": "10.2.0.0/16"
2021-07-17T14:14:43.0344059Z [cluster2] },
2021-07-17T14:14:43.0344454Z [cluster2] {
2021-07-17T14:14:43.0345000Z [cluster2] "name": "SUBMARINER_SERVICECIDR",
2021-07-17T14:14:43.0345584Z [cluster2] "value": "100.2.0.0/16"
2021-07-17T14:14:43.0346015Z [cluster2] },
2021-07-17T14:14:43.0346421Z [cluster2] {
2021-07-17T14:14:43.0346945Z [cluster2] "name": "SUBMARINER_GLOBALCIDR"
2021-07-17T14:14:43.0347496Z [cluster2] },
2021-07-17T14:14:43.0348147Z [cluster2] {
2021-07-17T14:14:43.0348686Z [cluster2] "name": "SUBMARINER_CLUSTERID",
2021-07-17T14:14:43.0349395Z [cluster2] "value": "cluster2"
2021-07-17T14:14:43.0349878Z [cluster2] },
2021-07-17T14:14:43.0350268Z [cluster2] {
2021-07-17T14:14:43.0350805Z [cluster2] "name": "SUBMARINER_COLORCODES",
2021-07-17T14:14:43.0351377Z [cluster2] "value": "blue"
2021-07-17T14:14:43.0351829Z [cluster2] },
2021-07-17T14:14:43.0352218Z [cluster2] {
2021-07-17T14:14:43.0352726Z [cluster2] "name": "SUBMARINER_DEBUG",
2021-07-17T14:14:43.0353280Z [cluster2] "value": "false"
2021-07-17T14:14:43.0353730Z [cluster2] },
2021-07-17T14:14:43.0354133Z [cluster2] {
2021-07-17T14:14:43.0354656Z [cluster2] "name": "SUBMARINER_NATENABLED",
2021-07-17T14:14:43.0355242Z [cluster2] "value": "false"
2021-07-17T14:14:43.0355683Z [cluster2] },
2021-07-17T14:14:43.0356085Z [cluster2] {
2021-07-17T14:14:43.0356587Z [cluster2] "name": "SUBMARINER_BROKER",
2021-07-17T14:14:43.0357138Z [cluster2] "value": "k8s"
2021-07-17T14:14:43.0357571Z [cluster2] },
2021-07-17T14:14:43.0357976Z [cluster2] {
2021-07-17T14:14:43.0358512Z [cluster2] "name": "SUBMARINER_CABLEDRIVER",
2021-07-17T14:14:43.0359140Z [cluster2] "value": "libreswan"
2021-07-17T14:14:43.0359613Z [cluster2] },
2021-07-17T14:14:43.0360017Z [cluster2] {
2021-07-17T14:14:43.0360532Z [cluster2] "name": "BROKER_K8S_APISERVER",
2021-07-17T14:14:43.0361078Z [cluster2] "value": "172.18.0.9:6443"
2021-07-17T14:14:43.0361523Z [cluster2] },
2021-07-17T14:14:43.0361915Z [cluster2] {
2021-07-17T14:14:43.0362557Z [cluster2] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-17T14:14:43.0539929Z [cluster2] "value": "***"
2021-07-17T14:14:43.0540542Z [cluster2] },
2021-07-17T14:14:43.0540940Z [cluster2] {
2021-07-17T14:14:43.0541531Z [cluster2] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-17T14:14:43.0542810Z [cluster2] "value": "submariner-k8s-broker"
2021-07-17T14:14:43.0543402Z [cluster2] },
2021-07-17T14:14:43.0543808Z [cluster2] {
2021-07-17T14:14:43.0544274Z [cluster2] "name": "BROKER_K8S_CA",
2021-07-17T14:14:43.2310964Z [cluster2] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-17T14:14:43.3005617Z [cluster2] },
2021-07-17T14:14:43.3006075Z [cluster2] {
2021-07-17T14:14:43.3006611Z [cluster2] "name": "CE_IPSEC_PSK",
2021-07-17T14:14:43.3008149Z [cluster2] "value": "XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C"
2021-07-17T14:14:43.3009570Z [cluster2] },
2021-07-17T14:14:43.3009980Z [cluster2] {
2021-07-17T14:14:43.3010456Z [cluster2] "name": "CE_IPSEC_DEBUG",
2021-07-17T14:14:43.3010995Z [cluster2] "value": "false"
2021-07-17T14:14:43.3011436Z [cluster2] },
2021-07-17T14:14:43.3011839Z [cluster2] {
2021-07-17T14:14:43.3012718Z [cluster2] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-17T14:14:43.3013395Z [cluster2] "value": "true"
2021-07-17T14:14:43.3013831Z [cluster2] },
2021-07-17T14:14:43.3014231Z [cluster2] {
2021-07-17T14:14:43.3014863Z [cluster2] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-17T14:14:43.3015509Z [cluster2] "value": "1"
2021-07-17T14:14:43.3015941Z [cluster2] },
2021-07-17T14:14:43.3016328Z [cluster2] {
2021-07-17T14:14:43.3017113Z [cluster2] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-17T14:14:43.3017919Z [cluster2] "value": "5"
2021-07-17T14:14:43.3018355Z [cluster2] },
2021-07-17T14:14:43.3018743Z [cluster2] {
2021-07-17T14:14:43.3019199Z [cluster2] "name": "NODE_NAME",
2021-07-17T14:14:43.3019704Z [cluster2] "valueFrom": {
2021-07-17T14:14:43.3020211Z [cluster2] "fieldRef": {
2021-07-17T14:14:43.3020729Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:43.3021467Z [cluster2] "fieldPath": "spec.nodeName"
2021-07-17T14:14:43.3022014Z [cluster2] }
2021-07-17T14:14:43.3022420Z [cluster2] }
2021-07-17T14:14:43.3022826Z [cluster2] },
2021-07-17T14:14:43.3023215Z [cluster2] {
2021-07-17T14:14:43.3023682Z [cluster2] "name": "POD_NAME",
2021-07-17T14:14:43.3024187Z [cluster2] "valueFrom": {
2021-07-17T14:14:43.3024697Z [cluster2] "fieldRef": {
2021-07-17T14:14:43.3025212Z [cluster2] "apiVersion": "v1",
2021-07-17T14:14:43.3025839Z [cluster2] "fieldPath": "metadata.name"
2021-07-17T14:14:43.3026489Z [cluster2] }
2021-07-17T14:14:43.3026899Z [cluster2] }
2021-07-17T14:14:43.3027291Z [cluster2] },
2021-07-17T14:14:43.3027691Z [cluster2] {
2021-07-17T14:14:43.3038527Z [cluster2] "name": "CE_IPSEC_IKEPORT",
2021-07-17T14:14:43.3039105Z [cluster2] "value": "500"
2021-07-17T14:14:43.3039536Z [cluster2] },
2021-07-17T14:14:43.3039948Z [cluster2] {
2021-07-17T14:14:43.3040456Z [cluster2] "name": "CE_IPSEC_NATTPORT",
2021-07-17T14:14:43.3040982Z [cluster2] "value": "4500"
2021-07-17T14:14:43.3041440Z [cluster2] },
2021-07-17T14:14:43.3041833Z [cluster2] {
2021-07-17T14:14:43.3042396Z [cluster2] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-17T14:14:43.3042999Z [cluster2] "value": "false"
2021-07-17T14:14:43.3043459Z [cluster2] },
2021-07-17T14:14:43.3043853Z [cluster2] {
2021-07-17T14:14:43.3044377Z [cluster2] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-17T14:14:43.3044941Z [cluster2] "value": "false"
2021-07-17T14:14:43.3045392Z [cluster2] }
2021-07-17T14:14:43.3045792Z [cluster2] ]
2021-07-17T14:14:43.3047430Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator
2021-07-17T14:14:43.3049127Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator
2021-07-17T14:14:43.3051279Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NAMESPACE").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.3053266Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_SERVICECIDR 100.2.0.0/16
2021-07-17T14:14:43.3054690Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_SERVICECIDR 100.2.0.0/16
2021-07-17T14:14:43.3056733Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_SERVICECIDR").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.3058722Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.2.0.0/16
2021-07-17T14:14:43.3060145Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.2.0.0/16
2021-07-17T14:14:43.3062183Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_CLUSTERCIDR").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.3064491Z [submariner-operator]$ [cluster2] validate_pod_container_envr1] "startTime": "2021-07-17T14:13:21Z"
2021-07-17T14:14:43.3065265Z [cluster1] }
2021-07-17T14:14:43.3065671Z [cluster1] }
2021-07-17T14:14:43.3066842Z [submariner-operator]$ [cluster1] validate_pod_container_equals image localhost:5000/submariner-gateway:local
2021-07-17T14:14:43.3068715Z [submariner-operator]$ [cluster1] validate_pod_container_equals image localhost:5000/submariner-gateway:local
2021-07-17T14:14:43.3070438Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[].image localhost:5000/submariner-gateway:local
2021-07-17T14:14:43.3072305Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].image localhost:5000/submariner-gateway:local
2021-07-17T14:14:43.3074357Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].image /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3076382Z [submariner-operator]$ [cluster1] validate_pod_container_has securityContext.capabilities.add net_admin
2021-07-17T14:14:43.3078328Z [submariner-operator]$ [cluster1] validate_pod_container_has securityContext.capabilities.add net_admin
2021-07-17T14:14:43.3080718Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.capabilities.add /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3083239Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:43.3091513Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:43.3093916Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:43.3096421Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.allowPrivilegeEscalation true
2021-07-17T14:14:43.3099350Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.allowPrivilegeEscalation /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3101793Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.privileged true
2021-07-17T14:14:43.3103540Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.privileged true
2021-07-17T14:14:43.3105321Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.privileged true
2021-07-17T14:14:43.3107263Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.privileged true
2021-07-17T14:14:43.3150259Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.privileged /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3152715Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.3155105Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.3157384Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.3159815Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.readOnlyRootFilesystem false
2021-07-17T14:14:43.3162641Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.readOnlyRootFilesystem /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3165062Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.runAsNonRoot false
2021-07-17T14:14:43.3166870Z [submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.runAsNonRoot false
2021-07-17T14:14:43.3168930Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.runAsNonRoot false
2021-07-17T14:14:43.3171082Z [submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.runAsNonRoot false
2021-07-17T14:14:43.3173506Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.runAsNonRoot /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3175489Z [submariner-operator]$ [cluster1] validate_pod_container_has command submariner.sh
2021-07-17T14:14:43.3176871Z [submariner-operator]$ [cluster1] validate_pod_container_has command submariner.sh
2021-07-17T14:14:43.3178651Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].command /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3180850Z [submariner-operator]$ [cluster1] jq -r .spec.containers[].env /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.3181992Z [cluster1] [
2021-07-17T14:14:43.3182389Z [cluster1] {
2021-07-17T14:14:43.3182932Z [cluster1] "name": "SUBMARINER_NAMESPACE",
2021-07-17T14:14:43.3183808Z [cluster1] "value": "submariner-operator"
2021-07-17T14:14:43.3184395Z [cluster1] },
2021-07-17T14:14:43.3184789Z [cluster1] {
2021-07-17T14:14:43.3185342Z [cluster1] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-17T14:14:43.3185927Z [cluster1] "value": "10.1.0.0/16"
2021-07-17T14:14:43.3186361Z [cluster1] },
2021-07-17T14:14:43.3186766Z [cluster1] {
2021-07-17T14:14:43.3187305Z [cluster1] "name": "SUBMARINER_SERVICECIDR",
2021-07-17T14:14:43.3195404Z [cluster1] "value": "100.1.0.0/16"
2021-07-17T14:14:43.3195950Z [cluster1] },
2021-07-17T14:14:43.3196361Z [cluster1] {
2021-07-17T14:14:43.3196894Z [cluster1] "name": "SUBMARINER_GLOBALCIDR"
2021-07-17T14:14:43.3197436Z [cluster1] },
2021-07-17T14:14:43.3197828Z [cluster1] {
2021-07-17T14:14:43.3198363Z [cluster1] "name": "SUBMARINER_CLUSTERID",
2021-07-17T14:14:43.3198948Z [cluster1] "value": "cluster1"
2021-07-17T14:14:43.3199419Z [cluster1] },
2021-07-17T14:14:43.3199817Z [cluster1] {
2021-07-17T14:14:43.3200347Z [cluster1] "name": "SUBMARINER_COLORCODES",
2021-07-17T14:14:43.3200938Z [cluster1] "value": "blue"
2021-07-17T14:14:43.3201375Z [cluster1] },
2021-07-17T14:14:43.3201800Z [cluster1] {
2021-07-17T14:14:43.3202291Z [cluster1] "name": "SUBMARINER_DEBUG",
2021-07-17T14:14:43.3202845Z [cluster1] "value": "false"
2021-07-17T14:14:43.3203290Z [cluster1] },
2021-07-17T14:14:43.3203688Z [cluster1] {
2021-07-17T14:14:43.3204220Z [cluster1] "name": "SUBMARINER_NATENABLED",
2021-07-17T14:14:43.3204809Z [cluster1] "value": "false"
2021-07-17T14:14:43.3205248Z [cluster1] },
2021-07-17T14:14:43.3205650Z [cluster1] {
2021-07-17T14:14:43.3206150Z [cluster1] "name": "SUBMARINER_BROKER",
2021-07-17T14:14:43.3206700Z [cluster1] "value": "k8s"
2021-07-17T14:14:43.3207129Z [cluster1] },
2021-07-17T14:14:43.3207527Z [cluster1] {
2021-07-17T14:14:43.3208074Z [cluster1] "name": "SUBMARINER_CABLEDRIVER",
2021-07-17T14:14:43.3208688Z [cluster1] "value": "libreswan"
2021-07-17T14:14:43.3209169Z [cluster1] },
2021-07-17T14:14:43.3209556Z [cluster1] {
2021-07-17T14:14:43.3210077Z [cluster1] "name": "BROKER_K8S_APISERVER",
2021-07-17T14:14:43.3210622Z [cluster1] "value": "172.18.0.9:6443"
2021-07-17T14:14:43.3211072Z [cluster1] },
2021-07-17T14:14:43.3211461Z [cluster1] {
2021-07-17T14:14:43.3212022Z [cluster1] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-17T14:14:43.3381861Z [cluster1] "value": "***"
2021-07-17T14:14:43.3382506Z [cluster1] },
2021-07-17T14:14:43.3382924Z [cluster1] {
2021-07-17T14:14:43.3383495Z [cluster1] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-17T14:14:43.3384832Z [cluster1] "value": "submariner-k8s-broker"
2021-07-17T14:14:43.3385423Z [cluster1] },
2021-07-17T14:14:43.3385826Z [cluster1] {
2021-07-17T14:14:43.3386293Z [cluster1] "name": "BROKER_K8S_CA",
2021-07-17T14:14:43.4022827Z [cluster1] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-17T14:14:43.4546000Z [cluster1] },
2021-07-17T14:14:43.4546454Z [cluster1] {
2021-07-17T14:14:43.4546960Z [cluster1] "name": "CE_IPSEC_PSK",
2021-07-17T14:14:43.4550851Z [cluster1] "value": "XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C"
2021-07-17T14:14:43.4552840Z [cluster1] },
2021-07-17T14:14:43.4553241Z [cluster1] {
2021-07-17T14:14:43.4553736Z [cluster1] "name": "CE_IPSEC_DEBUG",
2021-07-17T14:14:43.4554281Z [cluster1] "value": "false"
2021-07-17T14:14:43.4554722Z [cluster1] },
2021-07-17T14:14:43.7074855Z [cluster1] {
2021-07-17T14:14:43.7075544Z [cluster1] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-17T14:14:43.7076243Z [cluster1] "value": "true"
2021-07-17T14:14:43.7076690Z [cluster1] },
2021-07-17T14:14:43.7077097Z [cluster1] {
2021-07-17T14:14:43.7077725Z [cluster1] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-17T14:14:43.7078389Z [cluster1] "value": "1"
2021-07-17T14:14:43.7078813Z [cluster1] },
2021-07-17T14:14:43.7079224Z [cluster1] {
2021-07-17T14:14:43.7080007Z [cluster1] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-17T14:14:43.7080821Z [cluster1] "value": "5"
2021-07-17T14:14:43.7081250Z [cluster1] },
2021-07-17T14:14:43.7081657Z [cluster1] {
2021-07-17T14:14:43.7082121Z [cluster1] "name": "NODE_NAME",
2021-07-17T14:14:43.7082628Z [cluster1] "valueFrom": {
2021-07-17T14:14:43.7083142Z [cluster1] "fieldRef": {
2021-07-17T14:14:43.7083662Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:43.7084295Z [cluster1] "fieldPath": "spec.nodeName"
2021-07-17T14:14:43.7084835Z [cluster1] }
2021-07-17T14:14:43.7085241Z [cluster1] }
2021-07-17T14:14:43.7085636Z [cluster1] },
2021-07-17T14:14:43.7086038Z [cluster1] {
2021-07-17T14:14:43.7086489Z [cluster1] "name": "POD_NAME",
2021-07-17T14:14:43.7087112Z [cluster1] "valueFrom": {
2021-07-17T14:14:43.7087611Z [cluster1] "fieldRef": {
2021-07-17T14:14:43.7088143Z [cluster1] "apiVersion": "v1",
2021-07-17T14:14:43.7088775Z [cluster1] "fieldPath": "metadata.name"
2021-07-17T14:14:43.7089312Z [cluster1] }
2021-07-17T14:14:43.7089721Z [cluster1] }
2021-07-17T14:14:43.7090122Z [cluster1] },
2021-07-17T14:14:43.7090527Z [cluster1] {
2021-07-17T14:14:43.7091013Z [cluster1] "name": "CE_IPSEC_IKEPORT",
2021-07-17T14:14:43.7091543Z [cluster1] "value": "500"
2021-07-17T14:14:43.7091965Z [cluster1] },
2021-07-17T14:14:43.7092372Z [cluster1] {
2021-07-17T14:14:43.7092858Z [cluster1] "name": "CE_IPSEC_NATTPORT",
2021-07-17T14:14:43.7093388Z [cluster1] "value": "4500"
2021-07-17T14:14:43.7093808Z [cluster1] },
2021-07-17T14:14:43.7094212Z [cluster1] {
2021-07-17T14:14:43.7094940Z [cluster1] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-17T14:14:43.7095566Z [cluster1] "value": "false"
2021-07-17T14:14:43.7096022Z [cluster1] },
2021-07-17T14:14:43.7096410Z [cluster1] {
2021-07-17T14:14:43.7096932Z [cluster1] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-17T14:14:43.7097495Z [cluster1] "value": "false"
2021-07-17T14:14:43.7097951Z [cluster1] }
2021-07-17T14:14:43.7098340Z [cluster1] ]
2021-07-17T14:14:43.7099972Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator
2021-07-17T14:14:43.7101666Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator
2021-07-17T14:14:43.7103823Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NAMESPACE").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7105795Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_SERVICECIDR 100.1.0.0/16
2021-07-17T14:14:43.7107226Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_SERVICECIDR 100.1.0.0/16
2021-07-17T14:14:43.7109396Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_SERVICECIDR").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7111349Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.1.0.0/16
2021-07-17T14:14:43.7112921Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.1.0.0/16
2021-07-17T14:14:43.7114944Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_CLUSTERCIDR").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7116871Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_COLORCODES blue
2021-07-17T14:14:43.7118403Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_COLORCODES blue
2021-07-17T14:14:43.7120417Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_COLORCODES").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7122429Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_DEBUG false
2021-07-17T14:14:43.7123784Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_DEBUG false
2021-07-17T14:14:43.7125822Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_DEBUG").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7127771Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NATENABLED false
2021-07-17T14:14:43.7129192Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NATENABLED false
2021-07-17T14:14:43.7131189Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NATENABLED").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7133079Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_BROKER k8s
2021-07-17T14:14:43.7134401Z [submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_BROKER k8s
2021-07-17T14:14:43.7136331Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_BROKER").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.7138237Z [submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.9:6443
2021-07-17T14:14:43.7139600Z [submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.9:6443
2021-07-17T14:14:43.7449169Z [3 SUBMARINER_COLORCODES blue
2021-07-17T14:14:43.7450357Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_COLORCODES blue
2021-07-17T14:14:43.7452590Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_COLORCODES").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.7454701Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_DEBUG false
2021-07-17T14:14:43.7456051Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_DEBUG false
2021-07-17T14:14:43.7458015Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_DEBUG").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.7459945Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NATENABLED false
2021-07-17T14:14:43.7461361Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NATENABLED false
2021-07-17T14:14:43.7463393Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NATENABLED").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.7465319Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_BROKER k8s
2021-07-17T14:14:43.7466860Z [submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_BROKER k8s
2021-07-17T14:14:43.7469357Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_BROKER").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.7471454Z [submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.9:6443
2021-07-17T14:14:43.7472840Z [submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.9:6443
2021-07-17T14:14:43.7474925Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_APISERVER").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.7477073Z [submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker
2021-07-17T14:14:43.7478893Z [submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker
2021-07-17T14:14:43.7481141Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_REMOTENAMESPACE").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:43.8103238Z [submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:43.9478838Z [submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrb6m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_APISERVER").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:43.9570848Z [submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker
2021-07-17T14:14:43.9572819Z [submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker
2021-07-17T14:14:43.9575098Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_REMOTENAMESPACE").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:44.0259232Z [submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:44.1365044Z [submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:44.1897388Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_CA").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:44.1899287Z [submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_DEBUG false
2021-07-17T14:14:44.1900618Z [submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_DEBUG false
2021-07-17T14:14:44.1902511Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_DEBUG").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:44.1904357Z [submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_IKEPORT 500
2021-07-17T14:14:44.6741874Z [submariner-operk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:44.7040948Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_CA").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7042898Z [submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_DEBUG false
2021-07-17T14:14:44.7044245Z [submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_DEBUG false
2021-07-17T14:14:44.7046153Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_DEBUG").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7048194Z [submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_IKEPORT 500
2021-07-17T14:14:44.7049539Z [submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_IKEPORT 500
2021-07-17T14:14:44.7051473Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_IKEPORT").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7053356Z [submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_NATTPORT 4500
2021-07-17T14:14:44.7054680Z [submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_NATTPORT 4500
2021-07-17T14:14:44.7056607Z [submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_NATTPORT").value /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7058652Z [submariner-operator]$ [cluster2] validate_equals .spec.serviceAccount submariner-gateway
2021-07-17T14:14:44.7060274Z [submariner-operator]$ [cluster2] validate_equals .spec.serviceAccount submariner-gateway
2021-07-17T14:14:44.7062450Z [submariner-operator]$ [cluster2] jq -r -M .spec.serviceAccount /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7065098Z [submariner-operator]$ [cluster2] validate_equals .status.phase Running
2021-07-17T14:14:44.7066558Z [submariner-operator]$ [cluster2] validate_equals .status.phase Running
2021-07-17T14:14:44.7068462Z [submariner-operator]$ [cluster2] jq -r -M .status.phase /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7070327Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-17T14:14:44.7072955Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-17T14:14:44.7074990Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner-gateway-q2xkr.cluster2.json
2021-07-17T14:14:44.7076649Z [submariner-operator]$ [cluster2] verify_subm_gateway_container
2021-07-17T14:14:44.7077822Z [submariner-operator]$ [cluster2] verify_subm_gateway_container
2021-07-17T14:14:44.7079855Z [submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-17T14:14:44.7082038Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:44.7084277Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:44.7086639Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-17T14:14:44.7088613Z [submariner-operator]$ [cluster2] env_file=/tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:44.7090424Z [submariner-operator]$ [cluster2] kubectl exec submariner-gateway-q2xkr --namespace=submariner-operator -- env
2021-07-17T14:14:45.1859455Z [submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.1861915Z [submariner-operator]$ [cluster2] kubectl exec submariner-gateway-q2xkr --namespace=submariner-operator -- env
2021-07-17T14:14:45.1864016Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec submariner-gateway-q2xkr --namespace=submariner-operator -- env
2021-07-17T14:14:45.1865568Z [cluster2] PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2021-07-17T14:14:45.1866500Z [cluster2] HOSTNAME=cluster2-worker
2021-07-17T14:14:45.1867123Z [cluster2] DISTTAG=f33container
2021-07-17T14:14:45.1867632Z [cluster2] FGC=f33
2021-07-17T14:14:45.1868463Z [cluster2] FBR=f33
2021-07-17T14:14:45.1869024Z [cluster2] SUBMARINER_CLUSTERCIDR=10.2.0.0/16
2021-07-17T14:14:45.1869671Z [cluster2] SUBMARINER_SERVICECIDR=100.2.0.0/16
2021-07-17T14:14:45.1870326Z [cluster2] SUBMARINER_COLORCODES=blue
2021-07-17T14:14:45.1870946Z [cluster2] BROKER_K8S_APISERVER=172.18.0.9:6443
2021-07-17T14:14:45.1871659Z [cluster2] SUBMARINER_HEALTHCHECKINTERVAL=1
2021-07-17T14:14:45.1872365Z [cluster2] CE_IPSEC_FORCEENCAPS=false
2021-07-17T14:14:45.1872994Z [cluster2] SUBMARINER_GLOBALCIDR=
2021-07-17T14:14:45.1873602Z [cluster2] SUBMARINER_DEBUG=false
2021-07-17T14:14:45.1874248Z [cluster2] SUBMARINER_CABLEDRIVER=libreswan
2021-07-17T14:14:45.1875313Z [cluster2] BROKER_K8S_REMOTENAMESPACE=submariner-k8s-broker
2021-07-17T14:14:45.1876073Z [cluster2] CE_IPSEC_NATTPORT=4500
2021-07-17T14:14:45.1876830Z [cluster2] NODE_NAME=cluster2-worker
2021-07-17T14:14:45.1877417Z [cluster2] CE_IPSEC_IKEPORT=500
2021-07-17T14:14:45.1878030Z [cluster2] SUBMARINER_CLUSTERID=cluster2
2021-07-17T14:14:45.2052944Z [cluster2] BROKER_K8S_APISERVERTOKEN=***
2021-07-17T14:14:45.2714033Z [cluster2] BROKER_K8S_CA=LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:45.3353448Z [cluster2] CE_IPSEC_PSK=XcUw42J27nAO6845MnCp0S6mp5IcdCoGWjuYNdwi9TKoXkjtuEgnrMPemoApTM2C
2021-07-17T14:14:45.3355149Z [cluster2] SUBMARINER_HEALTHCHECKENABLED=true
2021-07-17T14:14:45.3356123Z [cluster2] SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT=5
2021-07-17T14:14:45.3357040Z [cluster2] CE_IPSEC_PREFERREDSERVER=false
2021-07-17T14:14:45.3358485Z [cluster2] SUBMARINER_NAMESPACE=submariner-operator
2021-07-17T14:14:45.3359270Z [cluster2] SUBMARINER_NATENABLED=false
2021-07-17T14:14:45.3361373Z [cluster2] SUBMARINER_BROKER=k8s
2021-07-17T14:14:45.3361945Z [cluster2] CE_IPSEC_DEBUG=false
2021-07-17T14:14:45.3362892Z [cluster2] POD_NAME=submariner-gateway-q2xkr
2021-07-17T14:14:45.3363714Z [cluster2] KUBERNETES_PORT=tcp://100.2.0.1:443
2021-07-17T14:14:45.3364368Z [cluster2] KUBERNETES_PORT_443_TCP_PORT=443
2021-07-17T14:14:45.3365091Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP_ADDR=100.2.5.76
2021-07-17T14:14:45.3372340Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_SERVICE_PORT=9153
2021-07-17T14:14:45.3373770Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP=tcp://100.2.168.225:8383
2021-07-17T14:14:45.3374994Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP=tcp://100.2.168.225:8686
2021-07-17T14:14:45.3376437Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP_PROTO=tcp
2021-07-17T14:14:45.3377422Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP_PROTO=udp
2021-07-17T14:14:45.3378392Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_SERVICE_HOST=100.2.187.160
2021-07-17T14:14:45.3379281Z [cluster2] KUBERNETES_PORT_443_TCP_PROTO=tcp
2021-07-17T14:14:45.3380045Z [cluster2] KUBERNETES_PORT_443_TCP_ADDR=100.2.0.1
2021-07-17T14:14:45.3380857Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP_PORT=8383
2021-07-17T14:14:45.3381808Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP=tcp://100.2.0.134:8080
2021-07-17T14:14:45.3382852Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP=tcp://100.2.214.118:8082
2021-07-17T14:14:45.3383875Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_SERVICE_HOST=100.2.5.76
2021-07-17T14:14:45.3384800Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP_PROTO=tcp
2021-07-17T14:14:45.3385726Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT=tcp://100.2.0.134:8080
2021-07-17T14:14:45.3386688Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_SERVICE_PORT=8082
2021-07-17T14:14:45.3387703Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT=tcp://100.2.214.118:8082
2021-07-17T14:14:45.3389087Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP=tcp://100.2.187.160:9153
2021-07-17T14:14:45.3391511Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_PORT_CR_METRICS=8686
2021-07-17T14:14:45.3392324Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP_ADDR=100.2.168.225
2021-07-17T14:14:45.3393128Z [cluster2] SUBMARINER_GATEWAY_METRICS_SERVICE_PORT_METRICS=8080
2021-07-17T14:14:45.3393909Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP_PORT=8080
2021-07-17T14:14:45.3394725Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP_PORT=9153
2021-07-17T14:14:45.3395536Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP_PORT=53
2021-07-17T14:14:45.3396415Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT=tcp://100.2.187.160:9153
2021-07-17T14:14:45.3397320Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_PORT_HTTP_METRICS=8383
2021-07-17T14:14:45.3398352Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_SERVICE_PORT_METRICS=8082
2021-07-17T14:14:45.3399237Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP_ADDR=100.2.214.118
2021-07-17T14:14:45.3399964Z [cluster2] KUBERNETES_SERVICE_HOST=100.2.0.1
2021-07-17T14:14:45.3400674Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP_ADDR=100.2.168.225
2021-07-17T14:14:45.3401452Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP_PROTO=tcp
2021-07-17T14:14:45.3402265Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP_PORT=8082
2021-07-17T14:14:45.3403055Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP_ADDR=100.2.0.134
2021-07-17T14:14:45.3403747Z [cluster2] KUBERNETES_SERVICE_PORT=443
2021-07-17T14:14:45.3404442Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP_PORT=8686
2021-07-17T14:14:45.3405245Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT=udp://100.2.5.76:53
2021-07-17T14:14:45.3406097Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_SERVICE_HOST=100.2.214.118
2021-07-17T14:14:45.3406910Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_SERVICE_PORT_UDP=53
2021-07-17T14:14:45.3407646Z [cluster2] KUBERNETES_SERVICE_PORT_HTTPS=443
2021-07-17T14:14:45.3408354Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_HOST=100.2.168.225
2021-07-17T14:14:45.3409181Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT=tcp://100.2.168.225:8383
2021-07-17T14:14:45.3409985Z [cluster2] SUBMARINER_GATEWAY_METRICS_SERVICE_HOST=100.2.0.134
2021-07-17T14:14:45.3410757Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP_PROTO=tcp
2021-07-17T14:14:45.3411604Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_SERVICE_PORT_METRICS=9153
2021-07-17T14:14:45.3412501Z [cluster2] KUBERNETES_PORT_443_TCP=tcp://100.2.0.1:443
2021-07-17T14:14:45.3413248Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_PORT=8383
2021-07-17T14:14:45.3414067Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP=udp://100.2.5.76:53
2021-07-17T14:14:45.3414890Z [cluster2] SUBMARINER_GATEWAY_METRICS_SERVICE_PORT=8080
2021-07-17T14:14:45.3415640Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_SERVICE_PORT=53
2021-07-17T14:14:45.3416471Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP_PROTO=tcp
2021-07-17T14:14:45.3417336Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP_ADDR=100.2.187.160
2021-07-17T14:14:45.3417999Z [cluster2] HOME=/root
2021-07-17T14:14:45.3419538Z [submariner-operator]$ [cluster2] grep BROKER_K8S_APISERVER=172.18.0.9:6443 /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.3420604Z [cluster2] BROKER_K8S_APISERVER=172.18.0.9:6443
2021-07-17T14:14:45.3422082Z [submariner-operator]$ [cluster2] grep SUBMARINER_NAMESPACE=submariner-operator /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.3423610Z [cluster2] SUBMARINER_NAMESPACE=submariner-operator
2021-07-17T14:14:45.3425039Z [submariner-operator]$ [cluster2] grep SUBMARINER_BROKER=k8s /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.3426084Z [cluster2] SUBMARINER_BROKER=k8s
2021-07-17T14:14:45.4016866Z [submariner-operator]$ [cluster2] grep BROKER_K8S_CA=LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo= /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.5336827Z [cluster2] BROKER_K8S_CA=LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOekUwTURZek5sb1hEVE14TURjeE5URTBNRFl6Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTVM4Ck51STZyaHdzMmVTMjRIY2dTVkZSSjZhdjdQOEN0dThHL3JyblhMWllpMkZab2xScjllcG9Ob2VQemlzUzUwL0sKMFdaN2ZQeCt2cTZVc0JwKzRtdDlrbk9UL09PMVN4UnlIVVJEd0srT3ZtQnM5Ky9SbzNsUEpZL09Pc0ZQbWdIUQprVzQ4RUJDTkZnYzhiQ2VHZitiQ2tWVVRuYkZZbkl0UmswKzhtWHA4MnVRVU5sLzFqa010VC9xMmtyU3FvSzhiCkRXcTdkUVRuZGF5RjA0V0p4TTIzcUNkdzNEKzdySkdIVFRCZDBJMmtyVXJ0VTRnL0Q3VWVqbUttUGozV1FycGwKa1VucndraC9LUEt1KzdXRnlVRnJvenoxMjhIZ01KekhjcFQ3Mk9RVFJlV01sR0ZTa25USkUxRVhMSE5qcU5jSQpNdHlxcTJFc0ZibUhzSWE4YVVjQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFBQkxTN01TbXVEcVdMSFZ2alJtMldoZVpIaFoKd29IUGowKzBZcTJIMUJoTVM0ZFUwdUdycllIbjhNSG9rcWJFMVVxRkZTSmU0Z3JyMkE1SXpEYkpReE8xeXlKNQp4SmtrcVRPc2g5M3BiUkExK2lVM2dOWVAxRU5nK2FRL0ttaGdvM29YRGNMVTZkUk1QU1Q0YkVrZytTd3FFN25OCnF5VjBHbEg4b2RuMG8rYnh4Vk4zUFlaVXRNdWFoZ1I5cVFtL1hSMDQ5MU1LdEg1QWUzZU53NWlUSUNSaEFzblEKNE4vZy9DRmV6ZU1ZY0NpdnpqOEc2NGJJK1dnZHJxamkrY0NSamtjSStPRXlCdEQxTGN6eVVtT0NPOGRNZm5ETgpNU2orcWhMSDB2VzZ4cjBUUy9DQ0JnUExJZTVQU3k0V0JDRnpwSEVFQzdqcnBoS09CcHMxSklNeXY2ND0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-17T14:14:45.5984220Z [submariner-operator]$ [cluster2] grep CE_IPSEC_DEBUG=false /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6002098Z [cluster2] CE_IPSEC_DEBUG=false
2021-07-17T14:14:45.6003704Z [submariner-operator]$ [cluster2] grep SUBMARINER_DEBUG=false /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6004828Z [cluster2] SUBMARINER_DEBUG=false
2021-07-17T14:14:45.6006412Z [submariner-operator]$ [cluster2] grep BROKER_K8S_REMOTENAMESPACE=submariner-k8s-broker /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6008114Z [cluster2] BROKER_K8S_REMOTENAMESPACE=submariner-k8s-broker
2021-07-17T14:14:45.6009702Z [submariner-operator]$ [cluster2] grep SUBMARINER_SERVICECIDR=100.2.0.0/16 /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6010858Z [cluster2] SUBMARINER_SERVICECIDR=100.2.0.0/16
2021-07-17T14:14:45.6012260Z [submariner-operator]$ [cluster2] grep SUBMARINER_CLUSTERCIDR=10.2.0.0/16 /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6013395Z [cluster2] SUBMARINER_CLUSTERCIDR=10.2.0.0/16
2021-07-17T14:14:45.6014731Z [submariner-operator]$ [cluster2] grep SUBMARINER_COLORCODES= /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6015863Z [cluster2] SUBMARINER_COLORCODES=blue
2021-07-17T14:14:45.6017224Z [submariner-operator]$ [cluster2] grep SUBMARINER_NATENABLED=false /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6018369Z [cluster2] SUBMARINER_NATENABLED=false
2021-07-17T14:14:45.6019640Z [submariner-operator]$ [cluster2] grep HOME=/root /tmp/submariner-gateway-q2xkr.env
2021-07-17T14:14:45.6020572Z [cluster2] HOME=/root
2021-07-17T14:14:45.6021987Z [submariner-operator]$ [cluster2] kubectl exec submariner-gateway-q2xkr --namespace=submariner-operator -- command -v command
2021-07-17T14:14:45.6024110Z [submariner-operator]$ [cluster2] kubectl exec submariner-gateway-q2xkr --namespace=submariner-operator -- command -v command
2021-07-17T14:14:45.6025901Z [submariner-operator]$ [cluster2] ator]$ [cluster1] validate_pod_container_env CE_IPSEC_IKEPORT 500
2021-07-17T14:14:45.6028022Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_IKEPORT").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:45.6030232Z [submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_NATTPORT 4500
2021-07-17T14:14:45.6031599Z [submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_NATTPORT 4500
2021-07-17T14:14:45.6034043Z [submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_NATTPORT").value /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:45.6050515Z [submariner-operator]$ [cluster1] validate_equals .spec.serviceAccount submariner-gateway
2021-07-17T14:14:45.6052238Z [submariner-operator]$ [cluster1] validate_equals .spec.serviceAccount submariner-gateway
2021-07-17T14:14:45.6054227Z [submariner-operator]$ [cluster1] jq -r -M .spec.serviceAccount /tmp/submariner-gateway-5775j.cluster1.json
2021-07-17T14:14:45.6056154Z [submariner-operator]$ [cluster1] validate_equals .status.ph
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment