Skip to content

Instantly share code, notes, and snippets.

@dfarrell07
Created July 19, 2021 22:30
Show Gist options
  • Save dfarrell07/4cfdf2021aafa0b85c6fc4b9b66e77f9 to your computer and use it in GitHub Desktop.
Save dfarrell07/4cfdf2021aafa0b85c6fc4b9b66e77f9 to your computer and use it in GitHub Desktop.
subm_random_fail_20210718
This file has been truncated, but you can view the full file.
2021-07-18T14:04:31.2495751Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-18T14:04:31.2495809Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-18T14:04:38.3765836Z Current runner version: '2.278.0'
2021-07-18T14:04:38.3794690Z ##[group]Operating System
2021-07-18T14:04:38.3795739Z Ubuntu
2021-07-18T14:04:38.3796204Z 20.04.2
2021-07-18T14:04:38.3796752Z LTS
2021-07-18T14:04:38.3797257Z ##[endgroup]
2021-07-18T14:04:38.3797941Z ##[group]Virtual Environment
2021-07-18T14:04:38.3798626Z Environment: ubuntu-20.04
2021-07-18T14:04:38.3799268Z Version: 20210712.0
2021-07-18T14:04:38.3800434Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-18T14:04:38.3801937Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-18T14:04:38.3802953Z ##[endgroup]
2021-07-18T14:04:38.3805081Z ##[group]GITHUB_TOKEN Permissions
2021-07-18T14:04:38.3806397Z Actions: write
2021-07-18T14:04:38.3807021Z Checks: write
2021-07-18T14:04:38.3807573Z Contents: write
2021-07-18T14:04:38.3808189Z Deployments: write
2021-07-18T14:04:38.3808914Z Discussions: write
2021-07-18T14:04:38.3809562Z Issues: write
2021-07-18T14:04:38.3810094Z Metadata: read
2021-07-18T14:04:38.3810705Z Packages: write
2021-07-18T14:04:38.3811287Z PullRequests: write
2021-07-18T14:04:38.3812010Z RepositoryProjects: write
2021-07-18T14:04:38.3812696Z SecurityEvents: write
2021-07-18T14:04:38.3813399Z Statuses: write
2021-07-18T14:04:38.3814078Z ##[endgroup]
2021-07-18T14:04:38.3817444Z Prepare workflow directory
2021-07-18T14:04:38.4507744Z Prepare all required actions
2021-07-18T14:04:38.4521073Z Getting action download info
2021-07-18T14:04:38.7155318Z Download action repository 'actions/checkout@v2'
2021-07-18T14:04:40.4386419Z Download action repository 'submariner-io/shipyard@devel'
2021-07-18T14:04:40.8389333Z ##[group]Run actions/checkout@v2
2021-07-18T14:04:40.8390077Z with:
2021-07-18T14:04:40.8390789Z repository: submariner-io/submariner-operator
2021-07-18T14:04:40.8391941Z token: ***
2021-07-18T14:04:40.8392460Z ssh-strict: true
2021-07-18T14:04:40.8393107Z persist-credentials: true
2021-07-18T14:04:40.8393744Z clean: true
2021-07-18T14:04:40.8394259Z fetch-depth: 1
2021-07-18T14:04:40.8394782Z lfs: false
2021-07-18T14:04:40.8395291Z submodules: false
2021-07-18T14:04:40.8395831Z ##[endgroup]
2021-07-18T14:04:41.0674061Z Syncing repository: submariner-io/submariner-operator
2021-07-18T14:04:41.0675204Z ##[group]Getting Git version info
2021-07-18T14:04:41.0676451Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-18T14:04:41.0694022Z [command]/usr/bin/git version
2021-07-18T14:04:41.0821580Z git version 2.32.0
2021-07-18T14:04:41.0843395Z ##[endgroup]
2021-07-18T14:04:41.0851190Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-18T14:04:41.0854709Z ##[group]Initializing the repository
2021-07-18T14:04:41.0859024Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-18T14:04:41.0943399Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-18T14:04:41.0944685Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-18T14:04:41.0947051Z hint: of your new repositories, which will suppress this warning, call:
2021-07-18T14:04:41.0947910Z hint:
2021-07-18T14:04:41.0948978Z hint: git config --global init.defaultBranch <name>
2021-07-18T14:04:41.0949819Z hint:
2021-07-18T14:04:41.0950842Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-18T14:04:41.0952197Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-18T14:04:41.0953090Z hint:
2021-07-18T14:04:41.0953925Z hint: git branch -m <name>
2021-07-18T14:04:41.0966150Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-18T14:04:41.0978016Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-18T14:04:41.1017186Z ##[endgroup]
2021-07-18T14:04:41.1018192Z ##[group]Disabling automatic garbage collection
2021-07-18T14:04:41.1022118Z [command]/usr/bin/git config --local gc.auto 0
2021-07-18T14:04:41.1059389Z ##[endgroup]
2021-07-18T14:04:41.1063980Z ##[group]Setting up auth
2021-07-18T14:04:41.1071591Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-18T14:04:41.1103217Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-18T14:04:41.1469593Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-18T14:04:41.1520151Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-18T14:04:41.1735820Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-18T14:04:41.1777970Z ##[endgroup]
2021-07-18T14:04:41.1778936Z ##[group]Fetching the repository
2021-07-18T14:04:41.1787859Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-18T14:04:41.5300067Z remote: Enumerating objects: 486, done.
2021-07-18T14:04:41.5300979Z remote: Counting objects: 0% (1/486)
2021-07-18T14:04:41.5301774Z remote: Counting objects: 1% (5/486)
2021-07-18T14:04:41.5302559Z remote: Counting objects: 2% (10/486)
2021-07-18T14:04:41.5303341Z remote: Counting objects: 3% (15/486)
2021-07-18T14:04:41.5304257Z remote: Counting objects: 4% (20/486)
2021-07-18T14:04:41.5305814Z remote: Counting objects: 5% (25/486)
2021-07-18T14:04:41.5306636Z remote: Counting objects: 6% (30/486)
2021-07-18T14:04:41.5307408Z remote: Counting objects: 7% (35/486)
2021-07-18T14:04:41.5308224Z remote: Counting objects: 8% (39/486)
2021-07-18T14:04:41.5309000Z remote: Counting objects: 9% (44/486)
2021-07-18T14:04:41.5309788Z remote: Counting objects: 10% (49/486)
2021-07-18T14:04:41.5310574Z remote: Counting objects: 11% (54/486)
2021-07-18T14:04:41.5311338Z remote: Counting objects: 12% (59/486)
2021-07-18T14:04:41.5312121Z remote: Counting objects: 13% (64/486)
2021-07-18T14:04:41.5312908Z remote: Counting objects: 14% (69/486)
2021-07-18T14:04:41.5313667Z remote: Counting objects: 15% (73/486)
2021-07-18T14:04:41.5314449Z remote: Counting objects: 16% (78/486)
2021-07-18T14:04:41.5315226Z remote: Counting objects: 17% (83/486)
2021-07-18T14:04:41.5316014Z remote: Counting objects: 18% (88/486)
2021-07-18T14:04:41.5316792Z remote: Counting objects: 19% (93/486)
2021-07-18T14:04:41.5317560Z remote: Counting objects: 20% (98/486)
2021-07-18T14:04:41.5318341Z remote: Counting objects: 21% (103/486)
2021-07-18T14:04:41.5319128Z remote: Counting objects: 22% (107/486)
2021-07-18T14:04:41.5320167Z remote: Counting objects: 23% (112/486)
2021-07-18T14:04:41.5320946Z remote: Counting objects: 24% (117/486)
2021-07-18T14:04:41.5321703Z remote: Counting objects: 25% (122/486)
2021-07-18T14:04:41.5322559Z remote: Counting objects: 26% (127/486)
2021-07-18T14:04:41.5323330Z remote: Counting objects: 27% (132/486)
2021-07-18T14:04:41.5324104Z remote: Counting objects: 28% (137/486)
2021-07-18T14:04:41.5324885Z remote: Counting objects: 29% (141/486)
2021-07-18T14:04:41.5325657Z remote: Counting objects: 30% (146/486)
2021-07-18T14:04:41.5326439Z remote: Counting objects: 31% (151/486)
2021-07-18T14:04:41.5327218Z remote: Counting objects: 32% (156/486)
2021-07-18T14:04:41.5327981Z remote: Counting objects: 33% (161/486)
2021-07-18T14:04:41.5328761Z remote: Counting objects: 34% (166/486)
2021-07-18T14:04:41.5329672Z remote: Counting objects: 35% (171/486)
2021-07-18T14:04:41.5330485Z remote: Counting objects: 36% (175/486)
2021-07-18T14:04:41.5331305Z remote: Counting objects: 37% (180/486)
2021-07-18T14:04:41.5332068Z remote: Counting objects: 38% (185/486)
2021-07-18T14:04:41.5332845Z remote: Counting objects: 39% (190/486)
2021-07-18T14:04:41.5333607Z remote: Counting objects: 40% (195/486)
2021-07-18T14:04:41.5334383Z remote: Counting objects: 41% (200/486)
2021-07-18T14:04:41.5335159Z remote: Counting objects: 42% (205/486)
2021-07-18T14:04:41.5335927Z remote: Counting objects: 43% (209/486)
2021-07-18T14:04:41.5336713Z remote: Counting objects: 44% (214/486)
2021-07-18T14:04:41.5337473Z remote: Counting objects: 45% (219/486)
2021-07-18T14:04:41.5338248Z remote: Counting objects: 46% (224/486)
2021-07-18T14:04:41.5339027Z remote: Counting objects: 47% (229/486)
2021-07-18T14:04:41.5339799Z remote: Counting objects: 48% (234/486)
2021-07-18T14:04:41.5340566Z remote: Counting objects: 49% (239/486)
2021-07-18T14:04:41.5341345Z remote: Counting objects: 50% (243/486)
2021-07-18T14:04:41.5342101Z remote: Counting objects: 51% (248/486)
2021-07-18T14:04:41.5342953Z remote: Counting objects: 52% (253/486)
2021-07-18T14:04:41.5343719Z remote: Counting objects: 53% (258/486)
2021-07-18T14:04:41.5344489Z remote: Counting objects: 54% (263/486)
2021-07-18T14:04:41.5346274Z remote: Counting objects: 55% (268/486)
2021-07-18T14:04:41.5347155Z remote: Counting objects: 56% (273/486)
2021-07-18T14:04:41.5347956Z remote: Counting objects: 57% (278/486)
2021-07-18T14:04:41.5348721Z remote: Counting objects: 58% (282/486)
2021-07-18T14:04:41.5349490Z remote: Counting objects: 59% (287/486)
2021-07-18T14:04:41.5350263Z remote: Counting objects: 60% (292/486)
2021-07-18T14:04:41.5351029Z remote: Counting objects: 61% (297/486)
2021-07-18T14:04:41.5351803Z remote: Counting objects: 62% (302/486)
2021-07-18T14:04:41.5352562Z remote: Counting objects: 63% (307/486)
2021-07-18T14:04:41.5353614Z remote: Counting objects: 64% (312/486)
2021-07-18T14:04:41.5354392Z remote: Counting objects: 65% (316/486)
2021-07-18T14:04:41.5355167Z remote: Counting objects: 66% (321/486)
2021-07-18T14:04:41.5355928Z remote: Counting objects: 67% (326/486)
2021-07-18T14:04:41.5356701Z remote: Counting objects: 68% (331/486)
2021-07-18T14:04:41.5357453Z remote: Counting objects: 69% (336/486)
2021-07-18T14:04:41.5358238Z remote: Counting objects: 70% (341/486)
2021-07-18T14:04:41.5359015Z remote: Counting objects: 71% (346/486)
2021-07-18T14:04:41.5359775Z remote: Counting objects: 72% (350/486)
2021-07-18T14:04:41.5360547Z remote: Counting objects: 73% (355/486)
2021-07-18T14:04:41.5361353Z remote: Counting objects: 74% (360/486)
2021-07-18T14:04:41.5362129Z remote: Counting objects: 75% (365/486)
2021-07-18T14:04:41.5362904Z remote: Counting objects: 76% (370/486)
2021-07-18T14:04:41.5363664Z remote: Counting objects: 77% (375/486)
2021-07-18T14:04:41.5364433Z remote: Counting objects: 78% (380/486)
2021-07-18T14:04:41.5365206Z remote: Counting objects: 79% (384/486)
2021-07-18T14:04:41.5366062Z remote: Counting objects: 80% (389/486)
2021-07-18T14:04:41.5366781Z remote: Counting objects: 81% (394/486)
2021-07-18T14:04:41.5367483Z remote: Counting objects: 82% (399/486)
2021-07-18T14:04:41.5368208Z remote: Counting objects: 83% (404/486)
2021-07-18T14:04:41.5369097Z remote: Counting objects: 84% (409/486)
2021-07-18T14:04:41.5369856Z remote: Counting objects: 85% (414/486)
2021-07-18T14:04:41.5370632Z remote: Counting objects: 86% (418/486)
2021-07-18T14:04:41.5371515Z remote: Counting objects: 87% (423/486)
2021-07-18T14:04:41.5372285Z remote: Counting objects: 88% (428/486)
2021-07-18T14:04:41.5373060Z remote: Counting objects: 89% (433/486)
2021-07-18T14:04:41.5373817Z remote: Counting objects: 90% (438/486)
2021-07-18T14:04:41.5374596Z remote: Counting objects: 91% (443/486)
2021-07-18T14:04:41.5375352Z remote: Counting objects: 92% (448/486)
2021-07-18T14:04:41.5376124Z remote: Counting objects: 93% (452/486)
2021-07-18T14:04:41.5376895Z remote: Counting objects: 94% (457/486)
2021-07-18T14:04:41.5377651Z remote: Counting objects: 95% (462/486)
2021-07-18T14:04:41.5378434Z remote: Counting objects: 96% (467/486)
2021-07-18T14:04:41.5379197Z remote: Counting objects: 97% (472/486)
2021-07-18T14:04:41.5379972Z remote: Counting objects: 98% (477/486)
2021-07-18T14:04:41.5380741Z remote: Counting objects: 99% (482/486)
2021-07-18T14:04:41.5381501Z remote: Counting objects: 100% (486/486)
2021-07-18T14:04:41.5382308Z remote: Counting objects: 100% (486/486), done.
2021-07-18T14:04:41.5383133Z remote: Compressing objects: 0% (1/353)
2021-07-18T14:04:41.5383938Z remote: Compressing objects: 1% (4/353)
2021-07-18T14:04:41.5384917Z remote: Compressing objects: 2% (8/353)
2021-07-18T14:04:41.5386003Z remote: Compressing objects: 3% (11/353)
2021-07-18T14:04:41.5386836Z remote: Compressing objects: 4% (15/353)
2021-07-18T14:04:41.5387663Z remote: Compressing objects: 5% (18/353)
2021-07-18T14:04:41.5388545Z remote: Compressing objects: 6% (22/353)
2021-07-18T14:04:41.5389473Z remote: Compressing objects: 7% (25/353)
2021-07-18T14:04:41.5390308Z remote: Compressing objects: 8% (29/353)
2021-07-18T14:04:41.5391130Z remote: Compressing objects: 9% (32/353)
2021-07-18T14:04:41.5391952Z remote: Compressing objects: 10% (36/353)
2021-07-18T14:04:41.5392772Z remote: Compressing objects: 11% (39/353)
2021-07-18T14:04:41.5393605Z remote: Compressing objects: 12% (43/353)
2021-07-18T14:04:41.5394420Z remote: Compressing objects: 13% (46/353)
2021-07-18T14:04:41.5395228Z remote: Compressing objects: 14% (50/353)
2021-07-18T14:04:41.5396047Z remote: Compressing objects: 15% (53/353)
2021-07-18T14:04:41.5396857Z remote: Compressing objects: 16% (57/353)
2021-07-18T14:04:41.5397675Z remote: Compressing objects: 17% (61/353)
2021-07-18T14:04:41.5398493Z remote: Compressing objects: 18% (64/353)
2021-07-18T14:04:41.5399305Z remote: Compressing objects: 19% (68/353)
2021-07-18T14:04:41.5400123Z remote: Compressing objects: 20% (71/353)
2021-07-18T14:04:41.5400927Z remote: Compressing objects: 21% (75/353)
2021-07-18T14:04:41.5401820Z remote: Compressing objects: 22% (78/353)
2021-07-18T14:04:41.5402580Z remote: Compressing objects: 23% (82/353)
2021-07-18T14:04:41.5403337Z remote: Compressing objects: 24% (85/353)
2021-07-18T14:04:41.5404291Z remote: Compressing objects: 25% (89/353)
2021-07-18T14:04:41.5405095Z remote: Compressing objects: 26% (92/353)
2021-07-18T14:04:41.5405907Z remote: Compressing objects: 27% (96/353)
2021-07-18T14:04:41.5406727Z remote: Compressing objects: 28% (99/353)
2021-07-18T14:04:41.5407532Z remote: Compressing objects: 29% (103/353)
2021-07-18T14:04:41.5408350Z remote: Compressing objects: 30% (106/353)
2021-07-18T14:04:41.5409171Z remote: Compressing objects: 31% (110/353)
2021-07-18T14:04:41.5409992Z remote: Compressing objects: 32% (113/353)
2021-07-18T14:04:41.5410819Z remote: Compressing objects: 33% (117/353)
2021-07-18T14:04:41.5411626Z remote: Compressing objects: 34% (121/353)
2021-07-18T14:04:41.5412449Z remote: Compressing objects: 35% (124/353)
2021-07-18T14:04:41.5413266Z remote: Compressing objects: 36% (128/353)
2021-07-18T14:04:41.5414191Z remote: Compressing objects: 37% (131/353)
2021-07-18T14:04:41.5415013Z remote: Compressing objects: 38% (135/353)
2021-07-18T14:04:41.5415814Z remote: Compressing objects: 39% (138/353)
2021-07-18T14:04:41.5416632Z remote: Compressing objects: 40% (142/353)
2021-07-18T14:04:41.5417454Z remote: Compressing objects: 41% (145/353)
2021-07-18T14:04:41.5418260Z remote: Compressing objects: 42% (149/353)
2021-07-18T14:04:41.5419076Z remote: Compressing objects: 43% (152/353)
2021-07-18T14:04:41.5419895Z remote: Compressing objects: 44% (156/353)
2021-07-18T14:04:41.5420711Z remote: Compressing objects: 45% (159/353)
2021-07-18T14:04:41.5421527Z remote: Compressing objects: 46% (163/353)
2021-07-18T14:04:41.5422338Z remote: Compressing objects: 47% (166/353)
2021-07-18T14:04:41.5423154Z remote: Compressing objects: 48% (170/353)
2021-07-18T14:04:41.5424016Z remote: Compressing objects: 49% (173/353)
2021-07-18T14:04:41.5426459Z remote: Compressing objects: 50% (177/353)
2021-07-18T14:04:41.5427301Z remote: Compressing objects: 51% (181/353)
2021-07-18T14:04:41.5428112Z remote: Compressing objects: 52% (184/353)
2021-07-18T14:04:41.5428926Z remote: Compressing objects: 53% (188/353)
2021-07-18T14:04:41.5429748Z remote: Compressing objects: 54% (191/353)
2021-07-18T14:04:41.5430582Z remote: Compressing objects: 55% (195/353)
2021-07-18T14:04:41.5431409Z remote: Compressing objects: 56% (198/353)
2021-07-18T14:04:41.5432227Z remote: Compressing objects: 57% (202/353)
2021-07-18T14:04:41.5433131Z remote: Compressing objects: 58% (205/353)
2021-07-18T14:04:41.5433977Z remote: Compressing objects: 59% (209/353)
2021-07-18T14:04:41.5434848Z remote: Compressing objects: 60% (212/353)
2021-07-18T14:04:41.5435663Z remote: Compressing objects: 61% (216/353)
2021-07-18T14:04:41.5436504Z remote: Compressing objects: 62% (219/353)
2021-07-18T14:04:41.5437308Z remote: Compressing objects: 63% (223/353)
2021-07-18T14:04:41.5438132Z remote: Compressing objects: 64% (226/353)
2021-07-18T14:04:41.5438938Z remote: Compressing objects: 65% (230/353)
2021-07-18T14:04:41.5439756Z remote: Compressing objects: 66% (233/353)
2021-07-18T14:04:41.5440574Z remote: Compressing objects: 67% (237/353)
2021-07-18T14:04:41.5441375Z remote: Compressing objects: 68% (241/353)
2021-07-18T14:04:41.5442192Z remote: Compressing objects: 69% (244/353)
2021-07-18T14:04:41.5443004Z remote: Compressing objects: 70% (248/353)
2021-07-18T14:04:41.5443827Z remote: Compressing objects: 71% (251/353)
2021-07-18T14:04:41.5444644Z remote: Compressing objects: 72% (255/353)
2021-07-18T14:04:41.5445448Z remote: Compressing objects: 73% (258/353)
2021-07-18T14:04:41.5446268Z remote: Compressing objects: 74% (262/353)
2021-07-18T14:04:41.5447099Z remote: Compressing objects: 75% (265/353)
2021-07-18T14:04:41.5447908Z remote: Compressing objects: 76% (269/353)
2021-07-18T14:04:41.5448726Z remote: Compressing objects: 77% (272/353)
2021-07-18T14:04:41.5449529Z remote: Compressing objects: 78% (276/353)
2021-07-18T14:04:41.5450346Z remote: Compressing objects: 79% (279/353)
2021-07-18T14:04:41.5451164Z remote: Compressing objects: 80% (283/353)
2021-07-18T14:04:41.5451971Z remote: Compressing objects: 81% (286/353)
2021-07-18T14:04:41.5452807Z remote: Compressing objects: 82% (290/353)
2021-07-18T14:04:41.5453619Z remote: Compressing objects: 83% (293/353)
2021-07-18T14:04:41.5454442Z remote: Compressing objects: 84% (297/353)
2021-07-18T14:04:41.5455262Z remote: Compressing objects: 85% (301/353)
2021-07-18T14:04:41.5456070Z remote: Compressing objects: 86% (304/353)
2021-07-18T14:04:41.5456990Z remote: Compressing objects: 87% (308/353)
2021-07-18T14:04:41.5457807Z remote: Compressing objects: 88% (311/353)
2021-07-18T14:04:41.5458611Z remote: Compressing objects: 89% (315/353)
2021-07-18T14:04:41.5459454Z remote: Compressing objects: 90% (318/353)
2021-07-18T14:04:41.5460276Z remote: Compressing objects: 91% (322/353)
2021-07-18T14:04:41.5461082Z remote: Compressing objects: 92% (325/353)
2021-07-18T14:04:41.5461901Z remote: Compressing objects: 93% (329/353)
2021-07-18T14:04:41.5462726Z remote: Compressing objects: 94% (332/353)
2021-07-18T14:04:41.5463547Z remote: Compressing objects: 95% (336/353)
2021-07-18T14:04:41.5464368Z remote: Compressing objects: 96% (339/353)
2021-07-18T14:04:41.5465319Z remote: Compressing objects: 97% (343/353)
2021-07-18T14:04:41.5466130Z remote: Compressing objects: 98% (346/353)
2021-07-18T14:04:41.5466953Z remote: Compressing objects: 99% (350/353)
2021-07-18T14:04:41.5467770Z remote: Compressing objects: 100% (353/353)
2021-07-18T14:04:41.5468610Z remote: Compressing objects: 100% (353/353), done.
2021-07-18T14:04:41.5469393Z Receiving objects: 0% (1/486)
2021-07-18T14:04:41.5470092Z Receiving objects: 1% (5/486)
2021-07-18T14:04:41.5470816Z Receiving objects: 2% (10/486)
2021-07-18T14:04:41.5471526Z Receiving objects: 3% (15/486)
2021-07-18T14:04:41.5472242Z Receiving objects: 4% (20/486)
2021-07-18T14:04:41.5472963Z Receiving objects: 5% (25/486)
2021-07-18T14:04:41.5473672Z Receiving objects: 6% (30/486)
2021-07-18T14:04:41.5474384Z Receiving objects: 7% (35/486)
2021-07-18T14:04:41.5475180Z Receiving objects: 8% (39/486)
2021-07-18T14:04:41.5475917Z Receiving objects: 9% (44/486)
2021-07-18T14:04:41.5476638Z Receiving objects: 10% (49/486)
2021-07-18T14:04:41.5477344Z Receiving objects: 11% (54/486)
2021-07-18T14:04:41.5478064Z Receiving objects: 12% (59/486)
2021-07-18T14:04:41.5478769Z Receiving objects: 13% (64/486)
2021-07-18T14:04:41.5479492Z Receiving objects: 14% (69/486)
2021-07-18T14:04:41.5480204Z Receiving objects: 15% (73/486)
2021-07-18T14:04:41.5480907Z Receiving objects: 16% (78/486)
2021-07-18T14:04:41.5481626Z Receiving objects: 17% (83/486)
2021-07-18T14:04:41.5482334Z Receiving objects: 18% (88/486)
2021-07-18T14:04:41.5483049Z Receiving objects: 19% (93/486)
2021-07-18T14:04:41.5483769Z Receiving objects: 20% (98/486)
2021-07-18T14:04:41.5484552Z Receiving objects: 21% (103/486)
2021-07-18T14:04:41.5485225Z Receiving objects: 22% (107/486)
2021-07-18T14:04:41.5485884Z Receiving objects: 23% (112/486)
2021-07-18T14:04:41.5486558Z Receiving objects: 24% (117/486)
2021-07-18T14:04:41.5487224Z Receiving objects: 25% (122/486)
2021-07-18T14:04:41.5488006Z Receiving objects: 26% (127/486)
2021-07-18T14:04:41.5488859Z Receiving objects: 27% (132/486)
2021-07-18T14:04:41.5489565Z Receiving objects: 28% (137/486)
2021-07-18T14:04:41.5490283Z Receiving objects: 29% (141/486)
2021-07-18T14:04:41.5491012Z Receiving objects: 30% (146/486)
2021-07-18T14:04:41.5491715Z Receiving objects: 31% (151/486)
2021-07-18T14:04:41.5492438Z Receiving objects: 32% (156/486)
2021-07-18T14:04:41.5493141Z Receiving objects: 33% (161/486)
2021-07-18T14:04:41.5493856Z Receiving objects: 34% (166/486)
2021-07-18T14:04:41.5494573Z Receiving objects: 35% (171/486)
2021-07-18T14:04:41.5495272Z Receiving objects: 36% (175/486)
2021-07-18T14:04:41.5495990Z Receiving objects: 37% (180/486)
2021-07-18T14:04:41.5496698Z Receiving objects: 38% (185/486)
2021-07-18T14:04:41.5497414Z Receiving objects: 39% (190/486)
2021-07-18T14:04:41.5498130Z Receiving objects: 40% (195/486)
2021-07-18T14:04:41.5498842Z Receiving objects: 41% (200/486)
2021-07-18T14:04:41.5499557Z Receiving objects: 42% (205/486)
2021-07-18T14:04:41.5500259Z Receiving objects: 43% (209/486)
2021-07-18T14:04:41.5500977Z Receiving objects: 44% (214/486)
2021-07-18T14:04:41.5501689Z Receiving objects: 45% (219/486)
2021-07-18T14:04:41.5502488Z Receiving objects: 46% (224/486)
2021-07-18T14:04:41.5503215Z Receiving objects: 47% (229/486)
2021-07-18T14:04:41.5504000Z Receiving objects: 48% (234/486)
2021-07-18T14:04:41.5505001Z Receiving objects: 49% (239/486)
2021-07-18T14:04:41.5505738Z Receiving objects: 50% (243/486)
2021-07-18T14:04:41.5506442Z Receiving objects: 51% (248/486)
2021-07-18T14:04:41.5507155Z Receiving objects: 52% (253/486)
2021-07-18T14:04:41.5507858Z Receiving objects: 53% (258/486)
2021-07-18T14:04:41.5508570Z Receiving objects: 54% (263/486)
2021-07-18T14:04:41.5509284Z Receiving objects: 55% (268/486)
2021-07-18T14:04:41.5509984Z Receiving objects: 56% (273/486)
2021-07-18T14:04:41.5510713Z Receiving objects: 57% (278/486)
2021-07-18T14:04:41.5511415Z Receiving objects: 58% (282/486)
2021-07-18T14:04:41.5512140Z Receiving objects: 59% (287/486)
2021-07-18T14:04:41.5512859Z Receiving objects: 60% (292/486)
2021-07-18T14:04:41.5513571Z Receiving objects: 61% (297/486)
2021-07-18T14:04:41.5514290Z Receiving objects: 62% (302/486)
2021-07-18T14:04:41.5515004Z Receiving objects: 63% (307/486)
2021-07-18T14:04:41.5515724Z Receiving objects: 64% (312/486)
2021-07-18T14:04:41.5516444Z Receiving objects: 65% (316/486)
2021-07-18T14:04:41.5517144Z Receiving objects: 66% (321/486)
2021-07-18T14:04:41.5517862Z Receiving objects: 67% (326/486)
2021-07-18T14:04:41.5518561Z Receiving objects: 68% (331/486)
2021-07-18T14:04:41.5519278Z Receiving objects: 69% (336/486)
2021-07-18T14:04:41.5519992Z Receiving objects: 70% (341/486)
2021-07-18T14:04:41.5520697Z Receiving objects: 71% (346/486)
2021-07-18T14:04:41.5521412Z Receiving objects: 72% (350/486)
2021-07-18T14:04:41.5522381Z Receiving objects: 73% (355/486)
2021-07-18T14:04:41.5523072Z Receiving objects: 74% (360/486)
2021-07-18T14:04:41.5523913Z Receiving objects: 75% (365/486)
2021-07-18T14:04:41.5524613Z Receiving objects: 76% (370/486)
2021-07-18T14:04:41.5525328Z Receiving objects: 77% (375/486)
2021-07-18T14:04:41.5526028Z Receiving objects: 78% (380/486)
2021-07-18T14:04:41.5526747Z Receiving objects: 79% (384/486)
2021-07-18T14:04:41.5527459Z Receiving objects: 80% (389/486)
2021-07-18T14:04:41.5528158Z Receiving objects: 81% (394/486)
2021-07-18T14:04:41.5528875Z Receiving objects: 82% (399/486)
2021-07-18T14:04:41.5529572Z Receiving objects: 83% (404/486)
2021-07-18T14:04:41.5530311Z Receiving objects: 84% (409/486)
2021-07-18T14:04:41.5531028Z Receiving objects: 85% (414/486)
2021-07-18T14:04:41.5531728Z Receiving objects: 86% (418/486)
2021-07-18T14:04:41.5532444Z Receiving objects: 87% (423/486)
2021-07-18T14:04:41.5533143Z Receiving objects: 88% (428/486)
2021-07-18T14:04:41.5533868Z Receiving objects: 89% (433/486)
2021-07-18T14:04:41.5534589Z Receiving objects: 90% (438/486)
2021-07-18T14:04:41.5535329Z Receiving objects: 91% (443/486)
2021-07-18T14:04:41.5536048Z Receiving objects: 92% (448/486)
2021-07-18T14:04:41.5536746Z Receiving objects: 93% (452/486)
2021-07-18T14:04:41.5537462Z Receiving objects: 94% (457/486)
2021-07-18T14:04:41.5538186Z Receiving objects: 95% (462/486)
2021-07-18T14:04:41.5538886Z Receiving objects: 96% (467/486)
2021-07-18T14:04:41.5540448Z remote: Total 486 (delta 154), reused 304 (delta 87), pack-reused 0
2021-07-18T14:04:41.5541311Z Receiving objects: 97% (472/486)
2021-07-18T14:04:41.5542042Z Receiving objects: 98% (477/486)
2021-07-18T14:04:41.5542765Z Receiving objects: 99% (482/486)
2021-07-18T14:04:41.5543473Z Receiving objects: 100% (486/486)
2021-07-18T14:04:41.5544256Z Receiving objects: 100% (486/486), 349.02 KiB | 7.27 MiB/s, done.
2021-07-18T14:04:41.5545148Z Resolving deltas: 0% (0/154)
2021-07-18T14:04:41.5545850Z Resolving deltas: 1% (2/154)
2021-07-18T14:04:41.5546570Z Resolving deltas: 2% (4/154)
2021-07-18T14:04:41.5547261Z Resolving deltas: 3% (5/154)
2021-07-18T14:04:41.5547963Z Resolving deltas: 4% (7/154)
2021-07-18T14:04:41.5548663Z Resolving deltas: 5% (8/154)
2021-07-18T14:04:41.5549347Z Resolving deltas: 6% (10/154)
2021-07-18T14:04:41.5550054Z Resolving deltas: 7% (11/154)
2021-07-18T14:04:41.5550879Z Resolving deltas: 8% (13/154)
2021-07-18T14:04:41.5551582Z Resolving deltas: 9% (14/154)
2021-07-18T14:04:41.5552272Z Resolving deltas: 10% (16/154)
2021-07-18T14:04:41.5552971Z Resolving deltas: 11% (17/154)
2021-07-18T14:04:41.5553675Z Resolving deltas: 12% (19/154)
2021-07-18T14:04:41.5554362Z Resolving deltas: 13% (21/154)
2021-07-18T14:04:41.5555060Z Resolving deltas: 14% (22/154)
2021-07-18T14:04:41.5555742Z Resolving deltas: 15% (24/154)
2021-07-18T14:04:41.5556444Z Resolving deltas: 16% (25/154)
2021-07-18T14:04:41.5557143Z Resolving deltas: 17% (27/154)
2021-07-18T14:04:41.5557831Z Resolving deltas: 18% (28/154)
2021-07-18T14:04:41.5558537Z Resolving deltas: 19% (30/154)
2021-07-18T14:04:41.5559223Z Resolving deltas: 20% (31/154)
2021-07-18T14:04:41.5559920Z Resolving deltas: 21% (33/154)
2021-07-18T14:04:41.5560621Z Resolving deltas: 22% (34/154)
2021-07-18T14:04:41.5561311Z Resolving deltas: 23% (36/154)
2021-07-18T14:04:41.5562015Z Resolving deltas: 24% (37/154)
2021-07-18T14:04:41.5562705Z Resolving deltas: 25% (39/154)
2021-07-18T14:04:41.5563407Z Resolving deltas: 26% (41/154)
2021-07-18T14:04:41.5564108Z Resolving deltas: 27% (42/154)
2021-07-18T14:04:41.5564796Z Resolving deltas: 28% (44/154)
2021-07-18T14:04:41.5565490Z Resolving deltas: 29% (45/154)
2021-07-18T14:04:41.5566170Z Resolving deltas: 30% (47/154)
2021-07-18T14:04:41.5566870Z Resolving deltas: 31% (48/154)
2021-07-18T14:04:41.5567580Z Resolving deltas: 32% (50/154)
2021-07-18T14:04:41.5568273Z Resolving deltas: 33% (51/154)
2021-07-18T14:04:41.5568976Z Resolving deltas: 34% (53/154)
2021-07-18T14:04:41.5569746Z Resolving deltas: 35% (54/154)
2021-07-18T14:04:41.5570464Z Resolving deltas: 36% (56/154)
2021-07-18T14:04:41.5571172Z Resolving deltas: 37% (57/154)
2021-07-18T14:04:41.5571857Z Resolving deltas: 38% (59/154)
2021-07-18T14:04:41.5572556Z Resolving deltas: 39% (61/154)
2021-07-18T14:04:41.5573245Z Resolving deltas: 40% (62/154)
2021-07-18T14:04:41.5573956Z Resolving deltas: 41% (64/154)
2021-07-18T14:04:41.5574660Z Resolving deltas: 42% (65/154)
2021-07-18T14:04:41.5575344Z Resolving deltas: 43% (67/154)
2021-07-18T14:04:41.5576044Z Resolving deltas: 44% (68/154)
2021-07-18T14:04:41.5576733Z Resolving deltas: 45% (70/154)
2021-07-18T14:04:41.5577466Z Resolving deltas: 46% (71/154)
2021-07-18T14:04:41.5578167Z Resolving deltas: 47% (73/154)
2021-07-18T14:04:41.5578970Z Resolving deltas: 48% (74/154)
2021-07-18T14:04:41.5579911Z Resolving deltas: 49% (76/154)
2021-07-18T14:04:41.5580658Z Resolving deltas: 50% (77/154)
2021-07-18T14:04:41.5581359Z Resolving deltas: 51% (79/154)
2021-07-18T14:04:41.5582074Z Resolving deltas: 52% (81/154)
2021-07-18T14:04:41.5582763Z Resolving deltas: 53% (82/154)
2021-07-18T14:04:41.5583459Z Resolving deltas: 54% (84/154)
2021-07-18T14:04:41.5584148Z Resolving deltas: 55% (85/154)
2021-07-18T14:04:41.5585008Z Resolving deltas: 56% (87/154)
2021-07-18T14:04:41.5604270Z Resolving deltas: 57% (88/154)
2021-07-18T14:04:41.5657111Z Resolving deltas: 58% (90/154)
2021-07-18T14:04:41.5657965Z Resolving deltas: 59% (91/154)
2021-07-18T14:04:41.5658687Z Resolving deltas: 60% (93/154)
2021-07-18T14:04:41.5659388Z Resolving deltas: 61% (94/154)
2021-07-18T14:04:41.5660097Z Resolving deltas: 62% (96/154)
2021-07-18T14:04:41.5660788Z Resolving deltas: 63% (98/154)
2021-07-18T14:04:41.5661498Z Resolving deltas: 64% (99/154)
2021-07-18T14:04:41.5662204Z Resolving deltas: 65% (101/154)
2021-07-18T14:04:41.5662898Z Resolving deltas: 66% (102/154)
2021-07-18T14:04:41.5663609Z Resolving deltas: 67% (104/154)
2021-07-18T14:04:41.5664308Z Resolving deltas: 68% (105/154)
2021-07-18T14:04:41.5665204Z Resolving deltas: 69% (107/154)
2021-07-18T14:04:41.5665940Z Resolving deltas: 70% (108/154)
2021-07-18T14:04:41.5666716Z Resolving deltas: 71% (110/154)
2021-07-18T14:04:41.5667376Z Resolving deltas: 72% (111/154)
2021-07-18T14:04:41.5668023Z Resolving deltas: 73% (113/154)
2021-07-18T14:04:41.5668680Z Resolving deltas: 74% (114/154)
2021-07-18T14:04:41.5669781Z Resolving deltas: 75% (116/154)
2021-07-18T14:04:41.5670477Z Resolving deltas: 76% (118/154)
2021-07-18T14:04:41.5671185Z Resolving deltas: 77% (119/154)
2021-07-18T14:04:41.5671883Z Resolving deltas: 78% (121/154)
2021-07-18T14:04:41.5672593Z Resolving deltas: 79% (122/154)
2021-07-18T14:04:41.5673300Z Resolving deltas: 80% (124/154)
2021-07-18T14:04:41.5673993Z Resolving deltas: 81% (125/154)
2021-07-18T14:04:41.5674703Z Resolving deltas: 82% (127/154)
2021-07-18T14:04:41.5675398Z Resolving deltas: 83% (128/154)
2021-07-18T14:04:41.5676099Z Resolving deltas: 84% (130/154)
2021-07-18T14:04:41.5677005Z Resolving deltas: 85% (131/154)
2021-07-18T14:04:41.5677652Z Resolving deltas: 86% (133/154)
2021-07-18T14:04:41.5678308Z Resolving deltas: 87% (134/154)
2021-07-18T14:04:41.5678956Z Resolving deltas: 88% (136/154)
2021-07-18T14:04:41.5679615Z Resolving deltas: 89% (138/154)
2021-07-18T14:04:41.5680272Z Resolving deltas: 90% (139/154)
2021-07-18T14:04:41.5680927Z Resolving deltas: 91% (141/154)
2021-07-18T14:04:41.5681581Z Resolving deltas: 92% (142/154)
2021-07-18T14:04:41.5682227Z Resolving deltas: 93% (144/154)
2021-07-18T14:04:41.5682883Z Resolving deltas: 94% (145/154)
2021-07-18T14:04:41.5683541Z Resolving deltas: 95% (147/154)
2021-07-18T14:04:41.5684182Z Resolving deltas: 96% (148/154)
2021-07-18T14:04:41.5684841Z Resolving deltas: 97% (150/154)
2021-07-18T14:04:41.5685492Z Resolving deltas: 98% (151/154)
2021-07-18T14:04:41.5686149Z Resolving deltas: 99% (153/154)
2021-07-18T14:04:41.5686803Z Resolving deltas: 100% (154/154)
2021-07-18T14:04:41.5687610Z Resolving deltas: 100% (154/154), done.
2021-07-18T14:04:41.5689151Z From https://github.com/submariner-io/submariner-operator
2021-07-18T14:04:41.5690495Z * [new ref] 0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-18T14:04:41.5691417Z ##[endgroup]
2021-07-18T14:04:41.5692142Z ##[group]Determining the checkout info
2021-07-18T14:04:41.5693078Z ##[endgroup]
2021-07-18T14:04:41.5693797Z ##[group]Checking out the ref
2021-07-18T14:04:41.5694999Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-18T14:04:41.5696134Z Switched to a new branch 'devel'
2021-07-18T14:04:41.5697218Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-18T14:04:41.5698047Z ##[endgroup]
2021-07-18T14:04:41.5698935Z [command]/usr/bin/git log -1 --format='%H'
2021-07-18T14:04:41.5699969Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-18T14:04:41.5915675Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-18T14:04:41.5916382Z with:
2021-07-18T14:04:41.5916876Z k8s_version: 1.19
2021-07-18T14:04:41.5917358Z using:
2021-07-18T14:04:41.5917919Z working-directory: .
2021-07-18T14:04:41.5918482Z target: e2e
2021-07-18T14:04:41.5918968Z focus: \[.*\]
2021-07-18T14:04:41.5919555Z skip: \[external-dataplane\]
2021-07-18T14:04:41.5920192Z testdir: test/e2e
2021-07-18T14:04:41.5920709Z ##[endgroup]
2021-07-18T14:04:42.4373790Z ##[group]Reclaiming free space
2021-07-18T14:04:55.3376892Z Filesystem Size Used Avail Use% Mounted on
2021-07-18T14:04:55.3381716Z /dev/root 84G 42G 43G 50% /
2021-07-18T14:04:55.3383988Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-18T14:04:55.3386419Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-18T14:04:55.3388328Z tmpfs 696M 1.1M 695M 1% /run
2021-07-18T14:04:55.3390777Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-18T14:04:55.3400733Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-18T14:04:55.3404785Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-18T14:04:55.3406795Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-18T14:04:55.3413107Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-18T14:04:55.3415164Z /dev/loop2 68M 68M 0 100% /snap/lxd/20326
2021-07-18T14:04:55.3417018Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-18T14:04:55.3419220Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-18T14:04:55.3420801Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-18T14:04:55.3422958Z ##[endgroup]
2021-07-18T14:04:55.3609415Z ##[group]Disable swap
2021-07-18T14:04:55.3972565Z ##[endgroup]
2021-07-18T14:04:55.4143420Z ##[group]Report available RAM
2021-07-18T14:04:55.4170832Z total used free shared buff/cache available
2021-07-18T14:04:55.4171666Z Mem: 6.8Gi 500Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-18T14:04:55.4172238Z Swap: 0B 0B 0B
2021-07-18T14:04:55.4175283Z ##[endgroup]
2021-07-18T14:04:55.4552617Z Downloading Makefile.dapper
2021-07-18T14:04:55.4926120Z Downloading dapper
2021-07-18T14:04:55.6703151Z .dapper.tmp version v0.5.6
2021-07-18T14:04:55.6738471Z Downloading Dockerfile.dapper
2021-07-18T14:04:55.7114396Z docker network create -d bridge kind
2021-07-18T14:04:56.0389578Z 9a434701667678aadd2a594a412b35f52695e918fdf92d9da63215cbe32eee54
2021-07-18T14:04:56.0428530Z ./.dapper -m bind make --debug=b e2e
2021-07-18T14:04:56.9407038Z Sending build context to Docker daemon 7.517MB
2021-07-18T14:04:56.9427218Z
2021-07-18T14:04:56.9429617Z Step 1/8 : ARG BASE_BRANCH
2021-07-18T14:04:56.9433097Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-18T14:04:56.9434849Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-18T14:04:56.9436077Z b1495d80d526: Pulling fs layer
2021-07-18T14:04:56.9436997Z fb3037ce215d: Pulling fs layer
2021-07-18T14:04:56.9438013Z 95344349df1d: Pulling fs layer
2021-07-18T14:04:56.9438676Z a3e11b0fdbf6: Pulling fs layer
2021-07-18T14:04:56.9440047Z b2d0ef6cbe4f: Pulling fs layer
2021-07-18T14:04:56.9440736Z fa188fe30729: Pulling fs layer
2021-07-18T14:04:56.9441361Z 05ca4b0545ef: Pulling fs layer
2021-07-18T14:04:56.9441986Z b17ce80b21da: Pulling fs layer
2021-07-18T14:04:56.9443148Z a3e11b0fdbf6: Waiting
2021-07-18T14:04:56.9443749Z b2d0ef6cbe4f: Waiting
2021-07-18T14:04:56.9444728Z fa188fe30729: Waiting
2021-07-18T14:04:56.9445307Z 05ca4b0545ef: Waiting
2021-07-18T14:04:56.9465478Z b17ce80b21da: Waiting
2021-07-18T14:04:57.1374395Z 95344349df1d: Verifying Checksum
2021-07-18T14:04:57.1407223Z 95344349df1d: Download complete
2021-07-18T14:04:57.3074973Z a3e11b0fdbf6: Verifying Checksum
2021-07-18T14:04:57.3075629Z a3e11b0fdbf6: Download complete
2021-07-18T14:04:57.3395202Z b1495d80d526: Verifying Checksum
2021-07-18T14:04:57.3395841Z b1495d80d526: Download complete
2021-07-18T14:04:57.4344727Z b2d0ef6cbe4f: Verifying Checksum
2021-07-18T14:04:57.4345974Z b2d0ef6cbe4f: Download complete
2021-07-18T14:04:57.4639916Z fa188fe30729: Verifying Checksum
2021-07-18T14:04:57.4641805Z fa188fe30729: Download complete
2021-07-18T14:04:57.5709705Z 05ca4b0545ef: Verifying Checksum
2021-07-18T14:04:57.5725371Z 05ca4b0545ef: Download complete
2021-07-18T14:04:57.6360434Z b17ce80b21da: Verifying Checksum
2021-07-18T14:04:57.6362259Z b17ce80b21da: Download complete
2021-07-18T14:04:59.5781488Z fb3037ce215d: Verifying Checksum
2021-07-18T14:04:59.5782265Z fb3037ce215d: Download complete
2021-07-18T14:05:00.8566682Z b1495d80d526: Pull complete
2021-07-18T14:05:12.0210180Z fb3037ce215d: Pull complete
2021-07-18T14:05:13.4636752Z 95344349df1d: Pull complete
2021-07-18T14:05:13.5505350Z a3e11b0fdbf6: Pull complete
2021-07-18T14:05:13.6215103Z b2d0ef6cbe4f: Pull complete
2021-07-18T14:05:13.7857695Z fa188fe30729: Pull complete
2021-07-18T14:05:13.8553596Z 05ca4b0545ef: Pull complete
2021-07-18T14:05:13.9455814Z b17ce80b21da: Pull complete
2021-07-18T14:05:13.9493178Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-18T14:05:13.9513757Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-18T14:05:13.9526042Z ---> 92b726655a41
2021-07-18T14:05:13.9527369Z Step 3/8 : ARG PROJECT
2021-07-18T14:05:13.9748134Z ---> Running in b6f6ff12f023
2021-07-18T14:05:14.9292424Z Removing intermediate container b6f6ff12f023
2021-07-18T14:05:14.9293748Z ---> 07404c7e9b3a
2021-07-18T14:05:14.9295472Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-18T14:05:14.9543262Z ---> Running in 65cafab78838
2021-07-18T14:05:15.8822395Z Removing intermediate container 65cafab78838
2021-07-18T14:05:15.8823535Z ---> 28f93cfdbcfd
2021-07-18T14:05:15.8824089Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-18T14:05:15.9130572Z ---> Running in 6e4a9ba553b4
2021-07-18T14:05:16.8793134Z Removing intermediate container 6e4a9ba553b4
2021-07-18T14:05:16.8794250Z ---> 83bf10df9f2a
2021-07-18T14:05:16.8794910Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-18T14:05:16.9002866Z ---> Running in 47abb749d9d4
2021-07-18T14:05:17.8320704Z Removing intermediate container 47abb749d9d4
2021-07-18T14:05:17.8329226Z ---> e46fb91a6f9a
2021-07-18T14:05:17.8330124Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-18T14:05:17.8547404Z ---> Running in aab6cfb81cbb
2021-07-18T14:05:18.7954144Z Removing intermediate container aab6cfb81cbb
2021-07-18T14:05:18.7955456Z ---> 7e1e4363702b
2021-07-18T14:05:18.7955904Z Step 8/8 : CMD ["sh"]
2021-07-18T14:05:18.8152903Z ---> Running in 1626c5eb0318
2021-07-18T14:05:19.7407636Z Removing intermediate container 1626c5eb0318
2021-07-18T14:05:19.7408997Z ---> 030b65535b68
2021-07-18T14:05:19.7602212Z Successfully built 030b65535b68
2021-07-18T14:05:19.7608002Z Successfully tagged submariner-operator:devel
2021-07-18T14:05:20.2669954Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-18T14:05:20.2717807Z [submariner-operator]$ mkdir -p bin dist output
2021-07-18T14:05:20.2727253Z [submariner-operator]$ make --debug=b e2e
2021-07-18T14:05:20.2727854Z GNU Make 4.3
2021-07-18T14:05:20.2738204Z Built for x86_64-redhat-linux-gnu
2021-07-18T14:05:20.2739653Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-18T14:05:20.2740611Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-18T14:05:20.2741638Z This is free software: you are free to change and redistribute it.
2021-07-18T14:05:20.2749082Z There is NO WARRANTY, to the extent permitted by law.
2021-07-18T14:05:20.2750096Z Reading makefiles...
2021-07-18T14:05:20.3995675Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-18T14:05:20.3996980Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-18T14:05:20.6329476Z Updating makefiles....
2021-07-18T14:05:20.6341158Z Updating goal targets....
2021-07-18T14:05:20.6342174Z File 'e2e' does not exist.
2021-07-18T14:05:20.6342797Z File 'clusters' does not exist.
2021-07-18T14:05:20.6343440Z Must remake target 'clusters'.
2021-07-18T14:05:20.6344940Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.19" --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:05:20.6376496Z Downloading shflags 1.0.3
2021-07-18T14:05:20.6439963Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-18T14:05:20.6440733Z Dload Upload Total Spent Left Speed
2021-07-18T14:05:20.6441160Z
2021-07-18T14:05:20.6784334Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-18T14:05:20.6785415Z 100 31091 100 31091 0 0 893k 0 --:--:-- --:--:-- --:--:-- 893k
2021-07-18T14:05:20.7464538Z Running with: k8s_version=1.19.11, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-18T14:05:20.7491528Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:05:20.7503685Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:20.7515300Z [submariner-operator]$ script_name=utils
2021-07-18T14:05:20.7528592Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:20.7548682Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:05:20.7560030Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:20.7570111Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:05:20.7583153Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:20.7606124Z [submariner-operator]$ broker=cluster1
2021-07-18T14:05:20.7618629Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:05:20.7632688Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:05:20.7653697Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:05:20.7667696Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:05:20.7676898Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:05:20.7688775Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:05:20.7700624Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:05:20.7710801Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:05:20.7722878Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:05:20.7734386Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:05:20.7746307Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:05:20.7759481Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:05:20.7771215Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:20.7783153Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:05:20.7795429Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:20.7816971Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:05:20.7829090Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:05:20.7857278Z [submariner-operator]$ cat <<EOM
2021-07-18T14:05:20.7858726Z Cluster settings::
2021-07-18T14:05:20.7859498Z broker - ${broker@Q}
2021-07-18T14:05:20.7860257Z clusters - ${clusters[*]@Q}
2021-07-18T14:05:20.7861296Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-18T14:05:20.7862308Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-18T14:05:20.7863356Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-18T14:05:20.7864132Z EOM
2021-07-18T14:05:20.7884566Z [submariner-operator]$ typeset -p cluster_cni
2021-07-18T14:05:20.7897622Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:20.7926072Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-18T14:05:20.7940263Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:20.7969697Z [submariner-operator]$ typeset -p cluster_subm
2021-07-18T14:05:20.7984315Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:20.8005508Z Cluster settings::
2021-07-18T14:05:20.8006253Z broker - 'cluster1'
2021-07-18T14:05:20.8007252Z clusters - 'cluster1' 'cluster2'
2021-07-18T14:05:20.8008339Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-18T14:05:20.8009711Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-18T14:05:20.8011001Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-18T14:05:20.8022061Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:05:20.8040757Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:05:20.8064292Z [submariner-operator]$ run_local_registry
2021-07-18T14:05:20.8076817Z [submariner-operator]$ run_local_registry
2021-07-18T14:05:20.8088616Z [submariner-operator]$ registry_running
2021-07-18T14:05:20.8099879Z [submariner-operator]$ registry_running
2021-07-18T14:05:20.8112700Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-18T14:05:20.8127494Z [submariner-operator]$ grep kind-registry
2021-07-18T14:05:21.0889134Z [submariner-operator]$ return 0
2021-07-18T14:05:21.0890614Z Deploying local registry kind-registry to serve images centrally.
2021-07-18T14:05:21.0893348Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-18T14:05:21.0913115Z [submariner-operator]$ selinuxenabled
2021-07-18T14:05:21.1428267Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-18T14:05:21.3669747Z Unable to find image 'registry:2' locally
2021-07-18T14:05:21.6508623Z 2: Pulling from library/registry
2021-07-18T14:05:21.7548312Z ddad3d7c1e96: Already exists
2021-07-18T14:05:21.7554729Z 6eda6749503f: Pulling fs layer
2021-07-18T14:05:21.7555381Z 363ab70c2143: Pulling fs layer
2021-07-18T14:05:21.7555976Z 5b94580856e6: Pulling fs layer
2021-07-18T14:05:21.7556538Z 12008541203a: Pulling fs layer
2021-07-18T14:05:21.7557067Z 12008541203a: Waiting
2021-07-18T14:05:21.8007779Z 6eda6749503f: Verifying Checksum
2021-07-18T14:05:21.8008391Z 6eda6749503f: Download complete
2021-07-18T14:05:21.8308683Z 5b94580856e6: Verifying Checksum
2021-07-18T14:05:21.8309305Z 5b94580856e6: Download complete
2021-07-18T14:05:21.8959150Z 12008541203a: Verifying Checksum
2021-07-18T14:05:21.8959710Z 12008541203a: Download complete
2021-07-18T14:05:21.9172102Z 363ab70c2143: Verifying Checksum
2021-07-18T14:05:21.9172688Z 363ab70c2143: Download complete
2021-07-18T14:05:21.9509164Z 6eda6749503f: Pull complete
2021-07-18T14:05:22.2635699Z 363ab70c2143: Pull complete
2021-07-18T14:05:22.3319058Z 5b94580856e6: Pull complete
2021-07-18T14:05:22.3954608Z 12008541203a: Pull complete
2021-07-18T14:05:22.3995710Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-18T14:05:22.4011943Z Status: Downloaded newer image for registry:2
2021-07-18T14:05:22.4203637Z 7db477c784ecd57b96c3f327592d0d59ca9e03661ff53ab449cdff68872a5713
2021-07-18T14:05:22.7749453Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-18T14:05:23.1872337Z [submariner-operator]$ declare_cidrs
2021-07-18T14:05:23.1890964Z [submariner-operator]$ declare_cidrs
2021-07-18T14:05:23.1894981Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:05:23.1911811Z [submariner-operator]$ i=1
2021-07-18T14:05:23.1912851Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:05:23.1923255Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:05:23.1933398Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:05:23.1944546Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:05:23.1955188Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:05:23.1964787Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:05:23.1976796Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:05:23.1986825Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:05:23.1998570Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:05:23.2012282Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:05:23.2020155Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:05:23.2030554Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:05:23.2037277Z [submariner-operator]$ [cluster2] wait 231
2021-07-18T14:05:23.2042389Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:05:23.2050655Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:05:23.2062466Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:05:23.2082212Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:05:23.2100899Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:05:23.2106056Z [submariner-operator]$ [cluster1] pids[cluster1]=240
2021-07-18T14:05:23.2114241Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-18T14:05:23.2128261Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:05:23.2135132Z [submariner-operator]$ [cluster2] pids[cluster2]=244
2021-07-18T14:05:23.2158616Z [submariner-operator]$ [cluster2] wait 244
2021-07-18T14:05:23.2165995Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:05:23.2179919Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-18T14:05:23.2202054Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:07:22.9510103Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:07:22.9511309Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:07:22.9512273Z [submariner-operator]$ [cluster2] wait 267
2021-07-18T14:07:22.9513243Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:07:22.9514328Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:07:22.9515849Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:22.9517924Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:22.9519301Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-18T14:07:22.9520235Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-18T14:07:22.9520893Z [cluster2] No kind clusters found.
2021-07-18T14:07:22.9521619Z [cluster2] Creating KIND cluster...
2021-07-18T14:07:22.9522991Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-18T14:07:22.9524044Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-18T14:07:22.9525079Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-18T14:07:22.9526007Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:22.9526848Z [cluster2] - role: control-plane
2021-07-18T14:07:22.9527698Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:22.9528487Z [cluster2] - role: control-plane
2021-07-18T14:07:22.9529174Z [cluster2] - role: worker
2021-07-18T14:07:22.9529936Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:22.9530740Z [cluster2] - role: control-plane
2021-07-18T14:07:22.9531396Z [cluster2] - role: worker
2021-07-18T14:07:22.9532024Z [cluster2] - role: worker
2021-07-18T14:07:22.9532596Z [cluster2] 
2021-07-18T14:07:22.9533138Z [cluster2] 
2021-07-18T14:07:22.9533938Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-18T14:07:22.9535270Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-18T14:07:22.9536771Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.19.11
2021-07-18T14:07:22.9537825Z [submariner-operator]$ [cluster2] kind version
2021-07-18T14:07:22.9538522Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-18T14:07:22.9539811Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-18T14:07:22.9540792Z [cluster2] ---
2021-07-18T14:07:22.9541234Z [cluster2] kind: Cluster
2021-07-18T14:07:22.9542004Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-18T14:07:22.9542606Z [cluster2] networking:
2021-07-18T14:07:22.9543207Z [cluster2] disableDefaultCNI: true
2021-07-18T14:07:22.9543802Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-18T14:07:22.9544374Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-18T14:07:22.9568238Z [cluster2] containerdConfigPatches:
2021-07-18T14:07:22.9569373Z [cluster2] - |-
2021-07-18T14:07:22.9570225Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-18T14:07:22.9571559Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-18T14:07:22.9572368Z [cluster2] kubeadmConfigPatches:
2021-07-18T14:07:22.9573162Z [cluster2] - |
2021-07-18T14:07:22.9573709Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-18T14:07:22.9574392Z [cluster2] kind: ClusterConfiguration
2021-07-18T14:07:22.9574955Z [cluster2] metadata:
2021-07-18T14:07:22.9575395Z [cluster2] name: config
2021-07-18T14:07:22.9575859Z [cluster2] networking:
2021-07-18T14:07:22.9576346Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-18T14:07:22.9576855Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-18T14:07:22.9577433Z [cluster2] dnsDomain: cluster2.local
2021-07-18T14:07:22.9577933Z [cluster2] nodes:
2021-07-18T14:07:22.9578555Z [cluster2] - role: control-plane
2021-07-18T14:07:22.9579168Z [cluster2] - role: worker
2021-07-18T14:07:22.9579746Z [cluster2] - role: worker
2021-07-18T14:07:22.9581076Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.19.11 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-18T14:07:22.9582203Z [cluster2] Creating cluster "cluster2" ...
2021-07-18T14:07:22.9584453Z [cluster2] • Ensuring node image (kindest/node:v1.19.11) 🖼 ...
2021-07-18T14:07:22.9585587Z [cluster2] ✓ Ensuring node image (kindest/node:v1.19.11) 🖼
2021-07-18T14:07:22.9586406Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-18T14:07:22.9587125Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-18T14:07:22.9587888Z [cluster2] • Writing configuration 📜 ...
2021-07-18T14:07:22.9588647Z [cluster2] ✓ Writing configuration 📜
2021-07-18T14:07:22.9589454Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-18T14:07:22.9590463Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-18T14:07:22.9591304Z [cluster2] • Installing StorageClass 💾 ...
2021-07-18T14:07:22.9592100Z [cluster2] ✓ Installing StorageClass 💾
2021-07-18T14:07:22.9592872Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-18T14:07:22.9593595Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-18T14:07:22.9594385Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-18T14:07:22.9595065Z [cluster2] You can now use your cluster with:
2021-07-18T14:07:22.9595670Z [cluster2]
2021-07-18T14:07:22.9596391Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-18T14:07:22.9597148Z [cluster2]
2021-07-18T14:07:22.9598219Z [cluster2] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-18T14:07:22.9599522Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:07:22.9600707Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:07:22.9602537Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-18T14:07:24.3602735Z [submariner-operator]$ [cluster2] head -n 1[submariner-operator]$ [cluster1] with_retries
2021-07-18T14:07:24.3604002Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:07:24.3604963Z [submariner-operator]$ [cluster1] wait 257
2021-07-18T14:07:24.3605953Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:07:24.3607239Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:07:24.3608903Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:24.3611004Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:24.3612510Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-18T14:07:24.3613534Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-18T14:07:24.3614233Z [cluster1] No kind clusters found.
2021-07-18T14:07:24.3614818Z [cluster1] Creating KIND cluster...
2021-07-18T14:07:24.3615730Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-18T14:07:24.3616794Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-18T14:07:24.3617799Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-18T14:07:24.3618747Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:24.3619565Z [cluster1] - role: control-plane
2021-07-18T14:07:24.3620396Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:24.3621205Z [cluster1] - role: control-plane
2021-07-18T14:07:24.3621876Z [cluster1] - role: worker
2021-07-18T14:07:24.3622652Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:24.3623443Z [cluster1] - role: control-plane
2021-07-18T14:07:24.3624120Z [cluster1] - role: worker
2021-07-18T14:07:24.3625000Z [cluster1] - role: worker
2021-07-18T14:07:24.3625621Z [cluster1] 
2021-07-18T14:07:24.3626150Z [cluster1] 
2021-07-18T14:07:24.3626963Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-18T14:07:24.3628285Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-18T14:07:24.3629681Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.19.11
2021-07-18T14:07:24.3630759Z [submariner-operator]$ [cluster1] kind version
2021-07-18T14:07:24.3631441Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-18T14:07:24.3632593Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-18T14:07:24.3633556Z [cluster1] ---
2021-07-18T14:07:24.3634006Z [cluster1] kind: Cluster
2021-07-18T14:07:24.3634754Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-18T14:07:24.3635498Z [cluster1] networking:
2021-07-18T14:07:24.3636084Z [cluster1] disableDefaultCNI: true
2021-07-18T14:07:24.3636695Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-18T14:07:24.3637238Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-18T14:07:24.3637932Z [cluster1] containerdConfigPatches:
2021-07-18T14:07:24.3638682Z [cluster1] - |-
2021-07-18T14:07:24.3639502Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-18T14:07:24.3640732Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-18T14:07:24.3641526Z [cluster1] kubeadmConfigPatches:
2021-07-18T14:07:24.3642221Z [cluster1] - |
2021-07-18T14:07:24.3642786Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-18T14:07:24.3643514Z [cluster1] kind: ClusterConfiguration
2021-07-18T14:07:24.3644105Z [cluster1] metadata:
2021-07-18T14:07:24.3644594Z [cluster1] name: config
2021-07-18T14:07:24.3645078Z [cluster1] networking:
2021-07-18T14:07:24.3645603Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-18T14:07:24.3646159Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-18T14:07:24.3646791Z [cluster1] dnsDomain: cluster1.local
2021-07-18T14:07:24.3647336Z [cluster1] nodes:
2021-07-18T14:07:24.3647985Z [cluster1] - role: control-plane
2021-07-18T14:07:24.3648653Z [cluster1] - role: worker
2021-07-18T14:07:24.3649256Z [cluster1] - role: worker
2021-07-18T14:07:24.3650711Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.19.11 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-18T14:07:24.3651996Z [cluster1] Creating cluster "cluster1" ...
2021-07-18T14:07:24.3652991Z [cluster1] • Ensuring node image (kindest/node:v1.19.11) 🖼 ...
2021-07-18T14:07:24.3653945Z [cluster1] ✓ Ensuring node image (kindest/node:v1.19.11) 🖼
2021-07-18T14:07:24.3654845Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-18T14:07:24.3669452Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-18T14:07:24.3670696Z [cluster1] • Writing configuration 📜 ...
2021-07-18T14:07:24.3671505Z [cluster1] ✓ Writing configuration 📜
2021-07-18T14:07:24.3672303Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-18T14:07:24.3673116Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-18T14:07:24.3673915Z [cluster1] • Installing StorageClass 💾 ...
2021-07-18T14:07:24.3674719Z [cluster1] ✓ Installing StorageClass 💾
2021-07-18T14:07:24.3675470Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-18T14:07:24.3676191Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-18T14:07:24.3677023Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-18T14:07:24.3677704Z [cluster1] You can now use your cluster with:
2021-07-18T14:07:24.3678211Z [cluster1]
2021-07-18T14:07:24.3678975Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-18T14:07:24.3679586Z [cluster1]
2021-07-18T14:07:24.3680645Z [cluster1] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-18T14:07:24.3681909Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:07:24.3682944Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:07:24.3684526Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-18T14:07:53.3598363Z [submariner-operator]$ [cluster1] head -n 1
2021-07-18T14:07:53.3600418Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:53.3602963Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:53.3605408Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:53.3608028Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:53.3610598Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:53.3613147Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:53.3614731Z [submariner-operator]$ [cluster2] wait 1519
2021-07-18T14:07:53.3615914Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-18T14:07:53.3617182Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-18T14:07:53.3618350Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-18T14:07:53.3619423Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-18T14:07:53.3620539Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-18T14:07:53.3621684Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-18T14:07:53.3622807Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-18T14:07:53.3623634Z [cluster2] Applying weave network...
2021-07-18T14:07:53.3625638Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-18T14:07:53.3627860Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-18T14:07:53.3630426Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-18T14:07:53.3632191Z [submariner-operator]$ [cluster2] wait 240
2021-07-18T14:07:53.3633201Z [cluster2] serviceaccount/weave-net created
2021-07-18T14:07:53.3634598Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:53.3636529Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:53.3638209Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:53.3639752Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:53.3641113Z [cluster2] daemonset.apps/weave-net created
2021-07-18T14:07:53.3642201Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-18T14:07:53.3643514Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:07:53.3645198Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:07:53.3646922Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:07:53.3648559Z [cluster2] pod/weave-net-7qp86 condition met
2021-07-18T14:07:53.3649477Z [cluster2] pod/weave-net-vxz2k condition met
2021-07-18T14:07:53.3650629Z [cluster2] pod/weave-net-zzkpb condition met
2021-07-18T14:07:53.3651665Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-18T14:07:53.3653047Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:07:53.3654624Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:07:53.3656307Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:07:53.3657693Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:07:53.3659001Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:07:53.3660045Z [cluster2] deployment "coredns" successfully rolled out
2021-07-18T14:07:53.3661130Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:07:59.3417525Z
2021-07-18T14:07:59.3420232Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:59.3423658Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:59.3426406Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:59.3428764Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:59.3431231Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:59.3433512Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:59.3435427Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-18T14:07:59.3436573Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-18T14:07:59.3437617Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-18T14:07:59.3438562Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-18T14:07:59.3439473Z [submariner-operator]$ [cluster1] wait 1593
2021-07-18T14:07:59.3440460Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-18T14:07:59.3441476Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-18T14:07:59.3443970Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-18T14:07:59.3444709Z [cluster1] Applying weave network...
2021-07-18T14:07:59.3446201Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-18T14:07:59.3448129Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-18T14:07:59.3450173Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-18T14:07:59.3451628Z [cluster1] serviceaccount/weave-net created
2021-07-18T14:07:59.3452864Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:59.3454596Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:59.3456144Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:59.3457559Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:07:59.3458759Z [cluster1] daemonset.apps/weave-net created
2021-07-18T14:07:59.3459636Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-18T14:07:59.3461111Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:07:59.3462713Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:07:59.3464453Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:07:59.3466333Z [cluster1] pod/weave-net-npxrn condition met
2021-07-18T14:07:59.3467401Z [cluster1] pod/weave-net-tsq98 condition met
2021-07-18T14:07:59.3468549Z [cluster1] pod/weave-net-v59t2 condition met
2021-07-18T14:07:59.3469448Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-18T14:07:59.3470820Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:07:59.3472271Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:07:59.3473852Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:07:59.3475133Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:07:59.3476223Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:07:59.3477163Z [cluster1] deployment "coredns" successfully rolled out
2021-07-18T14:07:59.3478105Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:07:59.3503680Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:07:59.3513498Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:07:59.3530734Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-18T14:07:59.3531636Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:07:59.3532183Z
2021-07-18T14:07:59.3533154Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:07:59.3534062Z
2021-07-18T14:07:59.3534831Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:07:59.3535317Z
2021-07-18T14:07:59.3536005Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:07:59.3536656Z EOM
2021-07-18T14:07:59.3554280Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:07:59.3554876Z
2021-07-18T14:07:59.3556175Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:07:59.3560588Z
2021-07-18T14:07:59.3561498Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:07:59.3561988Z
2021-07-18T14:07:59.3562687Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:07:59.3566101Z Successfully remade target file 'clusters'.
2021-07-18T14:07:59.3566939Z File 'preload-images' does not exist.
2021-07-18T14:07:59.3568086Z File 'images' does not exist.
2021-07-18T14:07:59.3569031Z File 'package/.image.submariner-operator' does not exist.
2021-07-18T14:07:59.3745309Z find: 'bin/submariner-operator': No such file or directory
2021-07-18T14:07:59.6930403Z File 'bin/submariner-operator' does not exist.
2021-07-18T14:07:59.6931364Z File 'vendor/modules.txt' does not exist.
2021-07-18T14:07:59.6932117Z Must remake target 'vendor/modules.txt'.
2021-07-18T14:07:59.6932625Z go mod download
2021-07-18T14:08:54.9517130Z go mod vendor
2021-07-18T14:08:57.0649405Z go mod tidy
2021-07-18T14:08:57.7474199Z Successfully remade target file 'vendor/modules.txt'.
2021-07-18T14:08:57.7476144Z File 'generate-embeddedyamls' does not exist.
2021-07-18T14:08:57.7477035Z File 'generate' does not exist.
2021-07-18T14:08:57.7478191Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-18T14:08:57.7479710Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-18T14:08:57.7481162Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-18T14:08:57.7513877Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-18T14:09:18.4699338Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-18T14:09:18.4700967Z Must remake target 'generate'.
2021-07-18T14:09:18.4738267Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-18T14:09:31.3792233Z Successfully remade target file 'generate'.
2021-07-18T14:09:31.3793681Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-18T14:09:31.3797523Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-18T14:09:31.3802388Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-18T14:09:31.3804349Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-18T14:09:33.5850617Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-18T14:09:33.5857776Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-18T14:09:33.5859341Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-18T14:09:33.5861931Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-18T14:09:34.9318210Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-18T14:09:34.9422699Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-18T14:09:34.9423838Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-18T14:09:35.6756037Z Generating yamls.go
2021-07-18T14:09:35.6760715Z deploy/crds/submariner.io_brokers.yaml
2021-07-18T14:09:35.6766909Z deploy/crds/submariner.io_submariners.yaml
2021-07-18T14:09:35.6797298Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-18T14:09:35.6800201Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-18T14:09:35.6803986Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-18T14:09:35.6808289Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-18T14:09:35.6813746Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-18T14:09:35.6820030Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-18T14:09:35.6828714Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-18T14:09:35.6835314Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-18T14:09:35.6842955Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-18T14:09:35.6854755Z config/broker/broker-admin/service_account.yaml
2021-07-18T14:09:35.6856173Z config/broker/broker-admin/role.yaml
2021-07-18T14:09:35.6858886Z config/broker/broker-admin/role_binding.yaml
2021-07-18T14:09:35.6861341Z config/broker/broker-client/service_account.yaml
2021-07-18T14:09:35.6865325Z config/broker/broker-client/role.yaml
2021-07-18T14:09:35.6868353Z config/broker/broker-client/role_binding.yaml
2021-07-18T14:09:35.6882653Z config/rbac/submariner-operator/service_account.yaml
2021-07-18T14:09:35.6884872Z config/rbac/submariner-operator/role.yaml
2021-07-18T14:09:35.6885983Z config/rbac/submariner-operator/role_binding.yaml
2021-07-18T14:09:35.6892208Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-18T14:09:35.6894440Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-18T14:09:35.6898019Z config/rbac/submariner-gateway/service_account.yaml
2021-07-18T14:09:35.6899379Z config/rbac/submariner-gateway/role.yaml
2021-07-18T14:09:35.6903387Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-18T14:09:35.6905104Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-18T14:09:35.6907833Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-18T14:09:35.6910215Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-18T14:09:35.6911445Z config/rbac/submariner-route-agent/role.yaml
2021-07-18T14:09:35.6914529Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-18T14:09:35.6921173Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-18T14:09:35.6923495Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-18T14:09:35.6930442Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-18T14:09:35.6931609Z config/rbac/submariner-globalnet/role.yaml
2021-07-18T14:09:35.6933588Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-18T14:09:35.6934748Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-18T14:09:35.6938905Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-18T14:09:35.6942155Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-18T14:09:35.6945476Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-18T14:09:35.6951248Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-18T14:09:35.6955232Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-18T14:09:35.6958129Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-18T14:09:35.6962050Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-18T14:09:35.6966593Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-18T14:09:35.6973608Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-18T14:09:35.6974490Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-18T14:09:35.6977260Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-18T14:09:35.6978410Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-18T14:09:35.7012262Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-18T14:09:35.7015274Z Must remake target 'generate-embeddedyamls'.
2021-07-18T14:09:35.7016402Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-18T14:09:35.7017476Z Must remake target 'bin/submariner-operator'.
2021-07-18T14:09:35.7018165Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:09:35.7019368Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-18T14:09:35.7020565Z bin/submariner-operator main.go
2021-07-18T14:09:35.7612677Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:09:35.7627917Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-18T14:09:35.7638627Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-18T14:09:35.7652564Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-18T14:11:11.1336014Z [submariner-operator]$ upx bin/submariner-operator
2021-07-18T14:11:16.9229131Z Ultimate Packer for eXecutables
2021-07-18T14:11:16.9230882Z Copyright (C) 1996 - 2020
2021-07-18T14:11:16.9231817Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-18T14:11:16.9232471Z
2021-07-18T14:11:16.9233110Z File size Ratio Format Name
2021-07-18T14:11:16.9239006Z -------------------- ------ ----------- -----------
2021-07-18T14:11:16.9240042Z 34459648 -> 9933112 28.83% linux/amd64 submariner-operator
2021-07-18T14:11:16.9240506Z
2021-07-18T14:11:16.9240856Z Packed 1 file.
2021-07-18T14:11:16.9241723Z Successfully remade target file 'bin/submariner-operator'.
2021-07-18T14:11:16.9243342Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-18T14:11:16.9244898Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-18T14:11:16.9246514Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-18T14:11:16.9247632Z File 'FORCE_IMAGE' does not exist.
2021-07-18T14:11:16.9248445Z Must remake target 'FORCE_IMAGE'.
2021-07-18T14:11:16.9249227Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-18T14:11:16.9250244Z Must remake target 'package/.image.submariner-operator'.
2021-07-18T14:11:16.9252028Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-18T14:11:16.9681777Z flags:WARN flag short name (h) already defined
2021-07-18T14:11:17.0233167Z [submariner-operator]$ set -e
2021-07-18T14:11:17.0248440Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:17.0261126Z [submariner-operator]$ cache_flag=
2021-07-18T14:11:17.0277015Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:17.0296378Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:17.3457146Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:17.9460693Z devel: Pulling from submariner/submariner-operator
2021-07-18T14:11:17.9467006Z 9aabc6bb514c: Pulling fs layer
2021-07-18T14:11:18.2169738Z 9aabc6bb514c: Verifying Checksum
2021-07-18T14:11:18.2170406Z 9aabc6bb514c: Download complete
2021-07-18T14:11:18.6067900Z 9aabc6bb514c: Pull complete
2021-07-18T14:11:18.6113816Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-18T14:11:18.6132743Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:18.6147747Z quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:18.6193091Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-18T14:11:18.6222033Z [submariner-operator]$ cut -f2 -d 
2021-07-18T14:11:18.6223899Z [submariner-operator]$ grep -v scratch
2021-07-18T14:11:18.6238316Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-18T14:11:18.6245861Z 
2021-07-18T14:11:19.4678140Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-18T14:11:20.2961325Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-18T14:11:20.3015230Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-18T14:11:21.1332067Z buildx_builder
2021-07-18T14:11:21.1386757Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-18T14:11:21.9785637Z #1 [internal] booting buildkit
2021-07-18T14:11:21.9786793Z #1 sha256:343851bf386dbe8923ae1da5f51c65219e68080f26fa594b8509e8089c8acc1d
2021-07-18T14:11:22.1290717Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-18T14:11:25.6962364Z #1 pulling image moby/buildkit:buildx-stable-1 3.7s done
2021-07-18T14:11:25.8463606Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-18T14:11:26.4466843Z #1 creating container buildx_buildkit_buildx_builder0 0.7s done
2021-07-18T14:11:26.4472816Z #1 DONE 4.4s
2021-07-18T14:11:26.7380825Z
2021-07-18T14:11:26.7382562Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-18T14:11:26.7403895Z #2 sha256:58e6f60ad016fc06849749d62504ad7862735d8ea33b9122a41206246913f65c
2021-07-18T14:11:26.7404867Z #2 transferring dockerfile: 230B 0.0s done
2021-07-18T14:11:26.7405434Z #2 DONE 0.0s
2021-07-18T14:11:26.7446225Z
2021-07-18T14:11:26.7446690Z #3 [internal] load .dockerignore
2021-07-18T14:11:26.7447906Z #3 sha256:c4e1f27d647c28a9c7b0eb82a3788598579f02fb05ce332e56ca98029512e3ff
2021-07-18T14:11:26.7448936Z #3 transferring context: 2B done
2021-07-18T14:11:26.7449406Z #3 DONE 0.0s
2021-07-18T14:11:26.7449640Z
2021-07-18T14:11:26.7450060Z #4 [internal] load build context
2021-07-18T14:11:26.7451158Z #4 sha256:1a82a2669d667a015a9adc8ebabef49dcf5aee61f6a8ef49407dad9573d8c6d4
2021-07-18T14:11:26.7452182Z #4 DONE 0.0s
2021-07-18T14:11:26.7452433Z
2021-07-18T14:11:26.7453592Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:26.7455011Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-18T14:11:27.0388388Z #6 DONE 0.3s
2021-07-18T14:11:27.0388716Z
2021-07-18T14:11:27.0389400Z #4 [internal] load build context
2021-07-18T14:11:27.0390523Z #4 sha256:1a82a2669d667a015a9adc8ebabef49dcf5aee61f6a8ef49407dad9573d8c6d4
2021-07-18T14:11:27.4617933Z #4 transferring context: 9.94MB 0.4s done
2021-07-18T14:11:27.4618695Z #4 DONE 0.4s
2021-07-18T14:11:27.4618984Z
2021-07-18T14:11:27.4620374Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:11:27.4621508Z #5 sha256:a19220b0f712245ac7a728b558a08810399d6e87cced6670eeb6e1143897c786
2021-07-18T14:11:27.4626437Z #5 CACHED
2021-07-18T14:11:27.4626757Z
2021-07-18T14:11:27.4627290Z #7 exporting to oci image format
2021-07-18T14:11:27.4628334Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:11:27.4629364Z #7 exporting layers done
2021-07-18T14:11:27.4630793Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-18T14:11:27.4632636Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-18T14:11:27.6183780Z #7 ...
2021-07-18T14:11:27.6184099Z
2021-07-18T14:11:27.6185565Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:11:27.6186767Z #5 sha256:a19220b0f712245ac7a728b558a08810399d6e87cced6670eeb6e1143897c786
2021-07-18T14:11:27.6188292Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.2s done
2021-07-18T14:11:27.6189419Z #5 CACHED
2021-07-18T14:11:27.6189662Z
2021-07-18T14:11:27.6190096Z #7 exporting to oci image format
2021-07-18T14:11:27.6191140Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:11:27.6192123Z #7 sending tarball
2021-07-18T14:11:27.7626925Z #7 sending tarball 0.2s done
2021-07-18T14:11:27.7627543Z #7 DONE 0.4s
2021-07-18T14:11:27.7643838Z
2021-07-18T14:11:27.7644381Z #9 exporting cache
2021-07-18T14:11:27.7645348Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-18T14:11:27.7646390Z #9 preparing build cache for export done
2021-07-18T14:11:27.7646868Z #9 DONE 0.0s
2021-07-18T14:11:27.7647115Z
2021-07-18T14:11:27.7647491Z #8 importing to docker
2021-07-18T14:11:27.7648369Z #8 sha256:8f812c2d54215d1f75542d51082c9efd41f463a5c4b76a44b847f3726a32df39
2021-07-18T14:11:27.7649185Z #8 DONE 0.0s
2021-07-18T14:11:27.7733351Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:28.0605356Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-18T14:11:28.0606482Z File 'build' does not exist.
2021-07-18T14:11:28.0607167Z File 'bin/subctl' does not exist.
2021-07-18T14:11:28.0608327Z File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-18T14:11:28.0860556Z Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-18T14:11:28.0861521Z mkdir -p bin
2021-07-18T14:11:28.0891502Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-18T14:11:28.0892319Z target=${target%.exe}; \
2021-07-18T14:11:28.0893005Z components=($(echo ${target//-/ })); \
2021-07-18T14:11:28.0893650Z GOOS=${components[-2]}; \
2021-07-18T14:11:28.0894276Z GOARCH=${components[-1]}; \
2021-07-18T14:11:28.0894745Z export GOARCH GOOS; \
2021-07-18T14:11:28.0895535Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:11:28.0896734Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-18T14:11:28.0898731Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-18T14:11:28.0900548Z --noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:11:28.1470294Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:11:28.1486164Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-18T14:11:28.1503714Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-18T14:11:28.1520122Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:12:04.0182183Z Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-18T14:12:04.0183527Z Must remake target 'bin/subctl'.
2021-07-18T14:12:04.0184472Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-18T14:12:04.0217775Z Successfully remade target file 'bin/subctl'.
2021-07-18T14:12:04.0219049Z Must remake target 'build'.
2021-07-18T14:12:04.0219786Z Successfully remade target file 'build'.
2021-07-18T14:12:04.0220450Z Must remake target 'images'.
2021-07-18T14:12:04.0221144Z Successfully remade target file 'images'.
2021-07-18T14:12:04.0221893Z Must remake target 'preload-images'.
2021-07-18T14:12:04.0222475Z set -e;\
2021-07-18T14:12:04.0222924Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-18T14:12:04.0223509Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-18T14:12:04.0225181Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-18T14:12:04.0226485Z import_image quay.io/submariner/${image};\
2021-07-18T14:12:04.0226985Z done
2021-07-18T14:12:04.0270361Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-18T14:12:04.0281332Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-18T14:12:04.0294756Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-18T14:12:04.3188430Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-18T14:12:04.6075300Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-18T14:12:04.6370941Z f9269f9cee12: Preparing
2021-07-18T14:12:05.2436156Z f9269f9cee12: Pushed
2021-07-18T14:12:05.2629821Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-18T14:12:05.2663052Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-18T14:12:05.2678945Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-18T14:12:05.2686175Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-18T14:12:05.5470853Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-18T14:12:05.5493364Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-18T14:12:06.0653040Z devel: Pulling from submariner/submariner-gateway
2021-07-18T14:12:06.0653975Z 8c741e919b67: Pulling fs layer
2021-07-18T14:12:06.0654953Z 13495efbbac4: Pulling fs layer
2021-07-18T14:12:06.0660610Z 6df6df193f2d: Pulling fs layer
2021-07-18T14:12:06.0661148Z 3afbe9ee7387: Pulling fs layer
2021-07-18T14:12:06.1844921Z 13495efbbac4: Verifying Checksum
2021-07-18T14:12:06.1845532Z 13495efbbac4: Download complete
2021-07-18T14:12:06.3787579Z 3afbe9ee7387: Verifying Checksum
2021-07-18T14:12:06.3788258Z 3afbe9ee7387: Download complete
2021-07-18T14:12:06.4392119Z 6df6df193f2d: Verifying Checksum
2021-07-18T14:12:06.4392762Z 6df6df193f2d: Download complete
2021-07-18T14:12:06.6433164Z 8c741e919b67: Verifying Checksum
2021-07-18T14:12:06.6433764Z 8c741e919b67: Download complete
2021-07-18T14:12:09.5593367Z 8c741e919b67: Pull complete
2021-07-18T14:12:10.6955413Z 13495efbbac4: Pull complete
2021-07-18T14:12:11.7856883Z 6df6df193f2d: Pull complete
2021-07-18T14:12:11.9766510Z 3afbe9ee7387: Pull complete
2021-07-18T14:12:11.9802494Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-18T14:12:11.9847402Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-18T14:12:11.9879655Z quay.io/submariner/submariner-gateway:devel
2021-07-18T14:12:11.9949127Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-18T14:12:12.2725429Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-18T14:12:12.5562790Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-18T14:12:12.8378871Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-18T14:12:12.8435508Z 71972a942ed4: Preparing
2021-07-18T14:12:12.8436363Z 3c7f2d60eacb: Preparing
2021-07-18T14:12:12.8436842Z 00c5f6897675: Preparing
2021-07-18T14:12:12.8437314Z b3b62c837788: Preparing
2021-07-18T14:12:13.1970537Z 00c5f6897675: Pushed
2021-07-18T14:12:15.2768792Z 71972a942ed4: Pushed
2021-07-18T14:12:17.0652359Z 3c7f2d60eacb: Pushed
2021-07-18T14:12:25.2691644Z b3b62c837788: Pushed
2021-07-18T14:12:25.2870892Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-18T14:12:25.2911581Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-18T14:12:25.2926742Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-18T14:12:25.2939161Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-18T14:12:25.5751041Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-18T14:12:25.5779925Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:12:26.1046411Z devel: Pulling from submariner/submariner-route-agent
2021-07-18T14:12:26.1047250Z 8c741e919b67: Already exists
2021-07-18T14:12:26.1059928Z 13495efbbac4: Already exists
2021-07-18T14:12:26.1080328Z 70cc6422093d: Pulling fs layer
2021-07-18T14:12:26.1084736Z 7ba74d821748: Pulling fs layer
2021-07-18T14:12:26.1085257Z 62b0802bcf90: Pulling fs layer
2021-07-18T14:12:26.1085763Z 3e9c83283ee4: Pulling fs layer
2021-07-18T14:12:26.1086231Z 3e9c83283ee4: Waiting
2021-07-18T14:12:26.1862340Z 62b0802bcf90: Verifying Checksum
2021-07-18T14:12:26.1862927Z 62b0802bcf90: Download complete
2021-07-18T14:12:26.2872941Z 3e9c83283ee4: Verifying Checksum
2021-07-18T14:12:26.2873682Z 3e9c83283ee4: Download complete
2021-07-18T14:12:26.2874243Z 7ba74d821748: Verifying Checksum
2021-07-18T14:12:26.2874773Z 7ba74d821748: Download complete
2021-07-18T14:12:26.3609314Z 70cc6422093d: Verifying Checksum
2021-07-18T14:12:26.3610122Z 70cc6422093d: Download complete
2021-07-18T14:12:27.7967279Z 70cc6422093d: Pull complete
2021-07-18T14:12:27.9724491Z 7ba74d821748: Pull complete
2021-07-18T14:12:28.0545636Z 62b0802bcf90: Pull complete
2021-07-18T14:12:28.1289547Z 3e9c83283ee4: Pull complete
2021-07-18T14:12:28.1331383Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-18T14:12:28.1348363Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:12:28.1378137Z quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:12:28.1455139Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-18T14:12:28.4240282Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-18T14:12:28.7112992Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-18T14:12:29.0017418Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-18T14:12:29.0045355Z 1d810a4c0610: Preparing
2021-07-18T14:12:29.0048127Z 7a86b74623fc: Preparing
2021-07-18T14:12:29.0051146Z 26de773c4486: Preparing
2021-07-18T14:12:29.0053986Z 6931e591f8e2: Preparing
2021-07-18T14:12:29.0057268Z 00c5f6897675: Preparing
2021-07-18T14:12:29.0060740Z b3b62c837788: Preparing
2021-07-18T14:12:29.0061540Z b3b62c837788: Waiting
2021-07-18T14:12:29.0227925Z 00c5f6897675: Mounted from submariner-gateway
2021-07-18T14:12:29.6717823Z b3b62c837788: Mounted from submariner-gateway
2021-07-18T14:12:29.6718700Z 7a86b74623fc: Pushed
2021-07-18T14:12:29.6719284Z 1d810a4c0610: Pushed
2021-07-18T14:12:29.6815463Z 26de773c4486: Pushed
2021-07-18T14:12:33.6446590Z 6931e591f8e2: Pushed
2021-07-18T14:12:33.6624506Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-18T14:12:33.6667189Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-18T14:12:33.6678053Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-18T14:12:33.6692038Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-18T14:12:33.9443277Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-18T14:12:33.9470503Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:12:34.4588293Z devel: Pulling from submariner/lighthouse-agent
2021-07-18T14:12:34.4591425Z ecd69139dc76: Pulling fs layer
2021-07-18T14:12:34.4592032Z 8261c1767de3: Pulling fs layer
2021-07-18T14:12:34.5209427Z ecd69139dc76: Verifying Checksum
2021-07-18T14:12:34.5210070Z ecd69139dc76: Download complete
2021-07-18T14:12:34.6124349Z ecd69139dc76: Pull complete
2021-07-18T14:12:34.6774408Z 8261c1767de3: Verifying Checksum
2021-07-18T14:12:34.6775065Z 8261c1767de3: Download complete
2021-07-18T14:12:34.8619989Z 8261c1767de3: Pull complete
2021-07-18T14:12:34.8653784Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-18T14:12:34.8668839Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:12:34.8747269Z quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:12:34.8752176Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-18T14:12:35.1535986Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-18T14:12:35.4354136Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-18T14:12:35.7101142Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-18T14:12:35.7144055Z 83c79e393e11: Preparing
2021-07-18T14:12:35.7144624Z 0026d2f62bbf: Preparing
2021-07-18T14:12:35.7614501Z 0026d2f62bbf: Pushed
2021-07-18T14:12:36.2774681Z 83c79e393e11: Pushed
2021-07-18T14:12:36.2985364Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-18T14:12:36.3021520Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-18T14:12:36.3029920Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-18T14:12:36.3044735Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-18T14:12:36.5828310Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-18T14:12:36.5854395Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:12:37.0957445Z devel: Pulling from submariner/lighthouse-coredns
2021-07-18T14:12:37.0958144Z 088e56360f76: Pulling fs layer
2021-07-18T14:12:37.0958649Z 18aed70882d2: Pulling fs layer
2021-07-18T14:12:37.1900985Z 088e56360f76: Verifying Checksum
2021-07-18T14:12:37.1901899Z 088e56360f76: Download complete
2021-07-18T14:12:37.2970784Z 18aed70882d2: Verifying Checksum
2021-07-18T14:12:37.2971780Z 18aed70882d2: Download complete
2021-07-18T14:12:37.3214169Z 088e56360f76: Pull complete
2021-07-18T14:12:37.5413849Z 18aed70882d2: Pull complete
2021-07-18T14:12:37.5456541Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-18T14:12:37.5476101Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:12:37.5501223Z quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:12:37.5547511Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-18T14:12:37.8381909Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-18T14:12:38.1181653Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-18T14:12:38.4036053Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-18T14:12:38.4079214Z 7fca351e51be: Preparing
2021-07-18T14:12:38.4079950Z 4fa0ece06e25: Preparing
2021-07-18T14:12:38.4595157Z 4fa0ece06e25: Pushed
2021-07-18T14:12:39.2021691Z 7fca351e51be: Pushed
2021-07-18T14:12:39.2267631Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-18T14:12:39.2295730Z Successfully remade target file 'preload-images'.
2021-07-18T14:12:39.2299406Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-18T14:12:39.2302631Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-18T14:12:39.2306186Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-18T14:12:39.2309383Z Must remake target 'deploy'.
2021-07-18T14:12:39.2313511Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:12:39.3188219Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-18T14:12:39.3214193Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:12:39.3232370Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:12:39.3248874Z [submariner-operator]$ script_name=utils
2021-07-18T14:12:39.3259337Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:12:39.3279339Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-18T14:12:39.3291983Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:12:39.3304401Z [submariner-operator]$ script_name=deploy_funcs
2021-07-18T14:12:39.3317449Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:12:39.3337015Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:12:39.3353671Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:12:39.3366413Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:12:39.3378915Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:12:39.3399887Z [submariner-operator]$ broker=cluster1
2021-07-18T14:12:39.3411527Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:12:39.3423029Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:12:39.3434816Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:12:39.3445983Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:12:39.3456744Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:12:39.3468214Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:12:39.3480795Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:12:39.3493304Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:12:39.3506866Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:12:39.3520245Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:12:39.3534028Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:12:39.3547008Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:12:39.3561039Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:12:39.3571753Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:12:39.3586078Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:12:39.3609764Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:12:39.3626639Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:12:39.3655360Z [submariner-operator]$ declare_cidrs
2021-07-18T14:12:39.3664586Z [submariner-operator]$ declare_cidrs
2021-07-18T14:12:39.3676946Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:12:39.3691080Z [submariner-operator]$ i=1
2021-07-18T14:12:39.3705589Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:12:39.3718846Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:12:39.3735278Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:12:39.3749183Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:12:39.3761998Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:12:39.3774211Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:12:39.3786068Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:12:39.3802922Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:12:39.3815458Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:12:39.3833606Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:12:39.3847317Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:12:39.3861172Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:12:39.3876035Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:12:39.3896081Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-18T14:12:39.3909296Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:12:39.3929088Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:12:39.3964579Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-18T14:12:39.5522935Z Installing subctl version devel
2021-07-18T14:12:39.5529093Z OS detected: linux
2021-07-18T14:12:39.5534318Z Architecture detected: amd64
2021-07-18T14:12:39.5540459Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-18T14:12:39.5546151Z
2021-07-18T14:12:39.5551059Z Downloading...
2021-07-18T14:12:40.7899469Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-18T14:12:40.8092546Z This provides subctl version: devel
2021-07-18T14:12:40.8113994Z
2021-07-18T14:12:40.8114700Z please update your path (and consider adding it to ~/.profile):
2021-07-18T14:12:40.8115332Z export PATH=$PATH:/go/bin
2021-07-18T14:12:40.8115747Z
2021-07-18T14:12:40.8220589Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:12:40.8233269Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:12:40.8241896Z Will deploy submariner using operator
2021-07-18T14:12:40.8256932Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-18T14:12:40.8272158Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:12:40.8283691Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-18T14:12:40.8295677Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-18T14:12:40.8316899Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:12:40.8330035Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:12:40.8341698Z 
2021-07-18T14:12:40.8359509Z [submariner-operator]$ [cluster2] subctl version
2021-07-18T14:12:40.8594957Z subctl version: devel-0105e4d
2021-07-18T14:12:40.8624143Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:12:40.8637238Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:12:40.8651618Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-18T14:12:40.8668109Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:12:40.8697654Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:12:40.8712840Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:12:40.8726630Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:12:40.8740873Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:12:40.8788865Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-18T14:12:40.8803054Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-18T14:12:40.8817030Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:12:40.8836454Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:12:40.8857912Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:12:40.8865695Z [submariner-operator]$ [cluster1] pids[cluster1]=7179
2021-07-18T14:12:40.8873339Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:12:40.8890092Z [submariner-operator]$ [cluster2] pids[cluster2]=7183
2021-07-18T14:12:40.8892944Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:12:40.8914444Z [submariner-operator]$ [cluster2] wait 7183
2021-07-18T14:12:40.8919583Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:12:40.8937809Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:12:40.8954037Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:12:41.2728745Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:12:41.2729932Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:12:41.2731292Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:12:41.2732693Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:41.2734334Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:41.2736228Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:41.2737564Z [cluster1] node/cluster1-worker labeled
2021-07-18T14:12:41.3034927Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:12:41.3036161Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:12:41.3037204Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:12:41.3038555Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:41.3040213Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:41.3041973Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:41.3043268Z [cluster2] node/cluster2-worker labeled
2021-07-18T14:12:41.3060767Z [submariner-operator]$ [cluster2] wait 7179
2021-07-18T14:12:41.3074224Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:12:41.3087765Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:12:41.3101437Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:12:41.3113032Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:12:41.3120643Z Installing broker...
2021-07-18T14:12:41.3132971Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:12:41.3147897Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:12:41.3178391Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-18T14:12:41.3192980Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-18T14:12:41.3426846Z • Setting up broker RBAC ...
2021-07-18T14:12:41.4224253Z ✓ Setting up broker RBAC
2021-07-18T14:12:41.4225380Z • Deploying the Submariner operator ...
2021-07-18T14:12:52.6956790Z ✓ Deploying the Submariner operator
2021-07-18T14:12:52.6957914Z ✓ Created operator CRDs
2021-07-18T14:12:52.6958767Z ✓ Created operator namespace: submariner-operator
2021-07-18T14:12:52.6959824Z ✓ Created operator service account and role
2021-07-18T14:12:52.6960765Z ✓ Created lighthouse service account and role
2021-07-18T14:12:52.6961853Z ✓ Created Lighthouse service accounts and roles
2021-07-18T14:12:52.6962812Z ✓ Deployed the operator successfully
2021-07-18T14:12:52.6963638Z • Deploying the broker ...
2021-07-18T14:12:52.7075146Z ✓ Deploying the broker
2021-07-18T14:12:52.7080250Z ✓ The broker has been deployed
2021-07-18T14:12:52.7094740Z • Creating broker-info.subm file ...
2021-07-18T14:12:52.7221621Z ✓ Creating broker-info.subm file
2021-07-18T14:12:52.7263189Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-18T14:12:52.7348879Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:12:52.7363293Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:12:52.7387997Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:12:52.7403502Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:12:52.7419410Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:12:52.7457399Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-18T14:12:52.7473304Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-18T14:12:52.7488841Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:12:52.7512070Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:12:52.7535923Z [submariner-operator]$ [cluster1] pids[cluster1]=7246
2021-07-18T14:12:52.7572672Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:12:52.7582217Z [submariner-operator]$ [cluster2] pids[cluster2]=7248
2021-07-18T14:12:52.7599026Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:12:52.7612842Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:12:52.7634065Z [submariner-operator]$ [cluster2] wait 7248
2021-07-18T14:12:52.7660615Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:12:52.7679138Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:12:52.7702637Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:12:59.4265691Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:12:59.4266922Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:12:59.4268162Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:12:59.4269643Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-18T14:12:59.4272811Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:12:59.4275927Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.8:6443
2021-07-18T14:12:59.4277207Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-18T14:12:59.4278003Z [cluster1] - cluster1-worker
2021-07-18T14:12:59.4278814Z [cluster1] • Discovering network details ...
2021-07-18T14:12:59.4279605Z [cluster1] Network plugin: weave-net
2021-07-18T14:12:59.4280298Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-18T14:12:59.4280856Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-18T14:12:59.4281604Z [cluster1] ✓ Discovering network details
2021-07-18T14:12:59.4282444Z [cluster1] • Discovering multi cluster details ...
2021-07-18T14:12:59.4283328Z [cluster1] • Validating Globalnet configurations ...
2021-07-18T14:12:59.4284254Z [cluster1] ✓ Validating Globalnet configurations
2021-07-18T14:12:59.4285138Z [cluster1] ✓ Discovering multi cluster details
2021-07-18T14:12:59.4286007Z [cluster1] • Deploying the Submariner operator ...
2021-07-18T14:12:59.4286867Z [cluster1] ✓ Deploying the Submariner operator
2021-07-18T14:12:59.4287788Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-18T14:12:59.4288634Z [cluster1] • Creating SA for cluster ...
2021-07-18T14:12:59.4289353Z [cluster1] ✓ Creating SA for cluster
2021-07-18T14:12:59.4290096Z [cluster1] • Deploying Submariner ...
2021-07-18T14:12:59.4290851Z [cluster1] ✓ Deploying Submariner
2021-07-18T14:12:59.4291607Z [cluster1] ✓ Submariner is up and running
2021-07-18T14:13:06.3016190Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:13:06.3017299Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-18T14:13:06.3018546Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:13:06.3020074Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-18T14:13:06.3023106Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:13:06.3026379Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.8:6443
2021-07-18T14:13:06.3027574Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-18T14:13:06.3028379Z [cluster2] - cluster2-worker
2021-07-18T14:13:06.3029179Z [cluster2] • Discovering network details ...
2021-07-18T14:13:06.3029982Z [cluster2] Network plugin: weave-net
2021-07-18T14:13:06.3030574Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-18T14:13:06.3031146Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-18T14:13:06.3031899Z [cluster2] ✓ Discovering network details
2021-07-18T14:13:06.3032738Z [cluster2] • Discovering multi cluster details ...
2021-07-18T14:13:06.3033641Z [cluster2] • Validating Globalnet configurations ...
2021-07-18T14:13:06.3034548Z [cluster2] ✓ Validating Globalnet configurations
2021-07-18T14:13:06.3035423Z [cluster2] ✓ Discovering multi cluster details
2021-07-18T14:13:06.3036344Z [cluster2] • Deploying the Submariner operator ...
2021-07-18T14:13:06.3037397Z [cluster2] ✓ Deploying the Submariner operator
2021-07-18T14:13:06.3038173Z [cluster2] ✓ Created operator CRDs
2021-07-18T14:13:06.3039111Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-18T14:13:06.3040098Z [cluster2] ✓ Created operator service account and role
2021-07-18T14:13:06.3041022Z [cluster2] ✓ Created lighthouse service account and role
2021-07-18T14:13:06.3041976Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-18T14:13:06.3042896Z [cluster2] ✓ Deployed the operator successfully
2021-07-18T14:13:06.3043708Z [cluster2] • Creating SA for cluster ...
2021-07-18T14:13:06.3044426Z [cluster2] ✓ Creating SA for cluster
2021-07-18T14:13:06.3045172Z [cluster2] • Deploying Submariner ...
2021-07-18T14:13:06.3045904Z [cluster2] ✓ Deploying Submariner
2021-07-18T14:13:06.3046664Z [cluster2] ✓ Submariner is up and running
2021-07-18T14:13:06.3069497Z [submariner-operator]$ [cluster2] wait 7246
2021-07-18T14:13:06.3136158Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:13:06.3148104Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:13:06.3208870Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-18T14:13:06.3240945Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:13:06.3343993Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:13:06.3396174Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:06.3416338Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:06.3433658Z [submariner-operator]$ [cluster2] wait 7289
2021-07-18T14:13:06.3452692Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:06.3481913Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:06.3521684Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:06.6649443Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:06.6694769Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:06.7711275Z • Showing Connections ...
2021-07-18T14:13:06.7848317Z ✗ Showing Connections
2021-07-18T14:13:06.7849059Z ✗ There are no gateways detected
2021-07-18T14:13:06.8265625Z • Showing Connections ...
2021-07-18T14:13:06.8301002Z panic: runtime error: invalid memory address or nil pointer dereference
2021-07-18T14:13:06.8308270Z [signal SIGSEGV: segmentation violation code=0x1 addr=0x60 pc=0x1a02ca9]
2021-07-18T14:13:06.8309001Z
2021-07-18T14:13:06.8311282Z goroutine 1 [running]:
2021-07-18T14:13:06.8316085Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.getConnectionsStatus(0xc00044e2d0, 0xc0004664e0)
2021-07-18T14:13:06.8320903Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:65 +0x89
2021-07-18T14:13:06.8326784Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.showConnections(0xc00044e2d0, 0xc000123630)
2021-07-18T14:13:06.8329504Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:132 +0x3f
2021-07-18T14:13:06.8333898Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd.ExecuteMultiCluster(0x1fe2f30)
2021-07-18T14:13:06.8336703Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/execute.go:103 +0x1a7
2021-07-18T14:13:06.8354619Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.init.1.func1(0xc000218580, 0x30541c8, 0x0, 0x0)
2021-07-18T14:13:06.8356287Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:49 +0x2d
2021-07-18T14:13:06.8357376Z github.com/spf13/cobra.(*Command).execute(0xc000218580, 0x30541c8, 0x0, 0x0, 0xc000218580, 0x30541c8)
2021-07-18T14:13:06.8358133Z github.com/spf13/[email protected]/command.go:863 +0x2c2
2021-07-18T14:13:06.8358888Z github.com/spf13/cobra.(*Command).ExecuteC(0x2ff79a0, 0x30256c0, 0x0, 0xc000062778)
2021-07-18T14:13:06.8359951Z github.com/spf13/[email protected]/command.go:977 +0x375
2021-07-18T14:13:06.8360611Z github.com/spf13/cobra.(*Command).Execute(...)
2021-07-18T14:13:06.8361242Z github.com/spf13/[email protected]/command.go:905
2021-07-18T14:13:06.8362338Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd.Execute(...)
2021-07-18T14:13:06.8363573Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/root.go:58
2021-07-18T14:13:06.8364283Z main.main()
2021-07-18T14:13:06.8365015Z command-line-arguments/main.go:31 +0x32
2021-07-18T14:13:06.8384528Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:06.8398665Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:12.8520080Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:12.8564064Z [submariner-operator]$ [cluster2] wait 7316
2021-07-18T14:13:12.8595984Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:12.8678392Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:12.8703454Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:12.8717611Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:12.8797523Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:13.0564455Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:13.0584541Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:13.2245367Z • Showing Connections ...
2021-07-18T14:13:13.2531961Z ✗ Showing Connections
2021-07-18T14:13:13.2532877Z ✗ There are no gateways detected
2021-07-18T14:13:13.6086152Z • Showing Connections ...
2021-07-18T14:13:13.6635953Z ✗ Showing Connections
2021-07-18T14:13:13.6637103Z ✗ There are no gateways detected
2021-07-18T14:13:13.6669656Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:13.6681722Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:19.6709521Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:19.6754258Z [submariner-operator]$ [cluster2] wait 7343
2021-07-18T14:13:19.6763732Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:19.6773902Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:19.6813642Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:19.6826169Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:19.6852555Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:19.9115092Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:19.9130923Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:20.1180168Z • Showing Connections ...
2021-07-18T14:13:20.1838856Z ✗ Showing Connections
2021-07-18T14:13:20.1839591Z ✗ No connections found
2021-07-18T14:13:20.2098790Z • Showing Connections ...
2021-07-18T14:13:20.2129163Z ✗ Showing Connections
2021-07-18T14:13:20.2129891Z ✗ There are no gateways detected
2021-07-18T14:13:20.2158019Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:20.2170819Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:26.2221595Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:26.2283868Z [submariner-operator]$ [cluster2] wait 7369
2021-07-18T14:13:26.2313223Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:26.2328979Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:26.2357505Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:26.2469359Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:26.2577557Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:26.7178272Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:26.7194761Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:26.9997913Z • Showing Connections ...
2021-07-18T14:13:27.5237529Z ✗ Showing Connections
2021-07-18T14:13:27.5238226Z ✗ No connections found
2021-07-18T14:13:27.6065586Z • Showing Connections ...
2021-07-18T14:13:27.6473782Z ✗ Showing Connections
2021-07-18T14:13:27.6474585Z ✗ There are no gateways detected
2021-07-18T14:13:27.6502638Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:27.6518066Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:33.6548218Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:33.6606285Z [submariner-operator]$ [cluster2] wait 7396
2021-07-18T14:13:33.6632743Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:33.6676969Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:33.6692032Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:33.6728171Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:33.6747774Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:33.8939189Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:33.8961488Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:34.0067887Z • Showing Connections ...
2021-07-18T14:13:34.0282605Z ✗ Showing Connections
2021-07-18T14:13:34.0283314Z ✗ There are no gateways detected
2021-07-18T14:13:34.0330368Z • Showing Connections ...
2021-07-18T14:13:34.0369523Z ✗ Showing Connections
2021-07-18T14:13:34.0370165Z ✗ No connections found
2021-07-18T14:13:34.0394708Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:34.0407530Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:40.0461756Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:40.0515478Z [submariner-operator]$ [cluster2] wait 7422
2021-07-18T14:13:40.0545555Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:40.0608087Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:40.0630409Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:40.0667597Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:40.0686852Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:40.6574769Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:40.6595926Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:40.7728708Z • Showing Connections ...
2021-07-18T14:13:40.7771280Z ✗ Showing Connections
2021-07-18T14:13:40.7771950Z ✗ No connections found
2021-07-18T14:13:40.9830156Z • Showing Connections ...
2021-07-18T14:13:41.0133718Z ✗ Showing Connections
2021-07-18T14:13:41.0134402Z ✗ No connections found
2021-07-18T14:13:41.0162574Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:41.0176411Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:47.0217646Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:47.0260591Z [submariner-operator]$ [cluster2] wait 7448
2021-07-18T14:13:47.0283743Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:47.0291468Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:47.0304327Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:47.0314471Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:47.0395892Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:47.1001467Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:47.1022342Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:47.1525555Z • Showing Connections ...
2021-07-18T14:13:47.1559169Z ✓ Showing Connections
2021-07-18T14:13:47.1665415Z • Showing Connections ...
2021-07-18T14:13:47.1690400Z ✓ Showing Connections
2021-07-18T14:13:47.1714882Z cluster2-worker cluster2 172.18.0.4 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 209.764µs
2021-07-18T14:13:47.1716086Z cluster1-worker cluster1 172.18.0.7 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 232.016µs
2021-07-18T14:13:47.1734028Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:47.1754195Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:47.1771519Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:13:47.1794720Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:13:47.1811337Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-18T14:13:47.1827188Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-18T14:13:47.1841311Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-18T14:13:47.1871739Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:13:47.1885447Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:13:47.1901980Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-18T14:13:47.5065277Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-18T14:13:47.5143042Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-18T14:13:48.1329098Z devel: Pulling from submariner/nettest
2021-07-18T14:13:48.1330673Z 5843afab3874: Already exists
2021-07-18T14:13:48.1360141Z 9565bb92f43f: Pulling fs layer
2021-07-18T14:13:48.1360830Z a31c0d5b4ad6: Pulling fs layer
2021-07-18T14:13:48.1361352Z dc3d13650205: Pulling fs layer
2021-07-18T14:13:48.2174781Z dc3d13650205: Verifying Checksum
2021-07-18T14:13:48.2175540Z dc3d13650205: Download complete
2021-07-18T14:13:48.2265881Z 9565bb92f43f: Verifying Checksum
2021-07-18T14:13:48.2266459Z 9565bb92f43f: Download complete
2021-07-18T14:13:48.3026796Z a31c0d5b4ad6: Verifying Checksum
2021-07-18T14:13:48.3027785Z a31c0d5b4ad6: Download complete
2021-07-18T14:13:48.5457653Z 9565bb92f43f: Pull complete
2021-07-18T14:13:48.9305524Z a31c0d5b4ad6: Pull complete
2021-07-18T14:13:49.0158200Z dc3d13650205: Pull complete
2021-07-18T14:13:49.0199174Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-18T14:13:49.0216613Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-18T14:13:49.0274146Z quay.io/submariner/nettest:devel
2021-07-18T14:13:49.0300392Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-18T14:13:49.3571984Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-18T14:13:49.6704918Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-18T14:13:49.9738147Z The push refers to repository [localhost:5000/nettest]
2021-07-18T14:13:49.9849826Z 4f2cdf68c81d: Preparing
2021-07-18T14:13:49.9850360Z 1f803d62c8b3: Preparing
2021-07-18T14:13:49.9850892Z 80c9eaab4c9e: Preparing
2021-07-18T14:13:49.9851469Z 72e830a4dff5: Preparing
2021-07-18T14:13:50.6112715Z 80c9eaab4c9e: Pushed
2021-07-18T14:13:50.6550681Z 4f2cdf68c81d: Pushed
2021-07-18T14:13:50.6630881Z 72e830a4dff5: Pushed
2021-07-18T14:13:51.2752418Z 1f803d62c8b3: Pushed
2021-07-18T14:13:51.3002117Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-18T14:13:51.3083236Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:51.3099779Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:51.3119060Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:13:51.3140838Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-18T14:13:51.3167456Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:51.3179578Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:51.3197038Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:51.8623332Z deployment.apps/netshoot created
2021-07-18T14:13:51.8734744Z Waiting for netshoot pods to be ready.
2021-07-18T14:13:51.8750169Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:13:51.8768753Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:13:51.8786364Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-18T14:13:52.1948551Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-18T14:13:54.4897691Z deployment "netshoot" successfully rolled out
2021-07-18T14:13:54.4957404Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:54.4973778Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:54.4991395Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:54.5009774Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-18T14:13:54.5026414Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:13:54.5045656Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-18T14:13:54.5068075Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:54.5082845Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:54.5099367Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:55.2533832Z deployment.apps/nginx-demo created
2021-07-18T14:13:55.2609311Z service/nginx-demo created
2021-07-18T14:13:55.4723267Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-18T14:13:55.4780538Z Waiting for nginx-demo pods to be ready.
2021-07-18T14:13:55.4794956Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:13:55.4829797Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:13:55.4846579Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:13:56.0094084Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:14:01.4432955Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:14:01.5484776Z deployment "nginx-demo" successfully rolled out
2021-07-18T14:14:01.5550567Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-18T14:14:01.5574656Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:14:01.5601413Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-18T14:14:01.5661046Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:14:01.5711861Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-18T14:14:01.9674062Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-18T14:14:01.9697196Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:14:01.9712470Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:14:01.9728176Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-18T14:14:01.9741633Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-18T14:14:01.9758336Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-18T14:14:01.9778113Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:14:01.9798148Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-18T14:14:01.9805512Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:14:01.9820426Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:14:02.2871231Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-q8td6 100.1.184.111
2021-07-18T14:14:02.2889293Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-q8td6 100.1.184.111
2021-07-18T14:14:02.2903738Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:14:02.2933614Z [submariner-operator]$ [cluster2] wait 7602
2021-07-18T14:14:02.2942418Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-q8td6 100.1.184.111
2021-07-18T14:14:02.2959363Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:14:02.2967088Z Attempting connectivity between clusters - netshoot-57677568b8-q8td6 --> 100.1.184.111
2021-07-18T14:14:02.2979969Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:14:02.2995854Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:14:02.3017938Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:14:02.3060980Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-q8td6 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.184.111
2021-07-18T14:14:02.3077207Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-q8td6 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.184.111
2021-07-18T14:14:02.3093523Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-q8td6 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.184.111
2021-07-18T14:14:02.7416554Z Connection test was successful!
2021-07-18T14:14:02.7436679Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:02.7450438Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:02.7463835Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:02.7478004Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:02.7493201Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:02.7510960Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:03.0530135Z deployment.apps "netshoot" deleted
2021-07-18T14:14:03.0605635Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:03.0626156Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:03.0645304Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:03.0660263Z [submariner-operator]$ [cluster1] remove_resource
2021-07-18T14:14:03.0674673Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:03.0688025Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:03.0702219Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:03.3652973Z deployment.apps "nginx-demo" deleted
2021-07-18T14:14:03.4066142Z service "nginx-demo" deleted
2021-07-18T14:14:03.4734980Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-18T14:14:03.4977053Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-18T14:14:03.4992285Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-18T14:14:03.5013319Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-18T14:14:03.5031739Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:14:03.5087892Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:03.5097901Z Successfully remade target file 'deploy'.
2021-07-18T14:14:03.5098701Z Must remake target 'e2e'.
2021-07-18T14:14:03.5100993Z scripts/kind-e2e/e2e.sh
2021-07-18T14:14:03.5191806Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:14:03.5209294Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:03.5228894Z [submariner-operator]$ script_name=utils
2021-07-18T14:14:03.5241712Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:03.5282673Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-18T14:14:03.5294704Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:03.5332325Z [submariner-operator]$ script_name=deploy_funcs
2021-07-18T14:14:03.5351668Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:03.5370579Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-18T14:14:03.5391115Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:03.5404652Z [submariner-operator]$ script_name=deploy_operator
2021-07-18T14:14:03.5426321Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:03.5446609Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:14:03.5459683Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:03.5474654Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:14:03.5489420Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:03.5513607Z [submariner-operator]$ broker=cluster1
2021-07-18T14:14:03.5525841Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:14:03.5540319Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:14:03.5560060Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:14:03.5576339Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:14:03.5590340Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:14:03.5611024Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:14:03.5637698Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:14:03.5651025Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:14:03.5664328Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:14:03.5679118Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:14:03.5693025Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:14:03.5715546Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:14:03.5734100Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:03.5747390Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:14:03.5759786Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:03.5791903Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:14:03.5806663Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:14:03.5962135Z [submariner-operator]$ timeout=2m
2021-07-18T14:14:03.5977189Z [submariner-operator]$ declare_kubeconfig
2021-07-18T14:14:03.5993581Z [submariner-operator]$ declare_kubeconfig
2021-07-18T14:14:03.6004492Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:14:03.6024403Z [submariner-operator]$ export KUBECONFIG
2021-07-18T14:14:03.6043147Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:14:03.6061724Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:14:03.6120749Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-18T14:14:03.6152603Z [submariner-operator]$ create_subm_vars
2021-07-18T14:14:03.6164805Z [submariner-operator]$ create_subm_vars
2021-07-18T14:14:03.6178457Z [submariner-operator]$ deployment_name=submariner
2021-07-18T14:14:03.6193185Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-18T14:14:03.6204545Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-18T14:14:03.6218220Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-18T14:14:03.6228522Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-18T14:14:03.6241099Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-18T14:14:03.6251374Z [submariner-operator]$ declare_cidrs
2021-07-18T14:14:03.6260723Z [submariner-operator]$ declare_cidrs
2021-07-18T14:14:03.6270583Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:14:03.6281289Z [submariner-operator]$ i=1
2021-07-18T14:14:03.6293812Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:14:03.6305999Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:14:03.6320659Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:14:03.6334894Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:14:03.6351590Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:14:03.6365103Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:14:03.6375983Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:14:03.6390019Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:14:03.6400184Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:14:03.6413910Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:14:03.6423395Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-18T14:14:03.6438880Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-18T14:14:03.6449605Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-18T14:14:03.6458750Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-18T14:14:03.6473157Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-18T14:14:03.6486611Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-18T14:14:03.6499572Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-18T14:14:03.6512912Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-18T14:14:03.6525968Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-18T14:14:03.6539282Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-18T14:14:03.6553201Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-18T14:14:03.6565885Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-18T14:14:03.6580219Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-18T14:14:03.6595949Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-18T14:14:03.6613139Z [submariner-operator]$ [cluster1] broker_vars
2021-07-18T14:14:03.6638001Z [submariner-operator]$ [cluster1] broker_vars
2021-07-18T14:14:03.6653532Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-18T14:14:03.6675621Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-18T14:14:03.6690781Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-18T14:14:03.6706079Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-18T14:14:04.1306690Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-18T14:14:04.1354187Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-18T14:14:04.1381401Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-18T14:14:04.1398977Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-18T14:14:04.5101329Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-18T14:14:04.5252318Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-18T14:14:04.5304343Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-18T14:14:04.5319416Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-18T14:14:04.5321476Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-18T14:14:04.8483085Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-18T14:14:04.8498916Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-18T14:14:04.8515510Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-18T14:14:04.8539544Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-18T14:14:04.9178845Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:05.0227900Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:05.0762110Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-18T14:14:05.0763521Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-18T14:14:05.0765189Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-18T14:14:05.0766416Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-18T14:14:05.0767660Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-18T14:14:05.0769238Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-18T14:14:05.2273275Z [submariner-operator]$ [cluster1] return
2021-07-18T14:14:05.2287677Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-18T14:14:05.2299308Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-18T14:14:05.2315425Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-18T14:14:05.5697173Z NAME TYPE DATA AGE
2021-07-18T14:14:05.5709745Z cluster-cluster1-token-kfvk7 kubernetes.io/service-account-token 3 66s
2021-07-18T14:14:05.5711474Z cluster-cluster2-token-x2l8t kubernetes.io/service-account-token 3 61s
2021-07-18T14:14:05.5713165Z default-token-dnkfr kubernetes.io/service-account-token 3 84s
2021-07-18T14:14:05.5715002Z submariner-k8s-broker-admin-token-4cz25 kubernetes.io/service-account-token 3 84s
2021-07-18T14:14:05.5717062Z submariner-k8s-broker-client-token-6xzc5 kubernetes.io/service-account-token 3 84s
2021-07-18T14:14:05.5780805Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-18T14:14:05.5792929Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-18T14:14:05.5805580Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-18T14:14:05.9017940Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:05.9033607Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-6xzc5 -n submariner-k8s-broker -o json
2021-07-18T14:14:05.9051919Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:05.9082930Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-6xzc5 -n submariner-k8s-broker -o json
2021-07-18T14:14:05.9095809Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-6xzc5 -n submariner-k8s-broker -o json
2021-07-18T14:14:06.2132932Z {
2021-07-18T14:14:06.2133692Z "apiVersion": "v1",
2021-07-18T14:14:06.2134173Z "data": {
2021-07-18T14:14:06.2806818Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-18T14:14:06.3446631Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-18T14:14:06.3447805Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-18T14:14:06.3449693Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:06.3452054Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-18T14:14:06.3453623Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-18T14:14:06.3455742Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:06.3463881Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-6xzc5
2021-07-18T14:14:06.3466486Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-6xzc5
2021-07-18T14:14:06.3468917Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:06.3470612Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-18T14:14:06.4109009Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklrMXZSazkyVWpseGVHNUxMVmg2WWpGU1kwaEJhelpIVmtaa1MweFFRelkwYzFwclVHeEdRV0phV1RnaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkwMmVIcGpOU0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pTXpReE5XUXpaV1l0TTJSbVlpMDBNRGRoTFdJMFlUa3ROalpoWkdZMVptSmxaRFptSWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLnFvek9PeDJ1NmViYW0yRHo4RFNxSHVFNGdUOXM1WmFXdlV6MWJpZHVNNnVUZEt1eW5MZUNUWjBwQVFGUkRySDZjOGpqM1Bta0h3Qkl4OVd5WExZYVJLR1phMU5pQVlPWlh6RDIxbmFjYkVVUFM2aTRwdGwzNnNIbGtTOGtXMkRmWnBleGpHckt4NDJEdVpRbm1qR1FzRVFWN0pLRnNoLTlsb25kQUhObnNyNmNmMmpBc1FVYkVrRkNOVkxBeHBQejg1RFZoLXFHcnBYWXZtOXVZMjRTOV93azk3UF9kYXVTTFNWMXNhc1pzWWlWejhXTUJKZ2hLQ3l0cFZDejNqMDgxcGxsY1BvczZ0ZDc1TDd6bms1X2RpV0lvbFRzRnpTNFpXYmRjZXlkWWlLMlo4Vkw4SThDclMtekM1cERCQjhLT01meUpQWF9sbU9SYlhfR1kwM2VxZw=="
2021-07-18T14:14:06.4619062Z },
2021-07-18T14:14:06.4619639Z "kind": "Secret",
2021-07-18T14:14:06.4620301Z "metadata": {
2021-07-18T14:14:06.4620729Z "annotations": {
2021-07-18T14:14:06.4622250Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-18T14:14:06.4623749Z "kubernetes.io/service-account.uid": "3415d3ef-3dfb-407a-b4a9-66adf5fbed6f"
2021-07-18T14:14:06.4624517Z },
2021-07-18T14:14:06.4625685Z "creationTimestamp": "2021-07-18T14:12:41Z",
2021-07-18T14:14:06.4626432Z "managedFields": [
2021-07-18T14:14:06.4627100Z {
2021-07-18T14:14:06.4627496Z "apiVersion": "v1",
2021-07-18T14:14:06.4628016Z "fieldsType": "FieldsV1",
2021-07-18T14:14:06.4628695Z "fieldsV1": {
2021-07-18T14:14:06.4629108Z "f:data": {
2021-07-18T14:14:06.4629473Z ".": {},
2021-07-18T14:14:06.4629872Z "f:ca.crt": {},
2021-07-18T14:14:06.4632264Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-18T14:14:06.4634206Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-18T14:14:06.4637369Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:06.4640401Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-6xzc5.cluster1.json
2021-07-18T14:14:06.4642217Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-18T14:14:06.4642873Z "f:namespace": {},
2021-07-18T14:14:06.4649375Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-18T14:14:06.4650403Z "f:token": {}
2021-07-18T14:14:06.4650869Z },
2021-07-18T14:14:06.4651276Z "f:metadata": {
2021-07-18T14:14:06.4651768Z "f:annotations": {
2021-07-18T14:14:06.4652798Z ".": {},
2021-07-18T14:14:06.4653735Z "f:kubernetes.io/service-account.name": {},
2021-07-18T14:14:06.4654893Z "f:kubernetes.io/service-account.uid": {}
2021-07-18T14:14:06.4660504Z }
2021-07-18T14:14:06.4663701Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-18T14:14:06.4664383Z },
2021-07-18T14:14:06.4665697Z "f:type": {}
2021-07-18T14:14:06.4666079Z },
2021-07-18T14:14:06.4666866Z "manager": "kube-controller-manager",
2021-07-18T14:14:06.4667566Z "operation": "Update",
2021-07-18T14:14:06.4668323Z "time": "2021-07-18T14:12:41Z"
2021-07-18T14:14:06.4668746Z }
2021-07-18T14:14:06.4669462Z ],
2021-07-18T14:14:06.4670467Z "name": "submariner-k8s-broker-client-token-6xzc5",
2021-07-18T14:14:06.4671960Z "namespace": "submariner-k8s-broker",
2021-07-18T14:14:06.4672692Z "resourceVersion": "1598",
2021-07-18T14:14:06.4674441Z "selfLink": "/api/v1/namespaces/submariner-k8s-broker/secrets/submariner-k8s-broker-client-token-6xzc5",
2021-07-18T14:14:06.4676053Z "uid": "1c9822ec-d50b-479a-84ca-ab8409a11b7d"
2021-07-18T14:14:06.4676636Z },
2021-07-18T14:14:06.4677400Z "type": "kubernetes.io/service-account-token"
2021-07-18T14:14:06.4678353Z }
2021-07-18T14:14:06.4682895Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:14:06.4734941Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-18T14:14:06.4740296Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-18T14:14:06.4755776Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:14:06.4772341Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:14:06.4845918Z [submariner-operator]$ [cluster1] pids[cluster1]=7849
2021-07-18T14:14:06.4848445Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:14:06.4872764Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:14:06.4873803Z [submariner-operator]$ [cluster2] pids[cluster2]=7853
2021-07-18T14:14:06.4887715Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-18T14:14:06.4894260Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-18T14:14:06.4907901Z [submariner-operator]$ [cluster2] wait 7853
2021-07-18T14:14:06.4972755Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:14:06.4992731Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:14:07.3334753Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-18T14:14:07.3336017Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-18T14:14:07.3337104Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-18T14:14:07.3338376Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:07.3339872Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:07.3341314Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:07.3342699Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:07.3344293Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-18T14:14:07.3345317Z [cluster2] NAME CREATED AT
2021-07-18T14:14:07.3346362Z [cluster2] endpoints.submariner.io 2021-07-18T14:13:06Z
2021-07-18T14:14:07.3347806Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.3349465Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:07.3351092Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.3352700Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:07.3354289Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-18T14:14:07.3355205Z [cluster2] {
2021-07-18T14:14:07.3355848Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:07.3356734Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-18T14:14:07.3357419Z [cluster2] "metadata": {
2021-07-18T14:14:07.3357918Z [cluster2] "annotations": {
2021-07-18T14:14:07.3358929Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:07.3359674Z [cluster2] },
2021-07-18T14:14:07.3360633Z [cluster2] "creationTimestamp": "2021-07-18T14:13:06Z",
2021-07-18T14:14:07.3361283Z [cluster2] "generation": 1,
2021-07-18T14:14:07.3361829Z [cluster2] "managedFields": [
2021-07-18T14:14:07.3362328Z [cluster2] {
2021-07-18T14:14:07.3362960Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:07.3363709Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:07.3364272Z [cluster2] "fieldsV1": {
2021-07-18T14:14:07.3364794Z [cluster2] "f:metadata": {
2021-07-18T14:14:07.3365352Z [cluster2] "f:annotations": {
2021-07-18T14:14:07.3365854Z [cluster2] ".": {},
2021-07-18T14:14:07.3366843Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:07.3367597Z [cluster2] }
2021-07-18T14:14:07.3368036Z [cluster2] },
2021-07-18T14:14:07.3368481Z [cluster2] "f:spec": {
2021-07-18T14:14:07.3369012Z [cluster2] "f:conversion": {
2021-07-18T14:14:07.3369508Z [cluster2] ".": {},
2021-07-18T14:14:07.3370013Z [cluster2] "f:strategy": {}
2021-07-18T14:14:07.3370486Z [cluster2] },
2021-07-18T14:14:07.3370961Z [cluster2] "f:group": {},
2021-07-18T14:14:07.3371462Z [cluster2] "f:names": {
2021-07-18T14:14:07.3371945Z [cluster2] "f:kind": {},
2021-07-18T14:14:07.3372581Z [cluster2] "f:listKind": {},
2021-07-18T14:14:07.3373103Z [cluster2] "f:plural": {},
2021-07-18T14:14:07.3373634Z [cluster2] "f:singular": {}
2021-07-18T14:14:07.3374102Z [cluster2] },
2021-07-18T14:14:07.3374576Z [cluster2] "f:scope": {},
2021-07-18T14:14:07.3375077Z [cluster2] "f:versions": {}
2021-07-18T14:14:07.3375561Z [cluster2] },
2021-07-18T14:14:07.3376010Z [cluster2] "f:status": {
2021-07-18T14:14:07.3376574Z [cluster2] "f:acceptedNames": {
2021-07-18T14:14:07.3377132Z [cluster2] "f:kind": {},
2021-07-18T14:14:07.3377629Z [cluster2] "f:plural": {}
2021-07-18T14:14:07.3378105Z [cluster2] },
2021-07-18T14:14:07.3378591Z [cluster2] "f:conditions": {},
2021-07-18T14:14:07.3379199Z [cluster2] "f:storedVersions": {}
2021-07-18T14:14:07.3379712Z [cluster2] }
2021-07-18T14:14:07.3380136Z [cluster2] },
2021-07-18T14:14:07.3380931Z [cluster2] "manager": "submariner-operator",
2021-07-18T14:14:07.3381621Z [cluster2] "operation": "Update",
2021-07-18T14:14:07.3382348Z [cluster2] "time": "2021-07-18T14:13:16Z"
2021-07-18T14:14:07.3382806Z [cluster2] }
2021-07-18T14:14:07.3383223Z [cluster2] ],
2021-07-18T14:14:07.3383838Z [cluster2] "name": "endpoints.submariner.io",
2021-07-18T14:14:07.3384575Z [cluster2] "resourceVersion": "1827",
2021-07-18T14:14:07.3385854Z [cluster2] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-18T14:14:07.3387336Z [cluster2] "uid": "88100d3f-e532-4bda-be79-efbccb9d9c9c"
2021-07-18T14:14:07.3387961Z [cluster2] },
2021-07-18T14:14:07.3388394Z [cluster2] "spec": {
2021-07-18T14:14:07.3388871Z [cluster2] "conversion": {
2021-07-18T14:14:07.3389403Z [cluster2] "strategy": "None"
2021-07-18T14:14:07.3389878Z [cluster2] },
2021-07-18T14:14:07.3390382Z [cluster2] "group": "submariner.io",
2021-07-18T14:14:07.3390919Z [cluster2] "names": {
2021-07-18T14:14:07.3391409Z [cluster2] "kind": "Endpoint",
2021-07-18T14:14:07.3392109Z [cluster2] "listKind": "EndpointList",
2021-07-18T14:14:07.3392721Z [cluster2] "plural": "endpoints",
2021-07-18T14:14:07.3393310Z [cluster2] "singular": "endpoint"
2021-07-18T14:14:07.3393789Z [cluster2] },
2021-07-18T14:14:07.3394288Z [cluster2] "scope": "Namespaced",
2021-07-18T14:14:07.3394812Z [cluster2] "versions": [
2021-07-18T14:14:07.3395270Z [cluster2] {
2021-07-18T14:14:07.3395705Z [cluster2] "name": "v1",
2021-07-18T14:14:07.3396187Z [cluster2] "schema": {
2021-07-18T14:14:07.3396759Z [cluster2] "openAPIV3Schema": {
2021-07-18T14:14:07.3397357Z [cluster2] "properties": {
2021-07-18T14:14:07.3397930Z [cluster2] "apiVersion": {
2021-07-18T14:14:07.3400304Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:07.3402157Z [cluster2] "type": "string"
2021-07-18T14:14:07.3402661Z [cluster2] },
2021-07-18T14:14:07.3403122Z [cluster2] "kind": {
2021-07-18T14:14:07.3405389Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:07.3407336Z [cluster2] "type": "string"
2021-07-18T14:14:07.3407823Z [cluster2] },
2021-07-18T14:14:07.3408320Z [cluster2] "metadata": {
2021-07-18T14:14:07.3408859Z [cluster2] "type": "object"
2021-07-18T14:14:07.3409355Z [cluster2] },
2021-07-18T14:14:07.3409813Z [cluster2] "spec": {
2021-07-18T14:14:07.3410351Z [cluster2] "properties": {
2021-07-18T14:14:07.3410910Z [cluster2] "backend": {
2021-07-18T14:14:07.3411443Z [cluster2] "type": "string"
2021-07-18T14:14:07.3411965Z [cluster2] },
2021-07-18T14:14:07.3412474Z [cluster2] "backend_config": {
2021-07-18T14:14:07.3413162Z [cluster2] "additionalProperties": {
2021-07-18T14:14:07.3413834Z [cluster2] "type": "string"
2021-07-18T14:14:07.3414352Z [cluster2] },
2021-07-18T14:14:07.3414874Z [cluster2] "type": "object"
2021-07-18T14:14:07.3415372Z [cluster2] },
2021-07-18T14:14:07.3415879Z [cluster2] "cable_name": {
2021-07-18T14:14:07.3416415Z [cluster2] "type": "string"
2021-07-18T14:14:07.3420145Z [cluster2] },
2021-07-18T14:14:07.3420688Z [cluster2] "cluster_id": {
2021-07-18T14:14:07.3421246Z [cluster2] "type": "string"
2021-07-18T14:14:07.3421754Z [cluster2] },
2021-07-18T14:14:07.3422316Z [cluster2] "healthCheckIP": {
2021-07-18T14:14:07.3422920Z [cluster2] "type": "string"
2021-07-18T14:14:07.3423417Z [cluster2] },
2021-07-18T14:14:07.3423927Z [cluster2] "hostname": {
2021-07-18T14:14:07.3446049Z [cluster2] "type": "string"
2021-07-18T14:14:07.3446698Z [cluster2] },
2021-07-18T14:14:07.3447208Z [cluster2] "nat_enabled": {
2021-07-18T14:14:07.3447784Z [cluster2] "type": "boolean"
2021-07-18T14:14:07.3448292Z [cluster2] },
2021-07-18T14:14:07.3448803Z [cluster2] "private_ip": {
2021-07-18T14:14:07.3449381Z [cluster2] "type": "string"
2021-07-18T14:14:07.3449878Z [cluster2] },
2021-07-18T14:14:07.3450380Z [cluster2] "public_ip": {
2021-07-18T14:14:07.3450918Z [cluster2] "type": "string"
2021-07-18T14:14:07.3451430Z [cluster2] },
2021-07-18T14:14:07.3451918Z [cluster2] "subnets": {
2021-07-18T14:14:07.3452530Z [cluster2] "items": {
2021-07-18T14:14:07.3453075Z [cluster2] "type": "string"
2021-07-18T14:14:07.3453582Z [cluster2] },
2021-07-18T14:14:07.3454094Z [cluster2] "type": "array"
2021-07-18T14:14:07.3454583Z [cluster2] }
2021-07-18T14:14:07.3455130Z [cluster2] },
2021-07-18T14:14:07.3455618Z [cluster2] "required": [
2021-07-18T14:14:07.3456159Z [cluster2] "backend",
2021-07-18T14:14:07.4070023Z [cluster2] [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-18T14:14:07.4074925Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-18T14:14:07.4076114Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-18T14:14:07.4077410Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:07.4078876Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:07.4080320Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:07.4081708Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:07.4083261Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-18T14:14:07.4084237Z [cluster1] NAME CREATED AT
2021-07-18T14:14:07.4085122Z [cluster1] endpoints.submariner.io 2021-07-18T14:12:51Z
2021-07-18T14:14:07.4086616Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.4088255Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:07.4089876Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.4091472Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:07.4093055Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-18T14:14:07.4093978Z [cluster1] {
2021-07-18T14:14:07.4094609Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:07.4095477Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-18T14:14:07.4096149Z [cluster1] "metadata": {
2021-07-18T14:14:07.4096666Z [cluster1] "annotations": {
2021-07-18T14:14:07.4097655Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:07.4098403Z [cluster1] },
2021-07-18T14:14:07.4099144Z [cluster1] "creationTimestamp": "2021-07-18T14:12:51Z",
2021-07-18T14:14:07.4099939Z [cluster1] "generation": 1,
2021-07-18T14:14:07.4100489Z [cluster1] "managedFields": [
2021-07-18T14:14:07.4100993Z [cluster1] {
2021-07-18T14:14:07.4101628Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:07.4102385Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:07.4102966Z [cluster1] "fieldsV1": {
2021-07-18T14:14:07.4103476Z [cluster1] "f:metadata": {
2021-07-18T14:14:07.4104033Z [cluster1] "f:annotations": {
2021-07-18T14:14:07.4104544Z [cluster1] ".": {},
2021-07-18T14:14:07.4106241Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:07.4106994Z [cluster1] }
2021-07-18T14:14:07.4107437Z [cluster1] },
2021-07-18T14:14:07.4107932Z [cluster1] "f:spec": {
2021-07-18T14:14:07.4108460Z [cluster1] "f:conversion": {
2021-07-18T14:14:07.4108981Z [cluster1] ".": {},
2021-07-18T14:14:07.4109468Z [cluster1] "f:strategy": {}
2021-07-18T14:14:07.4109958Z [cluster1] },
2021-07-18T14:14:07.4110418Z [cluster1] "f:group": {},
2021-07-18T14:14:07.4111037Z [cluster1] "f:names": {
2021-07-18T14:14:07.4111517Z [cluster1] "f:kind": {},
2021-07-18T14:14:07.4112039Z [cluster1] "f:listKind": {},
2021-07-18T14:14:07.4112692Z [cluster1] "f:plural": {},
2021-07-18T14:14:07.4113220Z [cluster1] "f:singular": {}
2021-07-18T14:14:07.4113693Z [cluster1] },
2021-07-18T14:14:07.4114168Z [cluster1] "f:scope": {},
2021-07-18T14:14:07.4114725Z [cluster1] "f:versions": {}
2021-07-18T14:14:07.4115188Z [cluster1] },
2021-07-18T14:14:07.4115661Z [cluster1] "f:status": {
2021-07-18T14:14:07.4116293Z [cluster1] "f:acceptedNames": {
2021-07-18T14:14:07.4116856Z [cluster1] "f:kind": {},
2021-07-18T14:14:07.4117353Z [cluster1] "f:plural": {}
2021-07-18T14:14:07.4117832Z [cluster1] },
2021-07-18T14:14:07.4118321Z [cluster1] "f:conditions": {},
2021-07-18T14:14:07.4118924Z [cluster1] "f:storedVersions": {}
2021-07-18T14:14:07.4119448Z [cluster1] }
2021-07-18T14:14:07.4119877Z [cluster1] },
2021-07-18T14:14:07.4120699Z [cluster1] "manager": "submariner-operator",
2021-07-18T14:14:07.4121375Z [cluster1] "operation": "Update",
2021-07-18T14:14:07.4122113Z [cluster1] "time": "2021-07-18T14:12:54Z"
2021-07-18T14:14:07.4122565Z [cluster1] }
2021-07-18T14:14:07.4122988Z [cluster1] ],
2021-07-18T14:14:07.4123603Z [cluster1] "name": "endpoints.submariner.io",
2021-07-18T14:14:07.4124342Z [cluster1] "resourceVersion": "1774",
2021-07-18T14:14:07.4125489Z [cluster1] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-18T14:14:07.4127031Z [cluster1] "uid": "0cf3f97e-b8b6-4e4d-9fd7-5d2b678d3dd8"
2021-07-18T14:14:07.4127644Z [cluster1] },
2021-07-18T14:14:07.4128030Z [cluster1] "spec": {
2021-07-18T14:14:07.4128494Z [cluster1] "conversion": {
2021-07-18T14:14:07.4128975Z [cluster1] "strategy": "None"
2021-07-18T14:14:07.4129418Z [cluster1] },
2021-07-18T14:14:07.4129890Z [cluster1] "group": "submariner.io",
2021-07-18T14:14:07.4130391Z [cluster1] "names": {
2021-07-18T14:14:07.4130845Z [cluster1] "kind": "Endpoint",
2021-07-18T14:14:07.4131470Z [cluster1] "listKind": "EndpointList",
2021-07-18T14:14:07.4132149Z [cluster1] "plural": "endpoints",
2021-07-18T14:14:07.4132692Z [cluster1] "singular": "endpoint"
2021-07-18T14:14:07.4133331Z [cluster1] },
2021-07-18T14:14:07.4133817Z [cluster1] "scope": "Namespaced",
2021-07-18T14:14:07.4134354Z [cluster1] "versions": [
2021-07-18T14:14:07.4134796Z [cluster1] {
2021-07-18T14:14:07.4135241Z [cluster1] "name": "v1",
2021-07-18T14:14:07.4135706Z [cluster1] "schema": {
2021-07-18T14:14:07.4136280Z [cluster1] "openAPIV3Schema": {
2021-07-18T14:14:07.4136876Z [cluster1] "properties": {
2021-07-18T14:14:07.4137450Z [cluster1] "apiVersion": {
2021-07-18T14:14:07.4139830Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:07.4141691Z [cluster1] "type": "string"
2021-07-18T14:14:07.4142199Z [cluster1] },
2021-07-18T14:14:07.4142675Z [cluster1] "kind": {
2021-07-18T14:14:07.4145038Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:07.4146969Z [cluster1] "type": "string"
2021-07-18T14:14:07.4147474Z [cluster1] },
2021-07-18T14:14:07.4147954Z [cluster1] "metadata": {
2021-07-18T14:14:07.4148504Z [cluster1] "type": "object"
2021-07-18T14:14:07.4148989Z [cluster1] },
2021-07-18T14:14:07.4149465Z [cluster1] "spec": {
2021-07-18T14:14:07.4149985Z [cluster1] "properties": {
2021-07-18T14:14:07.4150540Z [cluster1] "backend": {
2021-07-18T14:14:07.4151069Z [cluster1] "type": "string"
2021-07-18T14:14:07.4151586Z [cluster1] },
2021-07-18T14:14:07.4152114Z [cluster1] "backend_config": {
2021-07-18T14:14:07.4152790Z [cluster1] "additionalProperties": {
2021-07-18T14:14:07.4153477Z [cluster1] "type": "string"
2021-07-18T14:14:07.4153987Z [cluster1] },
2021-07-18T14:14:07.4154506Z [cluster1] "type": "object"
2021-07-18T14:14:07.4155004Z [cluster1] },
2021-07-18T14:14:07.4155508Z [cluster1] "cable_name": {
2021-07-18T14:14:07.4156059Z [cluster1] "type": "string"
2021-07-18T14:14:07.4156557Z [cluster1] },
2021-07-18T14:14:07.4157061Z [cluster1] "cluster_id": {
2021-07-18T14:14:07.4157603Z [cluster1] "type": "string"
2021-07-18T14:14:07.4158118Z [cluster1] },
2021-07-18T14:14:07.4158655Z [cluster1] "healthCheckIP": {
2021-07-18T14:14:07.4159257Z [cluster1] "type": "string"
2021-07-18T14:14:07.4159757Z [cluster1] },
2021-07-18T14:14:07.4160435Z [cluster1] "hostname": {
2021-07-18T14:14:07.4161064Z [cluster1] "type": "string"
2021-07-18T14:14:07.4161561Z [cluster1] },
2021-07-18T14:14:07.4162064Z [cluster1] "nat_enabled": {
2021-07-18T14:14:07.4162617Z [cluster1] "type": "boolean"
2021-07-18T14:14:07.4163133Z [cluster1] },
2021-07-18T14:14:07.4163629Z [cluster1] "private_ip": {
2021-07-18T14:14:07.4164193Z [cluster1] "type": "string"
2021-07-18T14:14:07.4164714Z [cluster1] },
2021-07-18T14:14:07.4165200Z [cluster1] "public_ip": {
2021-07-18T14:14:07.4165751Z [cluster1] "type": "string"
2021-07-18T14:14:07.4166240Z [cluster1] },
2021-07-18T14:14:07.4166740Z [cluster1] "subnets": {
2021-07-18T14:14:07.4167250Z [cluster1] "items": {
2021-07-18T14:14:07.4167794Z [cluster1] "type": "string"
2021-07-18T14:14:07.4168299Z [cluster1] },
2021-07-18T14:14:07.4168807Z [cluster1] "type": "array"
2021-07-18T14:14:07.4169315Z [cluster1] }
2021-07-18T14:14:07.4169760Z [cluster1] },
2021-07-18T14:14:07.4170325Z [cluster1] "required": [
2021-07-18T14:14:07.4170847Z [cluster1] "backend",
2021-07-18T14:14:07.6074761Z [cluster1] "cable_name",
2021-07-18T14:14:07.6075379Z [cluster2] "cluster_id",
2021-07-18T14:14:07.6075935Z [cluster2] "hostname",
2021-07-18T14:14:07.6076474Z [cluster2] "nat_enabled",
2021-07-18T14:14:07.6077179Z [cluster2] "private_ip",
2021-07-18T14:14:07.6077717Z [cluster2] "public_ip",
2021-07-18T14:14:07.6078257Z [cluster2] "subnets"
2021-07-18T14:14:07.6078739Z [cluster2] ],
2021-07-18T14:14:07.6079254Z [cluster2] "type": "object"
2021-07-18T14:14:07.6079739Z [cluster2] }
2021-07-18T14:14:07.6080193Z [cluster2] },
2021-07-18T14:14:07.6080684Z [cluster2] "required": [
2021-07-18T14:14:07.6081179Z [cluster2] "spec"
2021-07-18T14:14:07.6081639Z [cluster2] ],
2021-07-18T14:14:07.6082116Z [cluster2] "type": "object"
2021-07-18T14:14:07.6082679Z [cluster2] }
2021-07-18T14:14:07.6083093Z [cluster2] },
2021-07-18T14:14:07.6083574Z [cluster2] "served": true,
2021-07-18T14:14:07.6084088Z [cluster2] "storage": true
2021-07-18T14:14:07.6084562Z [cluster2] }
2021-07-18T14:14:07.6084961Z [cluster2] ]
2021-07-18T14:14:07.6085373Z [cluster2] },
2021-07-18T14:14:07.6085790Z [cluster2] "status": {
2021-07-18T14:14:07.6086320Z [cluster2] "acceptedNames": {
2021-07-18T14:14:07.6086889Z [cluster2] "kind": "Endpoint",
2021-07-18T14:14:07.6087471Z [cluster2] "listKind": "EndpointList",
2021-07-18T14:14:07.6088099Z [cluster2] "plural": "endpoints",
2021-07-18T14:14:07.6088673Z [cluster2] "singular": "endpoint"
2021-07-18T14:14:07.6089169Z [cluster2] },
2021-07-18T14:14:07.6089620Z [cluster2] "conditions": [
2021-07-18T14:14:07.6090091Z [cluster2] {
2021-07-18T14:14:07.6091337Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:06Z",
2021-07-18T14:14:07.6092261Z [cluster2] "message": "no conflicts found",
2021-07-18T14:14:07.6092889Z [cluster2] "reason": "NoConflicts",
2021-07-18T14:14:07.6093458Z [cluster2] "status": "True",
2021-07-18T14:14:07.6094046Z [cluster2] "type": "NamesAccepted"
2021-07-18T14:14:07.6094561Z [cluster2] },
2021-07-18T14:14:07.6094984Z [cluster2] {
2021-07-18T14:14:07.6095781Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:06Z",
2021-07-18T14:14:07.6096564Z [cluster2] "message": "the initial names have been accepted",
2021-07-18T14:14:07.6097372Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-18T14:14:07.6098046Z [cluster2] "status": "True",
2021-07-18T14:14:07.6098595Z [cluster2] "type": "Established"
2021-07-18T14:14:07.6099101Z [cluster2] }
2021-07-18T14:14:07.6099518Z [cluster2] ],
2021-07-18T14:14:07.6100016Z [cluster2] "storedVersions": [
2021-07-18T14:14:07.6100536Z [cluster2] "v1"
2021-07-18T14:14:07.6100939Z [cluster2] ]
2021-07-18T14:14:07.6101346Z [cluster2] }
2021-07-18T14:14:07.6101727Z [cluster2] }
2021-07-18T14:14:07.6102846Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:14:07.6104562Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:14:07.6106666Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.6108451Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:14:07.6109713Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:14:07.6111338Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.6112943Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:14:07.6114260Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:14:07.6115975Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.6117604Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-18T14:14:07.6118907Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-18T14:14:07.6120578Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.6122370Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:14:07.6123926Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:14:07.6125865Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:07.6127509Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-18T14:14:07.6128524Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-18T14:14:07.6129765Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:14:07.6131178Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:14:07.6132562Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-18T14:14:07.6133928Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-18T14:14:07.6526612Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd "cable_name",
2021-07-18T14:14:07.6527515Z [cluster1] "cluster_id",
2021-07-18T14:14:07.6528067Z [cluster1] "hostname",
2021-07-18T14:14:07.6528612Z [cluster1] "nat_enabled",
2021-07-18T14:14:07.6529382Z [cluster1] "private_ip",
2021-07-18T14:14:07.6529923Z [cluster1] "public_ip",
2021-07-18T14:14:07.6530456Z [cluster1] "subnets"
2021-07-18T14:14:07.6530935Z [cluster1] ],
2021-07-18T14:14:07.6531449Z [cluster1] "type": "object"
2021-07-18T14:14:07.6531934Z [cluster1] }
2021-07-18T14:14:07.6532394Z [cluster1] },
2021-07-18T14:14:07.6532885Z [cluster1] "required": [
2021-07-18T14:14:07.6533378Z [cluster1] "spec"
2021-07-18T14:14:07.6533926Z [cluster1] ],
2021-07-18T14:14:07.6534404Z [cluster1] "type": "object"
2021-07-18T14:14:07.6534894Z [cluster1] }
2021-07-18T14:14:07.6535309Z [cluster1] },
2021-07-18T14:14:07.6535790Z [cluster1] "served": true,
2021-07-18T14:14:07.6536304Z [cluster1] "storage": true
2021-07-18T14:14:07.6536773Z [cluster1] }
2021-07-18T14:14:07.6537173Z [cluster1] ]
2021-07-18T14:14:07.6537580Z [cluster1] },
2021-07-18T14:14:07.6538000Z [cluster1] "status": {
2021-07-18T14:14:07.6538524Z [cluster1] "acceptedNames": {
2021-07-18T14:14:07.6539092Z [cluster1] "kind": "Endpoint",
2021-07-18T14:14:07.6539676Z [cluster1] "listKind": "EndpointList",
2021-07-18T14:14:07.6540397Z [cluster1] "plural": "endpoints",
2021-07-18T14:14:07.6540974Z [cluster1] "singular": "endpoint"
2021-07-18T14:14:07.6541475Z [cluster1] },
2021-07-18T14:14:07.6541936Z [cluster1] "conditions": [
2021-07-18T14:14:07.6542412Z [cluster1] {
2021-07-18T14:14:07.6543255Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:51Z",
2021-07-18T14:14:07.6543973Z [cluster1] "message": "no conflicts found",
2021-07-18T14:14:07.6544586Z [cluster1] "reason": "NoConflicts",
2021-07-18T14:14:07.6545261Z [cluster1] "status": "True",
2021-07-18T14:14:07.6545849Z [cluster1] "type": "NamesAccepted"
2021-07-18T14:14:07.6546466Z [cluster1] },
2021-07-18T14:14:07.6546892Z [cluster1] {
2021-07-18T14:14:07.6547678Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:51Z",
2021-07-18T14:14:07.6548464Z [cluster1] "message": "the initial names have been accepted",
2021-07-18T14:14:07.6549267Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-18T14:14:07.6549943Z [cluster1] "status": "True",
2021-07-18T14:14:07.6550563Z [cluster1] "type": "Established"
2021-07-18T14:14:07.6551073Z [cluster1] }
2021-07-18T14:14:07.6551473Z [cluster1] ],
2021-07-18T14:14:07.6551985Z [cluster1] "storedVersions": [
2021-07-18T14:14:07.6552504Z [cluster1] "v1"
2021-07-18T14:14:07.6552910Z [cluster1] ]
2021-07-18T14:14:07.6553317Z [cluster1] }
2021-07-18T14:14:07.6553708Z [cluster1] }
2021-07-18T14:14:07.6554832Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:14:07.6556402Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:14:07.6558206Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.6559811Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:14:07.6561068Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:14:07.6562721Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.6564323Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:14:07.6565726Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:14:07.6567371Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.6568975Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-18T14:14:07.6570264Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-18T14:14:07.6571961Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.6573745Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:14:07.6575290Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:14:07.6577232Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:07.6578863Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-18T14:14:07.6579900Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-18T14:14:07.6581152Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:14:07.6582578Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:14:07.6583977Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-18T14:14:07.6606127Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-18T14:14:08.3760396Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-18T14:14:08.3761426Z [cluster1] NAME CREATED AT
2021-07-18T14:14:08.3762309Z [cluster1] clusters.submariner.io 2021-07-18T14:12:51Z
2021-07-18T14:14:08.3763746Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:08.3765354Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:14:08.3766926Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:08.3768497Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:14:08.3770170Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-18T14:14:08.3771086Z [cluster1] {
2021-07-18T14:14:08.3771711Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:08.3772563Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-18T14:14:08.3773250Z [cluster1] "metadata": {
2021-07-18T14:14:08.3773749Z [cluster1] "annotations": {
2021-07-18T14:14:08.3774756Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:08.3775488Z [cluster1] },
2021-07-18T14:14:08.3776243Z [cluster1] "creationTimestamp": "2021-07-18T14:12:51Z",
2021-07-18T14:14:08.3776872Z [cluster1] "generation": 1,
2021-07-18T14:14:08.3777416Z [cluster1] "managedFields": [
2021-07-18T14:14:08.3777914Z [cluster1] {
2021-07-18T14:14:08.3778547Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:08.3779294Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:08.3779854Z [cluster1] "fieldsV1": {
2021-07-18T14:14:08.3780381Z [cluster1] "f:metadata": {
2021-07-18T14:14:08.3780915Z [cluster1] "f:annotations": {
2021-07-18T14:14:08.3781431Z [cluster1] ".": {},
2021-07-18T14:14:08.3782395Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:08.3783141Z [cluster1] }
2021-07-18T14:14:08.3783578Z [cluster1] },
2021-07-18T14:14:08.3784222Z [cluster1] "f:spec": {
2021-07-18T14:14:08.3784873Z [cluster1] "f:conversion": {
2021-07-18T14:14:08.3787268Z [cluster1] ".": {},
2021-07-18T14:14:08.3787789Z [cluster1] "f:strategy": {}
2021-07-18T14:14:08.3788263Z [cluster1] },
2021-07-18T14:14:08.3788733Z [cluster1] "f:group": {},
2021-07-18T14:14:08.3789223Z [cluster1] "f:names": {
2021-07-18T14:14:08.3789740Z [cluster1] "f:kind": {},
2021-07-18T14:14:08.3790255Z [cluster1] "f:listKind": {},
2021-07-18T14:14:08.3790775Z [cluster1] "f:plural": {},
2021-07-18T14:14:08.3791301Z [cluster1] "f:singular": {}
2021-07-18T14:14:08.3791769Z [cluster1] },
2021-07-18T14:14:08.3792243Z [cluster1] "f:scope": {},
2021-07-18T14:14:08.3792752Z [cluster1] "f:versions": {}
2021-07-18T14:14:08.3793230Z [cluster1] },
2021-07-18T14:14:08.3793678Z [cluster1] "f:status": {
2021-07-18T14:14:08.3794239Z [cluster1] "f:acceptedNames": {
2021-07-18T14:14:08.3794784Z [cluster1] "f:kind": {},
2021-07-18T14:14:08.3795285Z [cluster1] "f:plural": {}
2021-07-18T14:14:08.3795756Z [cluster1] },
2021-07-18T14:14:08.3796396Z [cluster1] "f:conditions": {},
2021-07-18T14:14:08.3797003Z [cluster1] "f:storedVersions": {}
2021-07-18T14:14:08.3797632Z [cluster1] }
2021-07-18T14:14:08.3798062Z [cluster1] },
2021-07-18T14:14:08.3799059Z [cluster1] "manager": "submariner-operator",
2021-07-18T14:14:08.3799752Z [cluster1] "operation": "Update",
2021-07-18T14:14:08.3800476Z [cluster1] "time": "2021-07-18T14:12:54Z"
2021-07-18T14:14:08.3800944Z [cluster1] }
2021-07-18T14:14:08.3801360Z [cluster1] ],
2021-07-18T14:14:08.3801954Z [cluster1] "name": "clusters.submariner.io",
2021-07-18T14:14:08.3802675Z [cluster1] "resourceVersion": "1773",
2021-07-18T14:14:08.3803892Z [cluster1] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-18T14:14:08.3805493Z [cluster1] "uid": "dd92f1a4-bff6-42fb-8e61-60c122ac4ad0"
2021-07-18T14:14:08.3806242Z [cluster1] },
2021-07-18T14:14:08.3806677Z [cluster1] "spec": {
2021-07-18T14:14:08.3814455Z [cluster1] "conversion": {
2021-07-18T14:14:08.3814998Z [cluster1] "strategy": "None"
2021-07-18T14:14:08.3815457Z [cluster1] },
2021-07-18T14:14:08.3815983Z [cluster1] "group": "submariner.io",
2021-07-18T14:14:08.3816525Z [cluster1] "names": {
2021-07-18T14:14:08.3817012Z [cluster1] "kind": "Cluster",
2021-07-18T14:14:08.3817589Z [cluster1] "listKind": "ClusterList",
2021-07-18T14:14:08.3818261Z [cluster1] "plural": "clusters",
2021-07-18T14:14:08.3818830Z [cluster1] "singular": "cluster"
2021-07-18T14:14:08.3819301Z [cluster1] },
2021-07-18T14:14:08.3819797Z [cluster1] "scope": "Namespaced",
2021-07-18T14:14:08.3820323Z [cluster1] "versions": [
2021-07-18T14:14:08.3820775Z [cluster1] {
2021-07-18T14:14:08.3821214Z [cluster1] "name": "v1",
2021-07-18T14:14:08.3821688Z [cluster1] "schema": {
2021-07-18T14:14:08.3822245Z [cluster1] "openAPIV3Schema": {
2021-07-18T14:14:08.3822850Z [cluster1] "properties": {
2021-07-18T14:14:08.3823422Z [cluster1] "apiVersion": {
2021-07-18T14:14:08.3826190Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:08.3828166Z [cluster1] "type": "string"
2021-07-18T14:14:08.3828674Z [cluster1] },
2021-07-18T14:14:08.3829135Z [cluster1] "kind": {
2021-07-18T14:14:08.3831436Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:08.3833268Z [cluster1] "type": "string"
2021-07-18T14:14:08.3833755Z [cluster1] },
2021-07-18T14:14:08.3834251Z [cluster1] "metadata": {
2021-07-18T14:14:08.3834787Z [cluster1] "type": "object"
2021-07-18T14:14:08.3835284Z [cluster1] },
2021-07-18T14:14:08.3835738Z [cluster1] "spec": {
2021-07-18T14:14:08.3836308Z [cluster1] "properties": {
2021-07-18T14:14:08.3836867Z [cluster1] "cluster_cidr": {
2021-07-18T14:14:08.3837413Z [cluster1] "items": {
2021-07-18T14:14:08.3838063Z [cluster1] "type": "string"
2021-07-18T14:14:08.3838664Z [cluster1] },
2021-07-18T14:14:08.3839181Z [cluster1] "type": "array"
2021-07-18T14:14:08.3839678Z [cluster1] },
2021-07-18T14:14:08.3840187Z [cluster1] "cluster_id": {
2021-07-18T14:14:08.3840731Z [cluster1] "type": "string"
2021-07-18T14:14:08.3841247Z [cluster1] },
2021-07-18T14:14:08.3841755Z [cluster1] "color_codes": {
2021-07-18T14:14:08.3842267Z [cluster1] "items": {
2021-07-18T14:14:08.3842810Z [cluster1] "type": "string"
2021-07-18T14:14:08.3843322Z [cluster1] },
2021-07-18T14:14:08.3843834Z [cluster1] "type": "array"
2021-07-18T14:14:08.3844323Z [cluster1] },
2021-07-18T14:14:08.3844823Z [cluster1] "global_cidr": {
2021-07-18T14:14:08.3845331Z [cluster1] "items": {
2021-07-18T14:14:08.3845880Z [cluster1] "type": "string"
2021-07-18T14:14:08.3846404Z [cluster1] },
2021-07-18T14:14:08.3846901Z [cluster1] "type": "array"
2021-07-18T14:14:08.3847400Z [cluster1] },
2021-07-18T14:14:08.3847901Z [cluster1] "service_cidr": {
2021-07-18T14:14:08.3848433Z [cluster1] "items": {
2021-07-18T14:14:08.3848961Z [cluster1] "type": "string"
2021-07-18T14:14:08.3849480Z [cluster1] },
2021-07-18T14:14:08.3849976Z [cluster1] "type": "array"
2021-07-18T14:14:08.3850484Z [cluster1] }
2021-07-18T14:14:08.3850937Z [cluster1] },
2021-07-18T14:14:08.3851425Z [cluster1] "required": [
2021-07-18T14:14:08.3851979Z [cluster1] "cluster_cidr",
2021-07-18T14:14:08.3852588Z [cluster1] "cluster_id",
2021-07-18T14:14:08.3853136Z [cluster1] "color_codes",
2021-07-18T14:14:08.3853663Z [cluster1] "global_cidr",
2021-07-18T14:14:08.3854207Z [cluster1] "service_cidr"
2021-07-18T14:14:08.3854698Z [cluster1] ],
2021-07-18T14:14:08.3855200Z [cluster1] "type": "object"
2021-07-18T14:14:08.3855703Z [cluster1] }
2021-07-18T14:14:08.3856134Z [cluster1] },
2021-07-18T14:14:08.3871500Z [cluster1] "required": [
2021-07-18T14:14:08.3872032Z [cluster1] "spec"
2021-07-18T14:14:08.3872644Z [cluster1] ],
2021-07-18T14:14:08.3873133Z [cluster1] "type": "object"
2021-07-18T14:14:08.3873625Z [cluster1] }
2021-07-18T14:14:08.3874059Z [cluster1] },
2021-07-18T14:14:08.3874542Z [cluster1] "served": true,
2021-07-18T14:14:08.3875051Z [cluster1] "storage": true
2021-07-18T14:14:08.3875520Z [cluster1] }
2021-07-18T14:14:08.3875930Z [cluster1] ]
2021-07-18T14:14:08.3876325Z [cluster1] },
2021-07-18T14:14:08.3876758Z [cluster1] "status": {
2021-07-18T14:14:08.3877268Z [cluster1] "acceptedNames": {
2021-07-18T14:14:08.3878009Z [cluster1] "kind": "Cluster",
2021-07-18T14:14:08.3878580Z [cluster1] "listKind": "ClusterList",
2021-07-18T14:14:08.3879184Z [cluster1] "plural": "clusters",
2021-07-18T14:14:08.3879741Z [cluster1] "singular": "cluster"
2021-07-18T14:14:08.3880231Z [cluster1] },
2021-07-18T14:14:08.3880685Z [cluster1] "conditions": [
2021-07-18T14:14:08.3881153Z [cluster1] {
2021-07-18T14:14:08.4158067Z [cluster1] "lastTransitionTime": "2021-07-18Ts clusters.submariner.io
2021-07-18T14:14:08.4158944Z [cluster2] NAME CREATED AT
2021-07-18T14:14:08.4159814Z [cluster2] clusters.submariner.io 2021-07-18T14:13:06Z
2021-07-18T14:14:08.4161238Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:08.4162824Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:14:08.4164530Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:08.4166123Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:14:08.4167661Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-18T14:14:08.4168584Z [cluster2] {
2021-07-18T14:14:08.4169208Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:08.4170078Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-18T14:14:08.4170751Z [cluster2] "metadata": {
2021-07-18T14:14:08.4171263Z [cluster2] "annotations": {
2021-07-18T14:14:08.4172267Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:08.4172998Z [cluster2] },
2021-07-18T14:14:08.4173745Z [cluster2] "creationTimestamp": "2021-07-18T14:13:06Z",
2021-07-18T14:14:08.4174352Z [cluster2] "generation": 1,
2021-07-18T14:14:08.4174905Z [cluster2] "managedFields": [
2021-07-18T14:14:08.4175396Z [cluster2] {
2021-07-18T14:14:08.4176041Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:08.4176775Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:08.4177347Z [cluster2] "fieldsV1": {
2021-07-18T14:14:08.4177848Z [cluster2] "f:metadata": {
2021-07-18T14:14:08.4178394Z [cluster2] "f:annotations": {
2021-07-18T14:14:08.4179068Z [cluster2] ".": {},
2021-07-18T14:14:08.4180051Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:08.4180809Z [cluster2] }
2021-07-18T14:14:08.4181230Z [cluster2] },
2021-07-18T14:14:08.4181694Z [cluster2] "f:spec": {
2021-07-18T14:14:08.4182203Z [cluster2] "f:conversion": {
2021-07-18T14:14:08.4182714Z [cluster2] ".": {},
2021-07-18T14:14:08.4183206Z [cluster2] "f:strategy": {}
2021-07-18T14:14:08.4183693Z [cluster2] },
2021-07-18T14:14:08.4184149Z [cluster2] "f:group": {},
2021-07-18T14:14:08.4184642Z [cluster2] "f:names": {
2021-07-18T14:14:08.4185396Z [cluster2] "f:kind": {},
2021-07-18T14:14:08.4185909Z [cluster2] "f:listKind": {},
2021-07-18T14:14:08.4186449Z [cluster2] "f:plural": {},
2021-07-18T14:14:08.4186962Z [cluster2] "f:singular": {}
2021-07-18T14:14:08.4187451Z [cluster2] },
2021-07-18T14:14:08.4187908Z [cluster2] "f:scope": {},
2021-07-18T14:14:08.4188427Z [cluster2] "f:versions": {}
2021-07-18T14:14:08.4188889Z [cluster2] },
2021-07-18T14:14:08.4189350Z [cluster2] "f:status": {
2021-07-18T14:14:08.4190027Z [cluster2] "f:acceptedNames": {
2021-07-18T14:14:08.4190573Z [cluster2] "f:kind": {},
2021-07-18T14:14:08.4191080Z [cluster2] "f:plural": {}
2021-07-18T14:14:08.4191541Z [cluster2] },
2021-07-18T14:14:08.4192044Z [cluster2] "f:conditions": {},
2021-07-18T14:14:08.4192633Z [cluster2] "f:storedVersions": {}
2021-07-18T14:14:08.4193170Z [cluster2] }
2021-07-18T14:14:08.4193584Z [cluster2] },
2021-07-18T14:14:08.4194428Z [cluster2] "manager": "submariner-operator",
2021-07-18T14:14:08.4195102Z [cluster2] "operation": "Update",
2021-07-18T14:14:08.4195835Z [cluster2] "time": "2021-07-18T14:13:16Z"
2021-07-18T14:14:08.4196300Z [cluster2] }
2021-07-18T14:14:08.4196700Z [cluster2] ],
2021-07-18T14:14:08.4197306Z [cluster2] "name": "clusters.submariner.io",
2021-07-18T14:14:08.4198011Z [cluster2] "resourceVersion": "1826",
2021-07-18T14:14:08.4199158Z [cluster2] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-18T14:14:08.4200594Z [cluster2] "uid": "da4bcc61-4604-4974-9bfa-cd1b7c739c70"
2021-07-18T14:14:08.4201228Z [cluster2] },
2021-07-18T14:14:08.4201770Z [cluster2] "spec": {
2021-07-18T14:14:08.4202260Z [cluster2] "conversion": {
2021-07-18T14:14:08.4202783Z [cluster2] "strategy": "None"
2021-07-18T14:14:08.4203258Z [cluster2] },
2021-07-18T14:14:08.4203847Z [cluster2] "group": "submariner.io",
2021-07-18T14:14:08.4204369Z [cluster2] "names": {
2021-07-18T14:14:08.4204861Z [cluster2] "kind": "Cluster",
2021-07-18T14:14:08.4205424Z [cluster2] "listKind": "ClusterList",
2021-07-18T14:14:08.4206021Z [cluster2] "plural": "clusters",
2021-07-18T14:14:08.4206569Z [cluster2] "singular": "cluster"
2021-07-18T14:14:08.4207059Z [cluster2] },
2021-07-18T14:14:08.4207541Z [cluster2] "scope": "Namespaced",
2021-07-18T14:14:08.4208074Z [cluster2] "versions": [
2021-07-18T14:14:08.4208517Z [cluster2] {
2021-07-18T14:14:08.4208958Z [cluster2] "name": "v1",
2021-07-18T14:14:08.4209433Z [cluster2] "schema": {
2021-07-18T14:14:08.4209991Z [cluster2] "openAPIV3Schema": {
2021-07-18T14:14:08.4210712Z [cluster2] "properties": {
2021-07-18T14:14:08.4211277Z [cluster2] "apiVersion": {
2021-07-18T14:14:08.4213658Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:08.4215516Z [cluster2] "type": "string"
2021-07-18T14:14:08.4216002Z [cluster2] },
2021-07-18T14:14:08.4216477Z [cluster2] "kind": {
2021-07-18T14:14:08.4218729Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:08.4220548Z [cluster2] "type": "string"
2021-07-18T14:14:08.4221046Z [cluster2] },
2021-07-18T14:14:08.4221525Z [cluster2] "metadata": {
2021-07-18T14:14:08.4222066Z [cluster2] "type": "object"
2021-07-18T14:14:08.4222546Z [cluster2] },
2021-07-18T14:14:08.4223100Z [cluster2] "spec": {
2021-07-18T14:14:08.4223624Z [cluster2] "properties": {
2021-07-18T14:14:08.4224299Z [cluster2] "cluster_cidr": {
2021-07-18T14:14:08.4225026Z [cluster2] "items": {
2021-07-18T14:14:08.4225524Z [cluster2] "type": "string"
2021-07-18T14:14:08.4226181Z [cluster2] },
2021-07-18T14:14:08.4226680Z [cluster2] "type": "array"
2021-07-18T14:14:08.4227183Z [cluster2] },
2021-07-18T14:14:08.4227678Z [cluster2] "cluster_id": {
2021-07-18T14:14:08.4228235Z [cluster2] "type": "string"
2021-07-18T14:14:08.4228753Z [cluster2] },
2021-07-18T14:14:08.4229248Z [cluster2] "color_codes": {
2021-07-18T14:14:08.4229787Z [cluster2] "items": {
2021-07-18T14:14:08.4230314Z [cluster2] "type": "string"
2021-07-18T14:14:08.4230832Z [cluster2] },
2021-07-18T14:14:08.4231330Z [cluster2] "type": "array"
2021-07-18T14:14:08.4231831Z [cluster2] },
2021-07-18T14:14:08.4232316Z [cluster2] "global_cidr": {
2021-07-18T14:14:08.4232839Z [cluster2] "items": {
2021-07-18T14:14:08.4233373Z [cluster2] "type": "string"
2021-07-18T14:14:08.4233876Z [cluster2] },
2021-07-18T14:14:08.4234384Z [cluster2] "type": "array"
2021-07-18T14:14:08.4234874Z [cluster2] },
2021-07-18T14:14:08.4235387Z [cluster2] "service_cidr": {
2021-07-18T14:14:08.4235902Z [cluster2] "items": {
2021-07-18T14:14:08.4236441Z [cluster2] "type": "string"
2021-07-18T14:14:08.4236957Z [cluster2] },
2021-07-18T14:14:08.4237452Z [cluster2] "type": "array"
2021-07-18T14:14:08.4238033Z [cluster2] }
2021-07-18T14:14:08.4238479Z [cluster2] },
2021-07-18T14:14:08.4238973Z [cluster2] "required": [
2021-07-18T14:14:08.4239510Z [cluster2] "cluster_cidr",
2021-07-18T14:14:08.4240057Z [cluster2] "cluster_id",
2021-07-18T14:14:08.4240589Z [cluster2] "color_codes",
2021-07-18T14:14:08.4241131Z [cluster2] "global_cidr",
2021-07-18T14:14:08.4241682Z [cluster2] "service_cidr"
2021-07-18T14:14:08.4242170Z [cluster2] ],
2021-07-18T14:14:08.4242680Z [cluster2] "type": "object"
2021-07-18T14:14:08.4243164Z [cluster2] }
2021-07-18T14:14:08.4243605Z [cluster2] },
2021-07-18T14:14:08.4244082Z [cluster2] "required": [
2021-07-18T14:14:08.4244587Z [cluster2] "spec"
2021-07-18T14:14:08.4245033Z [cluster2] ],
2021-07-18T14:14:08.4245523Z [cluster2] "type": "object"
2021-07-18T14:14:08.4245992Z [cluster2] }
2021-07-18T14:14:08.4246418Z [cluster2] },
2021-07-18T14:14:08.4246891Z [cluster2] "served": true,
2021-07-18T14:14:08.4247401Z [cluster2] "storage": true
2021-07-18T14:14:08.4247937Z [cluster2] }
2021-07-18T14:14:08.4248332Z [cluster2] ]
2021-07-18T14:14:08.4248734Z [cluster2] },
2021-07-18T14:14:08.4249152Z [cluster2] "status": {
2021-07-18T14:14:08.4249678Z [cluster2] "acceptedNames": {
2021-07-18T14:14:08.4250225Z [cluster2] "kind": "Cluster",
2021-07-18T14:14:08.4250803Z [cluster2] "listKind": "ClusterList",
2021-07-18T14:14:08.4251391Z [cluster2] "plural": "clusters",
2021-07-18T14:14:08.4251962Z [cluster2] "singular": "cluster"
2021-07-18T14:14:08.4252433Z [cluster2] },
2021-07-18T14:14:08.4252900Z [cluster2] "conditions": [
2021-07-18T14:14:08.4253362Z [cluster2] {
2021-07-18T14:14:09.5338241Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:06Z",
2021-07-18T14:14:09.5339319Z [cluster2] "message": "no conflicts found",
2021-07-18T14:14:09.5340038Z [cluster2] "reason": "NoConflicts",
2021-07-18T14:14:09.5340718Z [cluster2] "status": "True",
2021-07-18T14:14:09.5341498Z [cluster2] "type": "NamesAccepted"
2021-07-18T14:14:09.5342093Z [cluster2] },
2021-07-18T14:14:09.5342598Z [cluster2] {
2021-07-18T14:14:09.5343500Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:06Z",
2021-07-18T14:14:09.5344348Z [cluster2] "message": "the initial names have been accepted",
2021-07-18T14:14:09.5345447Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-18T14:14:09.5346171Z [cluster2] "status": "True",
2021-07-18T14:14:09.5346806Z [cluster2] "type": "Established"
2021-07-18T14:14:09.5347401Z [cluster2] }
2021-07-18T14:14:09.5347886Z [cluster2] ],
2021-07-18T14:14:09.5348472Z [cluster2] "storedVersions": [
2021-07-18T14:14:09.5349051Z [cluster2] "v1"
2021-07-18T14:14:09.5349558Z [cluster2] ]
2021-07-18T14:14:09.5350047Z [cluster2] }
2021-07-18T14:14:09.5350739Z [cluster2] }
2021-07-18T14:14:09.5352544Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:14:09.5355666Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:14:09.5357854Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:09.5359920Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:14:09.5361740Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:14:09.5363544Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:09.5365435Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:14:09.5367059Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:14:09.5369142Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:09.5371000Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-18T14:14:09.5372593Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-18T14:14:09.5374636Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:09.5376952Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:14:09.5378920Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:14:09.5381230Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:14:09.5383262Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-18T14:14:09.5384612Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-18T14:14:09.5404097Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:14:09.5405691Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:14:09.5407134Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:14:09.5408494Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:14:09.5409990Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-18T14:14:09.5411113Z [cluster2] NAME CREATED AT
2021-07-18T14:14:09.5412012Z [cluster2] submariners.submariner.io 2021-07-18T14:12:53Z
2021-07-18T14:14:09.5413529Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:14:09.5415574Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:14:09.5417576Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:14:09.5419709Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:14:09.5421744Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-18T14:14:09.5422929Z [cluster2] {
2021-07-18T14:14:09.5423623Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:09.5424551Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-18T14:14:09.5425361Z [cluster2] "metadata": {
2021-07-18T14:14:09.5426071Z [cluster2] "annotations": {
2021-07-18T14:14:09.5427199Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:09.5428010Z [cluster2] },
2021-07-18T14:14:09.5428862Z [cluster2] "creationTimestamp": "2021-07-18T14:12:53Z",
2021-07-18T14:14:09.5429443Z [cluster2] "generation": 1,
2021-07-18T14:14:09.5429964Z [cluster2] "managedFields": [
2021-07-18T14:14:09.5430415Z [cluster2] {
2021-07-18T14:14:09.5431240Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:09.5431934Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:09.5432469Z [cluster2] "fieldsV1": {
2021-07-18T14:14:09.5433121Z [cluster2] "f:status": {
2021-07-18T14:14:09.5439804Z [cluster2] "f:acceptedNames": {
2021-07-18T14:14:09.5440392Z [cluster2] "f:kind": {},
2021-07-18T14:14:09.5440898Z [cluster2] "f:listKind": {},
2021-07-18T14:14:09.5441434Z [cluster2] "f:plural": {},
2021-07-18T14:14:09.5441955Z [cluster2] "f:singular": {}
2021-07-18T14:14:09.5442442Z [cluster2] },
2021-07-18T14:14:09.5442935Z [cluster2] "f:conditions": {}
2021-07-18T14:14:09.5443425Z [cluster2] }
2021-07-18T14:14:09.5443852Z [cluster2] },
2021-07-18T14:14:09.5444692Z [cluster2] "manager": "kube-apiserver",
2021-07-18T14:14:09.5445335Z [cluster2] "operation": "Update",
2021-07-18T14:14:09.5446169Z [cluster2] "time": "2021-07-18T14:12:53Z"
2021-07-18T14:14:09.5446603Z [cluster2] },
2021-07-18T14:14:09.5446983Z [cluster2] {
2021-07-18T14:14:09.5447583Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:09.5448265Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:09.5448803Z [cluster2] "fieldsV1": {
2021-07-18T14:14:09.5449274Z [cluster2] "f:metadata": {
2021-07-18T14:14:09.5449781Z [cluster2] "f:annotations": {
2021-07-18T14:14:09.5450259Z [cluster2] ".": {},
2021-07-18T14:14:09.5451246Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:09.5451945Z [cluster2] }
2021-07-18T14:14:09.5452337Z [cluster2] },
2021-07-18T14:14:09.5452769Z [cluster2] "f:spec": {
2021-07-18T14:14:09.5453274Z [cluster2] "f:conversion": {
2021-07-18T14:14:09.5453749Z [cluster2] ".": {},
2021-07-18T14:14:09.5454204Z [cluster2] "f:strategy": {}
2021-07-18T14:14:09.5454656Z [cluster2] },
2021-07-18T14:14:09.5455094Z [cluster2] "f:group": {},
2021-07-18T14:14:09.5455544Z [cluster2] "f:names": {
2021-07-18T14:14:09.5455995Z [cluster2] "f:kind": {},
2021-07-18T14:14:09.5456461Z [cluster2] "f:listKind": {},
2021-07-18T14:14:09.5456949Z [cluster2] "f:plural": {},
2021-07-18T14:14:09.5457426Z [cluster2] "f:singular": {}
2021-07-18T14:14:09.5457872Z [cluster2] },
2021-07-18T14:14:09.5458295Z [cluster2] "f:scope": {},
2021-07-18T14:14:09.5458772Z [cluster2] "f:versions": {}
2021-07-18T14:14:09.5459203Z [cluster2] },
2021-07-18T14:14:09.5459632Z [cluster2] "f:status": {
2021-07-18T14:14:09.5460161Z [cluster2] "f:storedVersions": {}
2021-07-18T14:14:09.5460635Z [cluster2] }
2021-07-18T14:14:09.5461025Z [cluster2] },
2021-07-18T14:14:09.5461464Z [cluster2] "manager": "subctl",
2021-07-18T14:14:09.5461990Z [cluster2] "operation": "Update",
2021-07-18T14:14:09.5462665Z [cluster2] "time": "2021-07-18T14:12:53Z"
2021-07-18T14:14:09.5463283Z [cluster2] }
2021-07-18T14:14:09.5463683Z [cluster2] ],
2021-07-18T14:14:09.5464337Z [cluster2] "name": "submariners.submariner.io",
2021-07-18T14:14:09.5488561Z [cluster2] "resourceVersion": "1641",
2021-07-18T14:14:09.5489785Z [cluster2] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-18T14:14:09.5491412Z [cluster2] "uid": "0ccf5071-1ea6-4957-840b-69b810a21b39"
2021-07-18T14:14:09.5491996Z [cluster2] },
2021-07-18T14:14:09.5492425Z [cluster2] "spec": {
2021-07-18T14:14:09.5493155Z [cluster2] "conversion": {
2021-07-18T14:14:09.5493834Z [cluster2] "strategy": "None"
2021-07-18T14:14:09.5494299Z [cluster2] },
2021-07-18T14:14:09.5494818Z [cluster2] "group": "submariner.io",
2021-07-18T14:14:09.5495343Z [cluster2] "names": {
2021-07-18T14:14:09.5495864Z [cluster2] "kind": "Submariner",
2021-07-18T14:14:09.5496476Z [cluster2] "listKind": "SubmarinerList",
2021-07-18T14:14:09.5497128Z [cluster2] "plural": "submariners",
2021-07-18T14:14:09.5497743Z [cluster2] "singular": "submariner"
2021-07-18T14:14:09.5498230Z [cluster2] },
2021-07-18T14:14:09.5498722Z [cluster2] "scope": "Namespaced",
2021-07-18T14:14:09.5499242Z [cluster2] "versions": [
2021-07-18T14:14:09.5499696Z [cluster2] {
2021-07-18T14:14:09.5500162Z [cluster2] "name": "v1alpha1",
2021-07-18T14:14:09.5500669Z [cluster2] "schema": {
2021-07-18T14:14:09.5501224Z [cluster2] "openAPIV3Schema": {
2021-07-18T14:14:09.5502032Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-18T14:14:09.5506561Z [cluster2] "properties": {
2021-07-18T14:14:09.5507173Z [cluster2] "apiVersion": {
2021-07-18T14:14:09.5509702Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:09.5511723Z [cluster2] "type": "string"
2021-07-18T14:14:09.5512338Z [cluster2] },
2021-07-18T14:14:09.5512780Z [cluster2] "kind": {
2021-07-18T14:14:09.5515161Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:09.5516974Z [cluster2] "type": "string"
2021-07-18T14:14:09.5517475Z [cluster2] },
2021-07-18T14:14:09.5518039Z [cluster2] "metadata": {
2021-07-18T14:14:09.5518548Z [cluster2] "type": "object"
2021-07-18T14:14:09.5518994Z [cluster2] },
2021-07-18T14:14:09.5519429Z [cluster2] "spec": {
2021-07-18T14:14:09.5520380Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-18T14:14:09.5521225Z [cluster2] "properties": {
2021-07-18T14:14:09.5521783Z [cluster2] "broker": {
2021-07-18T14:14:09.5522311Z [cluster2] "type": "string"
2021-07-18T14:14:09.5522832Z [cluster2] },
2021-07-18T14:14:09.5523426Z [cluster2] "brokerK8sApiServer": {
2021-07-18T14:14:09.5524080Z [cluster2] "type": "string"
2021-07-18T14:14:09.5524580Z [cluster2] },
2021-07-18T14:14:09.5525244Z [cluster2] "brokerK8sApiServerToken": {
2021-07-18T14:14:09.5525958Z [cluster2] "type": "string"
2021-07-18T14:14:09.5526446Z [cluster2] },
2021-07-18T14:14:09.5526975Z [cluster2] "brokerK8sCA": {
2021-07-18T14:14:09.5527537Z [cluster2] "type": "string"
2021-07-18T14:14:09.5528136Z [cluster2] },
2021-07-18T14:14:09.5528809Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-18T14:14:09.5529536Z [cluster2] "type": "string"
2021-07-18T14:14:09.5530027Z [cluster2] },
2021-07-18T14:14:09.5530550Z [cluster2] "cableDriver": {
2021-07-18T14:14:09.5531125Z [cluster2] "type": "string"
2021-07-18T14:14:09.5531627Z [cluster2] },
2021-07-18T14:14:09.5532174Z [cluster2] "ceIPSecDebug": {
2021-07-18T14:14:09.5532759Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5533274Z [cluster2] },
2021-07-18T14:14:09.5533910Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-18T14:14:09.5534620Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5535120Z [cluster2] },
2021-07-18T14:14:09.5535686Z [cluster2] "ceIPSecIKEPort": {
2021-07-18T14:14:09.5536304Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5536808Z [cluster2] },
2021-07-18T14:14:09.5537377Z [cluster2] "ceIPSecNATTPort": {
2021-07-18T14:14:09.5538052Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5538569Z [cluster2] },
2021-07-18T14:14:09.5539083Z [cluster2] "ceIPSecPSK": {
2021-07-18T14:14:09.5539658Z [cluster2] "type": "string"
2021-07-18T14:14:09.5540148Z [cluster2] },
2021-07-18T14:14:09.5540813Z [cluster2] "ceIPSecPreferredServer": {
2021-07-18T14:14:09.5541541Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5542045Z [cluster2] },
2021-07-18T14:14:09.5542574Z [cluster2] "clusterCIDR": {
2021-07-18T14:14:09.5543310Z [cluster2] "type": "string"
2021-07-18T14:14:09.5543981Z [cluster2] },
2021-07-18T14:14:09.5544483Z [cluster2] "clusterID": {
2021-07-18T14:14:09.5570416Z [cluster2] "type": "string"
2021-07-18T14:14:09.5570962Z [cluster2] },
2021-07-18T14:14:09.5571476Z [cluster2] "colorCodes": {
2021-07-18T14:14:09.5572046Z [cluster2] "type": "string"
2021-07-18T14:14:09.5572541Z [cluster2] },
2021-07-18T14:14:09.5573193Z [cluster2] "connectionHealthCheck": {
2021-07-18T14:14:09.5573893Z [cluster2] "properties": {
2021-07-18T14:14:09.5574461Z [cluster2] "enabled": {
2021-07-18T14:14:09.5575022Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5575556Z [cluster2] },
2021-07-18T14:14:09.5576135Z [cluster2] "intervalSeconds": {
2021-07-18T14:14:09.5576937Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-18T14:14:09.5577704Z [cluster2] "format": "int64",
2021-07-18T14:14:09.5578274Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5579114Z [cluster2] },
2021-07-18T14:14:09.5579723Z [cluster2] "maxPacketLossCount": {
2021-07-18T14:14:09.5580739Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-18T14:14:09.5581652Z [cluster2] "format": "int64",
2021-07-18T14:14:09.5582231Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5582771Z [cluster2] }
2021-07-18T14:14:09.5583230Z [cluster2] },
2021-07-18T14:14:09.5583748Z [cluster2] "type": "object"
2021-07-18T14:14:09.5584255Z [cluster2] },
2021-07-18T14:14:09.5585031Z [cluster2] "coreDNSCustomConfig": {
2021-07-18T14:14:09.5585719Z [cluster2] "properties": {
2021-07-18T14:14:09.5586326Z [cluster2] "configMapName": {
2021-07-18T14:14:09.5586935Z [cluster2] "type": "string"
2021-07-18T14:14:09.5587450Z [cluster2] },
2021-07-18T14:14:09.5587983Z [cluster2] "namespace": {
2021-07-18T14:14:09.5588554Z [cluster2] "type": "string"
2021-07-18T14:14:09.5589158Z [cluster2] }
2021-07-18T14:14:09.5589629Z [cluster2] },
2021-07-18T14:14:09.5590143Z [cluster2] "type": "object"
2021-07-18T14:14:09.5590655Z [cluster2] },
2021-07-18T14:14:09.5591185Z [cluster2] "customDomains": {
2021-07-18T14:14:09.5591757Z [cluster2] "items": {
2021-07-18T14:14:09.5592288Z [cluster2] "type": "string"
2021-07-18T14:14:09.5592807Z [cluster2] },
2021-07-18T14:14:09.5593319Z [cluster2] "type": "array",
2021-07-18T14:14:09.5594454Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-18T14:14:09.5595060Z [cluster2] },
2021-07-18T14:14:09.5595501Z [cluster2] "debug": {
2021-07-18T14:14:09.5596010Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5596482Z [cluster2] },
2021-07-18T14:14:09.5596967Z [cluster2] "globalCIDR": {
2021-07-18T14:14:09.5597486Z [cluster2] "type": "string"
2021-07-18T14:14:09.5597967Z [cluster2] },
2021-07-18T14:14:09.5598485Z [cluster2] "imageOverrides": {
2021-07-18T14:14:09.5599144Z [cluster2] "additionalProperties": {
2021-07-18T14:14:09.5599783Z [cluster2] "type": "string"
2021-07-18T14:14:09.5600245Z [cluster2] },
2021-07-18T14:14:09.5600729Z [cluster2] "type": "object"
2021-07-18T14:14:09.5601192Z [cluster2] },
2021-07-18T14:14:09.5601754Z [cluster2] "loadBalancerEnabled": {
2021-07-18T14:14:09.5602377Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5603046Z [cluster2] },
2021-07-18T14:14:09.5603560Z [cluster2] "namespace": {
2021-07-18T14:14:09.5604260Z [cluster2] "type": "string"
2021-07-18T14:14:09.5609316Z [cluster2] },
2021-07-18T14:14:09.5609957Z [cluster2] "natEnabled": {
2021-07-18T14:14:09.5610544Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5611055Z [cluster2] },
2021-07-18T14:14:09.5611577Z [cluster2] "repository": {
2021-07-18T14:14:09.5614765Z [cluster2] "type": "string"
2021-07-18T14:14:09.5615506Z [cluster2] },
2021-07-18T14:14:09.5616046Z [cluster2] "serviceCIDR": {
2021-07-18T14:14:09.5616616Z [cluster2] "type": "string"
2021-07-18T14:14:09.5617130Z [cluster2] },
2021-07-18T14:14:09.5617860Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-18T14:14:09.5618593Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5619094Z [cluster2] },
2021-07-18T14:14:09.5620051Z [cluster2] "version": {
2021-07-18T14:14:09.5620687Z [cluster2] "type": "string"
2021-07-18T14:14:09.5621180Z [cluster2] }
2021-07-18T14:14:09.5621638Z [cluster2] },
2021-07-18T14:14:09.5622302Z [cluster2] "required": [
2021-07-18T14:14:09.5622838Z [cluster2] "broker",
2021-07-18T14:14:09.5623459Z [cluster2] "brokerK8sApiServer",
2021-07-18T14:14:09.5624270Z [cluster2] "brokerK8sApiServerToken",
2021-07-18T14:14:09.5625772Z [cluster2] "brokerK8sCA",
2021-07-18T14:14:09.5627147Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-18T14:14:09.5628097Z [cluster2] "ceIPSecDebug",
2021-07-18T14:14:09.5628843Z [cluster2] "ceIPSecPSK",
2021-07-18T14:14:09.5629747Z [cluster2] "clusterCIDR",
2021-07-18T14:14:09.5630385Z [cluster2] "clusterID",
2021-07-18T14:14:09.5630915Z [cluster2] "debug",
2021-07-18T14:14:09.5631447Z [cluster2] "namespace",
2021-07-18T14:14:09.5632122Z [cluster2] "natEnabled",
2021-07-18T14:14:09.5632845Z [cluster2] "serviceCIDR"
2021-07-18T14:14:09.5633360Z [cluster2] ],
2021-07-18T14:14:09.5633947Z [cluster2] "type": "object"
2021-07-18T14:14:09.5634400Z [cluster2] },
2021-07-18T14:14:09.5634839Z [cluster2] "status": {
2021-07-18T14:14:09.5635590Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-18T14:14:09.5636388Z [cluster2] "properties": {
2021-07-18T14:14:09.5636926Z [cluster2] "clusterCIDR": {
2021-07-18T14:14:09.5637453Z [cluster2] "type": "string"
2021-07-18T14:14:09.5638167Z [cluster2] },
2021-07-18T14:14:09.5638665Z [cluster2] "clusterID": {
2021-07-18T14:14:09.5639218Z [cluster2] "type": "string"
2021-07-18T14:14:09.5640310Z [cluster2] },
2021-07-18T14:14:09.5640933Z [cluster2] "colorCodes": {
2021-07-18T14:14:09.5641619Z [cluster2] "type": "string"
2021-07-18T14:14:09.5642141Z [cluster2] },
2021-07-18T14:14:09.5642689Z [cluster2] "deploymentInfo": {
2021-07-18T14:14:09.5643315Z [cluster2] "properties": {
2021-07-18T14:14:09.5643936Z [cluster2] "cloudProvider": {
2021-07-18T14:14:09.5644537Z [cluster2] "type": "string"
2021-07-18T14:14:09.5645071Z [cluster2] },
2021-07-18T14:14:09.5645631Z [cluster2] "kubernetesType": {
2021-07-18T14:14:09.5646252Z [cluster2] "type": "string"
2021-07-18T14:14:09.5646762Z [cluster2] },
2021-07-18T14:14:09.5647419Z [cluster2] "kubernetesTypeVersion": {
2021-07-18T14:14:09.5648119Z [cluster2] "type": "string"
2021-07-18T14:14:09.5648633Z [cluster2] },
2021-07-18T14:14:09.5651633Z [cluster2] "kubernetesVersion": {
2021-07-18T14:14:09.5652323Z [cluster2] "type": "string"
2021-07-18T14:14:09.5652848Z [cluster2] }
2021-07-18T14:14:09.5653312Z [cluster2] },
2021-07-18T14:14:09.5654253Z [cluster2] "type": "object"
2021-07-18T14:14:09.5654755Z [cluster2] },
2021-07-18T14:14:09.5655418Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-18T14:14:09.5656145Z [cluster2] "properties": {
2021-07-18T14:14:09.5656904Z [cluster2] "lastResourceVersion": {
2021-07-18T14:14:09.5657582Z [cluster2] "type": "string"
2021-07-18T14:14:09.5658087Z [cluster2] },
2021-07-18T14:14:09.5658790Z [cluster2] "mismatchedContainerImages": {
2021-07-18T14:14:09.5659550Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.5660469Z [cluster2] },
2021-07-18T14:14:09.5661236Z [cluster2] "nonReadyContainerStates": {
2021-07-18T14:14:09.5661934Z [cluster2] "items": {
2021-07-18T14:14:09.5663224Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:14:09.5664550Z [cluster2] "properties": {
2021-07-18T14:14:09.5665258Z [cluster2] "running": {
2021-07-18T14:14:09.5665982Z [cluster2] "description": "Details about a running container",
2021-07-18T14:14:09.5666723Z [cluster2] "properties": {
2021-07-18T14:14:09.5667335Z [cluster2] "startedAt": {
2021-07-18T14:14:09.5668565Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-18T14:14:09.5669582Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.5670208Z [cluster2] "type": "string"
2021-07-18T14:14:09.5672073Z [cluster2] }
2021-07-18T14:14:09.5673179Z [cluster2] },
2021-07-18T14:14:09.5673814Z [cluster2] "type": "object"
2021-07-18T14:14:09.5674351Z [cluster2] },
2021-07-18T14:14:09.5674905Z [cluster2] "terminated": {
2021-07-18T14:14:09.5675670Z [cluster2] "description": "Details about a terminated container",
2021-07-18T14:14:09.5676446Z [cluster2] "properties": {
2021-07-18T14:14:09.5677066Z [cluster2] "containerID": {
2021-07-18T14:14:09.5680019Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:14:09.5680877Z [cluster2] "type": "string"
2021-07-18T14:14:09.5681423Z [cluster2] },
2021-07-18T14:14:09.5681987Z [cluster2] "exitCode": {
2021-07-18T14:14:09.5683205Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-18T14:14:09.5684250Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5684870Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5685424Z [cluster2] },
2021-07-18T14:14:09.5685994Z [cluster2] "finishedAt": {
2021-07-18T14:14:09.5686794Z [cluster2] "description": "Time at which the container last terminated",
2021-07-18T14:14:09.5687895Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.5688532Z [cluster2] "type": "string"
2021-07-18T14:14:09.5689077Z [cluster2] },
2021-07-18T14:14:09.5690171Z [cluster2] "message": {
2021-07-18T14:14:09.5691024Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-18T14:14:09.5691845Z [cluster2] "type": "string"
2021-07-18T14:14:09.5692467Z [cluster2] },
2021-07-18T14:14:09.5692989Z [cluster2] "reason": {
2021-07-18T14:14:09.5693798Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-18T14:14:09.5694596Z [cluster2] "type": "string"
2021-07-18T14:14:09.5695152Z [cluster2] },
2021-07-18T14:14:09.5695680Z [cluster2] "signal": {
2021-07-18T14:14:09.5696439Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-18T14:14:09.5723209Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5723975Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5724551Z [cluster2] },
2021-07-18T14:14:09.5725115Z [cluster2] "startedAt": {
2021-07-18T14:14:09.5725951Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-18T14:14:09.5727211Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.5727829Z [cluster2] "type": "string"
2021-07-18T14:14:09.5728387Z [cluster2] }
2021-07-18T14:14:09.5728900Z [cluster2] },
2021-07-18T14:14:09.5729433Z [cluster2] "required": [
2021-07-18T14:14:09.5730030Z [cluster2] "exitCode"
2021-07-18T14:14:09.5730560Z [cluster2] ],
2021-07-18T14:14:09.5731111Z [cluster2] "type": "object"
2021-07-18T14:14:09.5731914Z [cluster2] },
2021-07-18T14:14:09.5732540Z [cluster2] "waiting": {
2021-07-18T14:14:09.5733262Z [cluster2] "description": "Details about a waiting container",
2021-07-18T14:14:09.5734002Z [cluster2] "properties": {
2021-07-18T14:14:09.5734617Z [cluster2] "message": {
2021-07-18T14:14:09.5735420Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-18T14:14:09.5736237Z [cluster2] "type": "string"
2021-07-18T14:14:09.5736781Z [cluster2] },
2021-07-18T14:14:09.5737318Z [cluster2] "reason": {
2021-07-18T14:14:09.5738077Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-18T14:14:09.5738837Z [cluster2] "type": "string"
2021-07-18T14:14:09.5739388Z [cluster2] }
2021-07-18T14:14:09.5739882Z [cluster2] },
2021-07-18T14:14:09.5740425Z [cluster2] "type": "object"
2021-07-18T14:14:09.5740973Z [cluster2] }
2021-07-18T14:14:09.5741451Z [cluster2] },
2021-07-18T14:14:09.5741983Z [cluster2] "type": "object"
2021-07-18T14:14:09.5742500Z [cluster2] },
2021-07-18T14:14:09.5743030Z [cluster2] "type": "array"
2021-07-18T14:14:09.5743632Z [cluster2] },
2021-07-18T14:14:09.5744103Z [cluster2] "status": {
2021-07-18T14:14:09.5745030Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:14:09.5745904Z [cluster2] "properties": {
2021-07-18T14:14:09.5746698Z [cluster2] "collisionCount": {
2021-07-18T14:14:09.5748076Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:14:09.5749539Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5750093Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5750600Z [cluster2] },
2021-07-18T14:14:09.5751107Z [cluster2] "conditions": {
2021-07-18T14:14:09.5752494Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:14:09.5753601Z [cluster2] "items": {
2021-07-18T14:14:09.5754527Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:14:09.5755478Z [cluster2] "properties": {
2021-07-18T14:14:09.5756249Z [cluster2] "lastTransitionTime": {
2021-07-18T14:14:09.5757187Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:14:09.5758309Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.5758934Z [cluster2] "type": "string"
2021-07-18T14:14:09.5759489Z [cluster2] },
2021-07-18T14:14:09.5760016Z [cluster2] "message": {
2021-07-18T14:14:09.5760882Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-18T14:14:09.5761751Z [cluster2] "type": "string"
2021-07-18T14:14:09.5762283Z [cluster2] },
2021-07-18T14:14:09.5762819Z [cluster2] "reason": {
2021-07-18T14:14:09.5763926Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-18T14:14:09.5764694Z [cluster2] "type": "string"
2021-07-18T14:14:09.5765429Z [cluster2] },
2021-07-18T14:14:09.5765969Z [cluster2] "status": {
2021-07-18T14:14:09.5767003Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:14:09.5767884Z [cluster2] "type": "string"
2021-07-18T14:14:09.5768464Z [cluster2] },
2021-07-18T14:14:09.5769100Z [cluster2] "type": {
2021-07-18T14:14:09.5769860Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-18T14:14:09.5770749Z [cluster2] "type": "string"
2021-07-18T14:14:09.5771331Z [cluster2] }
2021-07-18T14:14:09.5771916Z [cluster2] },
2021-07-18T14:14:09.5772572Z [cluster2] "required": [
2021-07-18T14:14:09.5773166Z [cluster2] "status",
2021-07-18T14:14:09.5773805Z [cluster2] "type"
2021-07-18T14:14:09.5968722Z [cluster2] ],
2021-07-18T14:14:09.5969412Z [cluster2] "type": "object"
2021-07-18T14:14:09.5969958Z [cluster2] },
2021-07-18T14:14:09.5970507Z [cluster2] "type": "array"
2021-07-18T14:14:09.5971024Z [cluster2] },
2021-07-18T14:14:09.5971696Z [cluster2] "currentNumberScheduled": {
2021-07-18T14:14:09.5973250Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.5974743Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5975355Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5975922Z [cluster2] },
2021-07-18T14:14:09.5976587Z [cluster2] "desiredNumberScheduled": {
2021-07-18T14:14:09.5978133Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.5979514Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5980106Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5980666Z [cluster2] },
2021-07-18T14:14:09.5981246Z [cluster2] "numberAvailable": {
2021-07-18T14:14:09.5982504Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.5983698Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5984281Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5984920Z [cluster2] },
2021-07-18T14:14:09.5985536Z [cluster2] "numberMisscheduled": {
2021-07-18T14:14:09.5986938Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.5988231Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5988818Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5989459Z [cluster2] },
2021-07-18T14:14:09.5989999Z [cluster2] "numberReady": {
2021-07-18T14:14:09.5990988Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:14:09.5991953Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5992641Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5993191Z [cluster2] },
2021-07-18T14:14:09.5993793Z [cluster2] "numberUnavailable": {
2021-07-18T14:14:09.5995052Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.5996222Z [cluster2] "format": "int32",
2021-07-18T14:14:09.5996801Z [cluster2] "type": "integer"
2021-07-18T14:14:09.5997350Z [cluster2] },
2021-07-18T14:14:09.5997962Z [cluster2] "observedGeneration": {
2021-07-18T14:14:09.5998980Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:14:09.5999815Z [cluster2] "format": "int64",
2021-07-18T14:14:09.6000413Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6000960Z [cluster2] },
2021-07-18T14:14:09.6001715Z [cluster2] "updatedNumberScheduled": {
2021-07-18T14:14:09.6002672Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:14:09.6003458Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6004058Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6004615Z [cluster2] }
2021-07-18T14:14:09.6005089Z [cluster2] },
2021-07-18T14:14:09.6005615Z [cluster2] "required": [
2021-07-18T14:14:09.6006320Z [cluster2] "currentNumberScheduled",
2021-07-18T14:14:09.6007187Z [cluster2] "desiredNumberScheduled",
2021-07-18T14:14:09.6007994Z [cluster2] "numberMisscheduled",
2021-07-18T14:14:09.6008681Z [cluster2] "numberReady"
2021-07-18T14:14:09.6009221Z [cluster2] ],
2021-07-18T14:14:09.6009749Z [cluster2] "type": "object"
2021-07-18T14:14:09.6010282Z [cluster2] }
2021-07-18T14:14:09.6010742Z [cluster2] },
2021-07-18T14:14:09.6011258Z [cluster2] "required": [
2021-07-18T14:14:09.6011990Z [cluster2] "mismatchedContainerImages"
2021-07-18T14:14:09.6012694Z [cluster2] ],
2021-07-18T14:14:09.6013206Z [cluster2] "type": "object"
2021-07-18T14:14:09.6013774Z [cluster2] },
2021-07-18T14:14:09.6014286Z [cluster2] "gateways": {
2021-07-18T14:14:09.6014802Z [cluster2] "items": {
2021-07-18T14:14:09.6015354Z [cluster2] "properties": {
2021-07-18T14:14:09.6035464Z [cluster2] "connections": {
2021-07-18T14:14:09.6036061Z [cluster2] "items": {
2021-07-18T14:14:09.6036645Z [cluster2] "properties": {
2021-07-18T14:14:09.6037260Z [cluster2] "endpoint": {
2021-07-18T14:14:09.6037885Z [cluster2] "properties": {
2021-07-18T14:14:09.6038479Z [cluster2] "backend": {
2021-07-18T14:14:09.6039083Z [cluster2] "type": "string"
2021-07-18T14:14:09.6039631Z [cluster2] },
2021-07-18T14:14:09.6040203Z [cluster2] "backend_config": {
2021-07-18T14:14:09.6040922Z [cluster2] "additionalProperties": {
2021-07-18T14:14:09.6041650Z [cluster2] "type": "string"
2021-07-18T14:14:09.6042391Z [cluster2] },
2021-07-18T14:14:09.6042943Z [cluster2] "type": "object"
2021-07-18T14:14:09.6043513Z [cluster2] },
2021-07-18T14:14:09.6044055Z [cluster2] "cable_name": {
2021-07-18T14:14:09.6044655Z [cluster2] "type": "string"
2021-07-18T14:14:09.6045205Z [cluster2] },
2021-07-18T14:14:09.6045841Z [cluster2] "cluster_id": {
2021-07-18T14:14:09.6046544Z [cluster2] "type": "string"
2021-07-18T14:14:09.6047061Z [cluster2] },
2021-07-18T14:14:09.6047767Z [cluster2] "healthCheckIP": {
2021-07-18T14:14:09.6048356Z [cluster2] "type": "string"
2021-07-18T14:14:09.6048874Z [cluster2] },
2021-07-18T14:14:09.6049389Z [cluster2] "hostname": {
2021-07-18T14:14:09.6050117Z [cluster2] "type": "string"
2021-07-18T14:14:09.6050672Z [cluster2] },
2021-07-18T14:14:09.6051207Z [cluster2] "nat_enabled": {
2021-07-18T14:14:09.6051816Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.6052389Z [cluster2] },
2021-07-18T14:14:09.6052934Z [cluster2] "private_ip": {
2021-07-18T14:14:09.6053545Z [cluster2] "type": "string"
2021-07-18T14:14:09.6054177Z [cluster2] },
2021-07-18T14:14:09.6054731Z [cluster2] "public_ip": {
2021-07-18T14:14:09.6055312Z [cluster2] "type": "string"
2021-07-18T14:14:09.6055867Z [cluster2] },
2021-07-18T14:14:09.6056413Z [cluster2] "subnets": {
2021-07-18T14:14:09.6057675Z [cluster2] "items": {
2021-07-18T14:14:09.6058356Z [cluster2] "type": "string"
2021-07-18T14:14:09.6058909Z [cluster2] },
2021-07-18T14:14:09.6059475Z [cluster2] "type": "array"
2021-07-18T14:14:09.6060021Z [cluster2] }
2021-07-18T14:14:09.6060532Z [cluster2] },
2021-07-18T14:14:09.6061084Z [cluster2] "required": [
2021-07-18T14:14:09.6061656Z [cluster2] "backend",
2021-07-18T14:14:09.6062234Z [cluster2] "cable_name",
2021-07-18T14:14:09.6062887Z [cluster2] "cluster_id",
2021-07-18T14:14:09.6064280Z [cluster2] "hostname",
2021-07-18T14:14:09.6065515Z [cluster2] "nat_enabled",
2021-07-18T14:14:09.6066214Z [cluster2] "private_ip",
2021-07-18T14:14:09.6066817Z [cluster2] "public_ip",
2021-07-18T14:14:09.6067386Z [cluster2] "subnets"
2021-07-18T14:14:09.6068322Z [cluster2] ],
2021-07-18T14:14:09.6068906Z [cluster2] "type": "object"
2021-07-18T14:14:09.6069411Z [cluster2] },
2021-07-18T14:14:09.6069939Z [cluster2] "latencyRTT": {
2021-07-18T14:14:09.6071142Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-18T14:14:09.6072202Z [cluster2] "properties": {
2021-07-18T14:14:09.6072807Z [cluster2] "average": {
2021-07-18T14:14:09.6073391Z [cluster2] "type": "string"
2021-07-18T14:14:09.6073952Z [cluster2] },
2021-07-18T14:14:09.6074468Z [cluster2] "last": {
2021-07-18T14:14:09.6075056Z [cluster2] "type": "string"
2021-07-18T14:14:09.6075607Z [cluster2] },
2021-07-18T14:14:09.6076135Z [cluster2] "max": {
2021-07-18T14:14:09.6076812Z [cluster2] "type": "string"
2021-07-18T14:14:09.6077364Z [cluster2] },
2021-07-18T14:14:09.6077894Z [cluster2] "min": {
2021-07-18T14:14:09.6078456Z [cluster2] "type": "string"
2021-07-18T14:14:09.6079015Z [cluster2] },
2021-07-18T14:14:09.6079555Z [cluster2] "stdDev": {
2021-07-18T14:14:09.6080135Z [cluster2] "type": "string"
2021-07-18T14:14:09.6080693Z [cluster2] }
2021-07-18T14:14:09.6081185Z [cluster2] },
2021-07-18T14:14:09.6081741Z [cluster2] "type": "object"
2021-07-18T14:14:09.6082273Z [cluster2] },
2021-07-18T14:14:09.6082799Z [cluster2] "status": {
2021-07-18T14:14:09.6083380Z [cluster2] "type": "string"
2021-07-18T14:14:09.6083910Z [cluster2] },
2021-07-18T14:14:09.6084556Z [cluster2] "statusMessage": {
2021-07-18T14:14:09.6085166Z [cluster2] "type": "string"
2021-07-18T14:14:09.6085708Z [cluster2] },
2021-07-18T14:14:09.6086235Z [cluster2] "usingIP": {
2021-07-18T14:14:09.6086825Z [cluster2] "type": "string"
2021-07-18T14:14:09.6087370Z [cluster2] },
2021-07-18T14:14:09.6087900Z [cluster2] "usingNAT": {
2021-07-18T14:14:09.6088498Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.6089037Z [cluster2] }
2021-07-18T14:14:09.6089538Z [cluster2] },
2021-07-18T14:14:09.6090064Z [cluster2] "required": [
2021-07-18T14:14:09.6090646Z [cluster2] "endpoint",
2021-07-18T14:14:09.6091213Z [cluster2] "status",
2021-07-18T14:14:09.6091799Z [cluster2] "statusMessage"
2021-07-18T14:14:09.6092380Z [cluster2] ],
2021-07-18T14:14:09.6092915Z [cluster2] "type": "object"
2021-07-18T14:14:09.6093454Z [cluster2] },
2021-07-18T14:14:09.6093968Z [cluster2] "type": "array"
2021-07-18T14:14:09.6094499Z [cluster2] },
2021-07-18T14:14:09.6095021Z [cluster2] "haStatus": {
2021-07-18T14:14:09.6095577Z [cluster2] "type": "string"
2021-07-18T14:14:09.6096105Z [cluster2] },
2021-07-18T14:14:09.6096651Z [cluster2] "localEndpoint": {
2021-07-18T14:14:09.6097282Z [cluster2] "properties": {
2021-07-18T14:14:09.6097897Z [cluster2] "backend": {
2021-07-18T14:14:09.6098479Z [cluster2] "type": "string"
2021-07-18T14:14:09.6099024Z [cluster2] },
2021-07-18T14:14:09.6099565Z [cluster2] "backend_config": {
2021-07-18T14:14:09.6100275Z [cluster2] "additionalProperties": {
2021-07-18T14:14:09.6100980Z [cluster2] "type": "string"
2021-07-18T14:14:09.6101528Z [cluster2] },
2021-07-18T14:14:09.6102064Z [cluster2] "type": "object"
2021-07-18T14:14:09.6102611Z [cluster2] },
2021-07-18T14:14:09.6103150Z [cluster2] "cable_name": {
2021-07-18T14:14:09.6103719Z [cluster2] "type": "string"
2021-07-18T14:14:09.6104263Z [cluster2] },
2021-07-18T14:14:09.6105077Z [cluster2] "cluster_id": {
2021-07-18T14:14:09.6105860Z [cluster2] "type": "string"
2021-07-18T14:14:09.6106627Z [cluster2] },
2021-07-18T14:14:09.6107228Z [cluster2] "healthCheckIP": {
2021-07-18T14:14:09.6108015Z [cluster2] "type": "string"
2021-07-18T14:14:09.6108696Z [cluster2] },
2021-07-18T14:14:09.6109392Z [cluster2] "hostname": {
2021-07-18T14:14:09.6110114Z [cluster2] "type": "string"
2021-07-18T14:14:09.6110807Z [cluster2] },
2021-07-18T14:14:09.6111474Z [cluster2] "nat_enabled": {
2021-07-18T14:14:09.6112221Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.6112935Z [cluster2] },
2021-07-18T14:14:09.6113706Z [cluster2] "private_ip": {
2021-07-18T14:14:09.6114268Z [cluster2] "type": "string"
2021-07-18T14:14:09.6115233Z [cluster2] },
2021-07-18T14:14:09.6115798Z [cluster2] "public_ip": {
2021-07-18T14:14:09.6116522Z [cluster2] "type": "string"
2021-07-18T14:14:09.6117215Z [cluster2] },
2021-07-18T14:14:09.6117896Z [cluster2] "subnets": {
2021-07-18T14:14:09.6118588Z [cluster2] "items": {
2021-07-18T14:14:09.6119302Z [cluster2] "type": "string"
2021-07-18T14:14:09.6120025Z [cluster2] },
2021-07-18T14:14:09.6120718Z [cluster2] "type": "array"
2021-07-18T14:14:09.6121265Z [cluster2] }
2021-07-18T14:14:09.6121911Z [cluster2] },
2021-07-18T14:14:09.6122672Z [cluster2] "required": [
2021-07-18T14:14:09.6123641Z [cluster2] "backend",
2021-07-18T14:14:09.6124367Z [cluster2] "cable_name",
2021-07-18T14:14:09.6126323Z [cluster2] "cluster_id",
2021-07-18T14:14:09.6127089Z [cluster2] "hostname",
2021-07-18T14:14:09.6127825Z [cluster2] "nat_enabled",
2021-07-18T14:14:09.6128426Z [cluster2] "private_ip",
2021-07-18T14:14:09.6129002Z [cluster2] "public_ip",
2021-07-18T14:14:09.6129557Z [cluster2] "subnets"
2021-07-18T14:14:09.6130249Z [cluster2] ],
2021-07-18T14:14:09.6130771Z [cluster2] "type": "object"
2021-07-18T14:14:09.6131302Z [cluster2] },
2021-07-18T14:14:09.6131853Z [cluster2] "statusFailure": {
2021-07-18T14:14:09.6132468Z [cluster2] "type": "string"
2021-07-18T14:14:09.6132993Z [cluster2] },
2021-07-18T14:14:09.6133874Z [cluster2] "version": {
2021-07-18T14:14:09.6134463Z [cluster2] "type": "string"
2021-07-18T14:14:09.6134985Z [cluster2] }
2021-07-18T14:14:09.6135465Z [cluster2] },
2021-07-18T14:14:09.6135969Z [cluster2] "required": [
2021-07-18T14:14:09.6136561Z [cluster2] "connections",
2021-07-18T14:14:09.6137150Z [cluster2] "haStatus",
2021-07-18T14:14:09.6137744Z [cluster2] "localEndpoint",
2021-07-18T14:14:09.6138388Z [cluster2] "statusFailure",
2021-07-18T14:14:09.6138967Z [cluster2] "version"
2021-07-18T14:14:09.6139485Z [cluster2] ],
2021-07-18T14:14:09.6139994Z [cluster2] "type": "object"
2021-07-18T14:14:09.6140518Z [cluster2] },
2021-07-18T14:14:09.6141180Z [cluster2] "type": "array"
2021-07-18T14:14:09.6141686Z [cluster2] },
2021-07-18T14:14:09.6142207Z [cluster2] "globalCIDR": {
2021-07-18T14:14:09.6142766Z [cluster2] "type": "string"
2021-07-18T14:14:09.6143275Z [cluster2] },
2021-07-18T14:14:09.6143951Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-18T14:14:09.6144694Z [cluster2] "properties": {
2021-07-18T14:14:09.6145523Z [cluster2] "lastResourceVersion": {
2021-07-18T14:14:09.6146504Z [cluster2] "type": "string"
2021-07-18T14:14:09.6147041Z [cluster2] },
2021-07-18T14:14:09.6147731Z [cluster2] "mismatchedContainerImages": {
2021-07-18T14:14:09.6155908Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.6156413Z [cluster2] },
2021-07-18T14:14:09.6157667Z [cluster2] "nonReadyContainerStates": {
2021-07-18T14:14:09.6158326Z [cluster2] "items": {
2021-07-18T14:14:09.6159534Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:14:09.6160767Z [cluster2] "properties": {
2021-07-18T14:14:09.6161300Z [cluster2] "running": {
2021-07-18T14:14:09.6161974Z [cluster2] "description": "Details about a running container",
2021-07-18T14:14:09.6162657Z [cluster2] "properties": {
2021-07-18T14:14:09.6163223Z [cluster2] "startedAt": {
2021-07-18T14:14:09.6167708Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-18T14:14:09.6168707Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6169302Z [cluster2] "type": "string"
2021-07-18T14:14:09.6169813Z [cluster2] }
2021-07-18T14:14:09.6170622Z [cluster2] },
2021-07-18T14:14:09.6171128Z [cluster2] "type": "object"
2021-07-18T14:14:09.6171827Z [cluster2] },
2021-07-18T14:14:09.6172388Z [cluster2] "terminated": {
2021-07-18T14:14:09.6173636Z [cluster2] "description": "Details about a terminated container",
2021-07-18T14:14:09.6175030Z [cluster2] "properties": {
2021-07-18T14:14:09.6175661Z [cluster2] "containerID": {
2021-07-18T14:14:09.6176878Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:14:09.6177720Z [cluster2] "type": "string"
2021-07-18T14:14:09.6208593Z [cluster2] },
2021-07-18T14:14:09.6209119Z [cluster2] "exitCode": {
2021-07-18T14:14:09.6209878Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-18T14:14:09.6210633Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6211202Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6211712Z [cluster2] },
2021-07-18T14:14:09.6212232Z [cluster2] "finishedAt": {
2021-07-18T14:14:09.6212957Z [cluster2] "description": "Time at which the container last terminated",
2021-07-18T14:14:09.6213974Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6214554Z [cluster2] "type": "string"
2021-07-18T14:14:09.6215196Z [cluster2] },
2021-07-18T14:14:09.6215711Z [cluster2] "message": {
2021-07-18T14:14:09.6216466Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-18T14:14:09.6217245Z [cluster2] "type": "string"
2021-07-18T14:14:09.6217754Z [cluster2] },
2021-07-18T14:14:09.6218251Z [cluster2] "reason": {
2021-07-18T14:14:09.6218996Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-18T14:14:09.6219782Z [cluster2] "type": "string"
2021-07-18T14:14:09.6220301Z [cluster2] },
2021-07-18T14:14:09.6220781Z [cluster2] "signal": {
2021-07-18T14:14:09.6221498Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-18T14:14:09.6222236Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6222859Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6223379Z [cluster2] },
2021-07-18T14:14:09.6223877Z [cluster2] "startedAt": {
2021-07-18T14:14:09.6224661Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-18T14:14:09.6225862Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6226433Z [cluster2] "type": "string"
2021-07-18T14:14:09.6226956Z [cluster2] }
2021-07-18T14:14:09.6227415Z [cluster2] },
2021-07-18T14:14:09.6227931Z [cluster2] "required": [
2021-07-18T14:14:09.6228469Z [cluster2] "exitCode"
2021-07-18T14:14:09.6228983Z [cluster2] ],
2021-07-18T14:14:09.6229503Z [cluster2] "type": "object"
2021-07-18T14:14:09.6230001Z [cluster2] },
2021-07-18T14:14:09.6230499Z [cluster2] "waiting": {
2021-07-18T14:14:09.6231162Z [cluster2] "description": "Details about a waiting container",
2021-07-18T14:14:09.6231851Z [cluster2] "properties": {
2021-07-18T14:14:09.6232393Z [cluster2] "message": {
2021-07-18T14:14:09.6233329Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-18T14:14:09.6234142Z [cluster2] "type": "string"
2021-07-18T14:14:09.6234682Z [cluster2] },
2021-07-18T14:14:09.6235295Z [cluster2] "reason": {
2021-07-18T14:14:09.6236043Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-18T14:14:09.6236921Z [cluster2] "type": "string"
2021-07-18T14:14:09.6237488Z [cluster2] }
2021-07-18T14:14:09.6237980Z [cluster2] },
2021-07-18T14:14:09.6238538Z [cluster2] "type": "object"
2021-07-18T14:14:09.6239072Z [cluster2] }
2021-07-18T14:14:09.6239565Z [cluster2] },
2021-07-18T14:14:09.6240088Z [cluster2] "type": "object"
2021-07-18T14:14:09.6240624Z [cluster2] },
2021-07-18T14:14:09.6241154Z [cluster2] "type": "array"
2021-07-18T14:14:09.6241665Z [cluster2] },
2021-07-18T14:14:09.6242165Z [cluster2] "status": {
2021-07-18T14:14:09.6242999Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:14:09.6243878Z [cluster2] "properties": {
2021-07-18T14:14:09.6244568Z [cluster2] "collisionCount": {
2021-07-18T14:14:09.6245953Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:14:09.6247300Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6247882Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6248431Z [cluster2] },
2021-07-18T14:14:09.6248959Z [cluster2] "conditions": {
2021-07-18T14:14:09.6250217Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:14:09.6251114Z [cluster2] "items": {
2021-07-18T14:14:09.6252020Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:14:09.6252974Z [cluster2] "properties": {
2021-07-18T14:14:09.6253663Z [cluster2] "lastTransitionTime": {
2021-07-18T14:14:09.6254602Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:14:09.6256329Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6257088Z [cluster2] "type": "string"
2021-07-18T14:14:09.6257615Z [cluster2] },
2021-07-18T14:14:09.6258111Z [cluster2] "message": {
2021-07-18T14:14:09.6258912Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-18T14:14:09.6259811Z [cluster2] "type": "string"
2021-07-18T14:14:09.6260313Z [cluster2] },
2021-07-18T14:14:09.6260812Z [cluster2] "reason": {
2021-07-18T14:14:09.6261821Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-18T14:14:09.6262555Z [cluster2] "type": "string"
2021-07-18T14:14:09.6263074Z [cluster2] },
2021-07-18T14:14:09.6263555Z [cluster2] "status": {
2021-07-18T14:14:09.6264287Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:14:09.6265140Z [cluster2] "type": "string"
2021-07-18T14:14:09.6265660Z [cluster2] },
2021-07-18T14:14:09.6266142Z [cluster2] "type": {
2021-07-18T14:14:09.6266805Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-18T14:14:09.6267493Z [cluster2] "type": "string"
2021-07-18T14:14:09.6268115Z [cluster2] }
2021-07-18T14:14:09.6268592Z [cluster2] },
2021-07-18T14:14:09.6269084Z [cluster2] "required": [
2021-07-18T14:14:09.6269622Z [cluster2] "status",
2021-07-18T14:14:09.6270125Z [cluster2] "type"
2021-07-18T14:14:09.6270615Z [cluster2] ],
2021-07-18T14:14:09.6271131Z [cluster2] "type": "object"
2021-07-18T14:14:09.6271633Z [cluster2] },
2021-07-18T14:14:09.6272134Z [cluster2] "type": "array"
2021-07-18T14:14:09.6272619Z [cluster2] },
2021-07-18T14:14:09.6273432Z [cluster2] "currentNumberScheduled": {
2021-07-18T14:14:09.6274910Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6276199Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6276801Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6277335Z [cluster2] },
2021-07-18T14:14:09.6278019Z [cluster2] "desiredNumberScheduled": {
2021-07-18T14:14:09.6279555Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6280930Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6281522Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6282110Z [cluster2] },
2021-07-18T14:14:09.6282704Z [cluster2] "numberAvailable": {
2021-07-18T14:14:09.6284133Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.6285901Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6286675Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6287219Z [cluster2] },
2021-07-18T14:14:09.6287853Z [cluster2] "numberMisscheduled": {
2021-07-18T14:14:09.6289546Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6290991Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6291597Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6292135Z [cluster2] },
2021-07-18T14:14:09.6292769Z [cluster2] "numberReady": {
2021-07-18T14:14:09.6293761Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:14:09.6294702Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6295305Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6295837Z [cluster2] },
2021-07-18T14:14:09.6296449Z [cluster2] "numberUnavailable": {
2021-07-18T14:14:09.6297682Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.6298860Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6299451Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6299986Z [cluster2] },
2021-07-18T14:14:09.6300615Z [cluster2] "observedGeneration": {
2021-07-18T14:14:09.6301849Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:14:09.6302866Z [cluster2] "format": "int64",
2021-07-18T14:14:09.6303469Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6304005Z [cluster2] },
2021-07-18T14:14:09.6304691Z [cluster2] "updatedNumberScheduled": {
2021-07-18T14:14:09.6305766Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:14:09.6306570Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6307166Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6307791Z [cluster2] }
2021-07-18T14:14:09.6308279Z [cluster2] },
2021-07-18T14:14:09.6309568Z [cluster2] "required": [
2021-07-18T14:14:09.6310328Z [cluster2] "currentNumberScheduled",
2021-07-18T14:14:09.6311267Z [cluster2] "desiredNumberScheduled",
2021-07-18T14:14:09.6312023Z [cluster2] "numberMisscheduled",
2021-07-18T14:14:09.6312675Z [cluster2] "numberReady"
2021-07-18T14:14:09.6313174Z [cluster2] ],
2021-07-18T14:14:09.6313663Z [cluster2] "type": "object"
2021-07-18T14:14:09.6314137Z [cluster2] }
2021-07-18T14:14:09.6314579Z [cluster2] },
2021-07-18T14:14:09.6315040Z [cluster2] "required": [
2021-07-18T14:14:09.6315735Z [cluster2] "mismatchedContainerImages"
2021-07-18T14:14:09.6316371Z [cluster2] ],
2021-07-18T14:14:09.6316851Z [cluster2] "type": "object"
2021-07-18T14:14:09.6317333Z [cluster2] },
2021-07-18T14:14:09.6317968Z [cluster2] "loadBalancerStatus": {
2021-07-18T14:14:09.6318799Z [cluster2] "properties": {
2021-07-18T14:14:09.6319853Z [cluster2] "status": {
2021-07-18T14:14:09.6321135Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-18T14:14:09.6321997Z [cluster2] "properties": {
2021-07-18T14:14:09.6322545Z [cluster2] "ingress": {
2021-07-18T14:14:09.6323903Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-18T14:14:09.6324905Z [cluster2] "items": {
2021-07-18T14:14:09.6326342Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-18T14:14:09.6327479Z [cluster2] "properties": {
2021-07-18T14:14:09.6328029Z [cluster2] "hostname": {
2021-07-18T14:14:09.6329250Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-18T14:14:09.6330171Z [cluster2] "type": "string"
2021-07-18T14:14:09.6330689Z [cluster2] },
2021-07-18T14:14:09.6331163Z [cluster2] "ip": {
2021-07-18T14:14:09.6332392Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-18T14:14:09.6333345Z [cluster2] "type": "string"
2021-07-18T14:14:09.6333844Z [cluster2] }
2021-07-18T14:14:09.6334411Z [cluster2] },
2021-07-18T14:14:09.6334916Z [cluster2] "type": "object"
2021-07-18T14:14:09.6335428Z [cluster2] },
2021-07-18T14:14:09.6335934Z [cluster2] "type": "array"
2021-07-18T14:14:09.6336417Z [cluster2] }
2021-07-18T14:14:09.6336876Z [cluster2] },
2021-07-18T14:14:09.6337359Z [cluster2] "type": "object"
2021-07-18T14:14:09.6337844Z [cluster2] }
2021-07-18T14:14:09.6338271Z [cluster2] },
2021-07-18T14:14:09.6338757Z [cluster2] "type": "object"
2021-07-18T14:14:09.6339243Z [cluster2] },
2021-07-18T14:14:09.6339714Z [cluster2] "natEnabled": {
2021-07-18T14:14:09.6340249Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.6340714Z [cluster2] },
2021-07-18T14:14:09.6341220Z [cluster2] "networkPlugin": {
2021-07-18T14:14:09.6341761Z [cluster2] "type": "string"
2021-07-18T14:14:09.6342287Z [cluster2] },
2021-07-18T14:14:09.6342924Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-18T14:14:09.6343818Z [cluster2] "properties": {
2021-07-18T14:14:09.6344505Z [cluster2] "lastResourceVersion": {
2021-07-18T14:14:09.6345376Z [cluster2] "type": "string"
2021-07-18T14:14:09.6345911Z [cluster2] },
2021-07-18T14:14:09.6346614Z [cluster2] "mismatchedContainerImages": {
2021-07-18T14:14:09.6347384Z [cluster2] "type": "boolean"
2021-07-18T14:14:09.6347904Z [cluster2] },
2021-07-18T14:14:09.6348588Z [cluster2] "nonReadyContainerStates": {
2021-07-18T14:14:09.6349300Z [cluster2] "items": {
2021-07-18T14:14:09.6350585Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:14:09.6351916Z [cluster2] "properties": {
2021-07-18T14:14:09.6352489Z [cluster2] "running": {
2021-07-18T14:14:09.6353208Z [cluster2] "description": "Details about a running container",
2021-07-18T14:14:09.6353962Z [cluster2] "properties": {
2021-07-18T14:14:09.6354565Z [cluster2] "startedAt": {
2021-07-18T14:14:09.6355676Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-18T14:14:09.6356925Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6357583Z [cluster2] "type": "string"
2021-07-18T14:14:09.6358124Z [cluster2] }
2021-07-18T14:14:09.6358733Z [cluster2] },
2021-07-18T14:14:09.6359293Z [cluster2] "type": "object"
2021-07-18T14:14:09.6359825Z [cluster2] },
2021-07-18T14:14:09.6360380Z [cluster2] "terminated": {
2021-07-18T14:14:09.6361330Z [cluster2] "description": "Details about a terminated container",
2021-07-18T14:14:09.6362114Z [cluster2] "properties": {
2021-07-18T14:14:09.6362751Z [cluster2] "containerID": {
2021-07-18T14:14:09.6363948Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:14:09.6364785Z [cluster2] "type": "string"
2021-07-18T14:14:09.6365326Z [cluster2] },
2021-07-18T14:14:09.6365878Z [cluster2] "exitCode": {
2021-07-18T14:14:09.6366678Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-18T14:14:09.6367487Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6368987Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6369547Z [cluster2] },
2021-07-18T14:14:09.6370113Z [cluster2] "finishedAt": {
2021-07-18T14:14:09.6370899Z [cluster2] "description": "Time at which the container last terminated",
2021-07-18T14:14:09.6371992Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6372629Z [cluster2] "type": "string"
2021-07-18T14:14:09.6373169Z [cluster2] },
2021-07-18T14:14:09.6373716Z [cluster2] "message": {
2021-07-18T14:14:09.6374542Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-18T14:14:09.6375388Z [cluster2] "type": "string"
2021-07-18T14:14:09.6375947Z [cluster2] },
2021-07-18T14:14:09.6376476Z [cluster2] "reason": {
2021-07-18T14:14:09.6377281Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-18T14:14:09.6378088Z [cluster2] "type": "string"
2021-07-18T14:14:09.6378640Z [cluster2] },
2021-07-18T14:14:09.6379160Z [cluster2] "signal": {
2021-07-18T14:14:09.6379940Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-18T14:14:09.6380737Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6381334Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6381986Z [cluster2] },
2021-07-18T14:14:09.6382531Z [cluster2] "startedAt": {
2021-07-18T14:14:09.6383380Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-18T14:14:09.6384482Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6385242Z [cluster2] "type": "string"
2021-07-18T14:14:09.6386083Z [cluster2] }
2021-07-18T14:14:09.6386579Z [cluster2] },
2021-07-18T14:14:09.6387129Z [cluster2] "required": [
2021-07-18T14:14:09.6387735Z [cluster2] "exitCode"
2021-07-18T14:14:09.6388265Z [cluster2] ],
2021-07-18T14:14:09.6388820Z [cluster2] "type": "object"
2021-07-18T14:14:09.6389348Z [cluster2] },
2021-07-18T14:14:09.6389879Z [cluster2] "waiting": {
2021-07-18T14:14:09.6390985Z [cluster2] "description": "Details about a waiting container",
2021-07-18T14:14:09.6391734Z [cluster2] "properties": {
2021-07-18T14:14:09.6394437Z [cluster2] "message": {
2021-07-18T14:14:09.6395435Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-18T14:14:09.6396444Z [cluster2] "type": "string"
2021-07-18T14:14:09.6397000Z [cluster2] },
2021-07-18T14:14:09.6397531Z [cluster2] "reason": {
2021-07-18T14:14:09.6398294Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-18T14:14:09.6399069Z [cluster2] "type": "string"
2021-07-18T14:14:09.6399628Z [cluster2] }
2021-07-18T14:14:09.6400125Z [cluster2] },
2021-07-18T14:14:09.6400850Z [cluster2] "type": "object"
2021-07-18T14:14:09.6401416Z [cluster2] }
2021-07-18T14:14:09.6401914Z [cluster2] },
2021-07-18T14:14:09.6402446Z [cluster2] "type": "object"
2021-07-18T14:14:09.6402967Z [cluster2] },
2021-07-18T14:14:09.6403490Z [cluster2] "type": "array"
2021-07-18T14:14:09.6404002Z [cluster2] },
2021-07-18T14:14:09.6404502Z [cluster2] "status": {
2021-07-18T14:14:09.6405335Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:14:09.6406225Z [cluster2] "properties": {
2021-07-18T14:14:09.6406973Z [cluster2] "collisionCount": {
2021-07-18T14:14:09.6408358Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:14:09.6409715Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6410295Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6410852Z [cluster2] },
2021-07-18T14:14:09.6411402Z [cluster2] "conditions": {
2021-07-18T14:14:09.6412738Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:14:09.6413635Z [cluster2] "items": {
2021-07-18T14:14:09.6414544Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:14:09.6415500Z [cluster2] "properties": {
2021-07-18T14:14:09.6416195Z [cluster2] "lastTransitionTime": {
2021-07-18T14:14:09.6417197Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:14:09.6418311Z [cluster2] "format": "date-time",
2021-07-18T14:14:09.6418932Z [cluster2] "type": "string"
2021-07-18T14:14:09.6419491Z [cluster2] },
2021-07-18T14:14:09.6420080Z [cluster2] "message": {
2021-07-18T14:14:09.6420931Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-18T14:14:09.6421810Z [cluster2] "type": "string"
2021-07-18T14:14:09.6422348Z [cluster2] },
2021-07-18T14:14:09.6422890Z [cluster2] "reason": {
2021-07-18T14:14:09.6423915Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-18T14:14:09.6424704Z [cluster2] "type": "string"
2021-07-18T14:14:09.6425373Z [cluster2] },
2021-07-18T14:14:09.6425896Z [cluster2] "status": {
2021-07-18T14:14:09.6426687Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:14:09.6427476Z [cluster2] "type": "string"
2021-07-18T14:14:09.6428036Z [cluster2] },
2021-07-18T14:14:09.6428564Z [cluster2] "type": {
2021-07-18T14:14:09.6429269Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-18T14:14:09.6430009Z [cluster2] "type": "string"
2021-07-18T14:14:09.6430628Z [cluster2] }
2021-07-18T14:14:09.6431139Z [cluster2] },
2021-07-18T14:14:09.6431668Z [cluster2] "required": [
2021-07-18T14:14:09.6432237Z [cluster2] "status",
2021-07-18T14:14:09.6432789Z [cluster2] "type"
2021-07-18T14:14:09.6433301Z [cluster2] ],
2021-07-18T14:14:09.6433847Z [cluster2] "type": "object"
2021-07-18T14:14:09.6434384Z [cluster2] },
2021-07-18T14:14:09.6434921Z [cluster2] "type": "array"
2021-07-18T14:14:09.6435434Z [cluster2] },
2021-07-18T14:14:09.6436116Z [cluster2] "currentNumberScheduled": {
2021-07-18T14:14:09.6437591Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6438884Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6439537Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6440069Z [cluster2] },
2021-07-18T14:14:09.6440750Z [cluster2] "desiredNumberScheduled": {
2021-07-18T14:14:09.6442281Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6443642Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6444239Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6444782Z [cluster2] },
2021-07-18T14:14:09.6445350Z [cluster2] "numberAvailable": {
2021-07-18T14:14:09.6446598Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.6447769Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6448366Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6448894Z [cluster2] },
2021-07-18T14:14:09.6449516Z [cluster2] "numberMisscheduled": {
2021-07-18T14:14:09.6450906Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6452190Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6452787Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6453320Z [cluster2] },
2021-07-18T14:14:09.6453975Z [cluster2] "numberReady": {
2021-07-18T14:14:09.6454963Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:14:09.6455833Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6456384Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6456879Z [cluster2] },
2021-07-18T14:14:09.6457710Z [cluster2] "numberUnavailable": {
2021-07-18T14:14:09.6459060Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.6460205Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6460806Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6461339Z [cluster2] },
2021-07-18T14:14:09.6461968Z [cluster2] "observedGeneration": {
2021-07-18T14:14:09.6462916Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:14:09.6463827Z [cluster2] "format": "int64",
2021-07-18T14:14:09.6464424Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6465050Z [cluster2] },
2021-07-18T14:14:09.6465729Z [cluster2] "updatedNumberScheduled": {
2021-07-18T14:14:09.6466678Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:14:09.6467670Z [cluster2] "format": "int32",
2021-07-18T14:14:09.6468271Z [cluster2] "type": "integer"
2021-07-18T14:14:09.6468804Z [cluster2] }
2021-07-18T14:14:09.6469664Z [cluster2] },
2021-07-18T14:14:09.6470442Z [cluster2] "required": [
2021-07-18T14:14:09.6471129Z [cluster2] "currentNumberScheduled",
2021-07-18T14:14:09.6471939Z [cluster2] "desiredNumberScheduled",
2021-07-18T14:14:09.6472678Z [cluster2] "numberMisscheduled",
2021-07-18T14:14:09.6473324Z [cluster2] "numberReady"
2021-07-18T14:14:09.6473823Z [cluster2] ],
2021-07-18T14:14:09.6474318Z [cluster2] "type": "object"
2021-07-18T14:14:09.6474794Z [cluster2] }
2021-07-18T14:14:09.6475238Z [cluster2] },
2021-07-18T14:14:09.6475698Z [cluster2] "required": [
2021-07-18T14:14:09.6476606Z [cluster2] "mismatchedContainerImages"
2021-07-18T14:14:09.6477306Z [cluster2] ],
2021-07-18T14:14:09.6482578Z [cluster2] "type": "object"
2021-07-18T14:14:09.6483121Z [cluster2] },
2021-07-18T14:14:09.6483650Z [cluster2] "serviceCIDR": {
2021-07-18T14:14:09.6484393Z [cluster2] "type": "string"
2021-07-18T14:14:09.6484901Z [cluster2] }
2021-07-18T14:14:09.6485364Z [cluster2] },
2021-07-18T14:14:09.6485853Z [cluster2] "required": [
2021-07-18T14:14:09.6486414Z [cluster2] "clusterID",
2021-07-18T14:14:09.6486985Z [cluster2] "natEnabled"
2021-07-18T14:14:09.6487480Z [cluster2] ],
2021-07-18T14:14:09.6497345Z [cluster2] 14:12:51Z",
2021-07-18T14:14:09.6498083Z [cluster1] "message": "no conflicts found",
2021-07-18T14:14:09.6498958Z [cluster1] "reason": "NoConflicts",
2021-07-18T14:14:09.6499529Z [cluster1] "status": "True",
2021-07-18T14:14:09.6500106Z [cluster1] "type": "NamesAccepted"
2021-07-18T14:14:09.6500639Z [cluster1] },
2021-07-18T14:14:09.6501057Z [cluster1] {
2021-07-18T14:14:09.6502040Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:51Z",
2021-07-18T14:14:09.6502816Z [cluster1] "message": "the initial names have been accepted",
2021-07-18T14:14:09.6503631Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-18T14:14:09.6504305Z [cluster1] "status": "True",
2021-07-18T14:14:09.6505723Z [cluster1] "type": "Established"
2021-07-18T14:14:09.6506397Z [cluster1] }
2021-07-18T14:14:09.6506802Z [cluster1] ],
2021-07-18T14:14:09.6507311Z [cluster1] "storedVersions": [
2021-07-18T14:14:09.6507815Z [cluster1] "v1"
2021-07-18T14:14:09.6508235Z [cluster1] ]
2021-07-18T14:14:09.6508626Z [cluster1] }
2021-07-18T14:14:09.6509028Z [cluster1] }
2021-07-18T14:14:09.6510167Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:14:09.6511725Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:14:09.6513484Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:09.6515066Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:14:09.6516546Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:14:09.6518156Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:09.6519752Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:14:09.6521089Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:14:09.6522706Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:09.6524280Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-18T14:14:09.6525561Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-18T14:14:09.6528099Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:09.6530151Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:14:09.6531888Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:14:09.6534092Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:14:09.6535841Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-18T14:14:09.6537040Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-18T14:14:09.6538565Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:14:09.6540495Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:14:09.6542238Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:14:09.6544363Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:14:09.6546469Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-18T14:14:09.6547478Z [cluster1] NAME CREATED AT
2021-07-18T14:14:09.6548389Z [cluster1] submariners.submariner.io 2021-07-18T14:12:41Z
2021-07-18T14:14:09.6549896Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:14:09.6551588Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:14:09.6553074Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:14:09.6554709Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-18T14:14:09.6556657Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:14:09.6557692Z [cluster1] {
2021-07-18T14:14:09.6558326Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:09.6559177Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-18T14:14:09.6559863Z [cluster1] "metadata": {
2021-07-18T14:14:09.6560482Z [cluster1] "annotations": {
2021-07-18T14:14:09.6561504Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:09.6562231Z [cluster1] },
2021-07-18T14:14:09.6562991Z [cluster1] "creationTimestamp": "2021-07-18T14:12:41Z",
2021-07-18T14:14:09.6563620Z [cluster1] "generation": 1,
2021-07-18T14:14:09.6564164Z [cluster1] "managedFields": [
2021-07-18T14:14:09.6564664Z [cluster1] {
2021-07-18T14:14:09.6565301Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:09.6566053Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:09.6566693Z [cluster1] "fieldsV1": {
2021-07-18T14:14:09.6567173Z [cluster1] "f:metadata": {
2021-07-18T14:14:09.6567671Z [cluster1] "f:annotations": {
2021-07-18T14:14:09.6568398Z [cluster1] ".": {},
2021-07-18T14:14:09.6569328Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:09.6570048Z [cluster1] }
2021-07-18T14:14:09.6570459Z [cluster1] },
2021-07-18T14:14:09.6571057Z [cluster1] "f:spec": {
2021-07-18T14:14:09.6571582Z [cluster1] "f:conversion": {
2021-07-18T14:14:09.6572078Z [cluster1] ".": {},
2021-07-18T14:14:09.6572588Z [cluster1] "f:strategy": {}
2021-07-18T14:14:09.6573067Z [cluster1] },
2021-07-18T14:14:09.6573540Z [cluster1] "f:group": {},
2021-07-18T14:14:09.6574023Z [cluster1] "f:names": {
2021-07-18T14:14:09.6574512Z [cluster1] "f:kind": {},
2021-07-18T14:14:09.6575035Z [cluster1] "f:listKind": {},
2021-07-18T14:14:09.6575549Z [cluster1] "f:plural": {},
2021-07-18T14:14:09.6576077Z [cluster1] "f:singular": {}
2021-07-18T14:14:09.6576548Z [cluster1] },
2021-07-18T14:14:09.6577019Z [cluster1] "f:scope": {},
2021-07-18T14:14:09.6577521Z [cluster1] "f:versions": {}
2021-07-18T14:14:09.6577999Z [cluster1] },
2021-07-18T14:14:09.6578449Z [cluster1] "f:status": {
2021-07-18T14:14:09.6579009Z [cluster1] "f:acceptedNames": {
2021-07-18T14:14:09.6579654Z [cluster1] "f:kind": {},
2021-07-18T14:14:09.6580163Z [cluster1] "f:plural": {}
2021-07-18T14:14:09.6580645Z [cluster1] },
2021-07-18T14:14:09.6581134Z [cluster1] "f:conditions": {},
2021-07-18T14:14:09.6581733Z [cluster1] "f:storedVersions": {}
2021-07-18T14:14:09.6582252Z [cluster1] }
2021-07-18T14:14:09.6582683Z [cluster1] },
2021-07-18T14:14:09.6583169Z [cluster1] "manager": "subctl",
2021-07-18T14:14:09.6583744Z [cluster1] "operation": "Update",
2021-07-18T14:14:09.6584491Z [cluster1] "time": "2021-07-18T14:12:53Z"
2021-07-18T14:14:09.6585130Z [cluster1] }
2021-07-18T14:14:09.6585533Z [cluster1] ],
2021-07-18T14:14:09.6586189Z [cluster1] "name": "submariners.submariner.io",
2021-07-18T14:14:09.6586955Z [cluster1] "resourceVersion": "1748",
2021-07-18T14:14:09.6588137Z [cluster1] "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-18T14:14:09.6590658Z [cluster1] "uid": "f9124e10-413a-4ac1-bb29-2de2c13e4aa3"
2021-07-18T14:14:09.6591446Z [cluster1] },
2021-07-18T14:14:09.6591879Z [cluster1] "spec": {
2021-07-18T14:14:09.6592355Z [cluster1] "conversion": {
2021-07-18T14:14:09.6592886Z [cluster1] "strategy": "None"
2021-07-18T14:14:09.6593348Z [cluster1] },
2021-07-18T14:14:09.6593982Z [cluster1] "group": "submariner.io",
2021-07-18T14:14:09.6594506Z [cluster1] "names": {
2021-07-18T14:14:09.6595022Z [cluster1] "kind": "Submariner",
2021-07-18T14:14:09.6595656Z [cluster1] "listKind": "SubmarinerList",
2021-07-18T14:14:09.6596387Z [cluster1] "plural": "submariners",
2021-07-18T14:14:09.6596952Z [cluster1] "singular": "submariner"
2021-07-18T14:14:09.6597415Z [cluster1] },
2021-07-18T14:14:09.6598066Z [cluster1] "scope": "Namespaced",
2021-07-18T14:14:09.6598592Z [cluster1] "versions": [
2021-07-18T14:14:09.6599047Z [cluster1] {
2021-07-18T14:14:09.6599702Z [cluster1] "name": "v1alpha1",
2021-07-18T14:14:09.6600225Z [cluster1] "schema": {
2021-07-18T14:14:09.6600783Z [cluster1] "openAPIV3Schema": {
2021-07-18T14:14:09.6601592Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-18T14:14:09.6602362Z [cluster1] "properties": {
2021-07-18T14:14:09.6602917Z [cluster1] "apiVersion": {
2021-07-18T14:14:09.6605354Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:09.6607219Z [cluster1] "type": "string"
2021-07-18T14:14:09.6607707Z [cluster1] },
2021-07-18T14:14:09.6608186Z [cluster1] "kind": {
2021-07-18T14:14:09.6610439Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:09.6612271Z [cluster1] "type": "string"
2021-07-18T14:14:09.6612770Z [cluster1] },
2021-07-18T14:14:09.6613250Z [cluster1] "metadata": {
2021-07-18T14:14:09.6613793Z [cluster1] "type": "object"
2021-07-18T14:14:09.6614370Z [cluster1] },
2021-07-18T14:14:09.6614845Z [cluster1] "spec": {
2021-07-18T14:14:09.6615634Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-18T14:14:09.6616468Z [cluster1] "properties": {
2021-07-18T14:14:09.6617027Z [cluster1] "broker": {
2021-07-18T14:14:09.6617557Z [cluster1] "type": "string"
2021-07-18T14:14:09.6618077Z [cluster1] },
2021-07-18T14:14:09.6618668Z [cluster1] "brokerK8sApiServer": {
2021-07-18T14:14:09.6619326Z [cluster1] "type": "string"
2021-07-18T14:14:09.6619839Z [cluster1] },
2021-07-18T14:14:09.6620538Z [cluster1] "brokerK8sApiServerToken": {
2021-07-18T14:14:09.6621254Z [cluster1] "type": "string"
2021-07-18T14:14:09.6621747Z [cluster1] },
2021-07-18T14:14:09.6622274Z [cluster1] "brokerK8sCA": {
2021-07-18T14:14:09.6622840Z [cluster1] "type": "string"
2021-07-18T14:14:09.6623344Z [cluster1] },
2021-07-18T14:14:09.6624011Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-18T14:14:09.6625319Z [cluster1] "type": "string"
2021-07-18T14:14:09.6626017Z [cluster1] },
2021-07-18T14:14:09.6626547Z [cluster1] "cableDriver": {
2021-07-18T14:14:09.6627128Z [cluster1] "type": "string"
2021-07-18T14:14:09.6627627Z [cluster1] },
2021-07-18T14:14:09.6628181Z [cluster1] "ceIPSecDebug": {
2021-07-18T14:14:09.6628773Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6629292Z [cluster1] },
2021-07-18T14:14:09.6629934Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-18T14:14:09.6630650Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6631172Z [cluster1] },
2021-07-18T14:14:09.6631729Z [cluster1] "ceIPSecIKEPort": {
2021-07-18T14:14:09.6632356Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6632864Z [cluster1] },
2021-07-18T14:14:09.6633440Z [cluster1] "ceIPSecNATTPort": {
2021-07-18T14:14:09.6634061Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6634585Z [cluster1] },
2021-07-18T14:14:09.6635097Z [cluster1] "ceIPSecPSK": {
2021-07-18T14:14:09.6635679Z [cluster1] "type": "string"
2021-07-18T14:14:09.6636198Z [cluster1] },
2021-07-18T14:14:09.6636853Z [cluster1] "ceIPSecPreferredServer": {
2021-07-18T14:14:09.6637580Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6638089Z [cluster1] },
2021-07-18T14:14:09.6638617Z [cluster1] "clusterCIDR": {
2021-07-18T14:14:09.6639180Z [cluster1] "type": "string"
2021-07-18T14:14:09.6639695Z [cluster1] },
2021-07-18T14:14:09.6640212Z [cluster1] "clusterID": {
2021-07-18T14:14:09.6640857Z [cluster1] "type": "string"
2021-07-18T14:14:09.6641373Z [cluster1] },
2021-07-18T14:14:09.6641882Z [cluster1] "colorCodes": {
2021-07-18T14:14:09.6642458Z [cluster1] "type": "string"
2021-07-18T14:14:09.6642956Z [cluster1] },
2021-07-18T14:14:09.6643595Z [cluster1] "connectionHealthCheck": {
2021-07-18T14:14:09.6644287Z [cluster1] "properties": {
2021-07-18T14:14:09.6644867Z [cluster1] "enabled": {
2021-07-18T14:14:09.6645443Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6645963Z [cluster1] },
2021-07-18T14:14:09.6646544Z [cluster1] "intervalSeconds": {
2021-07-18T14:14:09.6647360Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-18T14:14:09.6648127Z [cluster1] "format": "int64",
2021-07-18T14:14:09.6648700Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6649233Z [cluster1] },
2021-07-18T14:14:09.6649851Z [cluster1] "maxPacketLossCount": {
2021-07-18T14:14:09.6650913Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-18T14:14:09.6651833Z [cluster1] "format": "int64",
2021-07-18T14:14:09.6652402Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6652930Z [cluster1] }
2021-07-18T14:14:09.6653410Z [cluster1] },
2021-07-18T14:14:09.6653914Z [cluster1] "type": "object"
2021-07-18T14:14:09.6654431Z [cluster1] },
2021-07-18T14:14:09.6655037Z [cluster1] "coreDNSCustomConfig": {
2021-07-18T14:14:09.6655716Z [cluster1] "properties": {
2021-07-18T14:14:09.6656320Z [cluster1] "configMapName": {
2021-07-18T14:14:09.6656938Z [cluster1] "type": "string"
2021-07-18T14:14:09.6657462Z [cluster1] },
2021-07-18T14:14:09.6657975Z [cluster1] "namespace": {
2021-07-18T14:14:09.6658546Z [cluster1] "type": "string"
2021-07-18T14:14:09.6659053Z [cluster1] }
2021-07-18T14:14:09.6659526Z [cluster1] },
2021-07-18T14:14:09.6660028Z [cluster1] "type": "object"
2021-07-18T14:14:09.6660540Z [cluster1] },
2021-07-18T14:14:09.6661067Z [cluster1] "customDomains": {
2021-07-18T14:14:09.6661631Z [cluster1] "items": {
2021-07-18T14:14:09.6662168Z [cluster1] "type": "string"
2021-07-18T14:14:09.6662668Z [cluster1] },
2021-07-18T14:14:09.6663181Z [cluster1] "type": "array",
2021-07-18T14:14:09.6664211Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-18T14:14:09.6665055Z [cluster1] },
2021-07-18T14:14:09.6665530Z [cluster1] "debug": {
2021-07-18T14:14:09.6666165Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6666674Z [cluster1] },
2021-07-18T14:14:09.6667199Z [cluster1] "globalCIDR": {
2021-07-18T14:14:09.6667771Z [cluster1] "type": "string"
2021-07-18T14:14:09.6668268Z [cluster1] },
2021-07-18T14:14:09.6675913Z [cluster1] "imageOverrides": {
2021-07-18T14:14:09.6676850Z [cluster1] "additionalProperties": {
2021-07-18T14:14:09.6677509Z [cluster1] "type": "string"
2021-07-18T14:14:09.6678286Z [cluster1] },
2021-07-18T14:14:09.6678782Z [cluster1] "type": "object"
2021-07-18T14:14:09.6679449Z [cluster1] },
2021-07-18T14:14:09.6680057Z [cluster1] "loadBalancerEnabled": {
2021-07-18T14:14:09.6680730Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6681239Z [cluster1] },
2021-07-18T14:14:09.6687857Z [cluster1] "namespace": {
2021-07-18T14:14:09.6688775Z [cluster1] "type": "string"
2021-07-18T14:14:09.6689314Z [cluster1] },
2021-07-18T14:14:09.6689990Z [cluster1] "natEnabled": {
2021-07-18T14:14:09.6690573Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6691100Z [cluster1] },
2021-07-18T14:14:09.6691611Z [cluster1] "repository": {
2021-07-18T14:14:09.6692187Z [cluster1] "type": "string"
2021-07-18T14:14:09.6692689Z [cluster1] },
2021-07-18T14:14:09.6693227Z [cluster1] "serviceCIDR": {
2021-07-18T14:14:09.6693802Z [cluster1] "type": "string"
2021-07-18T14:14:09.6694308Z [cluster1] },
2021-07-18T14:14:09.6694964Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-18T14:14:09.6695695Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6696216Z [cluster1] },
2021-07-18T14:14:09.6696700Z [cluster1] "version": {
2021-07-18T14:14:09.6697238Z [cluster1] "type": "string"
2021-07-18T14:14:09.6697730Z [cluster1] }
2021-07-18T14:14:09.6698185Z [cluster1] },
2021-07-18T14:14:09.6698667Z [cluster1] "required": [
2021-07-18T14:14:09.6699201Z [cluster1] "broker",
2021-07-18T14:14:09.6699821Z [cluster1] "brokerK8sApiServer",
2021-07-18T14:14:09.6700618Z [cluster1] "brokerK8sApiServerToken",
2021-07-18T14:14:09.6701679Z [cluster1] "brokerK8sCA",
2021-07-18T14:14:09.6702577Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-18T14:14:09.6703492Z [cluster1] "ceIPSecDebug",
2021-07-18T14:14:09.6704095Z [cluster1] "ceIPSecPSK",
2021-07-18T14:14:09.6704956Z [cluster1] "clusterCIDR",
2021-07-18T14:14:09.6705523Z [cluster1] "clusterID",
2021-07-18T14:14:09.6706064Z [cluster1] "debug",
2021-07-18T14:14:09.6706595Z [cluster1] "namespace",
2021-07-18T14:14:09.6707267Z [cluster1] "natEnabled",
2021-07-18T14:14:09.6707863Z [cluster1] "serviceCIDR"
2021-07-18T14:14:09.6708369Z [cluster1] ],
2021-07-18T14:14:09.6708883Z [cluster1] "type": "object"
2021-07-18T14:14:09.6709365Z [cluster1] },
2021-07-18T14:14:09.6709851Z [cluster1] "status": {
2021-07-18T14:14:09.6710664Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-18T14:14:09.6711532Z [cluster1] "properties": {
2021-07-18T14:14:09.6712123Z [cluster1] "clusterCIDR": {
2021-07-18T14:14:09.6712680Z [cluster1] "type": "string"
2021-07-18T14:14:09.6713186Z [cluster1] },
2021-07-18T14:14:09.6713691Z [cluster1] "clusterID": {
2021-07-18T14:14:09.6714249Z [cluster1] "type": "string"
2021-07-18T14:14:09.6714742Z [cluster1] },
2021-07-18T14:14:09.6715266Z [cluster1] "colorCodes": {
2021-07-18T14:14:09.6715819Z [cluster1] "type": "string"
2021-07-18T14:14:09.6716330Z [cluster1] },
2021-07-18T14:14:09.6716977Z [cluster1] "deploymentInfo": {
2021-07-18T14:14:09.6717607Z [cluster1] "properties": {
2021-07-18T14:14:09.6718177Z [cluster1] "cloudProvider": {
2021-07-18T14:14:09.6718723Z [cluster1] "type": "string"
2021-07-18T14:14:09.6719203Z [cluster1] },
2021-07-18T14:14:09.6719725Z [cluster1] "kubernetesType": {
2021-07-18T14:14:09.6720329Z [cluster1] "type": "string"
2021-07-18T14:14:09.6720804Z [cluster1] },
2021-07-18T14:14:09.6721424Z [cluster1] "kubernetesTypeVersion": {
2021-07-18T14:14:09.6722077Z [cluster1] "type": "string"
2021-07-18T14:14:09.6722557Z [cluster1] },
2021-07-18T14:14:09.6723117Z [cluster1] "kubernetesVersion": {
2021-07-18T14:14:09.6723705Z [cluster1] "type": "string"
2021-07-18T14:14:09.6724186Z [cluster1] }
2021-07-18T14:14:09.6724612Z [cluster1] },
2021-07-18T14:14:09.6725091Z [cluster1] "type": "object"
2021-07-18T14:14:09.6725572Z [cluster1] },
2021-07-18T14:14:09.6726170Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-18T14:14:09.6727147Z [cluster1] "properties": {
2021-07-18T14:14:09.6727779Z [cluster1] "lastResourceVersion": {
2021-07-18T14:14:09.6728414Z [cluster1] "type": "string"
2021-07-18T14:14:09.6728885Z [cluster1] },
2021-07-18T14:14:09.6729552Z [cluster1] "mismatchedContainerImages": {
2021-07-18T14:14:09.6730266Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6730745Z [cluster1] },
2021-07-18T14:14:09.6731379Z [cluster1] "nonReadyContainerStates": {
2021-07-18T14:14:09.6732084Z [cluster1] "items": {
2021-07-18T14:14:09.6733280Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:14:09.6734775Z [cluster1] "properties": {
2021-07-18T14:14:09.6735356Z [cluster1] "running": {
2021-07-18T14:14:09.6736094Z [cluster1] "description": "Details about a running container",
2021-07-18T14:14:09.6736835Z [cluster1] "properties": {
2021-07-18T14:14:09.6737451Z [cluster1] "startedAt": {
2021-07-18T14:14:09.6738693Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-18T14:14:09.6739710Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.6740348Z [cluster1] "type": "string"
2021-07-18T14:14:09.6740891Z [cluster1] }
2021-07-18T14:14:09.6741392Z [cluster1] },
2021-07-18T14:14:09.6742021Z [cluster1] "type": "object"
2021-07-18T14:14:09.6742555Z [cluster1] },
2021-07-18T14:14:09.6743104Z [cluster1] "terminated": {
2021-07-18T14:14:09.6743868Z [cluster1] "description": "Details about a terminated container",
2021-07-18T14:14:09.6744646Z [cluster1] "properties": {
2021-07-18T14:14:09.6745464Z [cluster1] "containerID": {
2021-07-18T14:14:09.6746635Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:14:09.6747476Z [cluster1] "type": "string"
2021-07-18T14:14:09.6748341Z [cluster1] },
2021-07-18T14:14:09.6748920Z [cluster1] "exitCode": {
2021-07-18T14:14:09.6749738Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-18T14:14:09.6750536Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6751149Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6751720Z [cluster1] },
2021-07-18T14:14:09.6752277Z [cluster1] "finishedAt": {
2021-07-18T14:14:09.6753441Z [cluster1] "description": "Time at which the container last terminated",
2021-07-18T14:14:09.6754699Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.6755333Z [cluster1] "type": "string"
2021-07-18T14:14:09.6755875Z [cluster1] },
2021-07-18T14:14:09.6756526Z [cluster1] "message": {
2021-07-18T14:14:09.6757377Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-18T14:14:09.6758200Z [cluster1] "type": "string"
2021-07-18T14:14:09.6758956Z [cluster1] },
2021-07-18T14:14:09.6759488Z [cluster1] "reason": {
2021-07-18T14:14:09.6760305Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-18T14:14:09.6761123Z [cluster1] "type": "string"
2021-07-18T14:14:09.6761666Z [cluster1] },
2021-07-18T14:14:09.6762296Z [cluster1] "signal": {
2021-07-18T14:14:09.6763007Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-18T14:14:09.6763740Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6764306Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6765098Z [cluster1] },
2021-07-18T14:14:09.6765657Z [cluster1] "startedAt": {
2021-07-18T14:14:09.6766491Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-18T14:14:09.6767633Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.6768261Z [cluster1] "type": "string"
2021-07-18T14:14:09.6768817Z [cluster1] }
2021-07-18T14:14:09.6769324Z [cluster1] },
2021-07-18T14:14:09.6769854Z [cluster1] "required": [
2021-07-18T14:14:09.6770454Z [cluster1] "exitCode"
2021-07-18T14:14:09.6770988Z [cluster1] ],
2021-07-18T14:14:09.6771534Z [cluster1] "type": "object"
2021-07-18T14:14:09.6772064Z [cluster1] },
2021-07-18T14:14:09.6772600Z [cluster1] "waiting": {
2021-07-18T14:14:09.6773330Z [cluster1] "description": "Details about a waiting container",
2021-07-18T14:14:09.6774068Z [cluster1] "properties": {
2021-07-18T14:14:09.6774667Z [cluster1] "message": {
2021-07-18T14:14:09.6775459Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-18T14:14:09.6776280Z [cluster1] "type": "string"
2021-07-18T14:14:09.6776835Z [cluster1] },
2021-07-18T14:14:09.6777358Z [cluster1] "reason": {
2021-07-18T14:14:09.6778189Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-18T14:14:09.6778959Z [cluster1] "type": "string"
2021-07-18T14:14:09.6779510Z [cluster1] }
2021-07-18T14:14:09.6780011Z [cluster1] },
2021-07-18T14:14:09.6780548Z [cluster1] "type": "object"
2021-07-18T14:14:09.6781100Z [cluster1] }
2021-07-18T14:14:09.6781907Z [cluster1] },
2021-07-18T14:14:09.6782450Z [cluster1] "type": "object"
2021-07-18T14:14:09.6782966Z [cluster1] },
2021-07-18T14:14:09.6783489Z [cluster1] "type": "array"
2021-07-18T14:14:09.6783999Z [cluster1] },
2021-07-18T14:14:09.6784501Z [cluster1] "status": {
2021-07-18T14:14:09.6785453Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:14:09.6786317Z [cluster1] "properties": {
2021-07-18T14:14:09.6786960Z [cluster1] "collisionCount": {
2021-07-18T14:14:09.6788427Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:14:09.6791895Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6792805Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6793356Z [cluster1] },
2021-07-18T14:14:09.6793907Z [cluster1] "conditions": {
2021-07-18T14:14:09.6795258Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:14:09.6796141Z [cluster1] "items": {
2021-07-18T14:14:09.6797076Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:14:09.6798014Z [cluster1] "properties": {
2021-07-18T14:14:09.6798717Z [cluster1] "lastTransitionTime": {
2021-07-18T14:14:09.6799666Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:14:09.6800755Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.6801385Z [cluster1] "type": "string"
2021-07-18T14:14:09.6801922Z [cluster1] },
2021-07-18T14:14:09.6802469Z [cluster1] "message": {
2021-07-18T14:14:09.6803327Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-18T14:14:09.6804253Z [cluster1] "type": "string"
2021-07-18T14:14:09.6805085Z [cluster1] },
2021-07-18T14:14:09.6805616Z [cluster1] "reason": {
2021-07-18T14:14:09.6806666Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-18T14:14:09.6807454Z [cluster1] "type": "string"
2021-07-18T14:14:09.6807986Z [cluster1] },
2021-07-18T14:14:09.6808527Z [cluster1] "status": {
2021-07-18T14:14:09.6809302Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:14:09.6810105Z [cluster1] "type": "string"
2021-07-18T14:14:09.6810645Z [cluster1] },
2021-07-18T14:14:09.6811175Z [cluster1] "type": {
2021-07-18T14:14:09.6811884Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-18T14:14:09.6812607Z [cluster1] "type": "string"
2021-07-18T14:14:09.6813158Z [cluster1] }
2021-07-18T14:14:09.6813717Z [cluster1] },
2021-07-18T14:14:09.6814263Z [cluster1] "required": [
2021-07-18T14:14:09.6814837Z [cluster1] "status",
2021-07-18T14:14:09.6815376Z [cluster1] "type"
2021-07-18T14:14:09.6815900Z [cluster1] ],
2021-07-18T14:14:09.6816432Z [cluster1] "type": "object"
2021-07-18T14:14:09.6816971Z [cluster1] },
2021-07-18T14:14:09.6817497Z [cluster1] "type": "array"
2021-07-18T14:14:09.6818026Z [cluster1] },
2021-07-18T14:14:09.6818708Z [cluster1] "currentNumberScheduled": {
2021-07-18T14:14:09.6820224Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6821541Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6822150Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6822693Z [cluster1] },
2021-07-18T14:14:09.6823381Z [cluster1] "desiredNumberScheduled": {
2021-07-18T14:14:09.6825199Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6826599Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6827477Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6828019Z [cluster1] },
2021-07-18T14:14:09.6828706Z [cluster1] "numberAvailable": {
2021-07-18T14:14:09.6829957Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.6831303Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6831902Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6832447Z [cluster1] },
2021-07-18T14:14:09.6833075Z [cluster1] "numberMisscheduled": {
2021-07-18T14:14:09.6834477Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.6835762Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6836367Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6836904Z [cluster1] },
2021-07-18T14:14:09.6837465Z [cluster1] "numberReady": {
2021-07-18T14:14:09.6838514Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:14:09.6839471Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6840060Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6840594Z [cluster1] },
2021-07-18T14:14:09.6841199Z [cluster1] "numberUnavailable": {
2021-07-18T14:14:09.6842425Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.6843584Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6844185Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6844944Z [cluster1] },
2021-07-18T14:14:09.6845585Z [cluster1] "observedGeneration": {
2021-07-18T14:14:09.6846526Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:14:09.6847391Z [cluster1] "format": "int64",
2021-07-18T14:14:09.6847989Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6848637Z [cluster1] },
2021-07-18T14:14:09.6849493Z [cluster1] "updatedNumberScheduled": {
2021-07-18T14:14:09.6850379Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:14:09.6851128Z [cluster1] "format": "int32",
2021-07-18T14:14:09.6851678Z [cluster1] "type": "integer"
2021-07-18T14:14:09.6852171Z [cluster1] }
2021-07-18T14:14:09.6852688Z [cluster1] },
2021-07-18T14:14:09.6853167Z [cluster1] "required": [
2021-07-18T14:14:09.6853842Z [cluster1] "currentNumberScheduled",
2021-07-18T14:14:09.6854627Z [cluster1] "desiredNumberScheduled",
2021-07-18T14:14:09.6855375Z [cluster1] "numberMisscheduled",
2021-07-18T14:14:09.6856310Z [cluster1] "numberReady"
2021-07-18T14:14:09.6856853Z [cluster1] ],
2021-07-18T14:14:09.6857385Z [cluster1] "type": "object"
2021-07-18T14:14:09.6857898Z [cluster1] }
2021-07-18T14:14:09.6858367Z [cluster1] },
2021-07-18T14:14:09.6858866Z [cluster1] "required": [
2021-07-18T14:14:09.6859810Z [cluster1] "mismatchedContainerImages"
2021-07-18T14:14:09.6860511Z [cluster1] ],
2021-07-18T14:14:09.6861032Z [cluster1] "type": "object"
2021-07-18T14:14:09.6861545Z [cluster1] },
2021-07-18T14:14:09.6862030Z [cluster1] "gateways": {
2021-07-18T14:14:09.6862558Z [cluster1] "items": {
2021-07-18T14:14:09.6863205Z [cluster1] "properties": {
2021-07-18T14:14:09.6863809Z [cluster1] "connections": {
2021-07-18T14:14:09.6864367Z [cluster1] "items": {
2021-07-18T14:14:09.6865103Z [cluster1] "properties": {
2021-07-18T14:14:09.6865712Z [cluster1] "endpoint": {
2021-07-18T14:14:09.6866312Z [cluster1] "properties": {
2021-07-18T14:14:09.6866916Z [cluster1] "backend": {
2021-07-18T14:14:09.6867501Z [cluster1] "type": "string"
2021-07-18T14:14:09.6868061Z [cluster1] },
2021-07-18T14:14:09.6868624Z [cluster1] "backend_config": {
2021-07-18T14:14:09.6869359Z [cluster1] "additionalProperties": {
2021-07-18T14:14:09.6870279Z [cluster1] "type": "string"
2021-07-18T14:14:09.6870863Z [cluster1] },
2021-07-18T14:14:09.6871427Z [cluster1] "type": "object"
2021-07-18T14:14:09.6871971Z [cluster1] },
2021-07-18T14:14:09.6872529Z [cluster1] "cable_name": {
2021-07-18T14:14:09.6873129Z [cluster1] "type": "string"
2021-07-18T14:14:09.6873680Z [cluster1] },
2021-07-18T14:14:09.6874223Z [cluster1] "cluster_id": {
2021-07-18T14:14:09.6874819Z [cluster1] "type": "string"
2021-07-18T14:14:09.6875379Z [cluster1] },
2021-07-18T14:14:09.6876039Z [cluster1] "healthCheckIP": {
2021-07-18T14:14:09.6876698Z [cluster1] "type": "string"
2021-07-18T14:14:09.6877255Z [cluster1] },
2021-07-18T14:14:09.6877788Z [cluster1] "hostname": {
2021-07-18T14:14:09.6878388Z [cluster1] "type": "string"
2021-07-18T14:14:09.6878933Z [cluster1] },
2021-07-18T14:14:09.6879494Z [cluster1] "nat_enabled": {
2021-07-18T14:14:09.6880103Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6880664Z [cluster1] },
2021-07-18T14:14:09.6881419Z [cluster1] "private_ip": {
2021-07-18T14:14:09.6882014Z [cluster1] "type": "string"
2021-07-18T14:14:09.6882577Z [cluster1] },
2021-07-18T14:14:09.6883111Z [cluster1] "public_ip": {
2021-07-18T14:14:09.6883784Z [cluster1] "type": "string"
2021-07-18T14:14:09.6884345Z [cluster1] },
2021-07-18T14:14:09.6884876Z [cluster1] "subnets": {
2021-07-18T14:14:09.6885444Z [cluster1] "items": {
2021-07-18T14:14:09.6886027Z [cluster1] "type": "string"
2021-07-18T14:14:09.6886594Z [cluster1] },
2021-07-18T14:14:09.6887140Z [cluster1] "type": "array"
2021-07-18T14:14:09.6887691Z [cluster1] }
2021-07-18T14:14:09.6888203Z [cluster1] },
2021-07-18T14:14:09.6888735Z [cluster1] "required": [
2021-07-18T14:14:09.6889315Z [cluster1] "backend",
2021-07-18T14:14:09.6889881Z [cluster1] "cable_name",
2021-07-18T14:14:09.6890469Z [cluster1] "cluster_id",
2021-07-18T14:14:09.6891056Z [cluster1] "hostname",
2021-07-18T14:14:09.6891828Z [cluster1] "nat_enabled",
2021-07-18T14:14:09.6892575Z [cluster1] "private_ip",
2021-07-18T14:14:09.6893155Z [cluster1] "public_ip",
2021-07-18T14:14:09.6893742Z [cluster1] "subnets"
2021-07-18T14:14:09.6894275Z [cluster1] ],
2021-07-18T14:14:09.6894830Z [cluster1] "type": "object"
2021-07-18T14:14:09.6895377Z [cluster1] },
2021-07-18T14:14:09.6895988Z [cluster1] "latencyRTT": {
2021-07-18T14:14:09.6897043Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-18T14:14:09.6898072Z [cluster1] "properties": {
2021-07-18T14:14:09.6898674Z [cluster1] "average": {
2021-07-18T14:14:09.6899271Z [cluster1] "type": "string"
2021-07-18T14:14:09.6899813Z [cluster1] },
2021-07-18T14:14:09.6900336Z [cluster1] "last": {
2021-07-18T14:14:09.6900903Z [cluster1] "type": "string"
2021-07-18T14:14:09.6901463Z [cluster1] },
2021-07-18T14:14:09.6901976Z [cluster1] "max": {
2021-07-18T14:14:09.6902551Z [cluster1] "type": "string"
2021-07-18T14:14:09.6903106Z [cluster1] },
2021-07-18T14:14:09.6903667Z [cluster1] "min": {
2021-07-18T14:14:09.6904237Z [cluster1] "type": "string"
2021-07-18T14:14:09.6904883Z [cluster1] },
2021-07-18T14:14:09.6905425Z [cluster1] "stdDev": {
2021-07-18T14:14:09.6906015Z [cluster1] "type": "string"
2021-07-18T14:14:09.6906557Z [cluster1] }
2021-07-18T14:14:09.6907072Z [cluster1] },
2021-07-18T14:14:09.6907607Z [cluster1] "type": "object"
2021-07-18T14:14:09.6908160Z [cluster1] },
2021-07-18T14:14:09.6908678Z [cluster1] "status": {
2021-07-18T14:14:09.6909256Z [cluster1] "type": "string"
2021-07-18T14:14:09.6909803Z [cluster1] },
2021-07-18T14:14:09.6910374Z [cluster1] "statusMessage": {
2021-07-18T14:14:09.6911012Z [cluster1] "type": "string"
2021-07-18T14:14:09.6911543Z [cluster1] },
2021-07-18T14:14:09.6912079Z [cluster1] "usingIP": {
2021-07-18T14:14:09.6920171Z [cluster1] "type": "string"
2021-07-18T14:14:09.6920925Z [cluster1] },
2021-07-18T14:14:09.6921451Z [cluster1] "usingNAT": {
2021-07-18T14:14:09.6922007Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6922530Z [cluster1] }
2021-07-18T14:14:09.6922984Z [cluster1] },
2021-07-18T14:14:09.6923896Z [cluster1] "required": [
2021-07-18T14:14:09.6932008Z [cluster1] "endpoint",
2021-07-18T14:14:09.6932794Z [cluster1] "status",
2021-07-18T14:14:09.6933513Z [cluster1] "statusMessage"
2021-07-18T14:14:09.6934261Z [cluster1] ],
2021-07-18T14:14:09.6934779Z [cluster1] "type": "object"
2021-07-18T14:14:09.6935286Z [cluster1] },
2021-07-18T14:14:09.6935786Z [cluster1] "type": "array"
2021-07-18T14:14:09.6942705Z [cluster1] },
2021-07-18T14:14:09.6943220Z [cluster1] "haStatus": {
2021-07-18T14:14:09.6943781Z [cluster1] "type": "string"
2021-07-18T14:14:09.6944268Z [cluster1] },
2021-07-18T14:14:09.6944968Z [cluster1] "localEndpoint": {
2021-07-18T14:14:09.6945550Z [cluster1] "properties": {
2021-07-18T14:14:09.6946279Z [cluster1] "backend": {
2021-07-18T14:14:09.6946840Z [cluster1] "type": "string"
2021-07-18T14:14:09.6947650Z [cluster1] },
2021-07-18T14:14:09.6948174Z [cluster1] "backend_config": {
2021-07-18T14:14:09.6948826Z [cluster1] "additionalProperties": {
2021-07-18T14:14:09.6949493Z [cluster1] "type": "string"
2021-07-18T14:14:09.6949999Z [cluster1] },
2021-07-18T14:14:09.6950514Z [cluster1] "type": "object"
2021-07-18T14:14:09.6951006Z [cluster1] },
2021-07-18T14:14:09.6951706Z [cluster1] "cable_name": {
2021-07-18T14:14:09.6952288Z [cluster1] "type": "string"
2021-07-18T14:14:09.6952814Z [cluster1] },
2021-07-18T14:14:09.6953343Z [cluster1] "cluster_id": {
2021-07-18T14:14:09.6953905Z [cluster1] "type": "string"
2021-07-18T14:14:09.6954444Z [cluster1] },
2021-07-18T14:14:09.6955015Z [cluster1] "healthCheckIP": {
2021-07-18T14:14:09.6955644Z [cluster1] "type": "string"
2021-07-18T14:14:09.6956185Z [cluster1] },
2021-07-18T14:14:09.6956704Z [cluster1] "hostname": {
2021-07-18T14:14:09.6957279Z [cluster1] "type": "string"
2021-07-18T14:14:09.6958168Z [cluster1] },
2021-07-18T14:14:09.6958743Z [cluster1] "nat_enabled": {
2021-07-18T14:14:09.6959332Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6959888Z [cluster1] },
2021-07-18T14:14:09.6960542Z [cluster1] "private_ip": {
2021-07-18T14:14:09.6961124Z [cluster1] "type": "string"
2021-07-18T14:14:09.6961676Z [cluster1] },
2021-07-18T14:14:09.6962195Z [cluster1] "public_ip": {
2021-07-18T14:14:09.6962770Z [cluster1] "type": "string"
2021-07-18T14:14:09.6963305Z [cluster1] },
2021-07-18T14:14:09.6963837Z [cluster1] "subnets": {
2021-07-18T14:14:09.6964867Z [cluster1] "items": {
2021-07-18T14:14:09.6965596Z [cluster1] "type": "string"
2021-07-18T14:14:09.6966164Z [cluster1] },
2021-07-18T14:14:09.6966692Z [cluster1] "type": "array"
2021-07-18T14:14:09.6967405Z [cluster1] }
2021-07-18T14:14:09.6967900Z [cluster1] },
2021-07-18T14:14:09.6968436Z [cluster1] "required": [
2021-07-18T14:14:09.6969360Z [cluster1] "backend",
2021-07-18T14:14:09.6969996Z [cluster1] "cable_name",
2021-07-18T14:14:09.6970566Z [cluster1] "cluster_id",
2021-07-18T14:14:09.6971125Z [cluster1] "hostname",
2021-07-18T14:14:09.6971696Z [cluster1] "nat_enabled",
2021-07-18T14:14:09.6972273Z [cluster1] "private_ip",
2021-07-18T14:14:09.6972847Z [cluster1] "public_ip",
2021-07-18T14:14:09.6973411Z [cluster1] "subnets"
2021-07-18T14:14:09.6973922Z [cluster1] ],
2021-07-18T14:14:09.6974466Z [cluster1] "type": "object"
2021-07-18T14:14:09.6975237Z [cluster1] },
2021-07-18T14:14:09.6975801Z [cluster1] "statusFailure": {
2021-07-18T14:14:09.6976410Z [cluster1] "type": "string"
2021-07-18T14:14:09.6976947Z [cluster1] },
2021-07-18T14:14:09.6977468Z [cluster1] "version": {
2021-07-18T14:14:09.6978106Z [cluster1] "type": "string"
2021-07-18T14:14:09.6983261Z [cluster1] }
2021-07-18T14:14:09.6983746Z [cluster1] },
2021-07-18T14:14:09.6984275Z [cluster1] "required": [
2021-07-18T14:14:09.6985322Z [cluster1] "connections",
2021-07-18T14:14:09.6985925Z [cluster1] "haStatus",
2021-07-18T14:14:09.6986535Z [cluster1] "localEndpoint",
2021-07-18T14:14:09.6987177Z [cluster1] "statusFailure",
2021-07-18T14:14:09.6987777Z [cluster1] "version"
2021-07-18T14:14:09.6988277Z [cluster1] ],
2021-07-18T14:14:09.6988945Z [cluster1] "type": "object"
2021-07-18T14:14:09.6989463Z [cluster1] },
2021-07-18T14:14:09.6989978Z [cluster1] "type": "array"
2021-07-18T14:14:09.6990473Z [cluster1] },
2021-07-18T14:14:09.6991000Z [cluster1] "globalCIDR": {
2021-07-18T14:14:09.6991580Z [cluster1] "type": "string"
2021-07-18T14:14:09.6992079Z [cluster1] },
2021-07-18T14:14:09.6992775Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-18T14:14:09.6993521Z [cluster1] "properties": {
2021-07-18T14:14:09.6994211Z [cluster1] "lastResourceVersion": {
2021-07-18T14:14:09.6994876Z [cluster1] "type": "string"
2021-07-18T14:14:09.6995406Z [cluster1] },
2021-07-18T14:14:09.6996098Z [cluster1] "mismatchedContainerImages": {
2021-07-18T14:14:09.6996870Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.6997399Z [cluster1] },
2021-07-18T14:14:09.6998372Z [cluster1] "nonReadyContainerStates": {
2021-07-18T14:14:09.6999092Z [cluster1] "items": {
2021-07-18T14:14:09.7000746Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:14:09.7002571Z [cluster1] "properties": {
2021-07-18T14:14:09.7003164Z [cluster1] "running": {
2021-07-18T14:14:09.7003879Z [cluster1] "description": "Details about a running container",
2021-07-18T14:14:09.7004635Z [cluster1] "properties": {
2021-07-18T14:14:09.7005235Z [cluster1] "startedAt": {
2021-07-18T14:14:09.7006764Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-18T14:14:09.7007808Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7008426Z [cluster1] "type": "string"
2021-07-18T14:14:09.7008979Z [cluster1] }
2021-07-18T14:14:09.7009486Z [cluster1] },
2021-07-18T14:14:09.7010243Z [cluster1] "type": "object"
2021-07-18T14:14:09.7010792Z [cluster1] },
2021-07-18T14:14:09.7011351Z [cluster1] "terminated": {
2021-07-18T14:14:09.7012120Z [cluster1] "description": "Details about a terminated container",
2021-07-18T14:14:09.7012879Z [cluster1] "properties": {
2021-07-18T14:14:09.7013511Z [cluster1] "containerID": {
2021-07-18T14:14:09.7014985Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:14:09.7017080Z [cluster1] "type": "string"
2021-07-18T14:14:09.7017958Z [cluster1] },
2021-07-18T14:14:09.7018649Z [cluster1] "exitCode": {
2021-07-18T14:14:09.7019916Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-18T14:14:09.7020759Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7021379Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7021949Z [cluster1] },
2021-07-18T14:14:09.7022505Z [cluster1] "finishedAt": {
2021-07-18T14:14:09.7023305Z [cluster1] "description": "Time at which the container last terminated",
2021-07-18T14:14:09.7024398Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7026384Z [cluster1] "type": "string"
2021-07-18T14:14:09.7027654Z [cluster1] },
2021-07-18T14:14:09.7028530Z [cluster1] "message": {
2021-07-18T14:14:09.7029760Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-18T14:14:09.7030969Z [cluster1] "type": "string"
2021-07-18T14:14:09.7031532Z [cluster1] },
2021-07-18T14:14:09.7032066Z [cluster1] "reason": {
2021-07-18T14:14:09.7032877Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-18T14:14:09.7033699Z [cluster1] "type": "string"
2021-07-18T14:14:09.7034242Z [cluster1] },
2021-07-18T14:14:09.7034768Z [cluster1] "signal": {
2021-07-18T14:14:09.7035534Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-18T14:14:09.7036329Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7036939Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7037495Z [cluster1] },
2021-07-18T14:14:09.7038046Z [cluster1] "startedAt": {
2021-07-18T14:14:09.7038877Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-18T14:14:09.7040076Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7040702Z [cluster1] "type": "string"
2021-07-18T14:14:09.7041260Z [cluster1] }
2021-07-18T14:14:09.7041774Z [cluster1] },
2021-07-18T14:14:09.7042306Z [cluster1] "required": [
2021-07-18T14:14:09.7043008Z [cluster1] "exitCode"
2021-07-18T14:14:09.7043546Z [cluster1] ],
2021-07-18T14:14:09.7044103Z [cluster1] "type": "object"
2021-07-18T14:14:09.7044631Z [cluster1] },
2021-07-18T14:14:09.7045162Z [cluster1] "waiting": {
2021-07-18T14:14:09.7045897Z [cluster1] "description": "Details about a waiting container",
2021-07-18T14:14:09.7046635Z [cluster1] "properties": {
2021-07-18T14:14:09.7047240Z [cluster1] "message": {
2021-07-18T14:14:09.7048046Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-18T14:14:09.7048863Z [cluster1] "type": "string"
2021-07-18T14:14:09.7050047Z [cluster1] },
2021-07-18T14:14:09.7050574Z [cluster1] "reason": {
2021-07-18T14:14:09.7051341Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-18T14:14:09.7052184Z [cluster1] "type": "string"
2021-07-18T14:14:09.7052736Z [cluster1] }
2021-07-18T14:14:09.7053247Z [cluster1] },
2021-07-18T14:14:09.7053785Z [cluster1] "type": "object"
2021-07-18T14:14:09.7054349Z [cluster1] }
2021-07-18T14:14:09.7054830Z [cluster1] },
2021-07-18T14:14:09.7055372Z [cluster1] "type": "object"
2021-07-18T14:14:09.7055897Z [cluster1] },
2021-07-18T14:14:09.7056420Z [cluster1] "type": "array"
2021-07-18T14:14:09.7056924Z [cluster1] },
2021-07-18T14:14:09.7057421Z [cluster1] "status": {
2021-07-18T14:14:09.7058268Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:14:09.7059127Z [cluster1] "properties": {
2021-07-18T14:14:09.7059773Z [cluster1] "collisionCount": {
2021-07-18T14:14:09.7061157Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:14:09.7062500Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7063098Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7063639Z [cluster1] },
2021-07-18T14:14:09.7064173Z [cluster1] "conditions": {
2021-07-18T14:14:09.7065657Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:14:09.7066644Z [cluster1] "items": {
2021-07-18T14:14:09.7067564Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:14:09.7068763Z [cluster1] "properties": {
2021-07-18T14:14:09.7069471Z [cluster1] "lastTransitionTime": {
2021-07-18T14:14:09.7070399Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:14:09.7071549Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7072180Z [cluster1] "type": "string"
2021-07-18T14:14:09.7072722Z [cluster1] },
2021-07-18T14:14:09.7073268Z [cluster1] "message": {
2021-07-18T14:14:09.7074118Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-18T14:14:09.7074993Z [cluster1] "type": "string"
2021-07-18T14:14:09.7075551Z [cluster1] },
2021-07-18T14:14:09.7076563Z [cluster1] "reason": {
2021-07-18T14:14:09.7077647Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-18T14:14:09.7078427Z [cluster1] "type": "string"
2021-07-18T14:14:09.7078996Z [cluster1] },
2021-07-18T14:14:09.7079662Z [cluster1] "status": {
2021-07-18T14:14:09.7080459Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:14:09.7081263Z [cluster1] "type": "string"
2021-07-18T14:14:09.7081803Z [cluster1] },
2021-07-18T14:14:09.7082334Z [cluster1] "type": {
2021-07-18T14:14:09.7083036Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-18T14:14:09.7083771Z [cluster1] "type": "string"
2021-07-18T14:14:09.7084329Z [cluster1] }
2021-07-18T14:14:09.7084821Z [cluster1] },
2021-07-18T14:14:09.7085365Z [cluster1] "required": [
2021-07-18T14:14:09.7085926Z [cluster1] "status",
2021-07-18T14:14:09.7086475Z [cluster1] "type"
2021-07-18T14:14:09.7086984Z [cluster1] ],
2021-07-18T14:14:09.7087531Z [cluster1] "type": "object"
2021-07-18T14:14:09.7110694Z [cluster1] },
2021-07-18T14:14:09.7111274Z [cluster1] "type": "array"
2021-07-18T14:14:09.7111819Z [cluster1] },
2021-07-18T14:14:09.7112910Z [cluster1] "currentNumberScheduled": {
2021-07-18T14:14:09.7114401Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.7115704Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7116319Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7116875Z [cluster1] },
2021-07-18T14:14:09.7117876Z [cluster1] "desiredNumberScheduled": {
2021-07-18T14:14:09.7119431Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.7120860Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7121604Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7122267Z [cluster1] },
2021-07-18T14:14:09.7122803Z [cluster1] "numberAvailable": {
2021-07-18T14:14:09.7124041Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.7125124Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7125682Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7126191Z [cluster1] },
2021-07-18T14:14:09.7128233Z [cluster1] "numberMisscheduled": {
2021-07-18T14:14:09.7129713Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.7131131Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7131728Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7132653Z [cluster1] },
2021-07-18T14:14:09.7133354Z [cluster1] "numberReady": {
2021-07-18T14:14:09.7134352Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:14:09.7135284Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7135879Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7136487Z [cluster1] },
2021-07-18T14:14:09.7137085Z [cluster1] "numberUnavailable": {
2021-07-18T14:14:09.7138336Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.7139488Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7140175Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7140717Z [cluster1] },
2021-07-18T14:14:09.7141342Z [cluster1] "observedGeneration": {
2021-07-18T14:14:09.7142295Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:14:09.7143137Z [cluster1] "format": "int64",
2021-07-18T14:14:09.7143728Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7144265Z [cluster1] },
2021-07-18T14:14:09.7148160Z [cluster1] "updatedNumberScheduled": {
2021-07-18T14:14:09.7149180Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:14:09.7149976Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7150576Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7151115Z [cluster1] }
2021-07-18T14:14:09.7151604Z [cluster1] },
2021-07-18T14:14:09.7152256Z [cluster1] "required": [
2021-07-18T14:14:09.7152973Z [cluster1] "currentNumberScheduled",
2021-07-18T14:14:09.7153822Z [cluster1] "desiredNumberScheduled",
2021-07-18T14:14:09.7154627Z [cluster1] "numberMisscheduled",
2021-07-18T14:14:09.7155320Z [cluster1] "numberReady"
2021-07-18T14:14:09.7155968Z [cluster1] ],
2021-07-18T14:14:09.7156639Z [cluster1] "type": "object"
2021-07-18T14:14:09.7157151Z [cluster1] }
2021-07-18T14:14:09.7157621Z [cluster1] },
2021-07-18T14:14:09.7158134Z [cluster1] "required": [
2021-07-18T14:14:09.7158871Z [cluster1] "mismatchedContainerImages"
2021-07-18T14:14:09.7159570Z [cluster1] ],
2021-07-18T14:14:09.7160071Z [cluster1] "type": "object"
2021-07-18T14:14:09.7160591Z [cluster1] },
2021-07-18T14:14:09.7161180Z [cluster1] "loadBalancerStatus": {
2021-07-18T14:14:09.7161850Z [cluster1] "properties": {
2021-07-18T14:14:09.7162396Z [cluster1] "status": {
2021-07-18T14:14:09.7163731Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-18T14:14:09.7164658Z [cluster1] "properties": {
2021-07-18T14:14:09.7165229Z [cluster1] "ingress": {
2021-07-18T14:14:09.7166702Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-18T14:14:09.7167784Z [cluster1] "items": {
2021-07-18T14:14:09.7169511Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-18T14:14:09.7170654Z [cluster1] "properties": {
2021-07-18T14:14:09.7171201Z [cluster1] "hostname": {
2021-07-18T14:14:09.7172422Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-18T14:14:09.7173364Z [cluster1] "type": "string"
2021-07-18T14:14:09.7173871Z [cluster1] },
2021-07-18T14:14:09.7174359Z [cluster1] "ip": {
2021-07-18T14:14:09.7175574Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-18T14:14:09.7176523Z [cluster1] "type": "string"
2021-07-18T14:14:09.7177210Z [cluster1] }
2021-07-18T14:14:09.7177719Z [cluster1] },
2021-07-18T14:14:09.7178269Z [cluster1] "type": "object"
2021-07-18T14:14:09.7178896Z [cluster1] },
2021-07-18T14:14:09.7179437Z [cluster1] "type": "array"
2021-07-18T14:14:09.7179958Z [cluster1] }
2021-07-18T14:14:09.7180442Z [cluster1] },
2021-07-18T14:14:09.7180968Z [cluster1] "type": "object"
2021-07-18T14:14:09.7181501Z [cluster1] }
2021-07-18T14:14:09.7181956Z [cluster1] },
2021-07-18T14:14:09.7182482Z [cluster1] "type": "object"
2021-07-18T14:14:09.7182995Z [cluster1] },
2021-07-18T14:14:09.7183503Z [cluster1] "natEnabled": {
2021-07-18T14:14:09.7184079Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.7184586Z [cluster1] },
2021-07-18T14:14:09.7185288Z [cluster1] "networkPlugin": {
2021-07-18T14:14:09.7185877Z [cluster1] "type": "string"
2021-07-18T14:14:09.7186392Z [cluster1] },
2021-07-18T14:14:09.7187101Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-18T14:14:09.7187857Z [cluster1] "properties": {
2021-07-18T14:14:09.7188547Z [cluster1] "lastResourceVersion": {
2021-07-18T14:14:09.7189217Z [cluster1] "type": "string"
2021-07-18T14:14:09.7189746Z [cluster1] },
2021-07-18T14:14:09.7190436Z [cluster1] "mismatchedContainerImages": {
2021-07-18T14:14:09.7191203Z [cluster1] "type": "boolean"
2021-07-18T14:14:09.7191727Z [cluster1] },
2021-07-18T14:14:09.7192403Z [cluster1] "nonReadyContainerStates": {
2021-07-18T14:14:09.7193108Z [cluster1] "items": {
2021-07-18T14:14:09.7194451Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:14:09.7195784Z [cluster1] "properties": {
2021-07-18T14:14:09.7196354Z [cluster1] "running": {
2021-07-18T14:14:09.7197077Z [cluster1] "description": "Details about a running container",
2021-07-18T14:14:09.7197825Z [cluster1] "properties": {
2021-07-18T14:14:09.7198418Z [cluster1] "startedAt": {
2021-07-18T14:14:09.7199505Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-18T14:14:09.7201025Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7201848Z [cluster1] "type": "string"
2021-07-18T14:14:09.7202412Z [cluster1] }
2021-07-18T14:14:09.7203336Z [cluster1] },
2021-07-18T14:14:09.7203906Z [cluster1] "type": "object"
2021-07-18T14:14:09.7204549Z [cluster1] },
2021-07-18T14:14:09.7205194Z [cluster1] "terminated": {
2021-07-18T14:14:09.7205893Z [cluster1] "description": "Details about a terminated container",
2021-07-18T14:14:09.7206612Z [cluster1] "properties": {
2021-07-18T14:14:09.7207451Z [cluster1] "containerID": {
2021-07-18T14:14:09.7208801Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:14:09.7209637Z [cluster1] "type": "string"
2021-07-18T14:14:09.7210178Z [cluster1] },
2021-07-18T14:14:09.7210746Z [cluster1] "exitCode": {
2021-07-18T14:14:09.7211574Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-18T14:14:09.7212363Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7212977Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7213848Z [cluster1] },
2021-07-18T14:14:09.7214579Z [cluster1] "finishedAt": {
2021-07-18T14:14:09.7215391Z [cluster1] "description": "Time at which the container last terminated",
2021-07-18T14:14:09.7216443Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7217089Z [cluster1] "type": "string"
2021-07-18T14:14:09.7217628Z [cluster1] },
2021-07-18T14:14:09.7218177Z [cluster1] "message": {
2021-07-18T14:14:09.7219090Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-18T14:14:09.7219937Z [cluster1] "type": "string"
2021-07-18T14:14:09.7220532Z [cluster1] },
2021-07-18T14:14:09.7221055Z [cluster1] "reason": {
2021-07-18T14:14:09.7222166Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-18T14:14:09.7223135Z [cluster1] "type": "string"
2021-07-18T14:14:09.7223692Z [cluster1] },
2021-07-18T14:14:09.7224234Z [cluster1] "signal": {
2021-07-18T14:14:09.7225151Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-18T14:14:09.7225949Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7226544Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7227113Z [cluster1] },
2021-07-18T14:14:09.7227681Z [cluster1] "startedAt": {
2021-07-18T14:14:09.7228605Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-18T14:14:09.7229758Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7230383Z [cluster1] "type": "string"
2021-07-18T14:14:09.7230951Z [cluster1] }
2021-07-18T14:14:09.7231447Z [cluster1] },
2021-07-18T14:14:09.7231996Z [cluster1] "required": [
2021-07-18T14:14:09.7232694Z [cluster1] "exitCode"
2021-07-18T14:14:09.7233190Z [cluster1] ],
2021-07-18T14:14:09.7233895Z [cluster1] "type": "object"
2021-07-18T14:14:09.7234428Z [cluster1] },
2021-07-18T14:14:09.7234960Z [cluster1] "waiting": {
2021-07-18T14:14:09.7235671Z [cluster1] "description": "Details about a waiting container",
2021-07-18T14:14:09.7236426Z [cluster1] "properties": {
2021-07-18T14:14:09.7237028Z [cluster1] "message": {
2021-07-18T14:14:09.7237825Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-18T14:14:09.7238641Z [cluster1] "type": "string"
2021-07-18T14:14:09.7239188Z [cluster1] },
2021-07-18T14:14:09.7239722Z [cluster1] "reason": {
2021-07-18T14:14:09.7240485Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-18T14:14:09.7241320Z [cluster1] "type": "string"
2021-07-18T14:14:09.7241874Z [cluster1] }
2021-07-18T14:14:09.7242360Z [cluster1] },
2021-07-18T14:14:09.7242902Z [cluster1] "type": "object"
2021-07-18T14:14:09.7243449Z [cluster1] }
2021-07-18T14:14:09.7243924Z [cluster1] },
2021-07-18T14:14:09.7244463Z [cluster1] "type": "object"
2021-07-18T14:14:09.7244981Z [cluster1] },
2021-07-18T14:14:09.7245499Z [cluster1] "type": "array"
2021-07-18T14:14:09.7246007Z [cluster1] },
2021-07-18T14:14:09.7246517Z [cluster1] "status": {
2021-07-18T14:14:09.7247347Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:14:09.7248219Z [cluster1] "properties": {
2021-07-18T14:14:09.7248857Z [cluster1] "collisionCount": {
2021-07-18T14:14:09.7250779Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:14:09.7252119Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7252677Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7253173Z [cluster1] },
2021-07-18T14:14:09.7253685Z [cluster1] "conditions": {
2021-07-18T14:14:09.7254860Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:14:09.7256284Z [cluster1] "items": {
2021-07-18T14:14:09.7257274Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:14:09.7258176Z [cluster1] "properties": {
2021-07-18T14:14:09.7258824Z [cluster1] "lastTransitionTime": {
2021-07-18T14:14:09.7259683Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:14:09.7260909Z [cluster1] "format": "date-time",
2021-07-18T14:14:09.7261532Z [cluster1] "type": "string"
2021-07-18T14:14:09.7262082Z [cluster1] },
2021-07-18T14:14:09.7262624Z [cluster1] "message": {
2021-07-18T14:14:09.7263484Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-18T14:14:09.7264593Z [cluster1] "type": "string"
2021-07-18T14:14:09.7265364Z [cluster1] },
2021-07-18T14:14:09.7265995Z [cluster1] "reason": {
2021-07-18T14:14:09.7267077Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-18T14:14:09.7267853Z [cluster1] "type": "string"
2021-07-18T14:14:09.7268412Z [cluster1] },
2021-07-18T14:14:09.7268932Z [cluster1] "status": {
2021-07-18T14:14:09.7269727Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:14:09.7270538Z [cluster1] "type": "string"
2021-07-18T14:14:09.7271075Z [cluster1] },
2021-07-18T14:14:09.7271607Z [cluster1] "type": {
2021-07-18T14:14:09.7272417Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-18T14:14:09.7273269Z [cluster1] "type": "string"
2021-07-18T14:14:09.7273917Z [cluster1] }
2021-07-18T14:14:09.7274388Z [cluster1] },
2021-07-18T14:14:09.7274964Z [cluster1] "required": [
2021-07-18T14:14:09.7275479Z [cluster1] "status",
2021-07-18T14:14:09.7275987Z [cluster1] "type"
2021-07-18T14:14:09.7276456Z [cluster1] ],
2021-07-18T14:14:09.7276970Z [cluster1] "type": "object"
2021-07-18T14:14:09.7277464Z [cluster1] },
2021-07-18T14:14:09.7277967Z [cluster1] "type": "array"
2021-07-18T14:14:09.7278464Z [cluster1] },
2021-07-18T14:14:09.7279080Z [cluster1] "currentNumberScheduled": {
2021-07-18T14:14:09.7280448Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.7281646Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7282205Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7282717Z [cluster1] },
2021-07-18T14:14:09.7283337Z [cluster1] "desiredNumberScheduled": {
2021-07-18T14:14:09.7285006Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.7286884Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7287658Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7288211Z [cluster1] },
2021-07-18T14:14:09.7288790Z [cluster1] "numberAvailable": {
2021-07-18T14:14:09.7290111Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.7291286Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7291878Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7292427Z [cluster1] },
2021-07-18T14:14:09.7293038Z [cluster1] "numberMisscheduled": {
2021-07-18T14:14:09.7294434Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:14:09.7295727Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7296329Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7296880Z [cluster1] },
2021-07-18T14:14:09.7297424Z [cluster1] "numberReady": {
2021-07-18T14:14:09.7298410Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:14:09.7299410Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7300007Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7300550Z [cluster1] },
2021-07-18T14:14:09.7301144Z [cluster1] "numberUnavailable": {
2021-07-18T14:14:09.7302395Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:14:09.7303846Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7304447Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7305136Z [cluster1] },
2021-07-18T14:14:09.7305753Z [cluster1] "observedGeneration": {
2021-07-18T14:14:09.7306707Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:14:09.7307542Z [cluster1] "format": "int64",
2021-07-18T14:14:09.7308145Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7308671Z [cluster1] },
2021-07-18T14:14:09.7309353Z [cluster1] "updatedNumberScheduled": {
2021-07-18T14:14:09.7310313Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:14:09.7311857Z [cluster1] "format": "int32",
2021-07-18T14:14:09.7312473Z [cluster1] "type": "integer"
2021-07-18T14:14:09.7313010Z [cluster1] }
2021-07-18T14:14:09.7313651Z [cluster1] },
2021-07-18T14:14:09.7314178Z [cluster1] "required": [
2021-07-18T14:14:09.7314993Z [cluster1] "currentNumberScheduled",
2021-07-18T14:14:09.7315861Z [cluster1] "desiredNumberScheduled",
2021-07-18T14:14:09.7316667Z [cluster1] "numberMisscheduled",
2021-07-18T14:14:09.7317356Z [cluster1] "numberReady"
2021-07-18T14:14:09.7317894Z [cluster1] ],
2021-07-18T14:14:09.7318432Z [cluster1] "type": "object"
2021-07-18T14:14:09.7318944Z [cluster1] }
2021-07-18T14:14:09.7319421Z [cluster1] },
2021-07-18T14:14:09.7319937Z [cluster1] "required": [
2021-07-18T14:14:09.7320709Z [cluster1] "mismatchedContainerImages"
2021-07-18T14:14:09.7321410Z [cluster1] ],
2021-07-18T14:14:09.7321920Z [cluster1] "type": "object"
2021-07-18T14:14:09.7322432Z [cluster1] },
2021-07-18T14:14:09.7322943Z [cluster1] "serviceCIDR": {
2021-07-18T14:14:09.7323521Z [cluster1] "type": "string"
2021-07-18T14:14:09.7324024Z [cluster1] }
2021-07-18T14:14:09.7324551Z [cluster1] },
2021-07-18T14:14:09.7325051Z [cluster1] "required": [
2021-07-18T14:14:09.7325593Z [cluster1] "clusterID",
2021-07-18T14:14:09.7326159Z [cluster1] "natEnabled"
2021-07-18T14:14:09.7326651Z [cluster1] ],
2021-07-18T14:14:09.7327155Z [cluster1] "type": "object"
2021-07-18T14:14:09.7327640Z [cluster1] }
2021-07-18T14:14:09.7328084Z [cluster1] },
2021-07-18T14:14:09.7328557Z [cluster1] "type": "object"
2021-07-18T14:14:09.7329039Z [cluster1] }
2021-07-18T14:14:09.7329464Z [cluster1] },
2021-07-18T14:14:09.7329932Z [cluster1] "served": true,
2021-07-18T14:14:09.7330460Z [cluster1] "storage": true,
2021-07-18T14:14:09.7330997Z [cluster1] "subresources": {
2021-07-18T14:14:09.7331532Z [cluster1] "status": {}
2021-07-18T14:14:09.7331971Z [cluster1] }
2021-07-18T14:14:09.7332391Z [cluster1] }
2021-07-18T14:14:09.7332789Z [cluster1] ]
2021-07-18T14:14:09.7333193Z [cluster1] },
2021-07-18T14:14:09.7333611Z [cluster1] "status": {
2021-07-18T14:14:09.7334133Z [cluster1] "acceptedNames": {
2021-07-18T14:14:09.7334702Z [cluster1] "kind": "Submariner",
2021-07-18T14:14:11.2143621Z [ "type": "object"
2021-07-18T14:14:11.2144238Z [cluster2] }
2021-07-18T14:14:11.2144917Z [cluster2] },
2021-07-18T14:14:11.2145407Z [cluster2] "type": "object"
2021-07-18T14:14:11.2145897Z [cluster2] }
2021-07-18T14:14:11.2146309Z [cluster2] },
2021-07-18T14:14:11.2146791Z [cluster2] "served": true,
2021-07-18T14:14:11.2147309Z [cluster2] "storage": true,
2021-07-18T14:14:11.2147947Z [cluster2] "subresources": {
2021-07-18T14:14:11.2148479Z [cluster2] "status": {}
2021-07-18T14:14:11.2148914Z [cluster2] }
2021-07-18T14:14:11.2149334Z [cluster2] }
2021-07-18T14:14:11.2149732Z [cluster2] ]
2021-07-18T14:14:11.2150137Z [cluster2] },
2021-07-18T14:14:11.2150556Z [cluster2] "status": {
2021-07-18T14:14:11.2151080Z [cluster2] "acceptedNames": {
2021-07-18T14:14:11.2151839Z [cluster2] "kind": "Submariner",
2021-07-18T14:14:11.2152474Z [cluster2] "listKind": "SubmarinerList",
2021-07-18T14:14:11.2153113Z [cluster2] "plural": "submariners",
2021-07-18T14:14:11.2153802Z [cluster2] "singular": "submariner"
2021-07-18T14:14:11.2154295Z [cluster2] },
2021-07-18T14:14:11.2154765Z [cluster2] "conditions": [
2021-07-18T14:14:11.2155230Z [cluster2] {
2021-07-18T14:14:11.2156445Z [cluster2] "lastTransitionTime": "2021-07-18T14:12:53Z",
2021-07-18T14:14:11.2157169Z [cluster2] "message": "no conflicts found",
2021-07-18T14:14:11.2157788Z [cluster2] "reason": "NoConflicts",
2021-07-18T14:14:11.2158352Z [cluster2] "status": "True",
2021-07-18T14:14:11.2158920Z [cluster2] "type": "NamesAccepted"
2021-07-18T14:14:11.2159451Z [cluster2] },
2021-07-18T14:14:11.2159857Z [cluster2] {
2021-07-18T14:14:11.2160655Z [cluster2] "lastTransitionTime": "2021-07-18T14:12:53Z",
2021-07-18T14:14:11.2161443Z [cluster2] "message": "the initial names have been accepted",
2021-07-18T14:14:11.2162332Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-18T14:14:11.2163001Z [cluster2] "status": "True",
2021-07-18T14:14:11.2163543Z [cluster2] "type": "Established"
2021-07-18T14:14:11.2164049Z [cluster2] }
2021-07-18T14:14:11.2164446Z [cluster2] ],
2021-07-18T14:14:11.2165079Z [cluster2] "storedVersions": [
2021-07-18T14:14:11.2165610Z [cluster2] "v1alpha1"
2021-07-18T14:14:11.2166057Z [cluster2] ]
2021-07-18T14:14:11.2166450Z [cluster2] }
2021-07-18T14:14:11.2166852Z [cluster2] }
2021-07-18T14:14:11.2168008Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:14:11.2169684Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:14:11.2171542Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:14:11.2173208Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:14:11.2174478Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:14:11.2176109Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:14:11.2177774Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:14:11.2179073Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:14:11.2180738Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:14:11.2182408Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-18T14:14:11.2183729Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-18T14:14:11.2185766Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:14:11.2187351Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-18T14:14:11.2188489Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-18T14:14:11.2189677Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-18T14:14:11.2190957Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-18T14:14:11.2192456Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-18T14:14:11.2193379Z [cluster2] NAME STATUS AGE
2021-07-18T14:14:11.2194193Z [cluster2] submariner-operator Active 77s
2021-07-18T14:14:11.2195504Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:14:11.2196975Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:14:11.2198686Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-18T14:14:11.2199686Z [cluster2] NAME CREATED AT
2021-07-18T14:14:11.2200590Z [cluster2] submariners.submariner.io 2021-07-18T14:12:53Z
2021-07-18T14:14:11.2219220Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-18T14:14:11.2220843Z [submariner-operator]$ [cluster2] grep submariners
2021-07-18T14:14:11.2221931Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-18T14:14:11.2223190Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-18T14:14:11.2224266Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-18T14:14:11.9587967Z [submariner-operator]$ [cluscluster1] "listKind": "SubmarinerList",
2021-07-18T14:14:11.9588854Z [cluster1] "plural": "submariners",
2021-07-18T14:14:11.9589462Z [cluster1] "singular": "submariner"
2021-07-18T14:14:11.9589967Z [cluster1] },
2021-07-18T14:14:11.9590422Z [cluster1] "conditions": [
2021-07-18T14:14:11.9590889Z [cluster1] {
2021-07-18T14:14:11.9591695Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:41Z",
2021-07-18T14:14:11.9592578Z [cluster1] "message": "no conflicts found",
2021-07-18T14:14:11.9593202Z [cluster1] "reason": "NoConflicts",
2021-07-18T14:14:11.9593758Z [cluster1] "status": "True",
2021-07-18T14:14:11.9594343Z [cluster1] "type": "NamesAccepted"
2021-07-18T14:14:11.9594860Z [cluster1] },
2021-07-18T14:14:11.9595276Z [cluster1] {
2021-07-18T14:14:11.9596211Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:41Z",
2021-07-18T14:14:11.9596998Z [cluster1] "message": "the initial names have been accepted",
2021-07-18T14:14:11.9597812Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-18T14:14:11.9598469Z [cluster1] "status": "True",
2021-07-18T14:14:11.9599032Z [cluster1] "type": "Established"
2021-07-18T14:14:11.9599651Z [cluster1] }
2021-07-18T14:14:11.9600062Z [cluster1] ],
2021-07-18T14:14:11.9600555Z [cluster1] "storedVersions": [
2021-07-18T14:14:11.9601111Z [cluster1] "v1alpha1"
2021-07-18T14:14:11.9601637Z [cluster1] ]
2021-07-18T14:14:11.9602040Z [cluster1] }
2021-07-18T14:14:11.9602423Z [cluster1] }
2021-07-18T14:14:11.9603578Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:14:11.9605235Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:14:11.9607115Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:14:11.9608770Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:14:11.9610064Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:14:11.9611731Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:14:11.9613355Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:14:11.9614657Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:14:11.9616328Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:14:11.9617984Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-18T14:14:11.9619440Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-18T14:14:11.9621182Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:14:11.9622740Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-18T14:14:11.9624267Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-18T14:14:11.9625685Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-18T14:14:11.9627084Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-18T14:14:11.9628506Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-18T14:14:11.9629436Z [cluster1] NAME STATUS AGE
2021-07-18T14:14:11.9630230Z [cluster1] submariner-operator Active 89s
2021-07-18T14:14:11.9631431Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:14:11.9632883Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:14:11.9634471Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-18T14:14:11.9635482Z [cluster1] NAME CREATED AT
2021-07-18T14:14:11.9636366Z [cluster1] submariners.submariner.io 2021-07-18T14:12:41Z
2021-07-18T14:14:11.9637449Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-18T14:14:11.9638634Z [submariner-operator]$ [cluster1] grep submariners
2021-07-18T14:14:11.9639692Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-18T14:14:11.9640921Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-18T14:14:11.9641987Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-18T14:14:11.9643434Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:14:11.9645131Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:14:11.9646964Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:14:11.9648080Z [cluster1] NAME SECRETS AGE
2021-07-18T14:14:11.9648881Z [cluster1] submariner-operator 1 90s
2021-07-18T14:14:11.9650218Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6503926Z [submariner-operator]$ [cluster1] kubectl get roles --namespacter2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6506331Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6508217Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6509459Z [cluster2] NAME SECRETS AGE
2021-07-18T14:14:13.6510255Z [cluster2] submariner-operator 1 78s
2021-07-18T14:14:13.6511599Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6513327Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6515205Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6516440Z [cluster2] NAME CREATED AT
2021-07-18T14:14:13.6517337Z [cluster2] submariner-operator 2021-07-18T14:12:53Z
2021-07-18T14:14:13.6518757Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6520759Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6522747Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6523941Z [cluster2] NAME ROLE AGE
2021-07-18T14:14:13.6524891Z [cluster2] submariner-operator Role/submariner-operator 79s
2021-07-18T14:14:13.6526553Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6528364Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6530323Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.6531768Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-18T14:14:13.6532701Z [cluster2] submariner-operator 1/1 1 1 73s
2021-07-18T14:14:13.6533790Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-18T14:14:13.6534776Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-18T14:14:13.6536395Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-18T14:14:13.6538671Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:13.6540982Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:13.6543324Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:13.6546800Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator -o json
2021-07-18T14:14:13.6549154Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator -o json
2021-07-18T14:14:13.6551561Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator -o json
2021-07-18T14:14:13.6552881Z [cluster2] {
2021-07-18T14:14:13.6553355Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:13.6553849Z [cluster2] "kind": "Pod",
2021-07-18T14:14:13.6554326Z [cluster2] "metadata": {
2021-07-18T14:14:13.6555124Z [cluster2] "creationTimestamp": "2021-07-18T14:12:59Z",
2021-07-18T14:14:13.6556257Z [cluster2] "generateName": "submariner-operator-5bfdb87494-",
2021-07-18T14:14:13.6557095Z [cluster2] "labels": {
2021-07-18T14:14:13.6557859Z [cluster2] "name": "submariner-operator",
2021-07-18T14:14:13.6558773Z [cluster2] "pod-template-hash": "5bfdb87494"
2021-07-18T14:14:13.6559331Z [cluster2] },
2021-07-18T14:14:13.6559827Z [cluster2] "managedFields": [
2021-07-18T14:14:13.6560314Z [cluster2] {
2021-07-18T14:14:13.6560803Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:13.6561393Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:13.6562097Z [cluster2] "fieldsV1": {
2021-07-18T14:14:13.6562618Z [cluster2] "f:metadata": {
2021-07-18T14:14:13.6563169Z [cluster2] "f:generateName": {},
2021-07-18T14:14:13.6563723Z [cluster2] "f:labels": {
2021-07-18T14:14:13.6564193Z [cluster2] ".": {},
2021-07-18T14:14:13.6564672Z [cluster2] "f:name": {},
2021-07-18T14:14:13.6565605Z [cluster2] "f:pod-template-hash": {}
2021-07-18T14:14:13.6566181Z [cluster2] },
2021-07-18T14:14:13.6566724Z [cluster2] "f:ownerReferences": {
2021-07-18T14:14:13.6567383Z [cluster2] ".": {},
2021-07-18T14:14:13.6568344Z [cluster2] "k:{\"uid\":\"3ea388a4-ea11-4edc-a04f-6743188ad2b8\"}": {
2021-07-18T14:14:13.6569038Z [cluster2] ".": {},
2021-07-18T14:14:13.6569573Z [cluster2] "f:apiVersion": {},
2021-07-18T14:14:13.6570227Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-18T14:14:13.6570888Z [cluster2] "f:controller": {},
2021-07-18T14:14:13.6571406Z [cluster2] "f:kind": {},
2021-07-18T14:14:13.6571902Z [cluster2] "f:name": {},
2021-07-18T14:14:13.6572390Z [cluster2] "f:uid": {}
2021-07-18T14:14:13.6572859Z [cluster2] }
2021-07-18T14:14:13.6573297Z [cluster2] }
2021-07-18T14:14:13.6573720Z [cluster2] },
2021-07-18T14:14:13.6574178Z [cluster2] "f:spec": {
2021-07-18T14:14:13.6574687Z [cluster2] "f:containers": {
2021-07-18T14:14:13.6575569Z [cluster2] "k:{\"name\":\"submariner-operator\"}": {
2021-07-18T14:14:13.6576319Z [cluster2] ".": {},
2021-07-18T14:14:13.6576816Z [cluster2] "f:command": {},
2021-07-18T14:14:13.6577316Z [cluster2] "f:env": {
2021-07-18T14:14:13.6577798Z [cluster2] ".": {},
2021-07-18T14:14:13.6578364Z [cluster2] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-18T14:14:13.6578922Z [cluster2] ".": {},
2021-07-18T14:14:13.6579416Z [cluster2] "f:name": {},
2021-07-18T14:14:13.6579920Z [cluster2] "f:value": {}
2021-07-18T14:14:13.6580412Z [cluster2] },
2021-07-18T14:14:13.6580927Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-18T14:14:13.6581458Z [cluster2] ".": {},
2021-07-18T14:14:13.6581944Z [cluster2] "f:name": {},
2021-07-18T14:14:13.6582491Z [cluster2] "f:valueFrom": {
2021-07-18T14:14:13.6583019Z [cluster2] ".": {},
2021-07-18T14:14:13.6583526Z [cluster2] "f:fieldRef": {
2021-07-18T14:14:13.6584054Z [cluster2] ".": {},
2021-07-18T14:14:13.6584607Z [cluster2] "f:apiVersion": {},
2021-07-18T14:14:13.6618737Z [cluster2] "f:fieldPath": {}
2021-07-18T14:14:13.6619394Z [cluster2] }
2021-07-18T14:14:13.6619868Z [cluster2] }
2021-07-18T14:14:13.6620322Z [cluster2] },
2021-07-18T14:14:13.6620897Z [cluster2] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-18T14:14:13.6621499Z [cluster2] ".": {},
2021-07-18T14:14:13.6621987Z [cluster2] "f:name": {},
2021-07-18T14:14:13.6622541Z [cluster2] "f:valueFrom": {
2021-07-18T14:14:13.6623059Z [cluster2] ".": {},
2021-07-18T14:14:13.6623592Z [cluster2] "f:fieldRef": {
2021-07-18T14:14:13.6624276Z [cluster2] ".": {},
2021-07-18T14:14:13.6624962Z [cluster2] "f:apiVersion": {},
2021-07-18T14:14:13.6625570Z [cluster2] "f:fieldPath": {}
2021-07-18T14:14:13.6626093Z [cluster2] }
2021-07-18T14:14:13.6626563Z [cluster2] }
2021-07-18T14:14:13.6627009Z [cluster2] }
2021-07-18T14:14:13.6627466Z [cluster2] },
2021-07-18T14:14:13.6627938Z [cluster2] "f:image": {},
2021-07-18T14:14:13.6628535Z [cluster2] "f:imagePullPolicy": {},
2021-07-18T14:14:13.6629200Z [cluster2] "f:name": {},
2021-07-18T14:14:13.6629735Z [cluster2] "f:resources": {},
2021-07-18T14:14:13.6630444Z [cluster2] "f:terminationMessagePath": {},
2021-07-18T14:14:13.6631313Z [cluster2] "f:terminationMessagePolicy": {}
2021-07-18T14:14:13.6631985Z [cluster2] }
2021-07-18T14:14:13.6632413Z [cluster2] },
2021-07-18T14:14:13.6632906Z [cluster2] "f:dnsPolicy": {},
2021-07-18T14:14:13.6633539Z [cluster2] "f:enableServiceLinks": {},
2021-07-18T14:14:13.6634213Z [cluster2] "f:restartPolicy": {},
2021-07-18T14:14:13.6634908Z [cluster2] "f:schedulerName": {},
2021-07-18T14:14:13.6635546Z [cluster2] "f:securityContext": {},
2021-07-18T14:14:13.6636191Z [cluster2] "f:serviceAccount": {},
2021-07-18T14:14:13.6636863Z [cluster2] "f:serviceAccountName": {},
2021-07-18T14:14:13.6637863Z [cluster2] "f:terminationGracePeriodSeconds": {}
2021-07-18T14:14:13.6638597Z [cluster2] }
2021-07-18T14:14:13.6639027Z [cluster2] },
2021-07-18T14:14:13.6640088Z [cluster2] "manager": "kube-controller-manager",
2021-07-18T14:14:13.6640825Z [cluster2] "operation": "Update",
2021-07-18T14:14:13.6641552Z [cluster2] "time": "2021-07-18T14:12:59Z"
2021-07-18T14:14:13.6642018Z [cluster2] },
2021-07-18T14:14:13.6642435Z [cluster2] {
2021-07-18T14:14:13.6642911Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:13.6643514Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:13.6644067Z [cluster2] "fieldsV1": {
2021-07-18T14:14:13.6644569Z [cluster2] "f:status": {
2021-07-18T14:14:13.6645081Z [cluster2] "f:conditions": {
2021-07-18T14:14:13.6645722Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-18T14:14:13.6646310Z [cluster2] ".": {},
2021-07-18T14:14:13.6646866Z [cluster2] "f:lastProbeTime": {},
2021-07-18T14:14:13.6647536Z [cluster2] "f:lastTransitionTime": {},
2021-07-18T14:14:13.6648164Z [cluster2] "f:status": {},
2021-07-18T14:14:13.6648674Z [cluster2] "f:type": {}
2021-07-18T14:14:13.6649136Z [cluster2] },
2021-07-18T14:14:13.6649679Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-18T14:14:13.6650221Z [cluster2] ".": {},
2021-07-18T14:14:13.6650771Z [cluster2] "f:lastProbeTime": {},
2021-07-18T14:14:13.6651441Z [cluster2] "f:lastTransitionTime": {},
2021-07-18T14:14:13.6652168Z [cluster2] "f:status": {},
2021-07-18T14:14:13.6652743Z [cluster2] "f:type": {}
2021-07-18T14:14:13.6653296Z [cluster2] },
2021-07-18T14:14:13.6653804Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-18T14:14:13.6654300Z [cluster2] ".": {},
2021-07-18T14:14:13.6654854Z [cluster2] "f:lastProbeTime": {},
2021-07-18T14:14:13.6655529Z [cluster2] "f:lastTransitionTime": {},
2021-07-18T14:14:13.6656154Z [cluster2] "f:status": {},
2021-07-18T14:14:13.6656659Z [cluster2] "f:type": {}
2021-07-18T14:14:13.6657132Z [cluster2] }
2021-07-18T14:14:13.6657558Z [cluster2] },
2021-07-18T14:14:13.6658134Z [cluster2] "f:containerStatuses": {},
2021-07-18T14:14:13.6658741Z [cluster2] "f:hostIP": {},
2021-07-18T14:14:13.6659240Z [cluster2] "f:phase": {},
2021-07-18T14:14:13.6659751Z [cluster2] "f:podIP": {},
2021-07-18T14:14:13.6660251Z [cluster2] "f:podIPs": {
2021-07-18T14:14:13.6660735Z [cluster2] ".": {},
2021-07-18T14:14:13.6661214Z [cluster2] "k:{\"ip\":\"10.2.0.3\"}": {
2021-07-18T14:14:13.6661703Z [cluster2] ".": {},
2021-07-18T14:14:13.6662168Z [cluster2] "f:ip": {}
2021-07-18T14:14:13.6662630Z [cluster2] }
2021-07-18T14:14:13.6663133Z [cluster2] },
2021-07-18T14:14:13.6663618Z [cluster2] "f:startTime": {}
2021-07-18T14:14:13.6664102Z [cluster2] }
2021-07-18T14:14:13.6664511Z [cluster2] },
2021-07-18T14:14:13.6685744Z [cluster2] "manager": "kubelet",
2021-07-18T14:14:13.6686437Z [cluster2] "operation": "Update",
2021-07-18T14:14:13.6687489Z [cluster2] "time": "2021-07-18T14:13:15Z"
2021-07-18T14:14:13.6687949Z [cluster2] }
2021-07-18T14:14:13.6688365Z [cluster2] ],
2021-07-18T14:14:13.6689372Z [cluster2] "name": "submariner-operator-5bfdb87494-czzrf",
2021-07-18T14:14:13.6690553Z [cluster2] "namespace": "submariner-operator",
2021-07-18T14:14:13.6691279Z [cluster2] "ownerReferences": [
2021-07-18T14:14:13.6691790Z [cluster2] {
2021-07-18T14:14:13.6692300Z [cluster2] "apiVersion": "apps/v1",
2021-07-18T14:14:13.6692972Z [cluster2] "blockOwnerDeletion": true,
2021-07-18T14:14:13.6693631Z [cluster2] "controller": true,
2021-07-18T14:14:13.6694227Z [cluster2] "kind": "ReplicaSet",
2021-07-18T14:14:13.6695253Z [cluster2] "name": "submariner-operator-5bfdb87494",
2021-07-18T14:14:13.6696419Z [cluster2] "uid": "3ea388a4-ea11-4edc-a04f-6743188ad2b8"
2021-07-18T14:14:13.6697075Z [cluster2] }
2021-07-18T14:14:13.6697481Z [cluster2] ],
2021-07-18T14:14:13.6698013Z [cluster2] "resourceVersion": "1815",
2021-07-18T14:14:13.6699462Z [cluster2] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-5bfdb87494-czzrf",
2021-07-18T14:14:13.6700933Z [cluster2] "uid": "8a13ed3f-842c-473c-9f45-1e1b04d2b2df"
2021-07-18T14:14:13.6701551Z [cluster2] },
2021-07-18T14:14:13.6701968Z [cluster2] "spec": {
2021-07-18T14:14:13.6702453Z [cluster2] "containers": [
2021-07-18T14:14:13.6702916Z [cluster2] {
2021-07-18T14:14:13.6703369Z [cluster2] "command": [
2021-07-18T14:14:13.6704132Z [cluster2] "submariner-operator",
2021-07-18T14:14:13.6705081Z [cluster2] "-alsologtostderr",
2021-07-18T14:14:13.6705782Z [cluster2] "-v=1"
2021-07-18T14:14:13.6706208Z [cluster2] ],
2021-07-18T14:14:13.6706745Z [cluster2] "env": [
2021-07-18T14:14:13.6707333Z [cluster2] {
2021-07-18T14:14:13.6707877Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-18T14:14:13.6708450Z [cluster2] "valueFrom": {
2021-07-18T14:14:13.6708993Z [cluster2] "fieldRef": {
2021-07-18T14:14:13.6709545Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:13.6710254Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-18T14:14:13.6710870Z [cluster2] }
2021-07-18T14:14:13.6711315Z [cluster2] }
2021-07-18T14:14:13.6711751Z [cluster2] },
2021-07-18T14:14:13.6712166Z [cluster2] {
2021-07-18T14:14:13.6712735Z [cluster2] "name": "POD_NAME",
2021-07-18T14:14:13.6713262Z [cluster2] "valueFrom": {
2021-07-18T14:14:13.6713802Z [cluster2] "fieldRef": {
2021-07-18T14:14:13.6714359Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:13.6715013Z [cluster2] "fieldPath": "metadata.name"
2021-07-18T14:14:13.6715572Z [cluster2] }
2021-07-18T14:14:13.6716007Z [cluster2] }
2021-07-18T14:14:13.6716426Z [cluster2] },
2021-07-18T14:14:13.6716853Z [cluster2] {
2021-07-18T14:14:13.6717368Z [cluster2] "name": "OPERATOR_NAME",
2021-07-18T14:14:13.6718423Z [cluster2] "value": "submariner-operator"
2021-07-18T14:14:13.6719024Z [cluster2] }
2021-07-18T14:14:13.6719437Z [cluster2] ],
2021-07-18T14:14:13.6720300Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:14:13.6721146Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-18T14:14:13.6722092Z [cluster2] "name": "submariner-operator",
2021-07-18T14:14:13.6722724Z [cluster2] "resources": {},
2021-07-18T14:14:13.6723690Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-18T14:14:13.6724667Z [cluster2] "terminationMessagePolicy": "File",
2021-07-18T14:14:13.6725386Z [cluster2] "volumeMounts": [
2021-07-18T14:14:13.6725883Z [cluster2] {
2021-07-18T14:14:13.6726588Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-18T14:14:13.6727851Z [cluster2] "name": "submariner-operator-token-zwj4g",
2021-07-18T14:14:13.6728672Z [cluster2] "readOnly": true
2021-07-18T14:14:13.6729161Z [cluster2] }
2021-07-18T14:14:13.6729570Z [cluster2] ]
2021-07-18T14:14:13.6729992Z [cluster2] }
2021-07-18T14:14:13.6730389Z [cluster2] ],
2021-07-18T14:14:13.6730933Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-18T14:14:13.6731636Z [cluster2] "enableServiceLinks": true,
2021-07-18T14:14:13.6732506Z [cluster2] "nodeName": "cluster2-worker",
2021-07-18T14:14:13.6733352Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-18T14:14:13.6734089Z [cluster2] "priority": 0,
2021-07-18T14:14:13.6734652Z [cluster2] "restartPolicy": "Always",
2021-07-18T14:14:13.6735529Z [cluster2] "schedulerName": "default-scheduler",
2021-07-18T14:14:13.6736254Z [cluster2] "securityContext": {},
2021-07-18T14:14:13.6737167Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-18T14:14:13.6738275Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-18T14:14:13.6739288Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-18T14:14:13.6740050Z [cluster2] "tolerations": [
2021-07-18T14:14:13.6740523Z [cluster2] {
2021-07-18T14:14:13.6741012Z [cluster2] "effect": "NoExecute",
2021-07-18T14:14:13.6741957Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-18T14:14:13.6742646Z [cluster2] "operator": "Exists",
2021-07-18T14:14:13.6743263Z [cluster2] "tolerationSeconds": 300
2021-07-18T14:14:13.6743799Z [cluster2] },
2021-07-18T14:14:13.6744215Z [cluster2] {
2021-07-18T14:14:13.6786802Z [cluster2] "effect": "NoExecute",
2021-07-18T14:14:13.6787549Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-18T14:14:13.6788362Z [cluster2] "operator": "Exists",
2021-07-18T14:14:13.6788975Z [cluster2] "tolerationSeconds": 300
2021-07-18T14:14:13.6789524Z [cluster2] }
2021-07-18T14:14:13.6789922Z [cluster2] ],
2021-07-18T14:14:13.6790368Z [cluster2] "volumes": [
2021-07-18T14:14:13.6790798Z [cluster2] {
2021-07-18T14:14:13.6791907Z [cluster2] "name": "submariner-operator-token-zwj4g",
2021-07-18T14:14:13.6792702Z [cluster2] "secret": {
2021-07-18T14:14:13.6793234Z [cluster2] "defaultMode": 420,
2021-07-18T14:14:13.6794332Z [cluster2] "secretName": "submariner-operator-token-zwj4g"
2021-07-18T14:14:13.6795130Z [cluster2] }
2021-07-18T14:14:13.6795549Z [cluster2] }
2021-07-18T14:14:13.6795944Z [cluster2] ]
2021-07-18T14:14:13.6796344Z [cluster2] },
2021-07-18T14:14:13.6796758Z [cluster2] "status": {
2021-07-18T14:14:13.6797245Z [cluster2] "conditions": [
2021-07-18T14:14:13.6797855Z [cluster2] {
2021-07-18T14:14:13.6798382Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:13.6799280Z [cluster2] "lastTransitionTime": "2021-07-18T14:12:59Z",
2021-07-18T14:14:13.6799921Z [cluster2] "status": "True",
2021-07-18T14:14:13.6800473Z [cluster2] "type": "Initialized"
2021-07-18T14:14:13.6800974Z [cluster2] },
2021-07-18T14:14:13.6801376Z [cluster2] {
2021-07-18T14:14:13.6801906Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:13.6802786Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:15Z",
2021-07-18T14:14:13.6803412Z [cluster2] "status": "True",
2021-07-18T14:14:13.6803930Z [cluster2] "type": "Ready"
2021-07-18T14:14:13.6804378Z [cluster2] },
2021-07-18T14:14:13.6804794Z [cluster2] {
2021-07-18T14:14:13.6805304Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:13.6806189Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:15Z",
2021-07-18T14:14:13.6806809Z [cluster2] "status": "True",
2021-07-18T14:14:13.6807406Z [cluster2] "type": "ContainersReady"
2021-07-18T14:14:13.6807941Z [cluster2] },
2021-07-18T14:14:13.6808360Z [cluster2] {
2021-07-18T14:14:13.9082485Z [clustere=submariner-operator submariner-operator
2021-07-18T14:14:13.9084194Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9085338Z [cluster1] NAME CREATED AT
2021-07-18T14:14:13.9086149Z [cluster1] submariner-operator 2021-07-18T14:12:41Z
2021-07-18T14:14:13.9087568Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9089409Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9091379Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9092558Z [cluster1] NAME ROLE AGE
2021-07-18T14:14:13.9093631Z [cluster1] submariner-operator Role/submariner-operator 91s
2021-07-18T14:14:13.9095387Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9097351Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9099388Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:14:13.9100830Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-18T14:14:13.9101750Z [cluster1] submariner-operator 1/1 1 1 86s
2021-07-18T14:14:13.9102715Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-18T14:14:13.9103803Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-18T14:14:13.9105523Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-18T14:14:13.9107771Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:13.9109955Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:13.9112277Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:13.9114794Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator -o json
2021-07-18T14:14:13.9117079Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator -o json
2021-07-18T14:14:13.9119762Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator -o json
2021-07-18T14:14:13.9121069Z [cluster1] {
2021-07-18T14:14:13.9121541Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:13.9122038Z [cluster1] "kind": "Pod",
2021-07-18T14:14:13.9122517Z [cluster1] "metadata": {
2021-07-18T14:14:13.9123312Z [cluster1] "creationTimestamp": "2021-07-18T14:12:47Z",
2021-07-18T14:14:13.9124430Z [cluster1] "generateName": "submariner-operator-5bfdb87494-",
2021-07-18T14:14:13.9125260Z [cluster1] "labels": {
2021-07-18T14:14:13.9126027Z [cluster1] "name": "submariner-operator",
2021-07-18T14:14:13.9127029Z [cluster1] "pod-template-hash": "5bfdb87494"
2021-07-18T14:14:13.9127589Z [cluster1] },
2021-07-18T14:14:13.9128082Z [cluster1] "managedFields": [
2021-07-18T14:14:13.9128567Z [cluster1] {
2021-07-18T14:14:13.9129055Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:13.9129638Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:13.9130215Z [cluster1] "fieldsV1": {
2021-07-18T14:14:13.9130734Z [cluster1] "f:metadata": {
2021-07-18T14:14:13.9131291Z [cluster1] "f:generateName": {},
2021-07-18T14:14:13.9131848Z [cluster1] "f:labels": {
2021-07-18T14:14:13.9132317Z [cluster1] ".": {},
2021-07-18T14:14:13.9132789Z [cluster1] "f:name": {},
2021-07-18T14:14:13.9133562Z [cluster1] "f:pod-template-hash": {}
2021-07-18T14:14:13.9134226Z [cluster1] },
2021-07-18T14:14:13.9134729Z [cluster1] "f:ownerReferences": {
2021-07-18T14:14:13.9135251Z [cluster1] ".": {},
2021-07-18T14:14:13.9136126Z [cluster1] "k:{\"uid\":\"cda410f8-08c3-41ee-b463-fbbdd114cc0e\"}": {
2021-07-18T14:14:13.9136782Z [cluster1] ".": {},
2021-07-18T14:14:13.9137554Z [cluster1] "f:apiVersion": {},
2021-07-18T14:14:13.9138210Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-18T14:14:13.9138868Z [cluster1] "f:controller": {},
2021-07-18T14:14:13.9139394Z [cluster1] "f:kind": {},
2021-07-18T14:14:13.9139892Z [cluster1] "f:name": {},
2021-07-18T14:14:13.9184570Z [cluster1] "f:uid": {}
2021-07-18T14:14:13.9185204Z [cluster1] }
2021-07-18T14:14:13.9185802Z [cluster1] }
2021-07-18T14:14:13.9186237Z [cluster1] },
2021-07-18T14:14:13.9186685Z [cluster1] "f:spec": {
2021-07-18T14:14:13.9187211Z [cluster1] "f:containers": {
2021-07-18T14:14:13.9188344Z [cluster1] "k:{\"name\":\"submariner-operator\"}": {
2021-07-18T14:14:13.9189001Z [cluster1] ".": {},
2021-07-18T14:14:13.9189493Z [cluster1] "f:command": {},
2021-07-18T14:14:13.9190008Z [cluster1] "f:env": {
2021-07-18T14:14:13.9190494Z [cluster1] ".": {},
2021-07-18T14:14:13.9191053Z [cluster1] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-18T14:14:13.9191621Z [cluster1] ".": {},
2021-07-18T14:14:13.9192111Z [cluster1] "f:name": {},
2021-07-18T14:14:13.9192897Z [cluster1] "f:value": {}
2021-07-18T14:14:13.9193372Z [cluster1] },
2021-07-18T14:14:13.9193908Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-18T14:14:13.9194433Z [cluster1] ".": {},
2021-07-18T14:14:13.9194934Z [cluster1] "f:name": {},
2021-07-18T14:14:13.9195483Z [cluster1] "f:valueFrom": {
2021-07-18T14:14:13.9195997Z [cluster1] ".": {},
2021-07-18T14:14:13.9196529Z [cluster1] "f:fieldRef": {
2021-07-18T14:14:13.9197044Z [cluster1] ".": {},
2021-07-18T14:14:13.9197595Z [cluster1] "f:apiVersion": {},
2021-07-18T14:14:13.9198188Z [cluster1] "f:fieldPath": {}
2021-07-18T14:14:13.9198718Z [cluster1] }
2021-07-18T14:14:13.9199183Z [cluster1] }
2021-07-18T14:14:13.9199636Z [cluster1] },
2021-07-18T14:14:13.9200278Z [cluster1] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-18T14:14:13.9200846Z [cluster1] ".": {},
2021-07-18T14:14:13.9201344Z [cluster1] "f:name": {},
2021-07-18T14:14:13.9201878Z [cluster1] "f:valueFrom": {
2021-07-18T14:14:13.9202403Z [cluster1] ".": {},
2021-07-18T14:14:13.9202913Z [cluster1] "f:fieldRef": {
2021-07-18T14:14:13.9203449Z [cluster1] ".": {},
2021-07-18T14:14:13.9204014Z [cluster1] "f:apiVersion": {},
2021-07-18T14:14:13.9204599Z [cluster1] "f:fieldPath": {}
2021-07-18T14:14:13.9205129Z [cluster1] }
2021-07-18T14:14:13.9205586Z [cluster1] }
2021-07-18T14:14:13.9206047Z [cluster1] }
2021-07-18T14:14:13.9206569Z [cluster1] },
2021-07-18T14:14:13.9207056Z [cluster1] "f:image": {},
2021-07-18T14:14:13.9207641Z [cluster1] "f:imagePullPolicy": {},
2021-07-18T14:14:13.9208233Z [cluster1] "f:name": {},
2021-07-18T14:14:13.9208771Z [cluster1] "f:resources": {},
2021-07-18T14:14:13.9209461Z [cluster1] "f:terminationMessagePath": {},
2021-07-18T14:14:13.9210337Z [cluster1] "f:terminationMessagePolicy": {}
2021-07-18T14:14:13.9210997Z [cluster1] }
2021-07-18T14:14:13.9211437Z [cluster1] },
2021-07-18T14:14:13.9211928Z [cluster1] "f:dnsPolicy": {},
2021-07-18T14:14:13.9212580Z [cluster1] "f:enableServiceLinks": {},
2021-07-18T14:14:13.9213242Z [cluster1] "f:restartPolicy": {},
2021-07-18T14:14:13.9213864Z [cluster1] "f:schedulerName": {},
2021-07-18T14:14:13.9214534Z [cluster1] "f:securityContext": {},
2021-07-18T14:14:13.9215174Z [cluster1] "f:serviceAccount": {},
2021-07-18T14:14:13.9215861Z [cluster1] "f:serviceAccountName": {},
2021-07-18T14:14:13.9216740Z [cluster1] "f:terminationGracePeriodSeconds": {}
2021-07-18T14:14:13.9217486Z [cluster1] }
2021-07-18T14:14:13.9217970Z [cluster1] },
2021-07-18T14:14:13.9218907Z [cluster1] "manager": "kube-controller-manager",
2021-07-18T14:14:13.9219626Z [cluster1] "operation": "Update",
2021-07-18T14:14:13.9220364Z [cluster1] "time": "2021-07-18T14:12:47Z"
2021-07-18T14:14:13.9220834Z [cluster1] },
2021-07-18T14:14:13.9221230Z [cluster1] {
2021-07-18T14:14:13.9221715Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:13.9222302Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:13.9222875Z [cluster1] "fieldsV1": {
2021-07-18T14:14:13.9223363Z [cluster1] "f:status": {
2021-07-18T14:14:13.9223886Z [cluster1] "f:conditions": {
2021-07-18T14:14:13.9224513Z [cluster1] "k:{\"type\":\"ContainersReady\"}": {
2021-07-18T14:14:13.9225207Z [cluster1] ".": {},
2021-07-18T14:14:13.9225753Z [cluster1] "f:lastProbeTime": {},
2021-07-18T14:14:13.9226447Z [cluster1] "f:lastTransitionTime": {},
2021-07-18T14:14:13.9227072Z [cluster1] "f:status": {},
2021-07-18T14:14:13.9227571Z [cluster1] "f:type": {}
2021-07-18T14:14:13.9228042Z [cluster1] },
2021-07-18T14:14:13.9228578Z [cluster1] "k:{\"type\":\"Initialized\"}": {
2021-07-18T14:14:13.9229133Z [cluster1] ".": {},
2021-07-18T14:14:13.9229670Z [cluster1] "f:lastProbeTime": {},
2021-07-18T14:14:13.9230355Z [cluster1] "f:lastTransitionTime": {},
2021-07-18T14:14:13.9230983Z [cluster1] "f:status": {},
2021-07-18T14:14:13.9231482Z [cluster1] "f:type": {}
2021-07-18T14:14:13.9231957Z [cluster1] },
2021-07-18T14:14:13.9232455Z [cluster1] "k:{\"type\":\"Ready\"}": {
2021-07-18T14:14:13.9232971Z [cluster1] ".": {},
2021-07-18T14:14:13.9233512Z [cluster1] "f:lastProbeTime": {},
2021-07-18T14:14:13.9234196Z [cluster1] "f:lastTransitionTime": {},
2021-07-18T14:14:13.9234806Z [cluster1] "f:status": {},
2021-07-18T14:14:13.9235394Z [cluster1] "f:type": {}
2021-07-18T14:14:13.9235872Z [cluster1] }
2021-07-18T14:14:13.9236301Z [cluster1] },
2021-07-18T14:14:13.9236871Z [cluster1] "f:containerStatuses": {},
2021-07-18T14:14:13.9237461Z [cluster1] "f:hostIP": {},
2021-07-18T14:14:13.9237975Z [cluster1] "f:phase": {},
2021-07-18T14:14:13.9238468Z [cluster1] "f:podIP": {},
2021-07-18T14:14:13.9238985Z [cluster1] "f:podIPs": {
2021-07-18T14:14:13.9239457Z [cluster1] ".": {},
2021-07-18T14:14:13.9239949Z [cluster1] "k:{\"ip\":\"10.1.128.2\"}": {
2021-07-18T14:14:13.9240426Z [cluster1] ".": {},
2021-07-18T14:14:13.9240900Z [cluster1] "f:ip": {}
2021-07-18T14:14:13.9241357Z [cluster1] }
2021-07-18T14:14:13.9241783Z [cluster1] },
2021-07-18T14:14:13.9248032Z [cluster1] "f:startTime": {}
2021-07-18T14:14:13.9248526Z [cluster1] }
2021-07-18T14:14:13.9256909Z [cluster1] },
2021-07-18T14:14:13.9257394Z [cluster1] "manager": "kubelet",
2021-07-18T14:14:13.9257940Z [cluster1] "operation": "Update",
2021-07-18T14:14:13.9258820Z [cluster1] "time": "2021-07-18T14:12:56Z"
2021-07-18T14:14:13.9259257Z [cluster1] }
2021-07-18T14:14:13.9259941Z [cluster1] ],
2021-07-18T14:14:13.9260905Z [cluster1] "name": "submariner-operator-5bfdb87494-nsc7t",
2021-07-18T14:14:13.9262004Z [cluster1] "namespace": "submariner-operator",
2021-07-18T14:14:13.9262665Z [cluster1] "ownerReferences": [
2021-07-18T14:14:13.9263149Z [cluster1] {
2021-07-18T14:14:13.9263610Z [cluster1] "apiVersion": "apps/v1",
2021-07-18T14:14:13.9264239Z [cluster1] "blockOwnerDeletion": true,
2021-07-18T14:14:13.9264944Z [cluster1] "controller": true,
2021-07-18T14:14:13.9265480Z [cluster1] "kind": "ReplicaSet",
2021-07-18T14:14:13.9266631Z [cluster1] "name": "submariner-operator-5bfdb87494",
2021-07-18T14:14:13.9267957Z [cluster1] "uid": "cda410f8-08c3-41ee-b463-fbbdd114cc0e"
2021-07-18T14:14:13.9268618Z [cluster1] }
2021-07-18T14:14:13.9269018Z [cluster1] ],
2021-07-18T14:14:13.9269546Z [cluster1] "resourceVersion": "1788",
2021-07-18T14:14:13.9272271Z [cluster1] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-5bfdb87494-nsc7t",
2021-07-18T14:14:13.9273795Z [cluster1] "uid": "13eb5597-7a35-412c-8522-74ca213b5fb6"
2021-07-18T14:14:13.9274352Z [cluster1] },
2021-07-18T14:14:13.9274779Z [cluster1] "spec": {
2021-07-18T14:14:13.9275256Z [cluster1] "containers": [
2021-07-18T14:14:13.9275722Z [cluster1] {
2021-07-18T14:14:13.9276171Z [cluster1] "command": [
2021-07-18T14:14:13.9276945Z [cluster1] "submariner-operator",
2021-07-18T14:14:13.9277783Z [cluster1] "-alsologtostderr",
2021-07-18T14:14:13.9278457Z [cluster1] "-v=1"
2021-07-18T14:14:13.9278894Z [cluster1] ],
2021-07-18T14:14:13.9279324Z [cluster1] "env": [
2021-07-18T14:14:13.9279772Z [cluster1] {
2021-07-18T14:14:13.9280294Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-18T14:14:13.9280877Z [cluster1] "valueFrom": {
2021-07-18T14:14:13.9281403Z [cluster1] "fieldRef": {
2021-07-18T14:14:13.9282425Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:13.9283296Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-18T14:14:13.9284633Z [cluster1] }
2021-07-18T14:14:13.9285188Z [cluster1] }
2021-07-18T14:14:13.9285752Z [cluster1] },
2021-07-18T14:14:13.9286181Z [cluster1] {
2021-07-18T14:14:13.9286922Z [cluster1] "name": "POD_NAME",
2021-07-18T14:14:13.9287465Z [cluster1] "valueFrom": {
2021-07-18T14:14:13.9287989Z [cluster1] "fieldRef": {
2021-07-18T14:14:13.9288551Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:13.9289194Z [cluster1] "fieldPath": "metadata.name"
2021-07-18T14:14:13.9289770Z [cluster1] }
2021-07-18T14:14:13.9290207Z [cluster1] }
2021-07-18T14:14:13.9290627Z [cluster1] },
2021-07-18T14:14:13.9291055Z [cluster1] {
2021-07-18T14:14:13.9291561Z [cluster1] "name": "OPERATOR_NAME",
2021-07-18T14:14:13.9292523Z [cluster1] "value": "submariner-operator"
2021-07-18T14:14:13.9293114Z [cluster1] }
2021-07-18T14:14:13.9293541Z [cluster1] ],
2021-07-18T14:14:13.9294393Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:14:13.9295255Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-18T14:14:13.9296187Z [cluster1] "name": "submariner-operator",
2021-07-18T14:14:13.9296828Z [cluster1] "resources": {},
2021-07-18T14:14:13.9297909Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-18T14:14:13.9299269Z [cluster1] "terminationMessagePolicy": "File",
2021-07-18T14:14:13.9300181Z [cluster1] "volumeMounts": [
2021-07-18T14:14:13.9300678Z [cluster1] {
2021-07-18T14:14:13.9301399Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-18T14:14:13.9302688Z [cluster1] "name": "submariner-operator-token-xptc5",
2021-07-18T14:14:13.9303822Z [cluster1] "readOnly": true
2021-07-18T14:14:13.9310700Z [cluster1] }
2021-07-18T14:14:13.9311172Z [cluster1] ]
2021-07-18T14:14:13.9311564Z [cluster1] }
2021-07-18T14:14:13.9311938Z [cluster1] ],
2021-07-18T14:14:13.9312439Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-18T14:14:13.9313078Z [cluster1] "enableServiceLinks": true,
2021-07-18T14:14:13.9314104Z [cluster1] "nodeName": "cluster1-worker2",
2021-07-18T14:14:13.9314946Z [cluster1] "preemptionPolicy": "PreemptLowerPriority",
2021-07-18T14:14:13.9315640Z [cluster1] "priority": 0,
2021-07-18T14:14:13.9316156Z [cluster1] "restartPolicy": "Always",
2021-07-18T14:14:13.9318501Z [cluster1] "schedulerName": "default-scheduler",
2021-07-18T14:14:13.9319571Z [cluster1] "securityContext": {},
2021-07-18T14:14:13.9320791Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-18T14:14:13.9322007Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-18T14:14:13.9323084Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-18T14:14:13.9324035Z [cluster1] "tolerations": [
2021-07-18T14:14:13.9324469Z [cluster1] {
2021-07-18T14:14:13.9324939Z [cluster1] "effect": "NoExecute",
2021-07-18T14:14:13.9325781Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-18T14:14:13.9326434Z [cluster1] "operator": "Exists",
2021-07-18T14:14:13.9326996Z [cluster1] "tolerationSeconds": 300
2021-07-18T14:14:13.9327507Z [cluster1] },
2021-07-18T14:14:13.9327882Z [cluster1] {
2021-07-18T14:14:13.9328356Z [cluster1] "effect": "NoExecute",
2021-07-18T14:14:13.9329023Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-18T14:14:13.9329662Z [cluster1] "operator": "Exists",
2021-07-18T14:14:13.9330405Z [cluster1] "tolerationSeconds": 300
2021-07-18T14:14:13.9330904Z [cluster1] }
2021-07-18T14:14:13.9331288Z [cluster1] ],
2021-07-18T14:14:13.9331688Z [cluster1] "volumes": [
2021-07-18T14:14:13.9332104Z [cluster1] {
2021-07-18T14:14:13.9332987Z [cluster1] "name": "submariner-operator-token-xptc5",
2021-07-18T14:14:13.9333728Z [cluster1] "secret": {
2021-07-18T14:14:13.9334207Z [cluster1] "defaultMode": 420,
2021-07-18T14:14:13.9335457Z [cluster1] "secretName": "submariner-operator-token-xptc5"
2021-07-18T14:14:13.9336208Z [cluster1] }
2021-07-18T14:14:13.9336585Z [cluster1] }
2021-07-18T14:14:13.9336964Z [cluster1] ]
2021-07-18T14:14:13.9337327Z [cluster1] },
2021-07-18T14:14:13.9337725Z [cluster1] "status": {
2021-07-18T14:14:13.9338167Z [cluster1] "conditions": [
2021-07-18T14:14:13.9338606Z [cluster1] {
2021-07-18T14:14:13.9339083Z [cluster1] "lastProbeTime": null,
2021-07-18T14:14:13.9339917Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:47Z",
2021-07-18T14:14:13.9340501Z [cluster1] "status": "True",
2021-07-18T14:14:13.9341023Z [cluster1] "type": "Initialized"
2021-07-18T14:14:13.9341494Z [cluster1] },
2021-07-18T14:14:13.9341870Z [cluster1] {
2021-07-18T14:14:13.9342355Z [cluster1] "lastProbeTime": null,
2021-07-18T14:14:13.9343961Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:56Z",
2021-07-18T14:14:13.9344570Z [cluster1] "status": "True",
2021-07-18T14:14:13.9345460Z [cluster1] "type": "Ready"
2021-07-18T14:14:13.9346119Z [cluster1] },
2021-07-18T14:14:13.9346495Z [cluster1] {
2021-07-18T14:14:13.9347109Z [cluster1] "lastProbeTime": null,
2021-07-18T14:14:13.9348098Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:56Z",
2021-07-18T14:14:13.9348834Z [cluster1] "status": "True",
2021-07-18T14:14:13.9349515Z [cluster1] "type": "ContainersReady"
2021-07-18T14:14:13.9350133Z [cluster1] },
2021-07-18T14:14:13.9350643Z [cluster1] {
2021-07-18T14:14:13.9351451Z [cluster1] "lastProbeTime": null,
2021-07-18T14:14:13.9352461Z [cluster1] "lastTransitionTime": "2021-07-18T14:12:47Z",
2021-07-18T14:14:13.9353463Z [cluster1] "status": "True",
2021-07-18T14:14:13.9354143Z [cluster1] "type": "PodScheduled"
2021-07-18T14:14:13.9354864Z [cluster1] }
2021-07-18T14:14:13.9355391Z [cluster1] ],
2021-07-18T14:14:13.9356365Z [cluster1] "containerStatuses": [
2021-07-18T14:14:13.9357011Z [cluster1] {
2021-07-18T14:14:13.9359130Z [cluster1] "containerID": "containerd://4b0a817605ea0cd8b5ea31905d7fe4bf7f0e56955d2d6074cebc02b82d2337df",
2021-07-18T14:14:13.9361929Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:14:14.5010073Z [cluster1] "imageID": "localhost:5000/submariner-ope2] "lastProbeTime": null,
2021-07-18T14:14:14.5011239Z [cluster2] "lastTransitionTime": "2021-07-18T14:12:59Z",
2021-07-18T14:14:14.5011895Z [cluster2] "status": "True",
2021-07-18T14:14:14.5012480Z [cluster2] "type": "PodScheduled"
2021-07-18T14:14:14.5013016Z [cluster2] }
2021-07-18T14:14:14.5013432Z [cluster2] ],
2021-07-18T14:14:14.5013956Z [cluster2] "containerStatuses": [
2021-07-18T14:14:14.5014538Z [cluster2] {
2021-07-18T14:14:14.5016233Z [cluster2] "containerID": "containerd://468f0974298274f63ccfafb311dd2281cd4f9dc3991c3736d8e9d18bbf73701d",
2021-07-18T14:14:14.5018387Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:14:14.5020195Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-18T14:14:14.5021367Z [cluster2] "lastState": {},
2021-07-18T14:14:14.5022386Z [cluster2] "name": "submariner-operator",
2021-07-18T14:14:14.5023011Z [cluster2] "ready": true,
2021-07-18T14:14:14.5023551Z [cluster2] "restartCount": 1,
2021-07-18T14:14:14.5024097Z [cluster2] "started": true,
2021-07-18T14:14:14.5024601Z [cluster2] "state": {
2021-07-18T14:14:14.5025198Z [cluster2] "running": {
2021-07-18T14:14:14.5025954Z [cluster2] "startedAt": "2021-07-18T14:13:14Z"
2021-07-18T14:14:14.5026473Z [cluster2] }
2021-07-18T14:14:14.5026887Z [cluster2] }
2021-07-18T14:14:14.5027433Z [cluster2] }
2021-07-18T14:14:14.5027831Z [cluster2] ],
2021-07-18T14:14:14.5028297Z [cluster2] "hostIP": "172.18.0.4",
2021-07-18T14:14:14.5028804Z [cluster2] "phase": "Running",
2021-07-18T14:14:14.5029319Z [cluster2] "podIP": "10.2.0.3",
2021-07-18T14:14:14.5029790Z [cluster2] "podIPs": [
2021-07-18T14:14:14.5030239Z [cluster2] {
2021-07-18T14:14:14.5030671Z [cluster2] "ip": "10.2.0.3"
2021-07-18T14:14:14.5031112Z [cluster2] }
2021-07-18T14:14:14.5031511Z [cluster2] ],
2021-07-18T14:14:14.5032022Z [cluster2] "qosClass": "BestEffort",
2021-07-18T14:14:14.5032951Z [cluster2] "startTime": "2021-07-18T14:12:59Z"
2021-07-18T14:14:14.5033427Z [cluster2] }
2021-07-18T14:14:14.5033826Z [cluster2] }
2021-07-18T14:14:14.5035412Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:14:14.5037098Z [submariner-operator]$ [cluster2] grep Running
2021-07-18T14:14:14.5038976Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:14:14.5041638Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:14:14.5043086Z [cluster2] Running
2021-07-18T14:14:14.5044533Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator
2021-07-18T14:14:14.5046837Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator
2021-07-18T14:14:14.5049150Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-czzrf --namespace=submariner-operator
2021-07-18T14:14:14.5050604Z [cluster2] I0718 14:13:15.678460 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-18T14:14:14.5051327Z [cluster2] I0718 14:13:15.678737 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-18T14:14:14.5052315Z [cluster2] I0718 14:13:15.678760 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-18T14:14:14.5053439Z [cluster2] I0718 14:13:15.678779 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-18T14:14:14.5054340Z [cluster2] I0718 14:13:15.678997 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-18T14:14:14.5055308Z [cluster2] I0718 14:13:16.186792 1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-18T14:14:14.5056249Z [cluster2] I0718 14:13:16.186880 1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-18T14:14:14.5058141Z [cluster2] I0718 14:13:16.694830 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-18T14:14:14.5059326Z [cluster2] I0718 14:13:16.695090 1 main.go:129] cmd "msg"="Registering Components."
2021-07-18T14:14:14.5060144Z [cluster2] I0718 14:13:16.695176 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-18T14:14:14.5061234Z [cluster2] I0718 14:13:20.059414 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5063122Z [cluster2] I0718 14:13:20.059457 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5064345Z [cluster2] I0718 14:13:20.059526 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-18T14:14:14.5065719Z [cluster2] I0718 14:13:20.059845 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-18T14:14:14.5067929Z [cluster2] I0718 14:13:20.060323 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-18T14:14:14.5071848Z [cluster2] I0718 14:13:20.060496 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:14:14.5076705Z [cluster2] I0718 14:13:20.060742 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:14:14.5083578Z [cluster2] I0718 14:13:20.062086 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:14:14.5092481Z [cluster2] I0718 14:13:20.062427 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:14:14.5097942Z [cluster2] I0718 14:13:20.161377 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:14:14.5100540Z [cluster2] I0718 14:13:20.161669 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-18T14:14:14.5104260Z [cluster2] I0718 14:13:20.165596 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-18T14:14:14.5132395Z [cluster2] I0718 14:13:20.167172 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:14:14.5174295Z [cluster2] I0718 14:13:20.167202 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:14.5177630Z [cluster2] I0718 14:13:20.174164 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:14:14.5180795Z [cluster2] I0718 14:13:20.174418 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-18T14:14:14.5183160Z [cluster2] I0718 14:13:20.174708 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-18T14:14:14.5185916Z [cluster2] I0718 14:13:20.174963 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5187677Z [cluster2] I0718 14:13:20.257529 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-18T14:14:14.5189479Z [cluster2] I0718 14:13:20.258600 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-18T14:14:14.5191088Z [cluster2] I0718 14:13:20.258805 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5192566Z [cluster2] I0718 14:13:20.258883 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5194506Z [cluster2] I0718 14:13:20.269038 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-18T14:14:14.5227447Z [cluster2] I0718 14:13:20.269531 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-18T14:14:14.5230072Z [cluster2] I0718 14:13:20.269492 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-18T14:14:14.5232873Z [cluster2] I0718 14:13:20.276617 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5236755Z [cluster2] I0718 14:13:20.284637 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-18T14:14:14.5239731Z [cluster2] I0718 14:13:20.406858 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-18T14:14:14.5253578Z [cluster2] I0718 14:13:20.406895 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-18T14:14:14.5255928Z [cluster2] I0718 14:13:20.406987 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5257602Z [cluster2] I0718 14:13:20.407021 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5258989Z [cluster2] I0718 14:13:20.407042 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5272956Z [cluster2] I0718 14:13:20.507326 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5277190Z [cluster2] I0718 14:13:20.557257 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5280476Z [cluster2] I0718 14:13:20.589646 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5283728Z [cluster2] I0718 14:13:21.026595 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5286894Z [cluster2] I0718 14:13:21.077038 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5292715Z [cluster2] I0718 14:13:21.098428 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5295638Z [cluster2] I0718 14:13:21.191818 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5298376Z [cluster2] I0718 14:13:21.192309 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5301282Z [cluster2] I0718 14:13:21.200924 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-18T14:14:14.5304581Z [cluster2] I0718 14:13:21.200946 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5308393Z [cluster2] I0718 14:13:21.215544 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5312964Z [cluster2] E0718 14:13:21.389251 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:14:14.5316850Z [cluster2] I0718 14:13:21.394357 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5321328Z [cluster2] E0718 14:13:21.522837 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5326886Z [cluster2] I0718 14:13:21.523347 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5328549Z [cluster2] I0718 14:13:21.523394 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5332458Z [cluster2] I0718 14:13:21.523408 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5334619Z [cluster2] I0718 14:13:21.528697 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5336824Z [cluster2] I0718 14:13:21.528743 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5338805Z [cluster2] I0718 14:13:21.528753 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5341676Z [cluster2] I0718 14:13:21.781156 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5345631Z [cluster2] I0718 14:13:21.812256 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5349725Z [cluster2] I0718 14:13:21.905736 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5352916Z [cluster2] I0718 14:13:21.906340 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5356619Z [cluster2] I0718 14:13:22.192172 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5361184Z [cluster2] I0718 14:13:22.286997 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5364516Z [cluster2] I0718 14:13:22.290452 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5367893Z [cluster2] I0718 14:13:22.632231 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5371697Z [cluster2] I0718 14:13:22.697418 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5375370Z [cluster2] I0718 14:13:22.748085 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-18T14:14:14.5379236Z [cluster2] E0718 14:13:22.748137 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"
2021-07-18T14:14:14.5383873Z [cluster2] E0718 14:13:22.748171 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:14:14.5395433Z [cluster2] I0718 14:13:22.768296 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5399222Z [cluster2] I0718 14:13:22.923757 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5402366Z [cluster2] I0718 14:13:22.926622 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5406053Z [cluster2] I0718 14:13:23.177575 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5409901Z [cluster2] I0718 14:13:23.178130 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5413183Z [cluster2] I0718 14:13:23.181349 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5416856Z [cluster2] E0718 14:13:23.384416 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-18T14:14:14.5421419Z [cluster2] E0718 14:13:23.384506 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-18T14:14:14.5425259Z [cluster2] I0718 14:13:23.384603 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5428574Z [cluster2] I0718 14:13:23.524944 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5431646Z [cluster2] I0718 14:13:23.572090 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5433312Z [cluster2] I0718 14:13:23.574558 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5434708Z [cluster2] I0718 14:13:23.574576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5437637Z [cluster2] E0718 14:13:23.595032 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5440636Z [cluster2] I0718 14:13:23.595090 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5442276Z [cluster2] I0718 14:13:23.595121 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5443667Z [cluster2] I0718 14:13:23.595150 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5446506Z [cluster2] I0718 14:13:23.722089 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5457547Z [cluster2] I0718 14:13:23.741214 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5461526Z [cluster2] I0718 14:13:24.012023 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5465292Z [cluster2] I0718 14:13:24.076301 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5509280Z [cluster2] I0718 14:13:24.132590 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5513199Z [cluster2] I0718 14:13:24.132627 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5516584Z [cluster2] I0718 14:13:24.513637 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5520181Z [cluster2] I0718 14:13:24.547439 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5523824Z [cluster2] I0718 14:13:24.586925 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5527089Z [cluster2] I0718 14:13:24.642685 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5530349Z [cluster2] I0718 14:13:24.643487 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5533539Z [cluster2] I0718 14:13:24.883861 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5536998Z [cluster2] I0718 14:13:25.151455 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5540410Z [cluster2] I0718 14:13:25.379167 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5543974Z [cluster2] I0718 14:13:25.603524 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5548052Z [cluster2] I0718 14:13:25.994335 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5552718Z [cluster2] E0718 14:13:26.335658 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: services \"submariner-lighthouse-coredns-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-18T14:14:14.5556680Z [cluster2] I0718 14:13:26.335726 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5560257Z [cluster2] I0718 14:13:26.375139 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5564093Z [cluster2] I0718 14:13:26.449077 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5567863Z [cluster2] I0718 14:13:26.575556 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5571196Z [cluster2] I0718 14:13:26.644530 1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5575729Z [cluster2] I0718 14:13:26.644572 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.90.172\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n"
2021-07-18T14:14:14.5579927Z [cluster2] I0718 14:13:26.989942 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5584215Z [cluster2] I0718 14:13:27.072153 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5588297Z [cluster2] I0718 14:13:27.514104 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5591994Z [cluster2] I0718 14:13:28.028357 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5595248Z [cluster2] I0718 14:13:28.040073 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5599640Z [cluster2] I0718 14:13:28.040115 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.90.172\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n"
2021-07-18T14:14:14.5604150Z [cluster2] I0718 14:13:28.062221 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5608594Z [cluster2] I0718 14:13:28.090807 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5665414Z [cluster2] I0718 14:13:28.121413 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5669335Z [cluster2] I0718 14:13:28.624109 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5673075Z [cluster2] I0718 14:13:28.665358 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5676988Z [cluster2] I0718 14:13:28.707304 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5680777Z [cluster2] I0718 14:13:29.212496 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5683926Z [cluster2] I0718 14:13:29.221821 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5688293Z [cluster2] I0718 14:13:29.221872 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.90.172\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n"
2021-07-18T14:14:14.5692047Z [cluster2] I0718 14:13:39.465176 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5693721Z [cluster2] I0718 14:13:39.465240 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5695113Z [cluster2] I0718 14:13:39.465287 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5697619Z [cluster2] I0718 14:13:39.564287 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5700896Z [cluster2] I0718 14:13:39.642921 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5704103Z [cluster2] I0718 14:13:40.157633 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5707926Z [cluster2] I0718 14:13:40.209893 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5710768Z [cluster2] I0718 14:13:40.285561 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5712562Z [cluster2] I0718 14:13:40.285768 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5713938Z [cluster2] I0718 14:13:40.286165 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5715914Z [cluster2] I0718 14:13:40.304723 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5717581Z [cluster2] I0718 14:13:40.304766 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5718957Z [cluster2] I0718 14:13:40.304777 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5721468Z [cluster2] I0718 14:13:40.978225 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5724652Z [cluster2] I0718 14:13:40.979482 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5746979Z [cluster2] I0718 14:13:41.085311 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5750568Z [cluster2] I0718 14:13:41.085583 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5754058Z [cluster2] I0718 14:13:41.646443 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5757338Z [cluster2] I0718 14:13:41.647348 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5760533Z [cluster2] I0718 14:13:41.714053 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5763808Z [cluster2] I0718 14:13:41.717780 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5766512Z [cluster2] I0718 14:13:41.934124 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5768172Z [cluster2] I0718 14:13:41.934172 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5769616Z [cluster2] I0718 14:13:41.934183 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5772098Z [cluster2] I0718 14:13:41.957718 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5775732Z [cluster2] E0718 14:13:42.037386 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5778698Z [cluster2] I0718 14:13:42.037430 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5780378Z [cluster2] I0718 14:13:42.037468 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5781764Z [cluster2] I0718 14:13:42.037478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5784293Z [cluster2] I0718 14:13:42.038974 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5788153Z [cluster2] I0718 14:13:42.130769 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5803576Z [cluster2] I0718 14:13:42.187212 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5807108Z [cluster2] I0718 14:13:42.217559 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5810446Z [cluster2] I0718 14:13:42.347963 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5814510Z [cluster2] I0718 14:13:42.385096 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5842233Z [cluster2] I0718 14:13:42.552780 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5845911Z [cluster2] I0718 14:13:42.603013 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5849266Z [cluster2] I0718 14:13:42.787475 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5852736Z [cluster2] I0718 14:13:42.819876 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5856058Z [cluster2] I0718 14:13:42.895639 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5859772Z [cluster2] I0718 14:13:42.936556 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.5863656Z [cluster2] I0718 14:13:42.958897 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5866822Z [cluster2] I0718 14:13:43.107936 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5868485Z [cluster2] I0718 14:13:43.107986 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5869873Z [cluster2] I0718 14:13:43.107996 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5872340Z [cluster2] I0718 14:13:43.128722 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5875625Z [cluster2] I0718 14:13:43.136655 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5878993Z [cluster2] I0718 14:13:43.460433 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5903663Z [cluster2] I0718 14:13:43.466061 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5908296Z [cluster2] I0718 14:13:43.466124 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.90.172\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n"
2021-07-18T14:14:14.5912391Z [cluster2] I0718 14:13:43.639173 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5915760Z [cluster2] I0718 14:13:43.647309 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5918499Z [cluster2] I0718 14:13:43.665771 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5920290Z [cluster2] I0718 14:13:43.665808 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5921718Z [cluster2] I0718 14:13:43.665820 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5923678Z [cluster2] I0718 14:13:43.675706 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5925334Z [cluster2] I0718 14:13:43.675784 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5926721Z [cluster2] I0718 14:13:43.675990 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5929263Z [cluster2] I0718 14:13:43.697486 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5951113Z [cluster2] I0718 14:13:43.707956 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5954446Z [cluster2] I0718 14:13:43.708275 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5957873Z [cluster2] I0718 14:13:43.712368 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5961074Z [cluster2] I0718 14:13:44.209858 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5964214Z [cluster2] I0718 14:13:44.214973 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5967373Z [cluster2] I0718 14:13:44.225244 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5970605Z [cluster2] I0718 14:13:44.231266 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5973294Z [cluster2] I0718 14:13:44.403721 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5975036Z [cluster2] I0718 14:13:44.403771 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5976397Z [cluster2] I0718 14:13:44.403781 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5978876Z [cluster2] I0718 14:13:44.412726 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5982095Z [cluster2] I0718 14:13:44.415973 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.5985591Z [cluster2] I0718 14:13:44.919165 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.5988788Z [cluster2] I0718 14:13:44.927053 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.5991501Z [cluster2] I0718 14:13:44.944199 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5994329Z [cluster2] I0718 14:13:44.944238 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.5996380Z [cluster2] I0718 14:13:44.944242 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.5998154Z [cluster2] I0718 14:13:44.944250 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.5999532Z [cluster2] I0718 14:13:44.944299 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6000916Z [cluster2] I0718 14:13:44.944310 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6004227Z [cluster2] I0718 14:13:44.952298 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6007441Z [cluster2] I0718 14:13:44.952940 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6010694Z [cluster2] I0718 14:13:44.956734 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6014009Z [cluster2] I0718 14:13:44.956970 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6017318Z [cluster2] I0718 14:13:45.461428 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6020425Z [cluster2] I0718 14:13:45.461727 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6023911Z [cluster2] I0718 14:13:45.469403 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6029396Z [cluster2] I0718 14:13:45.481550 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6033184Z [cluster2] I0718 14:13:45.487798 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.6036933Z [cluster2] I0718 14:13:45.488317 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6040503Z [cluster2] I0718 14:13:45.506470 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6044591Z [cluster2] E0718 14:13:45.512082 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6047623Z [cluster2] I0718 14:13:45.512129 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6049278Z [cluster2] I0718 14:13:45.512164 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6050673Z [cluster2] I0718 14:13:45.512181 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6052648Z [cluster2] I0718 14:13:45.515770 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6054309Z [cluster2] I0718 14:13:45.515817 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6055695Z [cluster2] I0718 14:13:45.515829 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6058155Z [cluster2] I0718 14:13:45.535395 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6062059Z [cluster2] I0718 14:13:45.539986 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6065419Z [cluster2] I0718 14:13:45.546697 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6092970Z [cluster2] I0718 14:13:45.547590 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6096743Z [cluster2] I0718 14:13:46.009901 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6100515Z [cluster2] I0718 14:13:46.014358 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:14.6104455Z [cluster2] I0718 14:13:46.019263 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6108217Z [cluster2] I0718 14:13:46.048533 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6111337Z [cluster2] I0718 14:13:46.049454 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6114777Z [cluster2] I0718 14:13:46.055911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6118076Z [cluster2] I0718 14:13:46.056284 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6121760Z [cluster2] E0718 14:13:46.066937 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6124798Z [cluster2] I0718 14:13:46.067113 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6126473Z [cluster2] I0718 14:13:46.067231 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6127864Z [cluster2] I0718 14:13:46.067274 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6130425Z [cluster2] I0718 14:13:46.080464 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6133799Z [cluster2] I0718 14:13:46.083586 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6137182Z [cluster2] I0718 14:13:46.521192 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6140538Z [cluster2] I0718 14:13:46.523122 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6145057Z [cluster2] I0718 14:13:46.523228 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.90.172\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n"
2021-07-18T14:14:14.6149153Z [cluster2] I0718 14:13:46.585538 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6180309Z [cluster2] I0718 14:13:46.592268 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6183508Z [cluster2] I0718 14:13:50.386423 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6185289Z [cluster2] I0718 14:13:50.387450 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6186783Z [cluster2] I0718 14:13:50.389333 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6189315Z [cluster2] I0718 14:13:50.428602 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6192306Z [cluster2] I0718 14:13:50.434823 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6195592Z [cluster2] I0718 14:13:50.937865 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6198778Z [cluster2] I0718 14:13:50.945709 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6201558Z [cluster2] I0718 14:13:50.969302 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6203231Z [cluster2] I0718 14:13:50.969468 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6204620Z [cluster2] I0718 14:13:50.969567 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6206572Z [cluster2] I0718 14:13:50.975273 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6208242Z [cluster2] I0718 14:13:50.975496 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6209623Z [cluster2] I0718 14:13:50.975587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6212188Z [cluster2] I0718 14:13:50.987025 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6215434Z [cluster2] I0718 14:13:50.994023 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6218671Z [cluster2] I0718 14:13:51.013579 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6221989Z [cluster2] I0718 14:13:51.029557 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6225360Z [cluster2] I0718 14:13:51.495452 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6228562Z [cluster2] I0718 14:13:51.503716 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6231778Z [cluster2] I0718 14:13:51.531590 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6234939Z [cluster2] I0718 14:13:51.538986 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6237660Z [cluster2] I0718 14:13:55.440362 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6239406Z [cluster2] I0718 14:13:55.440431 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6240775Z [cluster2] I0718 14:13:55.440442 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6243264Z [cluster2] I0718 14:13:55.454736 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6246474Z [cluster2] I0718 14:13:55.463156 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6249674Z [cluster2] I0718 14:13:55.964931 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6252871Z [cluster2] I0718 14:13:55.973155 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6307100Z [cluster2] I0718 14:13:55.992289 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6308776Z [cluster2] I0718 14:13:55.992344 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6310167Z [cluster2] I0718 14:13:55.992361 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6312157Z [cluster2] I0718 14:13:56.003701 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6313954Z [cluster2] I0718 14:13:56.003742 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6315337Z [cluster2] I0718 14:13:56.003752 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6317832Z [cluster2] I0718 14:13:56.011528 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6321102Z [cluster2] I0718 14:13:56.017370 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6324319Z [cluster2] I0718 14:13:56.018814 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6327544Z [cluster2] I0718 14:13:56.030827 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6330746Z [cluster2] I0718 14:13:56.518969 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6334026Z [cluster2] I0718 14:13:56.529920 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6337201Z [cluster2] I0718 14:13:56.532902 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6340650Z [cluster2] I0718 14:13:56.546234 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6343347Z [cluster2] I0718 14:14:00.484877 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6345144Z [cluster2] I0718 14:14:00.484943 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6346549Z [cluster2] I0718 14:14:00.484954 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6349005Z [cluster2] I0718 14:14:00.507832 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6352247Z [cluster2] I0718 14:14:00.521844 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6355557Z [cluster2] I0718 14:14:01.023380 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6358751Z [cluster2] I0718 14:14:01.029876 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6361448Z [cluster2] I0718 14:14:01.042209 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6363115Z [cluster2] I0718 14:14:01.042251 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6364480Z [cluster2] I0718 14:14:01.042276 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6366451Z [cluster2] I0718 14:14:01.046257 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6368113Z [cluster2] I0718 14:14:01.046296 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6369479Z [cluster2] I0718 14:14:01.046308 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6372043Z [cluster2] I0718 14:14:01.054049 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6375217Z [cluster2] I0718 14:14:01.098349 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6378427Z [cluster2] I0718 14:14:01.109083 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6381762Z [cluster2] I0718 14:14:01.131331 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6389045Z [cluster2] I0718 14:14:01.611035 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6394165Z [cluster2] I0718 14:14:01.630823 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6397498Z [cluster2] I0718 14:14:01.638860 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6400711Z [cluster2] I0718 14:14:01.667798 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6403561Z [cluster2] I0718 14:14:05.530358 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6405800Z [cluster2] I0718 14:14:05.530410 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6407210Z [cluster2] I0718 14:14:05.530420 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6409736Z [cluster2] I0718 14:14:05.547699 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6412952Z [cluster2] I0718 14:14:05.555196 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6416163Z [cluster2] I0718 14:14:06.056692 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6419343Z [cluster2] I0718 14:14:06.064076 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6422195Z [cluster2] I0718 14:14:06.083812 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6423873Z [cluster2] I0718 14:14:06.083859 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6425467Z [cluster2] I0718 14:14:06.083869 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6427438Z [cluster2] I0718 14:14:06.084500 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6429106Z [cluster2] I0718 14:14:06.084678 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6430490Z [cluster2] I0718 14:14:06.084767 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6432958Z [cluster2] I0718 14:14:06.101825 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6436137Z [cluster2] I0718 14:14:06.104427 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6439356Z [cluster2] I0718 14:14:06.114352 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6442710Z [cluster2] I0718 14:14:06.127183 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6445929Z [cluster2] I0718 14:14:06.615924 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6449098Z [cluster2] I0718 14:14:06.623009 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6452293Z [cluster2] I0718 14:14:06.632682 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6455454Z [cluster2] I0718 14:14:06.646167 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6458172Z [cluster2] I0718 14:14:10.560518 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6459844Z [cluster2] I0718 14:14:10.560704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6461283Z [cluster2] I0718 14:14:10.560722 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6463762Z [cluster2] I0718 14:14:10.569471 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6467440Z [cluster2] I0718 14:14:10.573625 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6470965Z [cluster2] I0718 14:14:11.075665 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6474206Z [cluster2] I0718 14:14:11.087363 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6480787Z [cluster2] I0718 14:14:11.128600 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6483036Z [cluster2] I0718 14:14:11.128653 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6492814Z [cluster2] I0718 14:14:11.128664 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6499799Z [cluster2] I0718 14:14:11.129876 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:14.6501614Z [cluster2] I0718 14:14:11.129931 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-18T14:14:14.6503165Z [cluster2] I0718 14:14:11.129946 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-18T14:14:14.6505926Z [cluster2] I0718 14:14:11.163710 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6520479Z [cluster2] I0718 14:14:11.171676 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:14.6523785Z [cluster2] I0718 14:14:11.190365 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6527286Z [cluster2] I0718 14:14:11.192473 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:14.6530469Z [cluster2] I0718 14:14:11.691976 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6542883Z [cluster2] I0718 14:14:11.695964 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:14.6546617Z [cluster2] I0718 14:14:11.706449 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.0905716Z [cluster2] I0718 14:14:11.719970 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Reqrator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-18T14:14:15.0907064Z [cluster1] "lastState": {
2021-07-18T14:14:15.0907605Z [cluster1] "terminated": {
2021-07-18T14:14:15.0909619Z [cluster1] "containerID": "containerd://f4b3faa54bd50d0f5c372544b9badd78041c47b5adbfaad4a2a5c0920db6a642",
2021-07-18T14:14:15.0911530Z [cluster1] "exitCode": 1,
2021-07-18T14:14:15.0912743Z [cluster1] "finishedAt": "2021-07-18T14:12:54Z",
2021-07-18T14:14:15.0913323Z [cluster1] "reason": "Error",
2021-07-18T14:14:15.0914095Z [cluster1] "startedAt": "2021-07-18T14:12:48Z"
2021-07-18T14:14:15.0914607Z [cluster1] }
2021-07-18T14:14:15.0915022Z [cluster1] },
2021-07-18T14:14:15.0915785Z [cluster1] "name": "submariner-operator",
2021-07-18T14:14:15.0916408Z [cluster1] "ready": true,
2021-07-18T14:14:15.0917057Z [cluster1] "restartCount": 1,
2021-07-18T14:14:15.0917608Z [cluster1] "started": true,
2021-07-18T14:14:15.0918107Z [cluster1] "state": {
2021-07-18T14:14:15.0918582Z [cluster1] "running": {
2021-07-18T14:14:15.0919408Z [cluster1] "startedAt": "2021-07-18T14:12:55Z"
2021-07-18T14:14:15.0919911Z [cluster1] }
2021-07-18T14:14:15.0920339Z [cluster1] }
2021-07-18T14:14:15.0920759Z [cluster1] }
2021-07-18T14:14:15.0921157Z [cluster1] ],
2021-07-18T14:14:15.0921805Z [cluster1] "hostIP": "172.18.0.5",
2021-07-18T14:14:15.0922319Z [cluster1] "phase": "Running",
2021-07-18T14:14:15.0922834Z [cluster1] "podIP": "10.1.128.2",
2021-07-18T14:14:15.0923306Z [cluster1] "podIPs": [
2021-07-18T14:14:15.0923751Z [cluster1] {
2021-07-18T14:14:15.0924186Z [cluster1] "ip": "10.1.128.2"
2021-07-18T14:14:15.0924623Z [cluster1] }
2021-07-18T14:14:15.0925022Z [cluster1] ],
2021-07-18T14:14:15.0925535Z [cluster1] "qosClass": "BestEffort",
2021-07-18T14:14:15.0926312Z [cluster1] "startTime": "2021-07-18T14:12:47Z"
2021-07-18T14:14:15.0926798Z [cluster1] }
2021-07-18T14:14:15.0927195Z [cluster1] }
2021-07-18T14:14:15.0928787Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:14:15.0931285Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:14:15.0932933Z [submariner-operator]$ [cluster1] grep Running
2021-07-18T14:14:15.0934875Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:14:15.0936321Z [cluster1] Running
2021-07-18T14:14:15.0937755Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator
2021-07-18T14:14:15.0940071Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator
2021-07-18T14:14:15.0942387Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-nsc7t --namespace=submariner-operator
2021-07-18T14:14:15.0943986Z [cluster1] I0718 14:12:55.471258 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-18T14:14:15.0944696Z [cluster1] I0718 14:12:55.471311 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-18T14:14:15.0946057Z [cluster1] I0718 14:12:55.471318 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-18T14:14:15.0947185Z [cluster1] I0718 14:12:55.471328 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-18T14:14:15.0948156Z [cluster1] I0718 14:12:55.471519 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-18T14:14:15.0949188Z [cluster1] I0718 14:12:55.978585 1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-18T14:14:15.0950129Z [cluster1] I0718 14:12:55.978616 1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-18T14:14:15.0951471Z [cluster1] I0718 14:12:56.484186 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-18T14:14:15.0952530Z [cluster1] I0718 14:12:56.484493 1 main.go:129] cmd "msg"="Registering Components."
2021-07-18T14:14:15.0953347Z [cluster1] I0718 14:12:56.484582 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-18T14:14:15.0954422Z [cluster1] I0718 14:12:59.614631 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.0956281Z [cluster1] I0718 14:12:59.614661 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.0957609Z [cluster1] I0718 14:12:59.614821 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-18T14:14:15.0958751Z [cluster1] I0718 14:12:59.615048 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-18T14:14:15.1048378Z [cluster1] I0718 14:12:59.615360 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-18T14:14:15.1052125Z [cluster1] I0718 14:12:59.615622 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:14:15.1059127Z [cluster1] I0718 14:12:59.616047 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:14:15.1068255Z [cluster1] I0718 14:12:59.616410 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:14:15.1075953Z [cluster1] I0718 14:12:59.616575 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:14:15.1079661Z [cluster1] I0718 14:12:59.618960 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:14:15.1081934Z [cluster1] I0718 14:12:59.716430 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1084102Z [cluster1] I0718 14:12:59.716543 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-18T14:14:15.1086251Z [cluster1] I0718 14:12:59.723139 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-18T14:14:15.1089349Z [cluster1] I0718 14:12:59.724250 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:14:15.1093762Z [cluster1] I0718 14:12:59.724509 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-18T14:14:15.1097950Z [cluster1] I0718 14:12:59.724744 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:14:15.1100768Z [cluster1] I0718 14:12:59.825473 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-18T14:14:15.1102669Z [cluster1] I0718 14:12:59.825515 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-18T14:14:15.1110308Z [cluster1] I0718 14:12:59.825638 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-18T14:14:15.1113336Z [cluster1] I0718 14:12:59.825688 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-18T14:14:15.1115889Z [cluster1] I0718 14:12:59.825791 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1119132Z [cluster1] I0718 14:12:59.826112 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-18T14:14:15.1131892Z [cluster1] E0718 14:12:59.904163 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1134952Z [cluster1] I0718 14:12:59.926529 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-18T14:14:15.1136851Z [cluster1] I0718 14:12:59.926718 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-18T14:14:15.1140403Z [cluster1] I0718 14:12:59.926885 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1142018Z [cluster1] I0718 14:12:59.931479 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-18T14:14:15.1143784Z [cluster1] I0718 14:12:59.931537 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-18T14:14:15.1145382Z [cluster1] I0718 14:12:59.931557 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1146751Z [cluster1] I0718 14:12:59.931612 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1149507Z [cluster1] I0718 14:12:59.938967 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1155784Z [cluster1] E0718 14:12:59.939076 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-18T14:14:15.1159115Z [cluster1] I0718 14:12:59.944222 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1160796Z [cluster1] I0718 14:12:59.944288 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1162194Z [cluster1] I0718 14:12:59.944362 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1164710Z [cluster1] I0718 14:12:59.973215 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1168504Z [cluster1] E0718 14:13:00.048789 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1171911Z [cluster1] I0718 14:13:00.136965 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1185160Z [cluster1] I0718 14:13:00.303378 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-18T14:14:15.1187115Z [cluster1] I0718 14:13:00.303554 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-18T14:14:15.1188601Z [cluster1] I0718 14:13:00.303633 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1190257Z [cluster1] I0718 14:13:00.303718 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1194972Z [cluster1] I0718 14:13:00.315811 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1198316Z [cluster1] I0718 14:13:00.363777 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1201955Z [cluster1] E0718 14:13:00.364759 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1206274Z [cluster1] I0718 14:13:00.646451 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1209558Z [cluster1] E0718 14:13:00.655965 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1213487Z [cluster1] I0718 14:13:00.661200 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1216463Z [cluster1] I0718 14:13:00.681441 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1219156Z [cluster1] I0718 14:13:00.681697 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1222068Z [cluster1] I0718 14:13:00.728156 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-18T14:14:15.1226540Z [cluster1] I0718 14:13:00.801281 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1230400Z [cluster1] I0718 14:13:00.867227 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1234431Z [cluster1] E0718 14:13:01.277422 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-18T14:14:15.1238141Z [cluster1] I0718 14:13:01.277478 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1240624Z [cluster1] I0718 14:13:01.292357 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1242295Z [cluster1] I0718 14:13:01.292532 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1243667Z [cluster1] I0718 14:13:01.292624 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1246179Z [cluster1] I0718 14:13:01.932998 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1250523Z [cluster1] I0718 14:13:01.999643 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1254025Z [cluster1] I0718 14:13:02.069828 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1258370Z [cluster1] E0718 14:13:02.387811 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1261529Z [cluster1] I0718 14:13:02.387864 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1263078Z [cluster1] I0718 14:13:02.387898 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1264361Z [cluster1] I0718 14:13:02.387908 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1266872Z [cluster1] I0718 14:13:02.447960 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1277136Z [cluster1] I0718 14:13:02.493255 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1281156Z [cluster1] I0718 14:13:02.511710 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1284540Z [cluster1] I0718 14:13:02.555708 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1288075Z [cluster1] I0718 14:13:02.570441 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1291643Z [cluster1] E0718 14:13:02.583084 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1295245Z [cluster1] I0718 14:13:02.598903 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1299905Z [cluster1] I0718 14:13:02.657129 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-18T14:14:15.1303834Z [cluster1] I0718 14:13:02.685640 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1308182Z [cluster1] I0718 14:13:03.157808 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1311970Z [cluster1] E0718 14:13:03.157852 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"
2021-07-18T14:14:15.1316568Z [cluster1] E0718 14:13:03.157887 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:14:15.1320397Z [cluster1] I0718 14:13:03.171707 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1323370Z [cluster1] I0718 14:13:03.233189 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1326664Z [cluster1] I0718 14:13:03.234722 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1329657Z [cluster1] I0718 14:13:03.237423 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1332926Z [cluster1] I0718 14:13:03.311072 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1336166Z [cluster1] I0718 14:13:03.327093 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1339675Z [cluster1] I0718 14:13:03.327776 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1343450Z [cluster1] I0718 14:13:03.451743 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1347461Z [cluster1] E0718 14:13:03.454765 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1351557Z [cluster1] I0718 14:13:03.456412 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1354566Z [cluster1] I0718 14:13:03.460955 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1356224Z [cluster1] I0718 14:13:03.460984 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1357603Z [cluster1] I0718 14:13:03.460994 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1359566Z [cluster1] I0718 14:13:03.462038 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1361201Z [cluster1] I0718 14:13:03.462063 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1362580Z [cluster1] I0718 14:13:03.462073 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1365212Z [cluster1] I0718 14:13:03.546305 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1368730Z [cluster1] I0718 14:13:03.547619 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1372174Z [cluster1] I0718 14:13:03.741935 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1375220Z [cluster1] E0718 14:13:03.839612 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1379828Z [cluster1] I0718 14:13:03.841703 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1383124Z [cluster1] I0718 14:13:03.906197 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1386930Z [cluster1] I0718 14:13:03.995328 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1390573Z [cluster1] I0718 14:13:04.066417 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1394422Z [cluster1] I0718 14:13:04.077807 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1397379Z [cluster1] I0718 14:13:04.112319 1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1401943Z [cluster1] I0718 14:13:04.112366 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.12.18\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n"
2021-07-18T14:14:15.1405811Z [cluster1] I0718 14:13:04.122629 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1409178Z [cluster1] I0718 14:13:04.129550 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1412956Z [cluster1] I0718 14:13:04.152873 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1416123Z [cluster1] I0718 14:13:04.384220 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1419005Z [cluster1] I0718 14:13:04.412039 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1421932Z [cluster1] I0718 14:13:04.476819 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1425088Z [cluster1] I0718 14:13:04.478210 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1428761Z [cluster1] I0718 14:13:04.479314 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1433088Z [cluster1] I0718 14:13:04.656672 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1436340Z [cluster1] I0718 14:13:04.756355 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1440740Z [cluster1] I0718 14:13:04.756396 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.12.18\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n"
2021-07-18T14:14:15.1444948Z [cluster1] I0718 14:13:05.021247 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1448740Z [cluster1] I0718 14:13:05.086942 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1452330Z [cluster1] E0718 14:13:05.105931 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1456072Z [cluster1] I0718 14:13:05.137693 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1459719Z [cluster1] I0718 14:13:05.656257 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1463495Z [cluster1] E0718 14:13:05.656614 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1466544Z [cluster1] I0718 14:13:05.665801 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1470591Z [cluster1] I0718 14:13:05.665848 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.12.18\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n"
2021-07-18T14:14:15.1475528Z [cluster1] E0718 14:13:06.626797 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1481038Z [cluster1] E0718 14:13:08.117384 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1484428Z [cluster1] E0718 14:13:10.947487 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1487770Z [cluster1] E0718 14:13:16.239322 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1490490Z [cluster1] I0718 14:13:17.170060 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1492136Z [cluster1] I0718 14:13:17.170103 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1493521Z [cluster1] I0718 14:13:17.170113 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1496087Z [cluster1] I0718 14:13:17.233808 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1500125Z [cluster1] I0718 14:13:17.298609 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1506579Z [cluster1] I0718 14:13:17.804992 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1510027Z [cluster1] I0718 14:13:17.818409 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1514603Z [cluster1] I0718 14:13:17.873119 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1516603Z [cluster1] I0718 14:13:17.873163 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1518432Z [cluster1] I0718 14:13:17.873173 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1520512Z [cluster1] I0718 14:13:17.874333 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1522174Z [cluster1] I0718 14:13:17.874359 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1523553Z [cluster1] I0718 14:13:17.874368 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1526539Z [cluster1] I0718 14:13:17.939033 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1530151Z [cluster1] I0718 14:13:17.952463 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1533427Z [cluster1] I0718 14:13:18.004503 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1536677Z [cluster1] I0718 14:13:18.032694 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1539887Z [cluster1] I0718 14:13:18.515627 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1543563Z [cluster1] I0718 14:13:18.526129 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1547298Z [cluster1] I0718 14:13:18.545407 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1549736Z [cluster1] I0718 14:13:18.652395 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1551288Z [cluster1] I0718 14:13:18.652452 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1552568Z [cluster1] I0718 14:13:18.652463 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1555165Z [cluster1] I0718 14:13:19.465800 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1559020Z [cluster1] I0718 14:13:19.466591 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1562425Z [cluster1] E0718 14:13:19.478767 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1565188Z [cluster1] I0718 14:13:19.478807 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1566737Z [cluster1] I0718 14:13:19.478844 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1568137Z [cluster1] I0718 14:13:19.478854 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1570432Z [cluster1] I0718 14:13:19.497092 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1573418Z [cluster1] I0718 14:13:19.499004 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1576491Z [cluster1] I0718 14:13:19.508710 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1582778Z [cluster1] I0718 14:13:20.013514 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1586115Z [cluster1] I0718 14:13:20.038332 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1589482Z [cluster1] I0718 14:13:20.089286 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1593987Z [cluster1] I0718 14:13:20.122908 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1597703Z [cluster1] E0718 14:13:20.123453 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1600705Z [cluster1] I0718 14:13:20.123495 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1603099Z [cluster1] I0718 14:13:20.123531 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1604590Z [cluster1] I0718 14:13:20.123541 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1606928Z [cluster1] I0718 14:13:20.149873 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1609929Z [cluster1] I0718 14:13:20.202341 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1612999Z [cluster1] I0718 14:13:20.721142 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1615937Z [cluster1] I0718 14:13:20.829527 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1618454Z [cluster1] I0718 14:13:20.865445 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1620301Z [cluster1] I0718 14:13:20.865485 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1621604Z [cluster1] I0718 14:13:20.865494 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1623445Z [cluster1] I0718 14:13:20.907255 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1625271Z [cluster1] I0718 14:13:20.907301 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1626548Z [cluster1] I0718 14:13:20.907312 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1628944Z [cluster1] I0718 14:13:20.946188 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1632098Z [cluster1] I0718 14:13:20.962414 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1635112Z [cluster1] I0718 14:13:21.024533 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1638151Z [cluster1] I0718 14:13:21.024795 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1641136Z [cluster1] I0718 14:13:21.530367 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1645102Z [cluster1] I0718 14:13:21.531285 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1648105Z [cluster1] I0718 14:13:21.619611 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1651616Z [cluster1] I0718 14:13:21.620336 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1655316Z [cluster1] I0718 14:13:22.615144 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1658661Z [cluster1] I0718 14:13:22.777989 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1662782Z [cluster1] I0718 14:13:22.819857 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1665658Z [cluster1] I0718 14:13:23.094367 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1667203Z [cluster1] I0718 14:13:23.098752 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1668486Z [cluster1] I0718 14:13:23.098777 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1670881Z [cluster1] I0718 14:13:23.381277 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1674019Z [cluster1] I0718 14:13:23.467992 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1678709Z [cluster1] I0718 14:13:23.510806 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1687194Z [cluster1] I0718 14:13:23.675394 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1690904Z [cluster1] I0718 14:13:23.946776 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1705392Z [cluster1] I0718 14:13:24.208982 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1708919Z [cluster1] I0718 14:13:24.449182 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1712542Z [cluster1] I0718 14:13:24.462843 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1715825Z [cluster1] I0718 14:13:24.472547 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1720611Z [cluster1] I0718 14:13:24.472669 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.12.18\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n"
2021-07-18T14:14:15.1724215Z [cluster1] I0718 14:13:24.604917 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1726299Z [cluster1] I0718 14:13:24.604966 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1728159Z [cluster1] I0718 14:13:24.604989 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1730188Z [cluster1] I0718 14:13:24.670739 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1731964Z [cluster1] I0718 14:13:24.670784 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1733338Z [cluster1] I0718 14:13:24.670808 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1735954Z [cluster1] I0718 14:13:24.825639 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1739195Z [cluster1] I0718 14:13:24.826233 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1742422Z [cluster1] I0718 14:13:24.861260 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1751274Z [cluster1] I0718 14:13:24.947584 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1756022Z [cluster1] I0718 14:13:25.382538 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1759210Z [cluster1] I0718 14:13:25.455285 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1773248Z [cluster1] I0718 14:13:25.485221 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1779186Z [cluster1] I0718 14:13:25.519130 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1786289Z [cluster1] I0718 14:13:25.562881 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1799496Z [cluster1] I0718 14:13:25.642156 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1830679Z [cluster1] I0718 14:13:25.865097 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1834720Z [cluster1] I0718 14:13:26.419581 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1838583Z [cluster1] I0718 14:13:26.482334 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1842488Z [cluster1] I0718 14:13:26.679998 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1846131Z [cluster1] E0718 14:13:26.987712 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.1849508Z [cluster1] I0718 14:13:27.194693 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1855324Z [cluster1] I0718 14:13:27.529307 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1888517Z [cluster1] I0718 14:13:27.529354 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.12.18\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n"
2021-07-18T14:14:15.1892449Z [cluster1] I0718 14:13:27.648819 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1896029Z [cluster1] I0718 14:13:27.671271 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1899850Z [cluster1] I0718 14:13:27.698837 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1906406Z [cluster1] I0718 14:13:28.201656 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1909359Z [cluster1] I0718 14:13:28.213708 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1911039Z [cluster1] I0718 14:13:28.213907 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1912424Z [cluster1] I0718 14:13:28.214004 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1916729Z [cluster1] I0718 14:13:28.229806 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:14:15.1920344Z [cluster1] I0718 14:13:28.247208 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1923936Z [cluster1] I0718 14:13:28.260210 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1927572Z [cluster1] I0718 14:13:28.273458 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1930696Z [cluster1] I0718 14:13:28.770013 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1933699Z [cluster1] I0718 14:13:28.776079 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1936495Z [cluster1] I0718 14:13:28.802974 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1941073Z [cluster1] I0718 14:13:28.803010 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.12.18\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n"
2021-07-18T14:14:15.1950526Z [cluster1] I0718 14:13:28.818351 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1953610Z [cluster1] I0718 14:13:28.834281 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1955285Z [cluster1] I0718 14:13:28.834325 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1956665Z [cluster1] I0718 14:13:28.834336 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1958758Z [cluster1] I0718 14:13:28.840734 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1960413Z [cluster1] I0718 14:13:28.840773 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1965463Z [cluster1] I0718 14:13:28.840783 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.1968093Z [cluster1] I0718 14:13:28.874405 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1971284Z [cluster1] I0718 14:13:28.880096 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1974475Z [cluster1] I0718 14:13:28.900533 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1977510Z [cluster1] I0718 14:13:28.948564 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.1980508Z [cluster1] I0718 14:13:29.402147 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1983968Z [cluster1] I0718 14:13:29.410822 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1988065Z [cluster1] I0718 14:13:29.449901 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.1991431Z [cluster1] I0718 14:13:29.457100 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.1994149Z [cluster1] I0718 14:13:43.564595 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.1995820Z [cluster1] I0718 14:13:43.564797 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.1997641Z [cluster1] I0718 14:13:43.564916 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2000854Z [cluster1] I0718 14:13:43.580133 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2005066Z [cluster1] I0718 14:13:43.587525 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2008531Z [cluster1] I0718 14:13:44.090084 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2011779Z [cluster1] I0718 14:13:44.100066 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2014612Z [cluster1] I0718 14:13:44.112648 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2021818Z [cluster1] I0718 14:13:44.112725 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2023363Z [cluster1] I0718 14:13:44.112743 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2025917Z [cluster1] I0718 14:13:44.112808 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2028204Z [cluster1] I0718 14:13:44.112848 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2029586Z [cluster1] I0718 14:13:44.112964 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2033338Z [cluster1] I0718 14:13:44.133460 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2040433Z [cluster1] I0718 14:13:44.138585 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2046337Z [cluster1] I0718 14:13:44.160922 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2049973Z [cluster1] I0718 14:13:44.187310 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2053550Z [cluster1] I0718 14:13:44.676147 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2056759Z [cluster1] I0718 14:13:44.683269 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2060562Z [cluster1] I0718 14:13:44.689881 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2063768Z [cluster1] I0718 14:13:44.701201 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2067396Z [cluster1] E0718 14:13:47.552808 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:14:15.2070954Z [cluster1] I0718 14:13:48.589371 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2072624Z [cluster1] I0718 14:13:48.589439 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2073995Z [cluster1] I0718 14:13:48.589450 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2076458Z [cluster1] I0718 14:13:48.599858 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2079687Z [cluster1] I0718 14:13:48.606962 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2082937Z [cluster1] I0718 14:13:49.108646 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2086666Z [cluster1] I0718 14:13:49.115220 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2089448Z [cluster1] I0718 14:13:49.134472 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2091111Z [cluster1] I0718 14:13:49.134651 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2092620Z [cluster1] I0718 14:13:49.134770 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2094577Z [cluster1] I0718 14:13:49.143950 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2096230Z [cluster1] I0718 14:13:49.143991 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2098281Z [cluster1] I0718 14:13:49.144002 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2101017Z [cluster1] I0718 14:13:49.145371 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2104242Z [cluster1] I0718 14:13:49.153152 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2108056Z [cluster1] I0718 14:13:49.156823 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2112043Z [cluster1] I0718 14:13:49.167523 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2115255Z [cluster1] I0718 14:13:49.660137 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2120067Z [cluster1] I0718 14:13:49.666145 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2123349Z [cluster1] I0718 14:13:49.671780 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2126554Z [cluster1] I0718 14:13:49.683318 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2129254Z [cluster1] I0718 14:13:53.616248 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2130926Z [cluster1] I0718 14:13:53.616331 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2132310Z [cluster1] I0718 14:13:53.616354 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2134754Z [cluster1] I0718 14:13:53.634776 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2138204Z [cluster1] I0718 14:13:53.643045 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2141456Z [cluster1] I0718 14:13:54.144212 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2144647Z [cluster1] I0718 14:13:54.149684 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2147826Z [cluster1] I0718 14:13:54.163189 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2149502Z [cluster1] I0718 14:13:54.163232 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2150888Z [cluster1] I0718 14:13:54.163243 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2152840Z [cluster1] I0718 14:13:54.163376 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2156001Z [cluster1] I0718 14:13:54.163528 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2157701Z [cluster1] I0718 14:13:54.163615 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2160042Z [cluster1] I0718 14:13:54.170377 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2163375Z [cluster1] I0718 14:13:54.172955 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2166605Z [cluster1] I0718 14:13:54.173472 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2169890Z [cluster1] I0718 14:13:54.186780 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2194907Z [cluster1] I0718 14:13:54.675290 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2198156Z [cluster1] I0718 14:13:54.681800 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2201520Z [cluster1] I0718 14:13:54.688108 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2206645Z [cluster1] I0718 14:13:54.699689 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2209461Z [cluster1] I0718 14:13:58.646918 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2211144Z [cluster1] I0718 14:13:58.646973 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2212526Z [cluster1] I0718 14:13:58.646991 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2215010Z [cluster1] I0718 14:13:58.662241 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2218224Z [cluster1] I0718 14:13:58.672751 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2221571Z [cluster1] I0718 14:13:59.174948 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2224871Z [cluster1] I0718 14:13:59.189461 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2228735Z [cluster1] I0718 14:13:59.201734 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2230389Z [cluster1] I0718 14:13:59.201844 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2231780Z [cluster1] I0718 14:13:59.201860 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2233747Z [cluster1] I0718 14:13:59.205687 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2235406Z [cluster1] I0718 14:13:59.205728 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2236775Z [cluster1] I0718 14:13:59.205742 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2239322Z [cluster1] I0718 14:13:59.215166 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2242559Z [cluster1] I0718 14:13:59.224098 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2246117Z [cluster1] I0718 14:13:59.224470 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2249380Z [cluster1] I0718 14:13:59.240852 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2252592Z [cluster1] I0718 14:13:59.725990 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2255806Z [cluster1] I0718 14:13:59.731518 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2259012Z [cluster1] I0718 14:13:59.744516 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2262737Z [cluster1] I0718 14:13:59.750723 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2265569Z [cluster1] I0718 14:14:03.690177 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2267107Z [cluster1] I0718 14:14:03.690239 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2268593Z [cluster1] I0718 14:14:03.690249 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2270917Z [cluster1] I0718 14:14:03.699258 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2274552Z [cluster1] I0718 14:14:03.705164 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2277769Z [cluster1] I0718 14:14:04.208141 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2281420Z [cluster1] I0718 14:14:04.217649 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2284469Z [cluster1] I0718 14:14:04.273741 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2286006Z [cluster1] I0718 14:14:04.273807 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2287386Z [cluster1] I0718 14:14:04.273820 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2290353Z [cluster1] I0718 14:14:04.289500 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2292022Z [cluster1] I0718 14:14:04.289563 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2293610Z [cluster1] I0718 14:14:04.289578 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2296189Z [cluster1] I0718 14:14:04.307220 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2299731Z [cluster1] I0718 14:14:04.309691 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2303341Z [cluster1] I0718 14:14:04.316175 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2307028Z [cluster1] I0718 14:14:04.337832 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2310226Z [cluster1] I0718 14:14:04.817617 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2313413Z [cluster1] I0718 14:14:04.827452 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2316869Z [cluster1] I0718 14:14:04.839822 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2320064Z [cluster1] I0718 14:14:04.845661 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2322770Z [cluster1] I0718 14:14:08.706776 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2324611Z [cluster1] I0718 14:14:08.706849 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2326017Z [cluster1] I0718 14:14:08.706860 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2328494Z [cluster1] I0718 14:14:08.729619 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2331925Z [cluster1] I0718 14:14:08.736717 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2334928Z [cluster1] I0718 14:14:09.239017 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2338551Z [cluster1] I0718 14:14:09.245642 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2346656Z [cluster1] I0718 14:14:09.261494 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2348220Z [cluster1] I0718 14:14:09.261700 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2349737Z [cluster1] I0718 14:14:09.261807 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2351748Z [cluster1] I0718 14:14:09.264220 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2353557Z [cluster1] I0718 14:14:09.264476 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2354931Z [cluster1] I0718 14:14:09.264583 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2357434Z [cluster1] I0718 14:14:09.278728 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2360660Z [cluster1] I0718 14:14:09.284189 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2363870Z [cluster1] I0718 14:14:09.286804 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2367079Z [cluster1] I0718 14:14:09.296480 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2370270Z [cluster1] I0718 14:14:09.786409 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2373454Z [cluster1] I0718 14:14:09.793024 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2376724Z [cluster1] I0718 14:14:09.802078 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2379890Z [cluster1] I0718 14:14:09.815607 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2382589Z [cluster1] I0718 14:14:13.728358 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2384248Z [cluster1] I0718 14:14:13.728413 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2386153Z [cluster1] I0718 14:14:13.728438 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2388690Z [cluster1] I0718 14:14:13.742217 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2393555Z [cluster1] I0718 14:14:13.749488 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:15.2396925Z [cluster1] I0718 14:14:14.251229 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:15.2400146Z [cluster1] I0718 14:14:14.260055 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.2402873Z [cluster1] I0718 14:14:14.275721 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.2404519Z [cluster1] I0718 14:14:14.276585 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:15.2405902Z [cluster1] I0718 14:14:14.276702 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:15.2407870Z [cluster1] I0718 14:14:14.287421 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:14:15.5423771Z [clusteruest.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:15.5427519Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-18T14:14:15.5429250Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-18T14:14:15.5431711Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:14:15.5434356Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:14:15.5436580Z [submariner-operator]$ [cluster2] grep submariner
2021-07-18T14:14:15.5439100Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-18T14:14:15.5440875Z [cluster2] submariner 69s
2021-07-18T14:14:15.5442750Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-18T14:14:15.5444858Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:15.5446386Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-18T14:14:15.5447904Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:15.5449840Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:15.5450874Z [cluster2] {
2021-07-18T14:14:15.5451444Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:14:15.5452096Z [cluster2] "kind": "Submariner",
2021-07-18T14:14:15.5452614Z [cluster2] "metadata": {
2021-07-18T14:14:15.5453422Z [cluster2] "creationTimestamp": "2021-07-18T14:13:06Z",
2021-07-18T14:14:15.5454033Z [cluster2] "generation": 1,
2021-07-18T14:14:15.5454589Z [cluster2] "managedFields": [
2021-07-18T14:14:15.5455073Z [cluster2] {
2021-07-18T14:14:15.5455679Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:14:15.5456370Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:15.5456938Z [cluster2] "fieldsV1": {
2021-07-18T14:14:15.5457436Z [cluster2] "f:spec": {
2021-07-18T14:14:15.5457890Z [cluster2] ".": {},
2021-07-18T14:14:15.5458368Z [cluster2] "f:broker": {},
2021-07-18T14:14:15.5459094Z [cluster2] "f:brokerK8sApiServer": {},
2021-07-18T14:14:15.5459888Z [cluster2] "f:brokerK8sApiServerToken": {},
2021-07-18T14:14:15.5460599Z [cluster2] "f:brokerK8sCA": {},
2021-07-18T14:14:15.5461335Z [cluster2] "f:brokerK8sRemoteNamespace": {},
2021-07-18T14:14:15.5462065Z [cluster2] "f:cableDriver": {},
2021-07-18T14:14:15.5462668Z [cluster2] "f:ceIPSecDebug": {},
2021-07-18T14:14:15.5463345Z [cluster2] "f:ceIPSecIKEPort": {},
2021-07-18T14:14:15.5463992Z [cluster2] "f:ceIPSecNATTPort": {},
2021-07-18T14:14:15.5464619Z [cluster2] "f:ceIPSecPSK": {},
2021-07-18T14:14:15.5465882Z [cluster2] "f:clusterCIDR": {},
2021-07-18T14:14:15.5466455Z [cluster2] "f:clusterID": {},
2021-07-18T14:14:15.5467001Z [cluster2] "f:colorCodes": {},
2021-07-18T14:14:15.5467694Z [cluster2] "f:connectionHealthCheck": {
2021-07-18T14:14:15.5468310Z [cluster2] ".": {},
2021-07-18T14:14:15.5468809Z [cluster2] "f:enabled": {},
2021-07-18T14:14:15.5469408Z [cluster2] "f:intervalSeconds": {},
2021-07-18T14:14:15.5470091Z [cluster2] "f:maxPacketLossCount": {}
2021-07-18T14:14:15.5470672Z [cluster2] },
2021-07-18T14:14:15.5471137Z [cluster2] "f:debug": {},
2021-07-18T14:14:15.5471660Z [cluster2] "f:namespace": {},
2021-07-18T14:14:15.5472209Z [cluster2] "f:natEnabled": {},
2021-07-18T14:14:15.5472777Z [cluster2] "f:repository": {},
2021-07-18T14:14:15.5473342Z [cluster2] "f:serviceCIDR": {},
2021-07-18T14:14:15.5474066Z [cluster2] "f:serviceDiscoveryEnabled": {},
2021-07-18T14:14:15.5474760Z [cluster2] "f:version": {}
2021-07-18T14:14:15.5475218Z [cluster2] }
2021-07-18T14:14:15.5475644Z [cluster2] },
2021-07-18T14:14:15.5476117Z [cluster2] "manager": "subctl",
2021-07-18T14:14:15.5476690Z [cluster2] "operation": "Update",
2021-07-18T14:14:15.5477538Z [cluster2] "time": "2021-07-18T14:13:06Z"
2021-07-18T14:14:15.5478157Z [cluster2] },
2021-07-18T14:14:15.5478706Z [cluster2] {
2021-07-18T14:14:15.5479316Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:14:15.5480002Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:15.5480569Z [cluster2] "fieldsV1": {
2021-07-18T14:14:15.5481079Z [cluster2] "f:status": {
2021-07-18T14:14:15.5481630Z [cluster2] ".": {},
2021-07-18T14:14:15.5482111Z [cluster2] "f:clusterCIDR": {},
2021-07-18T14:14:15.5482628Z [cluster2] "f:clusterID": {},
2021-07-18T14:14:15.5483148Z [cluster2] "f:colorCodes": {},
2021-07-18T14:14:15.5483697Z [cluster2] "f:deploymentInfo": {},
2021-07-18T14:14:15.5484386Z [cluster2] "f:gatewayDaemonSetStatus": {
2021-07-18T14:14:15.5484983Z [cluster2] ".": {},
2021-07-18T14:14:15.5485555Z [cluster2] "f:lastResourceVersion": {},
2021-07-18T14:14:15.5486330Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-18T14:14:15.5487150Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-18T14:14:15.5487786Z [cluster2] "f:status": {
2021-07-18T14:14:15.5488231Z [cluster2] ".": {},
2021-07-18T14:14:15.5489047Z [cluster2] "f:currentNumberScheduled": {},
2021-07-18T14:14:15.5489961Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-18T14:14:15.5490722Z [cluster2] "f:numberAvailable": {},
2021-07-18T14:14:15.5491510Z [cluster2] "f:numberMisscheduled": {},
2021-07-18T14:14:15.5492134Z [cluster2] "f:numberReady": {},
2021-07-18T14:14:15.5492760Z [cluster2] "f:observedGeneration": {},
2021-07-18T14:14:15.5493491Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-18T14:14:15.5494090Z [cluster2] }
2021-07-18T14:14:15.5494495Z [cluster2] },
2021-07-18T14:14:15.5494952Z [cluster2] "f:gateways": {},
2021-07-18T14:14:15.5495604Z [cluster2] "f:globalnetDaemonSetStatus": {
2021-07-18T14:14:15.5496234Z [cluster2] ".": {},
2021-07-18T14:14:15.5496863Z [cluster2] "f:mismatchedContainerImages": {}
2021-07-18T14:14:15.5497715Z [cluster2] },
2021-07-18T14:14:15.5528553Z [cluster2] "f:loadBalancerStatus": {},
2021-07-18T14:14:15.5529240Z [cluster2] "f:natEnabled": {},
2021-07-18T14:14:15.5529810Z [cluster2] "f:networkPlugin": {},
2021-07-18T14:14:15.5530526Z [cluster2] "f:routeAgentDaemonSetStatus": {
2021-07-18T14:14:15.5531193Z [cluster2] ".": {},
2021-07-18T14:14:15.5531750Z [cluster2] "f:lastResourceVersion": {},
2021-07-18T14:14:15.5532539Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-18T14:14:15.5533445Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-18T14:14:15.5534078Z [cluster2] "f:status": {
2021-07-18T14:14:15.5534535Z [cluster2] ".": {},
2021-07-18T14:14:15.5535380Z [cluster2] "f:currentNumberScheduled": {},
2021-07-18T14:14:15.5536316Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-18T14:14:15.5537062Z [cluster2] "f:numberAvailable": {},
2021-07-18T14:14:15.5537766Z [cluster2] "f:numberMisscheduled": {},
2021-07-18T14:14:15.5538422Z [cluster2] "f:numberReady": {},
2021-07-18T14:14:15.5539306Z [cluster2] "f:observedGeneration": {},
2021-07-18T14:14:15.5540114Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-18T14:14:15.5540750Z [cluster2] }
2021-07-18T14:14:15.5541190Z [cluster2] },
2021-07-18T14:14:15.5541699Z [cluster2] "f:serviceCIDR": {}
2021-07-18T14:14:15.5542212Z [cluster2] }
2021-07-18T14:14:15.5542670Z [cluster2] },
2021-07-18T14:14:15.5543736Z [cluster2] "manager": "submariner-operator",
2021-07-18T14:14:15.5544520Z [cluster2] "operation": "Update",
2021-07-18T14:14:15.5545852Z [cluster2] "time": "2021-07-18T14:13:44Z"
2021-07-18T14:14:15.5546328Z [cluster2] }
2021-07-18T14:14:15.5546732Z [cluster2] ],
2021-07-18T14:14:15.5547221Z [cluster2] "name": "submariner",
2021-07-18T14:14:15.5548067Z [cluster2] "namespace": "submariner-operator",
2021-07-18T14:14:15.5548800Z [cluster2] "resourceVersion": "2204",
2021-07-18T14:14:15.5550045Z [cluster2] "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-18T14:14:15.5551283Z [cluster2] "uid": "f54679c1-0105-4005-8e29-401e64628ca5"
2021-07-18T14:14:15.5551923Z [cluster2] },
2021-07-18T14:14:15.5552360Z [cluster2] "spec": {
2021-07-18T14:14:15.5552819Z [cluster2] "broker": "k8s",
2021-07-18T14:14:15.5553561Z [cluster2] "brokerK8sApiServer": "172.18.0.8:6443",
2021-07-18T14:14:15.5760002Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-18T14:14:15.6475190Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-18T14:14:15.7169561Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-18T14:14:15.7170543Z [cluster2] "cableDriver": "libreswan",
2021-07-18T14:14:15.7171201Z [cluster2] "ceIPSecDebug": false,
2021-07-18T14:14:15.7171819Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-18T14:14:15.7172457Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-18T14:14:15.7173497Z [cluster2] "ceIPSecPSK": "x9rD3nVFmFOuBKQK7uq/b8kF8w3P69CvoWu3GMZ5HuGVZJR/TZDQ30yF6Xp2Rg8y",
2021-07-18T14:14:15.7174471Z [cluster2] "clusterCIDR": "",
2021-07-18T14:14:15.7175039Z [cluster2] "clusterID": "cluster2",
2021-07-18T14:14:15.7175618Z [cluster2] "colorCodes": "blue",
2021-07-18T14:14:15.7176289Z [cluster2] "connectionHealthCheck": {
2021-07-18T14:14:15.7176931Z [cluster2] "enabled": true,
2021-07-18T14:14:15.7177768Z [cluster2] "intervalSeconds": 1,
2021-07-18T14:14:15.7178435Z [cluster2] "maxPacketLossCount": 5
2021-07-18T14:14:15.7178993Z [cluster2] },
2021-07-18T14:14:15.7179441Z [cluster2] "debug": false,
2021-07-18T14:14:15.7180316Z [cluster2] "namespace": "submariner-operator",
2021-07-18T14:14:15.7180992Z [cluster2] "natEnabled": false,
2021-07-18T14:14:15.7181587Z [cluster2] "repository": "localhost:5000",
2021-07-18T14:14:15.7182165Z [cluster2] "serviceCIDR": "",
2021-07-18T14:14:15.7224036Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-18T14:14:15.7225046Z [cluster2] "version": "local"
2021-07-18T14:14:15.7225511Z [cluster2] },
2021-07-18T14:14:15.7225951Z [cluster2] "status": {
2021-07-18T14:14:15.7226462Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-18T14:14:15.7227051Z [cluster2] "clusterID": "cluster2",
2021-07-18T14:14:15.7227617Z [cluster2] "colorCodes": "blue",
2021-07-18T14:14:15.7228285Z [cluster2] "deploymentInfo": {},
2021-07-18T14:14:15.7228979Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-18T14:14:15.7229747Z [cluster2] "lastResourceVersion": "2003",
2021-07-18T14:14:15.7230574Z [cluster2] "mismatchedContainerImages": false,
2021-07-18T14:14:15.7231447Z [cluster2] "nonReadyContainerStates": [],
2021-07-18T14:14:15.7232096Z [cluster2] "status": {
2021-07-18T14:14:15.7232723Z [cluster2] "currentNumberScheduled": 1,
2021-07-18T14:14:15.7233761Z [cluster2] "desiredNumberScheduled": 1,
2021-07-18T14:14:15.7234475Z [cluster2] "numberAvailable": 1,
2021-07-18T14:14:15.7235145Z [cluster2] "numberMisscheduled": 0,
2021-07-18T14:14:15.7235765Z [cluster2] "numberReady": 1,
2021-07-18T14:14:15.7236399Z [cluster2] "observedGeneration": 1,
2021-07-18T14:14:15.7237144Z [cluster2] "updatedNumberScheduled": 1
2021-07-18T14:14:15.7237764Z [cluster2] }
2021-07-18T14:14:15.7238168Z [cluster2] },
2021-07-18T14:14:15.7238625Z [cluster2] "gateways": [
2021-07-18T14:14:15.7239077Z [cluster2] {
2021-07-18T14:14:15.7239551Z [cluster2] "connections": [
2021-07-18T14:14:15.7240038Z [cluster2] {
2021-07-18T14:14:15.7240512Z [cluster2] "endpoint": {
2021-07-18T14:14:15.7241086Z [cluster2] "backend": "libreswan",
2021-07-18T14:14:15.7241663Z [cluster2] "backend_config": {
2021-07-18T14:14:15.7242811Z [cluster2] "natt-discovery-port": "4490",
2021-07-18T14:14:15.7243737Z [cluster2] "preferred-server": "false"
2021-07-18T14:14:15.7244334Z [cluster2] },
2021-07-18T14:14:15.7245407Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-7",
2021-07-18T14:14:15.7246376Z [cluster2] "cluster_id": "cluster1",
2021-07-18T14:14:15.8830537Z [cluster2] "healthCheckIP": "10.1.0.1",
2021-07-18T14:14:15.8832006Z [cluster2] "hostname": "cluster1-worker",
2021-07-18T14:14:15.8832676Z [cluster2] "nat_enabled": false,
2021-07-18T14:14:15.8833399Z [cluster2] "private_ip": "172.18.0.7",
2021-07-18T14:14:15.8834024Z [cluster2] "public_ip": "40.84.35.32",
2021-07-18T14:14:15.8834594Z [cluster2] "subnets": [
2021-07-18T14:14:15.8835119Z [cluster2] "100.1.0.0/16",
2021-07-18T14:14:15.8835598Z [cluster2] "10.1.0.0/16"
2021-07-18T14:14:15.8836044Z [cluster2] ]
2021-07-18T14:14:15.8836485Z [cluster2] },
2021-07-18T14:14:15.8836990Z [cluster2] "latencyRTT": {
2021-07-18T14:14:15.8837979Z [cluster2] "average": "182.223µs",
2021-07-18T14:14:15.8838712Z [cluster2] "last": "190.913µs",
2021-07-18T14:14:15.8839375Z [cluster2] "max": "287.819µs",
2021-07-18T14:14:15.8840043Z [cluster2] "min": "132.809µs",
2021-07-18T14:14:15.8840708Z [cluster2] "stdDev": "38.184µs"
2021-07-18T14:14:15.8841198Z [cluster2] },
2021-07-18T14:14:15.8841721Z [cluster2] "status": "connected",
2021-07-18T14:14:15.8842326Z [cluster2] "statusMessage": "",
2021-07-18T14:14:15.8843011Z [cluster2] "usingIP": "172.18.0.7"
2021-07-18T14:14:15.8843543Z [cluster2] }
2021-07-18T14:14:15.8843980Z [cluster2] ],
2021-07-18T14:14:15.8844471Z [cluster2] "haStatus": "active",
2021-07-18T14:14:15.8845056Z [cluster2] "localEndpoint": {
2021-07-18T14:14:15.8845650Z [cluster2] "backend": "libreswan",
2021-07-18T14:14:15.8846233Z [cluster2] "backend_config": {
2021-07-18T14:14:15.8847059Z [cluster2] "natt-discovery-port": "4490",
2021-07-18T14:14:15.8847963Z [cluster2] "preferred-server": "false"
2021-07-18T14:14:15.8848525Z [cluster2] },
2021-07-18T14:14:15.8849584Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-4",
2021-07-18T14:14:15.8850653Z [cluster2] "cluster_id": "cluster2",
2021-07-18T14:14:15.8851261Z [cluster2] "healthCheckIP": "10.2.0.1",
2021-07-18T14:14:15.8852125Z [cluster2] "hostname": "cluster2-worker",
2021-07-18T14:14:15.8852762Z [cluster2] "nat_enabled": false,
2021-07-18T14:14:15.8853330Z [cluster2] "private_ip": "172.18.0.4",
2021-07-18T14:14:15.8853863Z [cluster2] "public_ip": "40.84.35.32",
2021-07-18T14:14:15.8854388Z [cluster2] "subnets": [
2021-07-18T14:14:15.8854860Z [cluster2] "100.2.0.0/16",
2021-07-18T14:14:15.8855325Z [cluster2] "10.2.0.0/16"
2021-07-18T14:14:15.8855773Z [cluster2] ]
2021-07-18T14:14:15.8856187Z [cluster2] },
2021-07-18T14:14:15.8856816Z [cluster2] "statusFailure": "",
2021-07-18T14:14:15.8857685Z [cluster2] "version": "devel-1441a80"
2021-07-18T14:14:15.8858175Z [cluster2] }
2021-07-18T14:14:15.8858548Z [cluster2] ],
2021-07-18T14:14:15.8859142Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-18T14:14:15.8859960Z [cluster2] "mismatchedContainerImages": false
2021-07-18T14:14:15.8860585Z [cluster2] },
2021-07-18T14:14:15.8861088Z [cluster2] "loadBalancerStatus": {},
2021-07-18T14:14:15.8861679Z [cluster2] "natEnabled": false,
2021-07-18T14:14:15.8862422Z [cluster2] "networkPlugin": "weave-net",
2021-07-18T14:14:15.8863146Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-18T14:14:15.8863900Z [cluster2] "lastResourceVersion": "2059",
2021-07-18T14:14:15.8864657Z [cluster2] "mismatchedContainerImages": false,
2021-07-18T14:14:15.8865578Z [cluster2] "nonReadyContainerStates": [],
2021-07-18T14:14:15.8866174Z [cluster2] "status": {
2021-07-18T14:14:15.8866778Z [cluster2] "currentNumberScheduled": 3,
2021-07-18T14:14:15.8867698Z [cluster2] "desiredNumberScheduled": 3,
2021-07-18T14:14:15.8868430Z [cluster2] "numberAvailable": 3,
2021-07-18T14:14:15.8869082Z [cluster2] "numberMisscheduled": 0,
2021-07-18T14:14:15.8869713Z [cluster2] "numberReady": 3,
2021-07-18T14:14:15.8870351Z [cluster2] "observedGeneration": 1,
2021-07-18T14:14:15.8871090Z [cluster2] "updatedNumberScheduled": 3
2021-07-18T14:14:15.8871801Z [cluster2] }
2021-07-18T14:14:15.8872207Z [cluster2] },
2021-07-18T14:14:15.8872706Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-18T14:14:15.8873177Z [cluster2] }
2021-07-18T14:14:15.8873578Z [cluster2] }
2021-07-18T14:14:15.8874702Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:14:15.8876312Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:14:15.8877945Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-18T14:14:15.8879464Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:14:15.8880858Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:14:15.8882287Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-18T14:14:15.8883618Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-18T14:14:15.8884771Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-18T14:14:16.1163178Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-18T14:14:16.1164702Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-18T14:14:16.1166094Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-18T14:14:16.1167838Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-18T14:14:16.1169436Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.8:6443
2021-07-18T14:14:16.1170930Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.8:6443
2021-07-18T14:14:16.1172690Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-18T14:14:16.1422641Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:14:16.1678386Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:14:16.1683990Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-18T14:14:16.4359699Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKU1] I0718 14:14:14.287551 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:14:16.4798013Z [cluster1] I0718 14:14:14.287620 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:14:16.4801102Z [cluster1] I0718 14:14:14.304140 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:16.4804102Z [cluster1] I0718 14:14:14.304695 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:16.4807113Z [cluster1] I0718 14:14:14.317659 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:16.4810298Z [cluster1] I0718 14:14:14.317994 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:14:16.4813515Z [cluster1] I0718 14:14:14.820044 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:16.4816785Z [cluster1] I0718 14:14:14.821207 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:14:16.4820180Z [cluster1] I0718 14:14:14.835929 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:16.4823692Z [cluster1] I0718 14:14:14.865170 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:14:16.4832860Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-18T14:14:16.4833868Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-18T14:14:16.4835117Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:14:16.4836647Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:14:16.4837958Z [submariner-operator]$ [cluster1] grep submariner
2021-07-18T14:14:16.4839279Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-18T14:14:16.4840451Z [cluster1] submariner 76s
2021-07-18T14:14:16.4841529Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-18T14:14:16.4843095Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:16.4844579Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-18T14:14:16.4846121Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:16.4847914Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:16.4848946Z [cluster1] {
2021-07-18T14:14:16.4849518Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:14:16.4850175Z [cluster1] "kind": "Submariner",
2021-07-18T14:14:16.4850695Z [cluster1] "metadata": {
2021-07-18T14:14:16.4851484Z [cluster1] "creationTimestamp": "2021-07-18T14:12:59Z",
2021-07-18T14:14:16.4852285Z [cluster1] "generation": 1,
2021-07-18T14:14:16.4852837Z [cluster1] "managedFields": [
2021-07-18T14:14:16.4853344Z [cluster1] {
2021-07-18T14:14:16.4853932Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:14:16.4854646Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:16.4855207Z [cluster1] "fieldsV1": {
2021-07-18T14:14:16.4855715Z [cluster1] "f:spec": {
2021-07-18T14:14:16.4856174Z [cluster1] ".": {},
2021-07-18T14:14:16.4874530Z [cluster1] "f:broker": {},
2021-07-18T14:14:16.4875299Z [cluster1] "f:brokerK8sApiServer": {},
2021-07-18T14:14:16.4876086Z [cluster1] "f:brokerK8sApiServerToken": {},
2021-07-18T14:14:16.4876817Z [cluster1] "f:brokerK8sCA": {},
2021-07-18T14:14:16.4877657Z [cluster1] "f:brokerK8sRemoteNamespace": {},
2021-07-18T14:14:16.4878363Z [cluster1] "f:cableDriver": {},
2021-07-18T14:14:16.4879013Z [cluster1] "f:ceIPSecDebug": {},
2021-07-18T14:14:16.4879612Z [cluster1] "f:ceIPSecIKEPort": {},
2021-07-18T14:14:16.4880215Z [cluster1] "f:ceIPSecNATTPort": {},
2021-07-18T14:14:16.4880808Z [cluster1] "f:ceIPSecPSK": {},
2021-07-18T14:14:16.4881354Z [cluster1] "f:clusterCIDR": {},
2021-07-18T14:14:16.4881871Z [cluster1] "f:clusterID": {},
2021-07-18T14:14:16.4882564Z [cluster1] "f:colorCodes": {},
2021-07-18T14:14:16.4883223Z [cluster1] "f:connectionHealthCheck": {
2021-07-18T14:14:16.4883809Z [cluster1] ".": {},
2021-07-18T14:14:16.4884263Z [cluster1] "f:enabled": {},
2021-07-18T14:14:16.4884828Z [cluster1] "f:intervalSeconds": {},
2021-07-18T14:14:16.4885471Z [cluster1] "f:maxPacketLossCount": {}
2021-07-18T14:14:16.4886022Z [cluster1] },
2021-07-18T14:14:16.4886465Z [cluster1] "f:debug": {},
2021-07-18T14:14:16.4886940Z [cluster1] "f:namespace": {},
2021-07-18T14:14:16.4887462Z [cluster1] "f:natEnabled": {},
2021-07-18T14:14:16.4887973Z [cluster1] "f:repository": {},
2021-07-18T14:14:16.4888512Z [cluster1] "f:serviceCIDR": {},
2021-07-18T14:14:16.4889177Z [cluster1] "f:serviceDiscoveryEnabled": {},
2021-07-18T14:14:16.4889825Z [cluster1] "f:version": {}
2021-07-18T14:14:16.4890252Z [cluster1] }
2021-07-18T14:14:16.4890651Z [cluster1] },
2021-07-18T14:14:16.4891109Z [cluster1] "manager": "subctl",
2021-07-18T14:14:16.4891625Z [cluster1] "operation": "Update",
2021-07-18T14:14:16.4892507Z [cluster1] "time": "2021-07-18T14:12:59Z"
2021-07-18T14:14:16.4892932Z [cluster1] },
2021-07-18T14:14:16.4893327Z [cluster1] {
2021-07-18T14:14:16.4893877Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:14:16.4894536Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:16.4895056Z [cluster1] "fieldsV1": {
2021-07-18T14:14:16.4895528Z [cluster1] "f:status": {
2021-07-18T14:14:16.4895962Z [cluster1] ".": {},
2021-07-18T14:14:16.4896447Z [cluster1] "f:clusterCIDR": {},
2021-07-18T14:14:16.4896979Z [cluster1] "f:clusterID": {},
2021-07-18T14:14:16.4897487Z [cluster1] "f:colorCodes": {},
2021-07-18T14:14:16.4898050Z [cluster1] "f:deploymentInfo": {},
2021-07-18T14:14:16.4898728Z [cluster1] "f:gatewayDaemonSetStatus": {
2021-07-18T14:14:16.4899645Z [cluster1] ".": {},
2021-07-18T14:14:16.4900254Z [cluster1] "f:lastResourceVersion": {},
2021-07-18T14:14:16.4901112Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-18T14:14:16.4902001Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-18T14:14:16.4902700Z [cluster1] "f:status": {
2021-07-18T14:14:16.4903189Z [cluster1] ".": {},
2021-07-18T14:14:16.4903832Z [cluster1] "f:currentNumberScheduled": {},
2021-07-18T14:14:16.4904692Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-18T14:14:16.4946451Z [cluster1] "f:numberAvailable": {},
2021-07-18T14:14:16.4947292Z [cluster1] "f:numberMisscheduled": {},
2021-07-18T14:14:16.4948214Z [cluster1] "f:numberReady": {},
2021-07-18T14:14:16.4948916Z [cluster1] "f:observedGeneration": {},
2021-07-18T14:14:16.4949725Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-18T14:14:16.4950363Z [cluster1] }
2021-07-18T14:14:16.4950811Z [cluster1] },
2021-07-18T14:14:16.4951293Z [cluster1] "f:gateways": {},
2021-07-18T14:14:16.4952013Z [cluster1] "f:globalnetDaemonSetStatus": {
2021-07-18T14:14:16.4952860Z [cluster1] ".": {},
2021-07-18T14:14:16.4953566Z [cluster1] "f:mismatchedContainerImages": {}
2021-07-18T14:14:16.4954233Z [cluster1] },
2021-07-18T14:14:16.4954929Z [cluster1] "f:loadBalancerStatus": {},
2021-07-18T14:14:16.4955564Z [cluster1] "f:natEnabled": {},
2021-07-18T14:14:16.4956174Z [cluster1] "f:networkPlugin": {},
2021-07-18T14:14:16.4956961Z [cluster1] "f:routeAgentDaemonSetStatus": {
2021-07-18T14:14:16.4957643Z [cluster1] ".": {},
2021-07-18T14:14:16.4958261Z [cluster1] "f:lastResourceVersion": {},
2021-07-18T14:14:16.4959164Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-18T14:14:16.4960077Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-18T14:14:16.4960709Z [cluster1] "f:status": {
2021-07-18T14:14:16.4961322Z [cluster1] ".": {},
2021-07-18T14:14:16.4962193Z [cluster1] "f:currentNumberScheduled": {},
2021-07-18T14:14:16.4963084Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-18T14:14:16.4963912Z [cluster1] "f:numberAvailable": {},
2021-07-18T14:14:16.4964641Z [cluster1] "f:numberMisscheduled": {},
2021-07-18T14:14:16.4965388Z [cluster1] "f:numberReady": {},
2021-07-18T14:14:16.4966077Z [cluster1] "f:observedGeneration": {},
2021-07-18T14:14:16.4966948Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-18T14:14:16.4967612Z [cluster1] }
2021-07-18T14:14:16.4968115Z [cluster1] },
2021-07-18T14:14:16.4968820Z [cluster1] "f:serviceCIDR": {}
2021-07-18T14:14:16.4969352Z [cluster1] }
2021-07-18T14:14:16.4969850Z [cluster1] },
2021-07-18T14:14:16.4970878Z [cluster1] "manager": "submariner-operator",
2021-07-18T14:14:16.4971633Z [cluster1] "operation": "Update",
2021-07-18T14:14:16.4972392Z [cluster1] "time": "2021-07-18T14:13:28Z"
2021-07-18T14:14:16.4972961Z [cluster1] }
2021-07-18T14:14:16.4973392Z [cluster1] ],
2021-07-18T14:14:16.4974046Z [cluster1] "name": "submariner",
2021-07-18T14:14:16.4975018Z [cluster1] "namespace": "submariner-operator",
2021-07-18T14:14:16.4975806Z [cluster1] "resourceVersion": "2313",
2021-07-18T14:14:16.4977162Z [cluster1] "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-18T14:14:16.4978533Z [cluster1] "uid": "8eecc600-8ce0-49ac-8d1c-3126d1cbc09b"
2021-07-18T14:14:16.4979351Z [cluster1] },
2021-07-18T14:14:16.4979804Z [cluster1] "spec": {
2021-07-18T14:14:16.4991100Z [cluster1] "broker": "k8s",
2021-07-18T14:14:16.4991704Z [cluster1] "brokerK8sApiServer": "172.18.0.8:6443",
2021-07-18T14:14:16.5176168Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-18T14:14:16.5856814Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-18T14:14:16.6415455Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-18T14:14:16.6416430Z [cluster1] "cableDriver": "libreswan",
2021-07-18T14:14:16.6417067Z [cluster1] "ceIPSecDebug": false,
2021-07-18T14:14:16.6417728Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-18T14:14:16.6418346Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-18T14:14:16.6419376Z [cluster1] "ceIPSecPSK": "x9rD3nVFmFOuBKQK7uq/b8kF8w3P69CvoWu3GMZ5HuGVZJR/TZDQ30yF6Xp2Rg8y",
2021-07-18T14:14:16.6420356Z [cluster1] "clusterCIDR": "",
2021-07-18T14:14:16.6420921Z [cluster1] "clusterID": "cluster1",
2021-07-18T14:14:16.6421502Z [cluster1] "colorCodes": "blue",
2021-07-18T14:14:16.6422295Z [cluster1] "connectionHealthCheck": {
2021-07-18T14:14:16.6422953Z [cluster1] "enabled": true,
2021-07-18T14:14:16.6423523Z [cluster1] "intervalSeconds": 1,
2021-07-18T14:14:16.6424195Z [cluster1] "maxPacketLossCount": 5
2021-07-18T14:14:16.6424885Z [cluster1] },
2021-07-18T14:14:16.6425354Z [cluster1] "debug": false,
2021-07-18T14:14:16.6426236Z [cluster1] "namespace": "submariner-operator",
2021-07-18T14:14:16.6426914Z [cluster1] "natEnabled": false,
2021-07-18T14:14:16.6427523Z [cluster1] "repository": "localhost:5000",
2021-07-18T14:14:16.6428102Z [cluster1] "serviceCIDR": "",
2021-07-18T14:14:16.6428815Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-18T14:14:16.6429500Z [cluster1] "version": "local"
2021-07-18T14:14:16.6429965Z [cluster1] },
2021-07-18T14:14:16.6430385Z [cluster1] "status": {
2021-07-18T14:14:16.6430905Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-18T14:14:16.6431709Z [cluster1] "clusterID": "cluster1",
2021-07-18T14:14:16.6432296Z [cluster1] "colorCodes": "blue",
2021-07-18T14:14:16.6432883Z [cluster1] "deploymentInfo": {},
2021-07-18T14:14:16.6433577Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-18T14:14:16.6434350Z [cluster1] "lastResourceVersion": "1973",
2021-07-18T14:14:16.6435168Z [cluster1] "mismatchedContainerImages": false,
2021-07-18T14:14:16.6436051Z [cluster1] "nonReadyContainerStates": [],
2021-07-18T14:14:16.6436696Z [cluster1] "status": {
2021-07-18T14:14:16.6437336Z [cluster1] "currentNumberScheduled": 1,
2021-07-18T14:14:16.6438153Z [cluster1] "desiredNumberScheduled": 1,
2021-07-18T14:14:16.6438864Z [cluster1] "numberAvailable": 1,
2021-07-18T14:14:16.6439532Z [cluster1] "numberMisscheduled": 0,
2021-07-18T14:14:16.6440151Z [cluster1] "numberReady": 1,
2021-07-18T14:14:16.6440783Z [cluster1] "observedGeneration": 1,
2021-07-18T14:14:16.6441533Z [cluster1] "updatedNumberScheduled": 1
2021-07-18T14:14:16.6442140Z [cluster1] }
2021-07-18T14:14:16.6442555Z [cluster1] },
2021-07-18T14:14:16.6442996Z [cluster1] "gateways": [
2021-07-18T14:14:16.6443451Z [cluster1] {
2021-07-18T14:14:16.6443922Z [cluster1] "connections": [
2021-07-18T14:14:16.6444416Z [cluster1] {
2021-07-18T14:14:16.6444885Z [cluster1] "endpoint": {
2021-07-18T14:14:16.6445555Z [cluster1] "backend": "libreswan",
2021-07-18T14:14:16.6446133Z [cluster1] "backend_config": {
2021-07-18T14:14:16.6447020Z [cluster1] "natt-discovery-port": "4490",
2021-07-18T14:14:16.6447934Z [cluster1] "preferred-server": "false"
2021-07-18T14:14:16.6448529Z [cluster1] },
2021-07-18T14:14:16.6449619Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-4",
2021-07-18T14:14:16.6450567Z [cluster1] "cluster_id": "cluster2",
2021-07-18T14:14:16.6451198Z [cluster1] "healthCheckIP": "10.2.0.1",
2021-07-18T14:14:16.6452054Z [cluster1] "hostname": "cluster2-worker",
2021-07-18T14:14:16.6452711Z [cluster1] "nat_enabled": false,
2021-07-18T14:14:16.6453277Z [cluster1] "private_ip": "172.18.0.4",
2021-07-18T14:14:16.6453837Z [cluster1] "public_ip": "40.84.35.32",
2021-07-18T14:14:16.6454372Z [cluster1] "subnets": [
2021-07-18T14:14:16.6454858Z [cluster1] "100.2.0.0/16",
2021-07-18T14:14:16.6455334Z [cluster1] "10.2.0.0/16"
2021-07-18T14:14:16.6455778Z [cluster1] ]
2021-07-18T14:14:16.6456231Z [cluster1] },
2021-07-18T14:14:16.6456720Z [cluster1] "latencyRTT": {
2021-07-18T14:14:16.6457480Z [cluster1] "average": "372.615µs",
2021-07-18T14:14:16.6458170Z [cluster1] "last": "117.208µs",
2021-07-18T14:14:16.6458678Z [cluster1] "max": "6.803961ms",
2021-07-18T14:14:16.6459331Z [cluster1] "min": "103.407µs",
2021-07-18T14:14:16.6459850Z [cluster1] "stdDev": "1.157822ms"
2021-07-18T14:14:16.6460346Z [cluster1] },
2021-07-18T14:14:16.6460852Z [cluster1] "status": "connected",
2021-07-18T14:14:16.6461458Z [cluster1] "statusMessage": "",
2021-07-18T14:14:16.6462023Z [cluster1] "usingIP": "172.18.0.4"
2021-07-18T14:14:16.6462503Z [cluster1] }
2021-07-18T14:14:16.6462919Z [cluster1] ],
2021-07-18T14:14:16.6463494Z [cluster1] "haStatus": "active",
2021-07-18T14:14:16.6464063Z [cluster1] "localEndpoint": {
2021-07-18T14:14:16.6464662Z [cluster1] "backend": "libreswan",
2021-07-18T14:14:16.6466334Z [cluster1] "backend_config": {
2021-07-18T14:14:16.6467264Z [cluster1] "natt-discovery-port": "4490",
2021-07-18T14:14:16.6468178Z [cluster1] "preferred-server": "false"
2021-07-18T14:14:16.6468756Z [cluster1] },
2021-07-18T14:14:16.6469830Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-7",
2021-07-18T14:14:16.6470774Z [cluster1] "cluster_id": "cluster1",
2021-07-18T14:14:16.6471402Z [cluster1] "healthCheckIP": "10.1.0.1",
2021-07-18T14:14:16.8118137Z [clustkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:16.8887338Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:16.9668004Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9669749Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:14:16.9671583Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:14:16.9673420Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9674932Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:14:16.9676170Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:14:16.9677588Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9679278Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:14:16.9680641Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:14:16.9682160Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9683939Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:14:16.9685310Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:14:16.9686874Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9688404Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-18T14:14:16.9689723Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-18T14:14:16.9691199Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9692565Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-18T14:14:16.9693774Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-18T14:14:16.9695163Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9696497Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-18T14:14:16.9697666Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-18T14:14:16.9698994Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9700515Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-18T14:14:16.9701493Z [cluster2] Generated cluster id: cluster2
2021-07-18T14:14:16.9702637Z [submariner-operator]$ [cluster1] "hostname": "cluster1-worker",
2021-07-18T14:14:16.9703438Z [cluster1] "nat_enabled": false,
2021-07-18T14:14:16.9703992Z [cluster1] "private_ip": "172.18.0.7",
2021-07-18T14:14:16.9704536Z [cluster1] "public_ip": "40.84.35.32",
2021-07-18T14:14:16.9705183Z [cluster1] "subnets": [
2021-07-18T14:14:16.9705673Z [cluster1] "100.1.0.0/16",
2021-07-18T14:14:16.9706125Z [cluster1] "10.1.0.0/16"
2021-07-18T14:14:16.9706575Z [cluster1] ]
2021-07-18T14:14:16.9706988Z [cluster1] },
2021-07-18T14:14:16.9707507Z [cluster1] "statusFailure": "",
2021-07-18T14:14:16.9708298Z [cluster1] "version": "devel-1441a80"
2021-07-18T14:14:16.9708829Z [cluster1] }
2021-07-18T14:14:16.9709246Z [cluster1] ],
2021-07-18T14:14:16.9709875Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-18T14:14:16.9710767Z [cluster1] "mismatchedContainerImages": false
2021-07-18T14:14:16.9711417Z [cluster1] },
2021-07-18T14:14:16.9711974Z [cluster1] "loadBalancerStatus": {},
2021-07-18T14:14:16.9712598Z [cluster1] "natEnabled": false,
2021-07-18T14:14:16.9713389Z [cluster1] "networkPlugin": "weave-net",
2021-07-18T14:14:16.9714171Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-18T14:14:16.9714992Z [cluster1] "lastResourceVersion": "2067",
2021-07-18T14:14:16.9715814Z [cluster1] "mismatchedContainerImages": false,
2021-07-18T14:14:16.9716807Z [cluster1] "nonReadyContainerStates": [],
2021-07-18T14:14:16.9717414Z [cluster1] "status": {
2021-07-18T14:14:16.9717997Z [cluster1] "currentNumberScheduled": 3,
2021-07-18T14:14:16.9718751Z [cluster1] "desiredNumberScheduled": 3,
2021-07-18T14:14:16.9719413Z [cluster1] "numberAvailable": 3,
2021-07-18T14:14:16.9720031Z [cluster1] "numberMisscheduled": 0,
2021-07-18T14:14:16.9720604Z [cluster1] "numberReady": 3,
2021-07-18T14:14:16.9721372Z [cluster1] "observedGeneration": 1,
2021-07-18T14:14:16.9722120Z [cluster1] "updatedNumberScheduled": 3
2021-07-18T14:14:16.9722734Z [cluster1] }
2021-07-18T14:14:16.9723133Z [cluster1] },
2021-07-18T14:14:16.9723719Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-18T14:14:16.9724208Z [cluster1] }
2021-07-18T14:14:16.9724593Z [cluster1] }
2021-07-18T14:14:16.9725715Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:14:16.9727294Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:14:16.9728920Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-18T14:14:16.9730423Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:14:16.9731807Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:14:16.9733237Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-18T14:14:16.9734534Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-18T14:14:16.9735706Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-18T14:14:16.9736982Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-18T14:14:16.9738332Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-18T14:14:16.9739620Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-18T14:14:16.9741048Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-18T14:14:16.9742643Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.8:6443
2021-07-18T14:14:16.9744113Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.8:6443
2021-07-18T14:14:16.9784722Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-18T14:14:17.0040968Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:14:17.0370571Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:14:17.0373846Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-18T14:14:17.0950511Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:17.7763129Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:17.8421504Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8423371Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:14:17.8425802Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:14:17.8427796Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8429442Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:14:17.8430776Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:14:17.8432291Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8433765Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:14:17.8435108Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:14:17.8436643Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8438161Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:14:17.8439536Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:14:17.8441072Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8442596Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-18T14:14:17.8443943Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-18T14:14:17.8445388Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8446763Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-18T14:14:17.8447950Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-18T14:14:17.8449360Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8450698Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-18T14:14:17.8451866Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-18T14:14:17.8453203Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8454840Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8455842Z [cluster1] Generated cluster id: cluster1
2021-07-18T14:14:17.8456904Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-18T14:14:17.8458177Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-18T14:14:17.8459606Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8460976Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-18T14:14:17.8462160Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-18T14:14:17.8463486Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8477733Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-18T14:14:17.8479713Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-18T14:14:17.8481285Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8482694Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-18T14:14:17.8484070Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-18T14:14:17.8485506Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-18T14:14:17.8487061Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-18T14:14:17.8488208Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-18T14:14:17.8489345Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-18T14:14:17.8490587Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-18T14:14:17.8491542Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:14:17.8492427Z [submariner-operator]$ [cluster1] wait 8555
2021-07-18T14:14:17.8493332Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-18T14:14:17.8494269Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-18T14:14:17.8495212Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-18T14:14:17.8496357Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-18T14:14:18.4559683Z [submariner-operator]$ [cluster1er2] validate_equals .spec.colorCodes blue
2021-07-18T14:14:18.4561182Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-18T14:14:18.4562623Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-18T14:14:18.4564009Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-18T14:14:18.4565191Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-18T14:14:18.4566531Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-18T14:14:18.4568038Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-18T14:14:18.4569525Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-18T14:14:18.4571053Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-18T14:14:18.4572458Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-18T14:14:18.4573843Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-18T14:14:18.4575179Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-18T14:14:18.4576411Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-18T14:14:18.4577691Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-18T14:14:18.4578969Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-18T14:14:18.4580116Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-18T14:14:18.4581147Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:14:18.4582092Z [submariner-operator]$ [cluster2] wait 8504
2021-07-18T14:14:18.4583073Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-18T14:14:18.4584093Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-18T14:14:18.4585328Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-18T14:14:18.4586443Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-18T14:14:18.4587658Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-18T14:14:18.4588580Z [cluster2] 
2021-07-18T14:14:18.4589128Z [cluster2] 
2021-07-18T14:14:18.4590432Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:18.4592184Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-18T14:14:18.4593518Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-18T14:14:18.4595003Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-18T14:14:18.4596672Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-18T14:14:18.4598039Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-18T14:14:18.4599415Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-18T14:14:18.4600671Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:18.4601531Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:18.4602507Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-18T14:14:18.4603624Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-18T14:14:18.4605155Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:14:18.4606721Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:14:18.4608142Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-18T14:14:18.4609492Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-18T14:14:18.4610714Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-18T14:14:18.4611882Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-18T14:14:18.4612922Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:14:18.4613928Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-18T14:14:18.4614964Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-18T14:14:18.4615732Z [cluster2] 
2021-07-18T14:14:18.4616479Z [submariner-operator]$ [cluster2] wait 8590
2021-07-18T14:14:18.4617378Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:18.4618449Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-18T14:14:18.4619622Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-18T14:14:18.4620805Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:14:18.4621735Z [submariner-operator]$ [cluster2] wait 8635
2021-07-18T14:14:18.4622730Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-18T14:14:18.4623770Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-18T14:14:20.0642585Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath] json_file=/tmp/submariner.cluster1.json
2021-07-18T14:14:20.0644017Z [cluster1] 
2021-07-18T14:14:20.0644564Z [cluster1] 
2021-07-18T14:14:20.0645873Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:14:20.0647468Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-18T14:14:20.0648807Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-18T14:14:20.0650322Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-18T14:14:20.0651840Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-18T14:14:20.0653164Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-18T14:14:20.0654634Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-18T14:14:20.0655899Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:14:20.0656825Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:14:20.0657863Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-18T14:14:20.0659008Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-18T14:14:20.0660369Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:14:20.0662081Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:14:20.0663482Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-18T14:14:20.0664894Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-18T14:14:20.0666138Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-18T14:14:20.0667296Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-18T14:14:20.0668354Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:14:20.0669453Z [submariner-operator]$ [cluster1] wait 8618
2021-07-18T14:14:20.0670432Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-18T14:14:20.0671464Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-18T14:14:20.0672230Z [cluster1] 
2021-07-18T14:14:20.0672967Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:14:20.0674159Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-18T14:14:20.0675472Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-18T14:14:20.0676545Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:14:20.0677485Z [submariner-operator]$ [cluster1] wait 8653
2021-07-18T14:14:20.0678464Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-18T14:14:20.0679675Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-18T14:14:20.0681421Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-18T14:14:20.0683783Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-18T14:14:20.0686028Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-18T14:14:20.0688054Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-18T14:14:20.0689825Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-18T14:14:20.0691838Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-18T14:14:20.0693441Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:14:20.0694454Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-18T14:14:20.0695498Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-18T14:14:20.0697111Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-18T14:14:20.0699150Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-18T14:14:20.0701332Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-18T14:14:20.0702984Z [cluster1] pod/submariner-gateway-pt4f4 condition met
2021-07-18T14:14:20.0704636Z [submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-18T14:14:20.5251982Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o={.status.desiredNumberScheduled}
2021-07-18T14:14:20.5280657Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-18T14:14:20.5283354Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-18T14:14:20.5285423Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-18T14:14:20.5287185Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-18T14:14:20.5289233Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-18T14:14:20.5290666Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:20.5291659Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-18T14:14:20.5292832Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-18T14:14:20.5294428Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-18T14:14:20.5296556Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-18T14:14:20.5298735Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-18T14:14:20.5300437Z [cluster2] pod/submariner-gateway-qbtqg condition met
2021-07-18T14:14:20.5302091Z [submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-18T14:14:20.5304168Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:20.5306510Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:20.5308810Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:20.5310896Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner-gateway-qbtqg.cluster2.json
2021-07-18T14:14:20.5312936Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-qbtqg --namespace=submariner-operator -o json
2021-07-18T14:14:20.5314850Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-qbtqg --namespace=submariner-operator -o json
2021-07-18T14:14:20.5316856Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-gateway-qbtqg --namespace=submariner-operator -o json
2021-07-18T14:14:20.5318819Z [submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-qbtqg.cluster2.json
2021-07-18T14:14:20.5319837Z [cluster2] {
2021-07-18T14:14:20.5320307Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:20.5320799Z [cluster2] "kind": "Pod",
2021-07-18T14:14:20.5321278Z [cluster2] "metadata": {
2021-07-18T14:14:20.5322058Z [cluster2] "creationTimestamp": "2021-07-18T14:13:20Z",
2021-07-18T14:14:20.5323013Z [cluster2] "generateName": "submariner-gateway-",
2021-07-18T14:14:20.5323676Z [cluster2] "labels": {
2021-07-18T14:14:20.5324423Z [cluster2] "app": "submariner-gateway",
2021-07-18T14:14:20.5325415Z [cluster2] "controller-revision-hash": "5998dbff94",
2021-07-18T14:14:20.5326526Z [cluster2] "gateway.submariner.io/node": "cluster2-worker",
2021-07-18T14:14:20.5327442Z [cluster2] "gateway.submariner.io/status": "active",
2021-07-18T14:14:20.5328427Z [cluster2] "pod-template-generation": "1"
2021-07-18T14:14:20.5329037Z [cluster2] },
2021-07-18T14:14:20.5329622Z [cluster2] "managedFields": [
2021-07-18T14:14:20.5330113Z [cluster2] {
2021-07-18T14:14:20.5330601Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:20.5331180Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:20.5331744Z [cluster2] "fieldsV1": {
2021-07-18T14:14:20.5332242Z [cluster2] "f:metadata": {
2021-07-18T14:14:20.5332804Z [cluster2] "f:generateName": {},
2021-07-18T14:14:20.5333356Z [cluster2] "f:labels": {
2021-07-18T14:14:20.5333852Z [cluster2] ".": {},
2021-07-18T14:14:20.5334308Z [cluster2] "f:app": {},
2021-07-18T14:14:20.5335190Z [cluster2] "f:controller-revision-hash": {},
2021-07-18T14:14:20.5336218Z [cluster2] "f:pod-template-generation": {}
2021-07-18T14:14:20.5336859Z [cluster2] },
2021-07-18T14:14:20.5337418Z [cluster2] "f:ownerReferences": {
2021-07-18T14:14:20.5337968Z [cluster2] ".": {},
2021-07-18T14:14:20.5338862Z [cluster2] "k:{\"uid\":\"b6d4110b-107c-498a-b86c-38c0f07ac962\"}": {
2021-07-18T14:14:20.5339519Z [cluster2] ".": {},
2021-07-18T14:14:20.5340049Z [cluster2] "f:apiVersion": {},
2021-07-18T14:14:20.5340708Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-18T14:14:20.5341370Z [cluster2] "f:controller": {},
2021-07-18T14:14:20.5341903Z [cluster2] "f:kind": {},
2021-07-18T14:14:20.5342394Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5342887Z [cluster2] "f:uid": {}
2021-07-18T14:14:20.5343339Z [cluster2] }
2021-07-18T14:14:20.5343775Z [cluster2] }
2021-07-18T14:14:20.5344207Z [cluster2] },
2021-07-18T14:14:20.5344660Z [cluster2] "f:spec": {
2021-07-18T14:14:20.5358420Z [cluster2] "f:affinity": {
2021-07-18T14:14:20.5358948Z [cluster2] ".": {},
2021-07-18T14:14:20.5359474Z [cluster2] "f:nodeAffinity": {
2021-07-18T14:14:20.5360007Z [cluster2] ".": {},
2021-07-18T14:14:20.5361297Z [cluster2] "f:requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-18T14:14:20.5362411Z [cluster2] ".": {},
2021-07-18T14:14:20.5363021Z [cluster2] "f:nodeSelectorTerms": {}
2021-07-18T14:14:20.5363682Z [cluster2] }
2021-07-18T14:14:20.5364095Z [cluster2] },
2021-07-18T14:14:20.5364606Z [cluster2] "f:podAntiAffinity": {
2021-07-18T14:14:20.5365132Z [cluster2] ".": {},
2021-07-18T14:14:20.5366160Z [cluster2] "f:requiredDuringSchedulingIgnoredDuringExecution": {}
2021-07-18T14:14:20.5367299Z [cluster2] }
2021-07-18T14:14:20.5367711Z [cluster2] },
2021-07-18T14:14:20.5368167Z [cluster2] "f:containers": {
2021-07-18T14:14:20.5369160Z [cluster2] "k:{\"name\":\"submariner-gateway\"}": {
2021-07-18T14:14:20.5369725Z [cluster2] ".": {},
2021-07-18T14:14:20.5370189Z [cluster2] "f:command": {},
2021-07-18T14:14:20.5370650Z [cluster2] "f:env": {
2021-07-18T14:14:20.5371100Z [cluster2] ".": {},
2021-07-18T14:14:20.5371633Z [cluster2] "k:{\"name\":\"BROKER_K8S_APISERVER\"}": {
2021-07-18T14:14:20.5372477Z [cluster2] ".": {},
2021-07-18T14:14:20.5372972Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5373475Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5373960Z [cluster2] },
2021-07-18T14:14:20.5374572Z [cluster2] "k:{\"name\":\"BROKER_K8S_APISERVERTOKEN\"}": {
2021-07-18T14:14:20.5375214Z [cluster2] ".": {},
2021-07-18T14:14:20.5375697Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5376212Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5376701Z [cluster2] },
2021-07-18T14:14:20.5377227Z [cluster2] "k:{\"name\":\"BROKER_K8S_CA\"}": {
2021-07-18T14:14:20.5377777Z [cluster2] ".": {},
2021-07-18T14:14:20.5378264Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5378781Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5379260Z [cluster2] },
2021-07-18T14:14:20.5379888Z [cluster2] "k:{\"name\":\"BROKER_K8S_REMOTENAMESPACE\"}": {
2021-07-18T14:14:20.5380516Z [cluster2] ".": {},
2021-07-18T14:14:20.5381015Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5381526Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5382004Z [cluster2] },
2021-07-18T14:14:20.5382556Z [cluster2] "k:{\"name\":\"CE_IPSEC_DEBUG\"}": {
2021-07-18T14:14:20.5383098Z [cluster2] ".": {},
2021-07-18T14:14:20.5383590Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5384095Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5384582Z [cluster2] },
2021-07-18T14:14:20.5385299Z [cluster2] "k:{\"name\":\"CE_IPSEC_FORCEENCAPS\"}": {
2021-07-18T14:14:20.5385884Z [cluster2] ".": {},
2021-07-18T14:14:20.5386384Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5386951Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5387443Z [cluster2] },
2021-07-18T14:14:20.5387996Z [cluster2] "k:{\"name\":\"CE_IPSEC_IKEPORT\"}": {
2021-07-18T14:14:20.5388559Z [cluster2] ".": {},
2021-07-18T14:14:20.5389040Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5389552Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5390043Z [cluster2] },
2021-07-18T14:14:20.5390596Z [cluster2] "k:{\"name\":\"CE_IPSEC_NATTPORT\"}": {
2021-07-18T14:14:20.5407201Z [cluster2] ".": {},
2021-07-18T14:14:20.5407722Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5408248Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5408746Z [cluster2] },
2021-07-18T14:14:20.5409383Z [cluster2] "k:{\"name\":\"CE_IPSEC_PREFERREDSERVER\"}": {
2021-07-18T14:14:20.5410026Z [cluster2] ".": {},
2021-07-18T14:14:20.5410516Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5411032Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5411506Z [cluster2] },
2021-07-18T14:14:20.5412211Z [cluster2] "k:{\"name\":\"CE_IPSEC_PSK\"}": {
2021-07-18T14:14:20.5412750Z [cluster2] ".": {},
2021-07-18T14:14:20.5413246Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5413742Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5414232Z [cluster2] },
2021-07-18T14:14:20.5414766Z [cluster2] "k:{\"name\":\"NODE_NAME\"}": {
2021-07-18T14:14:20.5415286Z [cluster2] ".": {},
2021-07-18T14:14:20.5415782Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5416311Z [cluster2] "f:valueFrom": {
2021-07-18T14:14:20.5416837Z [cluster2] ".": {},
2021-07-18T14:14:20.5417347Z [cluster2] "f:fieldRef": {
2021-07-18T14:14:20.5417879Z [cluster2] ".": {},
2021-07-18T14:14:20.5418422Z [cluster2] "f:apiVersion": {},
2021-07-18T14:14:20.5419024Z [cluster2] "f:fieldPath": {}
2021-07-18T14:14:20.5419557Z [cluster2] }
2021-07-18T14:14:20.5420018Z [cluster2] }
2021-07-18T14:14:20.5420478Z [cluster2] },
2021-07-18T14:14:20.5420995Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-18T14:14:20.5421527Z [cluster2] ".": {},
2021-07-18T14:14:20.5422010Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5422555Z [cluster2] "f:valueFrom": {
2021-07-18T14:14:20.5423086Z [cluster2] ".": {},
2021-07-18T14:14:20.5423599Z [cluster2] "f:fieldRef": {
2021-07-18T14:14:20.5424126Z [cluster2] ".": {},
2021-07-18T14:14:20.5424659Z [cluster2] "f:apiVersion": {},
2021-07-18T14:14:20.5425505Z [cluster2] "f:fieldPath": {}
2021-07-18T14:14:20.5426058Z [cluster2] }
2021-07-18T14:14:20.5426499Z [cluster2] }
2021-07-18T14:14:20.5426922Z [cluster2] },
2021-07-18T14:14:20.5427459Z [cluster2] "k:{\"name\":\"SUBMARINER_BROKER\"}": {
2021-07-18T14:14:20.5427997Z [cluster2] ".": {},
2021-07-18T14:14:20.5428450Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5428933Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5429375Z [cluster2] },
2021-07-18T14:14:20.5429943Z [cluster2] "k:{\"name\":\"SUBMARINER_CABLEDRIVER\"}": {
2021-07-18T14:14:20.5430500Z [cluster2] ".": {},
2021-07-18T14:14:20.5430962Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5431446Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5431887Z [cluster2] },
2021-07-18T14:14:20.5432451Z [cluster2] "k:{\"name\":\"SUBMARINER_CLUSTERCIDR\"}": {
2021-07-18T14:14:20.5433012Z [cluster2] ".": {},
2021-07-18T14:14:20.5433642Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5434144Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5434693Z [cluster2] },
2021-07-18T14:14:20.5435275Z [cluster2] "k:{\"name\":\"SUBMARINER_CLUSTERID\"}": {
2021-07-18T14:14:20.5435877Z [cluster2] ".": {},
2021-07-18T14:14:20.5436366Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5436866Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5437352Z [cluster2] },
2021-07-18T14:14:20.5437947Z [cluster2] "k:{\"name\":\"SUBMARINER_COLORCODES\"}": {
2021-07-18T14:14:20.5438559Z [cluster2] ".": {},
2021-07-18T14:14:20.5439041Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5439556Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5440039Z [cluster2] },
2021-07-18T14:14:20.5440598Z [cluster2] "k:{\"name\":\"SUBMARINER_DEBUG\"}": {
2021-07-18T14:14:20.5441171Z [cluster2] ".": {},
2021-07-18T14:14:20.5441653Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5442549Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5443048Z [cluster2] },
2021-07-18T14:14:20.5443651Z [cluster2] "k:{\"name\":\"SUBMARINER_GLOBALCIDR\"}": {
2021-07-18T14:14:20.5444244Z [cluster2] ".": {},
2021-07-18T14:14:20.5444740Z [cluster2] "f:name": {}
2021-07-18T14:14:20.5445217Z [cluster2] },
2021-07-18T14:14:20.5445884Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKENABLED\"}": {
2021-07-18T14:14:20.5447084Z [cluster2] ".": {},
2021-07-18T14:14:20.5447586Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5448102Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5448574Z [cluster2] },
2021-07-18T14:14:20.5456256Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKINTERVAL\"}": {
2021-07-18T14:14:20.5457305Z [cluster2] ".": {},
2021-07-18T14:14:20.5457801Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5458322Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5458802Z [cluster2] },
2021-07-18T14:14:20.5459634Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT\"}": {
2021-07-18T14:14:20.5460460Z [cluster2] ".": {},
2021-07-18T14:14:20.5460967Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5461467Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5461964Z [cluster2] },
2021-07-18T14:14:20.5462567Z [cluster2] "k:{\"name\":\"SUBMARINER_NAMESPACE\"}": {
2021-07-18T14:14:20.5463155Z [cluster2] ".": {},
2021-07-18T14:14:20.5463652Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5464404Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5465009Z [cluster2] },
2021-07-18T14:14:20.5465602Z [cluster2] "k:{\"name\":\"SUBMARINER_NATENABLED\"}": {
2021-07-18T14:14:20.5466209Z [cluster2] ".": {},
2021-07-18T14:14:20.5466705Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5467294Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5467780Z [cluster2] },
2021-07-18T14:14:20.5468379Z [cluster2] "k:{\"name\":\"SUBMARINER_SERVICECIDR\"}": {
2021-07-18T14:14:20.5468994Z [cluster2] ".": {},
2021-07-18T14:14:20.5469478Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5469997Z [cluster2] "f:value": {}
2021-07-18T14:14:20.5470469Z [cluster2] }
2021-07-18T14:14:20.5470930Z [cluster2] },
2021-07-18T14:14:20.5471418Z [cluster2] "f:image": {},
2021-07-18T14:14:20.5472096Z [cluster2] "f:imagePullPolicy": {},
2021-07-18T14:14:20.5472653Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5473116Z [cluster2] "f:ports": {
2021-07-18T14:14:20.5473569Z [cluster2] ".": {},
2021-07-18T14:14:20.5474146Z [cluster2] "k:{\"containerPort\":4490,\"protocol\":\"UDP\"}": {
2021-07-18T14:14:20.5474731Z [cluster2] ".": {},
2021-07-18T14:14:20.5475235Z [cluster2] "f:containerPort": {},
2021-07-18T14:14:20.5475801Z [cluster2] "f:hostPort": {},
2021-07-18T14:14:20.5476303Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5476791Z [cluster2] "f:protocol": {}
2021-07-18T14:14:20.5477446Z [cluster2] },
2021-07-18T14:14:20.5478057Z [cluster2] "k:{\"containerPort\":4500,\"protocol\":\"UDP\"}": {
2021-07-18T14:14:20.5478690Z [cluster2] ".": {},
2021-07-18T14:14:20.5479230Z [cluster2] "f:containerPort": {},
2021-07-18T14:14:20.5479836Z [cluster2] "f:hostPort": {},
2021-07-18T14:14:20.5480375Z [cluster2] "f:name": {},
2021-07-18T14:14:20.5480898Z [cluster2] "f:protocol": {}
2021-07-18T14:14:20.5481466Z [cluster2] }
2021-07-18T14:14:20.5481914Z [cluster2] },
2021-07-18T14:14:20.5482425Z [cluster2] "f:resources": {},
2021-07-18T14:14:20.5483023Z [cluster2] "f:securityContext": {
2021-07-18T14:14:20.5483593Z [cluster2] ".": {},
2021-07-18T14:14:20.5484263Z [cluster2] "f:allowPrivilegeEscalation": {},
2021-07-18T14:14:20.5485024Z [cluster2] "f:capabilities": {
2021-07-18T14:14:20.5485569Z [cluster2] ".": {},
2021-07-18T14:14:20.5486045Z [cluster2] "f:add": {},
2021-07-18T14:14:20.5486553Z [cluster2] "f:drop": {}
2021-07-18T14:14:20.5487026Z [cluster2] },
2021-07-18T14:14:20.5487556Z [cluster2] "f:privileged": {},
2021-07-18T14:14:20.5488270Z [cluster2] "f:readOnlyRootFilesystem": {},
2021-07-18T14:14:20.5489004Z [cluster2] "f:runAsNonRoot": {}
2021-07-18T14:14:20.5489532Z [cluster2] },
2021-07-18T14:14:20.5490281Z [cluster2] "f:terminationMessagePath": {},
2021-07-18T14:14:20.5491101Z [cluster2] "f:terminationMessagePolicy": {},
2021-07-18T14:14:20.5491836Z [cluster2] "f:volumeMounts": {
2021-07-18T14:14:20.5492336Z [cluster2] ".": {},
2021-07-18T14:14:20.5492873Z [cluster2] "k:{\"mountPath\":\"/etc/ipsec.d\"}": {
2021-07-18T14:14:20.5493601Z [cluster2] ".": {},
2021-07-18T14:14:20.5494115Z [cluster2] "f:mountPath": {},
2021-07-18T14:14:20.5494665Z [cluster2] "f:name": {}
2021-07-18T14:14:20.5495152Z [cluster2] },
2021-07-18T14:14:20.5495724Z [cluster2] "k:{\"mountPath\":\"/var/lib/ipsec/nss\"}": {
2021-07-18T14:14:20.5496313Z [cluster2] ".": {},
2021-07-18T14:14:20.5496826Z [cluster2] "f:mountPath": {},
2021-07-18T14:14:20.5497376Z [cluster2] "f:name": {}
2021-07-18T14:14:20.5497848Z [cluster2] }
2021-07-18T14:14:20.5498298Z [cluster2] }
2021-07-18T14:14:20.5498734Z [cluster2] }
2021-07-18T14:14:20.5499173Z [cluster2] },
2021-07-18T14:14:20.5499673Z [cluster2] "f:dnsPolicy": {},
2021-07-18T14:14:20.5500305Z [cluster2] "f:enableServiceLinks": {},
2021-07-18T14:14:20.5500970Z [cluster2] "f:hostNetwork": {},
2021-07-18T14:14:20.5501544Z [cluster2] "f:nodeSelector": {
2021-07-18T14:14:20.5502069Z [cluster2] ".": {},
2021-07-18T14:14:20.5502634Z [cluster2] "f:submariner.io/gateway": {}
2021-07-18T14:14:20.5503197Z [cluster2] },
2021-07-18T14:14:20.5503716Z [cluster2] "f:restartPolicy": {},
2021-07-18T14:14:20.5504335Z [cluster2] "f:schedulerName": {},
2021-07-18T14:14:20.5505085Z [cluster2] "f:securityContext": {},
2021-07-18T14:14:20.5505719Z [cluster2] "f:serviceAccount": {},
2021-07-18T14:14:20.5506508Z [cluster2] "f:serviceAccountName": {},
2021-07-18T14:14:20.5507509Z [cluster2] "f:terminationGracePeriodSeconds": {},
2021-07-18T14:14:20.5508327Z [cluster2] "f:tolerations": {},
2021-07-18T14:14:20.5508922Z [cluster2] "f:volumes": {
2021-07-18T14:14:20.5509411Z [cluster2] ".": {},
2021-07-18T14:14:20.5509919Z [cluster2] "k:{\"name\":\"ipsecd\"}": {
2021-07-18T14:14:20.5510434Z [cluster2] ".": {},
2021-07-18T14:14:20.5510955Z [cluster2] "f:emptyDir": {},
2021-07-18T14:14:20.5511471Z [cluster2] "f:name": {}
2021-07-18T14:14:20.5511943Z [cluster2] },
2021-07-18T14:14:20.5512453Z [cluster2] "k:{\"name\":\"ipsecnss\"}": {
2021-07-18T14:14:20.5512986Z [cluster2] ".": {},
2021-07-18T14:14:20.5513486Z [cluster2] "f:emptyDir": {},
2021-07-18T14:14:20.5514009Z [cluster2] "f:name": {}
2021-07-18T14:14:20.5514466Z [cluster2] }
2021-07-18T14:14:20.5514908Z [cluster2] }
2021-07-18T14:14:20.5515344Z [cluster2] }
2021-07-18T14:14:20.5515756Z [cluster2] },
2021-07-18T14:14:20.5516790Z [cluster2] "manager": "kube-controller-manager",
2021-07-18T14:14:20.5517901Z [cluster2] "operation": "Update",
2021-07-18T14:14:20.5518684Z [cluster2] "time": "2021-07-18T14:13:20Z"
2021-07-18T14:14:20.5519136Z [cluster2] },
2021-07-18T14:14:20.5519550Z [cluster2] {
2021-07-18T14:14:20.5520133Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:20.5520806Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:20.5521322Z [cluster2] "fieldsV1": {
2021-07-18T14:14:20.5521788Z [cluster2] "f:status": {
2021-07-18T14:14:20.5522280Z [cluster2] "f:conditions": {
2021-07-18T14:14:20.5522859Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-18T14:14:20.5523421Z [cluster2] ".": {},
2021-07-18T14:14:20.5523924Z [cluster2] "f:lastProbeTime": {},
2021-07-18T14:14:20.5524559Z [cluster2] "f:lastTransitionTime": {},
2021-07-18T14:14:20.5525122Z [cluster2] "f:status": {},
2021-07-18T14:14:20.5525596Z [cluster2] "f:type": {}
2021-07-18T14:14:20.5526406Z [cluster2] },
2021-07-18T14:14:20.5527087Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-18T14:14:20.5527608Z [cluster2] ".": {},
2021-07-18T14:14:20.5528275Z [cluster2] "f:lastProbeTime": {},
2021-07-18T14:14:20.5528919Z [cluster2] "f:lastTransitionTime": {},
2021-07-18T14:14:20.5529487Z [cluster2] "f:status": {},
2021-07-18T14:14:20.5529967Z [cluster2] "f:type": {}
2021-07-18T14:14:20.5530393Z [cluster2] },
2021-07-18T14:14:20.5530862Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-18T14:14:20.5531320Z [cluster2] ".": {},
2021-07-18T14:14:20.5531836Z [cluster2] "f:lastProbeTime": {},
2021-07-18T14:14:20.5532473Z [cluster2] "f:lastTransitionTime": {},
2021-07-18T14:14:20.5533043Z [cluster2] "f:status": {},
2021-07-18T14:14:20.5533516Z [cluster2] "f:type": {}
2021-07-18T14:14:20.5533943Z [cluster2] }
2021-07-18T14:14:20.5534351Z [cluster2] },
2021-07-18T14:14:20.5534871Z [cluster2] "f:containerStatuses": {},
2021-07-18T14:14:20.5535433Z [cluster2] "f:hostIP": {},
2021-07-18T14:14:20.5535962Z [cluster2] "f:phase": {},
2021-07-18T14:14:20.5536439Z [cluster2] "f:podIP": {},
2021-07-18T14:14:20.5536911Z [cluster2] "f:podIPs": {
2021-07-18T14:14:20.5537353Z [cluster2] ".": {},
2021-07-18T14:14:20.5537808Z [cluster2] "k:{\"ip\":\"172.18.0.4\"}": {
2021-07-18T14:14:20.5538248Z [cluster2] ".": {},
2021-07-18T14:14:20.5538693Z [cluster2] "f:ip": {}
2021-07-18T14:14:20.5539112Z [cluster2] }
2021-07-18T14:14:20.5539523Z [cluster2] },
2021-07-18T14:14:20.5539973Z [cluster2] "f:startTime": {}
2021-07-18T14:14:20.5540425Z [cluster2] }
2021-07-18T14:14:20.5540807Z [cluster2] },
2021-07-18T14:14:20.5541268Z [cluster2] "manager": "kubelet",
2021-07-18T14:14:20.5541803Z [cluster2] "operation": "Update",
2021-07-18T14:14:20.5542571Z [cluster2] "time": "2021-07-18T14:13:39Z"
2021-07-18T14:14:20.5543005Z [cluster2] },
2021-07-18T14:14:20.5543379Z [cluster2] {
2021-07-18T14:14:20.5543831Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:20.5544371Z [cluster2] "fieldsType": "FieldsV1",
2021-07-18T14:14:20.5545324Z [cluster2] "fieldsV1": {
2021-07-18T14:14:20.5545796Z [cluster2] "f:metadata": {
2021-07-18T14:14:20.5546364Z [cluster2] "f:labels": {
2021-07-18T14:14:20.5546961Z [cluster2] "f:gateway.submariner.io/node": {},
2021-07-18T14:14:20.5547719Z [cluster2] "f:gateway.submariner.io/status": {}
2021-07-18T14:14:20.5548301Z [cluster2] }
2021-07-18T14:14:20.5548694Z [cluster2] }
2021-07-18T14:14:20.5549090Z [cluster2] },
2021-07-18T14:14:20.5549846Z [cluster2] "manager": "submariner-gateway",
2021-07-18T14:14:20.5550477Z [cluster2] "operation": "Update",
2021-07-18T14:14:20.5551144Z [cluster2] "time": "2021-07-18T14:13:40Z"
2021-07-18T14:14:20.5551578Z [cluster2] }
2021-07-18T14:14:20.5551952Z [cluster2] ],
2021-07-18T14:14:20.5552693Z [cluster2] "name": "submariner-gateway-qbtqg",
2021-07-18T14:14:20.5553602Z [cluster2] "namespace": "submariner-operator",
2021-07-18T14:14:20.5554265Z [cluster2] "ownerReferences": [
2021-07-18T14:14:20.5554757Z [cluster2] {
2021-07-18T14:14:20.5555216Z [cluster2] "apiVersion": "apps/v1",
2021-07-18T14:14:20.5555846Z [cluster2] "blockOwnerDeletion": true,
2021-07-18T14:14:20.5556443Z [cluster2] "controller": true,
2021-07-18T14:14:20.5557005Z [cluster2] "kind": "DaemonSet",
2021-07-18T14:14:20.5557754Z [cluster2] "name": "submariner-gateway",
2021-07-18T14:14:20.5558648Z [cluster2] "uid": "b6d4110b-107c-498a-b86c-38c0f07ac962"
2021-07-18T14:14:20.5559204Z [cluster2] }
2021-07-18T14:14:20.5559586Z [cluster2] ],
2021-07-18T14:14:20.5560059Z [cluster2] "resourceVersion": "2022",
2021-07-18T14:14:20.5561402Z [cluster2] "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-qbtqg",
2021-07-18T14:14:20.5562752Z [cluster2] "uid": "1ba82e16-8b3a-4f92-ad37-816b382b127a"
2021-07-18T14:14:20.5563529Z [cluster2] },
2021-07-18T14:14:20.5563954Z [cluster2] "spec": {
2021-07-18T14:14:20.5564409Z [cluster2] "affinity": {
2021-07-18T14:14:20.5564931Z [cluster2] "nodeAffinity": {
2021-07-18T14:14:20.5566085Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-18T14:14:20.5567382Z [cluster2] "nodeSelectorTerms": [
2021-07-18T14:14:20.5567892Z [cluster2] {
2021-07-18T14:14:20.5568440Z [cluster2] "matchFields": [
2021-07-18T14:14:20.5568925Z [cluster2] {
2021-07-18T14:14:20.5569430Z [cluster2] "key": "metadata.name",
2021-07-18T14:14:20.5569996Z [cluster2] "operator": "In",
2021-07-18T14:14:20.5570484Z [cluster2] "values": [
2021-07-18T14:14:20.5571211Z [cluster2] "cluster2-worker"
2021-07-18T14:14:20.5571724Z [cluster2] ]
2021-07-18T14:14:20.5572145Z [cluster2] }
2021-07-18T14:14:20.5572549Z [cluster2] ]
2021-07-18T14:14:20.5572955Z [cluster2] }
2021-07-18T14:14:20.5573352Z [cluster2] ]
2021-07-18T14:14:20.5573733Z [cluster2] }
2021-07-18T14:14:20.5574120Z [cluster2] },
2021-07-18T14:14:20.5574595Z [cluster2] "podAntiAffinity": {
2021-07-18T14:14:20.5575714Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-18T14:14:20.5576702Z [cluster2] {
2021-07-18T14:14:20.5577188Z [cluster2] "labelSelector": {
2021-07-18T14:14:20.5577727Z [cluster2] "matchLabels": {
2021-07-18T14:14:20.5578514Z [cluster2] "app": "submariner-gateway"
2021-07-18T14:14:20.5579055Z [cluster2] }
2021-07-18T14:14:20.5579523Z [cluster2] },
2021-07-18T14:14:20.5580116Z [cluster2] "topologyKey": "kubernetes.io/hostname"
2021-07-18T14:14:20.5580865Z [cluster2] }
2021-07-18T14:14:20.5581294Z [cluster2] ]
2021-07-18T14:14:20.5581698Z [cluster2] }
2021-07-18T14:14:20.5582105Z [cluster2] },
2021-07-18T14:14:20.5582557Z [cluster2] "containers": [
2021-07-18T14:14:20.5583021Z [cluster2] {
2021-07-18T14:14:20.5583462Z [cluster2] "command": [
2021-07-18T14:14:20.5584005Z [cluster2] "submariner.sh"
2021-07-18T14:14:20.5584489Z [cluster2] ],
2021-07-18T14:14:20.5585168Z [cluster2] "env": [
2021-07-18T14:14:20.5585598Z [cluster2] {
2021-07-18T14:14:20.5586160Z [cluster2] "name": "SUBMARINER_NAMESPACE",
2021-07-18T14:14:20.5587098Z [cluster2] "value": "submariner-operator"
2021-07-18T14:14:20.5587693Z [cluster2] },
2021-07-18T14:14:20.5588121Z [cluster2] {
2021-07-18T14:14:20.5588683Z [cluster2] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-18T14:14:20.5589296Z [cluster2] "value": "10.2.0.0/16"
2021-07-18T14:14:20.5589749Z [cluster2] },
2021-07-18T14:14:20.5590171Z [cluster2] {
2021-07-18T14:14:20.5590731Z [cluster2] "name": "SUBMARINER_SERVICECIDR",
2021-07-18T14:14:20.5591338Z [cluster2] "value": "100.2.0.0/16"
2021-07-18T14:14:20.5591802Z [cluster2] },
2021-07-18T14:14:20.5592215Z [cluster2] {
2021-07-18T14:14:20.5592770Z [cluster2] "name": "SUBMARINER_GLOBALCIDR"
2021-07-18T14:14:20.5593309Z [cluster2] },
2021-07-18T14:14:20.5593737Z [cluster2] {
2021-07-18T14:14:20.5594376Z [cluster2] "name": "SUBMARINER_CLUSTERID",
2021-07-18T14:14:20.5594955Z [cluster2] "value": "cluster2"
2021-07-18T14:14:20.5595401Z [cluster2] },
2021-07-18T14:14:20.5595796Z [cluster2] {
2021-07-18T14:14:20.5596306Z [cluster2] "name": "SUBMARINER_COLORCODES",
2021-07-18T14:14:20.5596864Z [cluster2] "value": "blue"
2021-07-18T14:14:20.5597305Z [cluster2] },
2021-07-18T14:14:20.5597763Z [cluster2] {
2021-07-18T14:14:20.5598259Z [cluster2] "name": "SUBMARINER_DEBUG",
2021-07-18T14:14:20.5598778Z [cluster2] "value": "false"
2021-07-18T14:14:20.5599225Z [cluster2] },
2021-07-18T14:14:20.5599614Z [cluster2] {
2021-07-18T14:14:20.5600135Z [cluster2] "name": "SUBMARINER_NATENABLED",
2021-07-18T14:14:20.5600684Z [cluster2] "value": "false"
2021-07-18T14:14:20.5601131Z [cluster2] },
2021-07-18T14:14:20.5601517Z [cluster2] {
2021-07-18T14:14:20.5602015Z [cluster2] "name": "SUBMARINER_BROKER",
2021-07-18T14:14:20.5602544Z [cluster2] "value": "k8s"
2021-07-18T14:14:20.5602964Z [cluster2] },
2021-07-18T14:14:20.5603358Z [cluster2] {
2021-07-18T14:14:20.5603877Z [cluster2] "name": "SUBMARINER_CABLEDRIVER",
2021-07-18T14:14:20.5604469Z [cluster2] "value": "libreswan"
2021-07-18T14:14:20.5605654Z [cluster2] },
2021-07-18T14:14:20.5606236Z [cluster2] {
2021-07-18T14:14:20.5606730Z [cluster2] "name": "BROKER_K8S_APISERVER",
2021-07-18T14:14:20.5607275Z [cluster2] "value": "172.18.0.8:6443"
2021-07-18T14:14:20.5607710Z [cluster2] },
2021-07-18T14:14:20.5608240Z [cluster2] {
2021-07-18T14:14:20.5609192Z [cluster2] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-18T14:14:20.5724763Z [cluster2] "value": "***"
2021-07-18T14:14:20.5725294Z [cluster2] },
2021-07-18T14:14:20.5725717Z [cluster2] {
2021-07-18T14:14:20.5726718Z [cluster2] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-18T14:14:20.5727835Z [cluster2] "value": "submariner-k8s-broker"
2021-07-18T14:14:20.5728442Z [cluster2] },
2021-07-18T14:14:20.5728879Z [cluster2] {
2021-07-18T14:14:20.5729368Z [cluster2] "name": "BROKER_K8S_CA",
2021-07-18T14:14:20.6231588Z [cluster2] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS29oCmJ3aThGZUJLbStERUlucFhlazBPNkd5cGdBUUgxN1l5ZTV5enhmVkpERmZDT2libWdMMktzdEtpeEh2Ni9XRlEKc01PNDZzUTN3RTVUd3RYTzJReGRhQUJKS2Fka0ptaWU2OEVQRVE1TllwdXJSWm5CTkp4bVhHTU1tWDdsVHJSOQpBdGFINm9jUmxvN0ViT1lyM2tnYVY1RmYxMDhLVzRxak9ySzFEbEFmL25icHRFc0RCN2VhKzcyTmVFNFlVMS9CCjBpMEw4SlhldFhZNjk1SHNnTEpZZlVsZXVTUUoyTnlsQnVPS3NXQ0xrSk02R2EvbUVNQUpIOExQOTRPaXFnWlYKdFJTZjRzYWlMeG5KNEc3WjZ0MXNhVzZZeXdQbkZ4UHB2eCtlMzExOVJhYjJ5VUxyWFluK3p6bjBtcmVnN29WMQpkTXlFMHVyaWs4eXUxblIrSW5NQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQY2srbWloNk9ranl3c0JyOE9uT0JlYnZCZC9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDS1duUnlVZG1qWnd0dTlhRnFqaS9heHpETS9VZndtS0RJTFR4UFVjT0tSdXpTcS9JcwpZTGNVNUxGZFhTalRkVkVyOUdYUXk3dUJHQU9OcnRUempxNUxKUkFCazVPeVZnUkhSa0MvMGZrSXhmbVlzeXRLCk1vTGZESTM4Y3JhSkNycFN5ZnB1OERDWWJYZi85Q3lqQUV1WUsySS80VGJkZG4xckxTVzUvVnRaU1lXWEI2WXUKN2JkalMwc1lmZHBtVnAxOFVJbmxnNzRUUjZlMmxLNWZlRjdtbk9udUh5RVlwR1AwbTdwaVVwR2RqZVdlekE2OAorYnZkRHZkUEFyZi9zMTBFeC9pRUdOVDRIcTU2U3hDQmdMRXdFekd2YkxwZzVzTWdleWgweWUxTWJvYlozL3p2Cm9rbEZJaGhCUnhWcFF2R25waFcraElicUw4aFNzUU1tbVkzYQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg=="
2021-07-18T14:14:20.6766482Z [cluster2] },
2021-07-18T14:14:20.6766950Z [cluster2] {
2021-07-18T14:14:20.6767480Z [cluster2] "name": "CE_IPSEC_PSK",
2021-07-18T14:14:20.6768696Z [cluster2] "value": "x9rD3nVFmFOuBKQK7uq/b8kF8w3P69CvoWu3GMZ5HuGVZJR/TZDQ30yF6Xp2Rg8y"
2021-07-18T14:14:20.6769580Z [cluster2] },
2021-07-18T14:14:20.6770015Z [cluster2] {
2021-07-18T14:14:20.6770516Z [cluster2] "name": "CE_IPSEC_DEBUG",
2021-07-18T14:14:20.6771073Z [cluster2] "value": "false"
2021-07-18T14:14:20.6771538Z [cluster2] },
2021-07-18T14:14:20.6771967Z [cluster2] {
2021-07-18T14:14:20.6772588Z [cluster2] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-18T14:14:20.6773270Z [cluster2] "value": "true"
2021-07-18T14:14:20.6773731Z [cluster2] },
2021-07-18T14:14:20.6774159Z [cluster2] {
2021-07-18T14:14:20.6774801Z [cluster2] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-18T14:14:20.6775463Z [cluster2] "value": "1"
2021-07-18T14:14:20.6775920Z [cluster2] },
2021-07-18T14:14:20.6776448Z [cluster2] {
2021-07-18T14:14:20.6777176Z [cluster2] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-18T14:14:20.6777918Z [cluster2] "value": "5"
2021-07-18T14:14:20.6778509Z [cluster2] },
2021-07-18T14:14:20.6778925Z [cluster2] {
2021-07-18T14:14:20.6779411Z [cluster2] "name": "NODE_NAME",
2021-07-18T14:14:20.6779943Z [cluster2] "valueFrom": {
2021-07-18T14:14:20.6780565Z [cluster2] "fieldRef": {
2021-07-18T14:14:20.6781131Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:20.6781772Z [cluster2] "fieldPath": "spec.nodeName"
2021-07-18T14:14:20.6782353Z [cluster2] }
2021-07-18T14:14:20.6782782Z [cluster2] }
2021-07-18T14:14:20.6783213Z [cluster2] },
2021-07-18T14:14:20.6783627Z [cluster2] {
2021-07-18T14:14:20.6784122Z [cluster2] "name": "POD_NAME",
2021-07-18T14:14:20.6784651Z [cluster2] "valueFrom": {
2021-07-18T14:14:20.6785341Z [cluster2] "fieldRef": {
2021-07-18T14:14:20.6785902Z [cluster2] "apiVersion": "v1",
2021-07-18T14:14:20.6786535Z [cluster2] "fieldPath": "metadata.name"
2021-07-18T14:14:20.6787119Z [cluster2] }
2021-07-18T14:14:20.6787545Z [cluster2] }
2021-07-18T14:14:20.6787977Z [cluster2] },
2021-07-18T14:14:20.6788392Z [cluster2] {
2021-07-18T14:14:20.6788920Z [cluster2] "name": "CE_IPSEC_IKEPORT",
2021-07-18T14:14:20.6789455Z [cluster2] "value": "500"
2021-07-18T14:14:20.6789909Z [cluster2] },
2021-07-18T14:14:20.6790331Z [cluster2] {
2021-07-18T14:14:20.6790863Z [cluster2] "name": "CE_IPSEC_NATTPORT",
2021-07-18T14:14:20.6791423Z [cluster2] "value": "4500"
2021-07-18T14:14:20.6791872Z [cluster2] },
2021-07-18T14:14:20.6792299Z [cluster2] {
2021-07-18T14:14:20.6792871Z [cluster2] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-18T14:14:20.6793508Z [cluster2] "value": "false"
2021-07-18T14:14:20.6793983Z [cluster2] },
2021-07-18T14:14:20.6794409Z [cluster2] {
2021-07-18T14:14:20.6794941Z [cluster2] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-18T14:14:20.6795536Z [cluster2] "value": "false"
2021-07-18T14:14:20.6796000Z [cluster2] }
2021-07-18T14:14:20.6796420Z [cluster2] ],
2021-07-18T14:14:20.6797625Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-18T14:14:20.6798513Z [cluster2] "imagePullPolicy": "Always",
2021-07-18T14:14:20.6799422Z [cluster2] "name": "submariner-gateway",
2021-07-18T14:14:20.6800014Z [cluster2] "ports": [
2021-07-18T14:14:20.6800467Z [cluster2] {
2021-07-18T14:14:20.6800980Z [cluster2] "containerPort": 4500,
2021-07-18T14:14:20.6801546Z [cluster2] "hostPort": 4500,
2021-07-18T14:14:20.6802291Z [cluster2] "name": "cable-encaps",
2021-07-18T14:14:20.6802894Z [cluster2] "protocol": "UDP"
2021-07-18T14:14:20.6803382Z [cluster2] },
2021-07-18T14:14:20.6803796Z [cluster2] {
2021-07-18T14:14:20.6804319Z [cluster2] "containerPort": 4490,
2021-07-18T14:14:20.6804876Z [cluster2] "hostPort": 4490,
2021-07-18T14:14:20.6805633Z [cluster2] "name": "natt-discovery",
2021-07-18T14:14:20.6806223Z [cluster2] "protocol": "UDP"
2021-07-18T14:14:20.6806709Z [cluster2] }
2021-07-18T14:14:20.6807117Z [cluster2] ],
2021-07-18T14:14:20.6807591Z [cluster2] "resources": {},
2021-07-18T14:14:20.6808159Z [cluster2] "securityContext": {
2021-07-18T14:14:20.6808932Z [cluster2] "allowPrivilegeEscalation": true,
2021-07-18T14:14:20.6809667Z [cluster2] "capabilities": {
2021-07-18T14:14:20.6810258Z [cluster2] "add": [
2021-07-18T14:14:20.6810746Z [cluster2] "net_admin"
2021-07-18T14:14:20.6811202Z [cluster2] ],
2021-07-18T14:14:20.6811663Z [cluster2] "drop": [
2021-07-18T14:14:20.6812122Z [cluster2] "all"
2021-07-18T14:14:20.6812571Z [cluster2] ]
2021-07-18T14:14:20.6812989Z [cluster2] },
2021-07-18T14:14:20.6813506Z [cluster2] "privileged": true,
2021-07-18T14:14:20.6814219Z [cluster2] "readOnlyRootFilesystem": false,
2021-07-18T14:14:20.6814955Z [cluster2] "runAsNonRoot": false
2021-07-18T14:14:20.6815467Z [cluster2] },
2021-07-18T14:14:20.6816399Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-18T14:14:20.6817379Z [cluster2] "terminationMessagePolicy": "File",
2021-07-18T14:14:20.6818107Z [cluster2] "volumeMounts": [
2021-07-18T14:14:20.6818611Z [cluster2] {
2021-07-18T14:14:20.6819142Z [cluster2] "mountPath": "/etc/ipsec.d",
2021-07-18T14:14:20.6819732Z [cluster2] "name": "ipsecd"
2021-07-18T14:14:20.6820200Z [cluster2] },
2021-07-18T14:14:20.6820626Z [cluster2] {
2021-07-18T14:14:20.6821161Z [cluster2] "mountPath": "/var/lib/ipsec/nss",
2021-07-18T14:14:20.6821776Z [cluster2] "name": "ipsecnss"
2021-07-18T14:14:20.6822269Z [cluster2] },
2021-07-18T14:14:20.6822683Z [cluster2] {
2021-07-18T14:14:20.6823394Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-18T14:14:20.6824628Z [cluster2] "name": "submariner-gateway-token-4b6k9",
2021-07-18T14:14:20.6825587Z [cluster2] "readOnly": true
2021-07-18T14:14:20.6826072Z [cluster2] }
2021-07-18T14:14:20.6826493Z [cluster2] ]
2021-07-18T14:14:20.6826899Z [cluster2] }
2021-07-18T14:14:20.6827309Z [cluster2] ],
2021-07-18T14:14:20.6827846Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-18T14:14:20.6828535Z [cluster2] "enableServiceLinks": true,
2021-07-18T14:14:20.6829188Z [cluster2] "hostNetwork": true,
2021-07-18T14:14:20.6830082Z [cluster2] "nodeName": "cluster2-worker",
2021-07-18T14:14:20.6830721Z [cluster2] "nodeSelector": {
2021-07-18T14:14:20.6831336Z [cluster2] "submariner.io/gateway": "true"
2021-07-18T14:14:20.6831877Z [cluster2] },
2021-07-18T14:14:20.6832580Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-18T14:14:20.6833326Z [cluster2] "priority": 0,
2021-07-18T14:14:20.6833881Z [cluster2] "restartPolicy": "Always",
2021-07-18T14:14:20.6834792Z [cluster2] "schedulerName": "default-scheduler",
2021-07-18T14:14:20.6835527Z [cluster2] "securityContext": {},
2021-07-18T14:14:20.6836427Z [cluster2] "serviceAccount": "submariner-gateway",
2021-07-18T14:14:20.6837502Z [cluster2] "serviceAccountName": "submariner-gateway",
2021-07-18T14:14:20.6838475Z [cluster2] "terminationGracePeriodSeconds": 1,
2021-07-18T14:14:20.6839253Z [cluster2] "tolerations": [
2021-07-18T14:14:20.6839720Z [cluster2] {
2021-07-18T14:14:20.6840215Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6840693Z [cluster2] },
2021-07-18T14:14:20.6841112Z [cluster2] {
2021-07-18T14:14:20.6841601Z [cluster2] "effect": "NoExecute",
2021-07-18T14:14:20.6842475Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-18T14:14:20.6843166Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6843636Z [cluster2] },
2021-07-18T14:14:20.6844135Z [cluster2] {
2021-07-18T14:14:20.6844630Z [cluster2] "effect": "NoExecute",
2021-07-18T14:14:20.6845348Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-18T14:14:20.6846034Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6846526Z [cluster2] },
2021-07-18T14:14:20.6846926Z [cluster2] {
2021-07-18T14:14:20.6847435Z [cluster2] "effect": "NoSchedule",
2021-07-18T14:14:20.6848368Z [cluster2] "key": "node.kubernetes.io/disk-pressure",
2021-07-18T14:14:20.6849098Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6849584Z [cluster2] },
2021-07-18T14:14:20.6849989Z [cluster2] {
2021-07-18T14:14:20.6850500Z [cluster2] "effect": "NoSchedule",
2021-07-18T14:14:20.6851436Z [cluster2] "key": "node.kubernetes.io/memory-pressure",
2021-07-18T14:14:20.6852179Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6852660Z [cluster2] },
2021-07-18T14:14:20.6853074Z [cluster2] {
2021-07-18T14:14:20.6853576Z [cluster2] "effect": "NoSchedule",
2021-07-18T14:14:20.6854495Z [cluster2] "key": "node.kubernetes.io/pid-pressure",
2021-07-18T14:14:20.6855199Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6855690Z [cluster2] },
2021-07-18T14:14:20.6856102Z [cluster2] {
2021-07-18T14:14:20.6856604Z [cluster2] "effect": "NoSchedule",
2021-07-18T14:14:20.6857505Z [cluster2] "key": "node.kubernetes.io/unschedulable",
2021-07-18T14:14:20.6858160Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6858615Z [cluster2] },
2021-07-18T14:14:20.6858987Z [cluster2] {
2021-07-18T14:14:20.6859460Z [cluster2] "effect": "NoSchedule",
2021-07-18T14:14:20.6860370Z [cluster2] "key": "node.kubernetes.io/network-unavailable",
2021-07-18T14:14:20.6861095Z [cluster2] "operator": "Exists"
2021-07-18T14:14:20.6861533Z [cluster2] }
2021-07-18T14:14:20.6861917Z [cluster2] ],
2021-07-18T14:14:20.6862328Z [cluster2] "volumes": [
2021-07-18T14:14:20.6862730Z [cluster2] {
2021-07-18T14:14:20.6863168Z [cluster2] "emptyDir": {},
2021-07-18T14:14:20.6863641Z [cluster2] "name": "ipsecd"
2021-07-18T14:14:20.6864076Z [cluster2] },
2021-07-18T14:14:20.6864527Z [cluster2] {
2021-07-18T14:14:20.6865065Z [cluster2] "emptyDir": {},
2021-07-18T14:14:20.6865737Z [cluster2] "name": "ipsecnss"
2021-07-18T14:14:20.6866213Z [cluster2] },
2021-07-18T14:14:20.6866610Z [cluster2] {
2021-07-18T14:14:20.6867561Z [cluster2] "name": "submariner-gateway-token-4b6k9",
2021-07-18T14:14:20.6868329Z [cluster2] "secret": {
2021-07-18T14:14:20.6868860Z [cluster2] "defaultMode": 420,
2021-07-18T14:14:20.6869919Z [cluster2] "secretName": "submariner-gateway-token-4b6k9"
2021-07-18T14:14:20.6870690Z [cluster2] }
2021-07-18T14:14:20.6871109Z [cluster2] }
2021-07-18T14:14:20.6871503Z [cluster2] ]
2021-07-18T14:14:20.6871903Z [cluster2] },
2021-07-18T14:14:20.6872319Z [cluster2] "status": {
2021-07-18T14:14:20.6872804Z [cluster2] "conditions": [
2021-07-18T14:14:20.6873253Z [cluster2] {
2021-07-18T14:14:20.6873785Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:20.6874663Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:20Z",
2021-07-18T14:14:20.6875305Z [cluster2] "status": "True",
2021-07-18T14:14:20.6875859Z [cluster2] "type": "Initialized"
2021-07-18T14:14:20.6876349Z [cluster2] },
2021-07-18T14:14:20.6876762Z [cluster2] {
2021-07-18T14:14:20.6877275Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:20.6878252Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:39Z",
2021-07-18T14:14:20.6878873Z [cluster2] "status": "True",
2021-07-18T14:14:20.6879386Z [cluster2] "type": "Ready"
2021-07-18T14:14:20.6879835Z [cluster2] },
2021-07-18T14:14:20.6880248Z [cluster2] {
2021-07-18T14:14:20.6880756Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:20.6881638Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:39Z",
2021-07-18T14:14:20.6882276Z [cluster2] "status": "True",
2021-07-18T14:14:20.6882860Z [cluster2] "type": "ContainersReady"
2021-07-18T14:14:20.6883403Z [cluster2] },
2021-07-18T14:14:20.6883807Z [cluster2] {
2021-07-18T14:14:20.6884330Z [cluster2] "lastProbeTime": null,
2021-07-18T14:14:20.6885197Z [cluster2] "lastTransitionTime": "2021-07-18T14:13:20Z",
2021-07-18T14:14:20.6885830Z [cluster2] "status": "True",
2021-07-18T14:14:20.6886398Z [cluster2] "type": "PodScheduled"
2021-07-18T14:14:20.6886914Z [cluster2] }
2021-07-18T14:14:20.6887311Z [cluster2] ],
2021-07-18T14:14:20.6887846Z [cluster2] "containerStatuses": [
2021-07-18T14:14:20.6888369Z [cluster2] {
2021-07-18T14:14:20.6890159Z [cluster2] "containerID": "containerd://cb2e1e79bf309286fdf08fd3581e6f20e025ce11826f935b2630e94bee743a02",
2021-07-18T14:14:20.6892389Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-18T14:14:20.6894036Z [cluster2] "imageID": "localhost:5000/submariner-gateway@sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895",
2021-07-18T14:14:20.6895246Z [cluster2] "lastState": {},
2021-07-18T14:14:20.6896035Z [cluster2] "name": "submariner-gateway",
2021-07-18T14:14:20.6896656Z [cluster2] "ready": true,
2021-07-18T14:14:20.6897198Z [cluster2] "restartCount": 0,
2021-07-18T14:14:20.6897734Z [cluster2] "started": true,
2021-07-18T14:14:20.6898234Z [cluster2] "state": {
2021-07-18T14:14:20.6898703Z [cluster2] "running": {
2021-07-18T14:14:20.6899442Z [cluster2] "startedAt": "2021-07-18T14:13:38Z"
2021-07-18T14:14:20.6899945Z [cluster2] }
2021-07-18T14:14:20.6900369Z [cluster2] }
2021-07-18T14:14:20.6900851Z [cluster2] }
2021-07-18T14:14:20.6901266Z [cluster2] ],
2021-07-18T14:14:21.0404999Z [cluster2] "hostIP=jsonpath={.items..metadata.name}
2021-07-18T14:14:21.0406709Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:21.0409010Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-18T14:14:21.0411137Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-gateway-pt4f4.cluster1.json
2021-07-18T14:14:21.0412992Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-pt4f4 --namespace=submariner-operator -o json
2021-07-18T14:14:21.0414769Z [submariner-operator]$ [cluster1] tee /tmp/submariner-gateway-pt4f4.cluster1.json
2021-07-18T14:14:21.0416586Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-pt4f4 --namespace=submariner-operator -o json
2021-07-18T14:14:21.0418541Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-gateway-pt4f4 --namespace=submariner-operator -o json
2021-07-18T14:14:21.0419613Z [cluster1] {
2021-07-18T14:14:21.0420040Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:21.0420512Z [cluster1] "kind": "Pod",
2021-07-18T14:14:21.0420959Z [cluster1] "metadata": {
2021-07-18T14:14:21.0421915Z [cluster1] "creationTimestamp": "2021-07-18T14:12:59Z",
2021-07-18T14:14:21.0422808Z [cluster1] "generateName": "submariner-gateway-",
2021-07-18T14:14:21.0423414Z [cluster1] "labels": {
2021-07-18T14:14:21.0424115Z [cluster1] "app": "submariner-gateway",
2021-07-18T14:14:21.0425587Z [cluster1] "controller-revision-hash": "6c796f7c77",
2021-07-18T14:14:21.0426902Z [cluster1] "gateway.submariner.io/node": "cluster1-worker",
2021-07-18T14:14:21.0427804Z [cluster1] "gateway.submariner.io/status": "active",
2021-07-18T14:14:21.0428801Z [cluster1] "pod-template-generation": "1"
2021-07-18T14:14:21.0429396Z [cluster1] },
2021-07-18T14:14:21.0429893Z [cluster1] "managedFields": [
2021-07-18T14:14:21.0430392Z [cluster1] {
2021-07-18T14:14:21.0430869Z [cluster1] "apiVersion": "v1",
2021-07-18T14:14:21.0431469Z [cluster1] "fieldsType": "FieldsV1",
2021-07-18T14:14:21.0432038Z [cluster1] "fieldsV1": {
2021-07-18T14:14:21.0432558Z [cluster1] "f:metadata": {
2021-07-18T14:14:21.0433119Z [cluster1] "f:generateName": {},
2021-07-18T14:14:21.0433680Z [cluster1] "f:labels": {
2021-07-18T14:14:21.0434147Z [cluster1] ".": {},
2021-07-18T14:14:21.0434616Z [cluster1] "f:app": {},
2021-07-18T14:14:21.0435499Z [cluster1] "f:controller-revision-hash": {},
2021-07-18T14:14:21.0436530Z [cluster1] "f:pod-template-generation": {}
2021-07-18T14:14:21.0437286Z [cluster1] },
2021-07-18T14:14:21.0437832Z [cluster1] "f:ownerReferences": {
2021-07-18T14:14:21.0438392Z [cluster1] ".": {},
2021-07-18T14:14:21.0439287Z [cluster1] "k:{\"uid\":\"3c3843f6-8bb6-4a8c-8b4f-8c6b0a789e18\"}": {
2021-07-18T14:14:21.0439973Z [cluster1] ".": {},
2021-07-18T14:14:21.0440493Z [cluster1] "f:apiVersion": {},
2021-07-18T14:14:21.0441160Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-18T14:14:21.0441819Z [cluster1] "f:controller": {},
2021-07-18T14:14:21.0442341Z [cluster1] "f:kind": {},
2021-07-18T14:14:21.0443007Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0443496Z [cluster1] "f:uid": {}
2021-07-18T14:14:21.0443967Z [cluster1] }
2021-07-18T14:14:21.0444396Z [cluster1] }
2021-07-18T14:14:21.0444934Z [cluster1] },
2021-07-18T14:14:21.0445489Z [cluster1] "f:spec": {
2021-07-18T14:14:21.0446147Z [cluster1] "f:affinity": {
2021-07-18T14:14:21.0446637Z [cluster1] ".": {},
2021-07-18T14:14:21.0447160Z [cluster1] "f:nodeAffinity": {
2021-07-18T14:14:21.0447696Z [cluster1] ".": {},
2021-07-18T14:14:21.0448809Z [cluster1] "f:requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-18T14:14:21.0449998Z [cluster1] ".": {},
2021-07-18T14:14:21.0450586Z [cluster1] "f:nodeSelectorTerms": {}
2021-07-18T14:14:21.0451181Z [cluster1] }
2021-07-18T14:14:21.0451620Z [cluster1] },
2021-07-18T14:14:21.0452177Z [cluster1] "f:podAntiAffinity": {
2021-07-18T14:14:21.0452739Z [cluster1] ".": {},
2021-07-18T14:14:21.0453862Z [cluster1] "f:requiredDuringSchedulingIgnoredDuringExecution": {}
2021-07-18T14:14:21.0455010Z [cluster1] }
2021-07-18T14:14:21.0455525Z [cluster1] },
2021-07-18T14:14:21.0456028Z [cluster1] "f:containers": {
2021-07-18T14:14:21.0456948Z [cluster1] "k:{\"name\":\"submariner-gateway\"}": {
2021-07-18T14:14:21.0457574Z [cluster1] ".": {},
2021-07-18T14:14:21.0458061Z [cluster1] "f:command": {},
2021-07-18T14:14:21.0458573Z [cluster1] "f:env": {
2021-07-18T14:14:21.0459400Z [cluster1] ".": {},
2021-07-18T14:14:21.0459935Z [cluster1] "k:{\"name\":\"BROKER_K8S_APISERVER\"}": {
2021-07-18T14:14:21.0460482Z [cluster1] ".": {},
2021-07-18T14:14:21.0460931Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0461415Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0461856Z [cluster1] },
2021-07-18T14:14:21.0462433Z [cluster1] "k:{\"name\":\"BROKER_K8S_APISERVERTOKEN\"}": {
2021-07-18T14:14:21.0463015Z [cluster1] ".": {},
2021-07-18T14:14:21.0463466Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0463944Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0464386Z [cluster1] },
2021-07-18T14:14:21.0485139Z [cluster1] "k:{\"name\":\"BROKER_K8S_CA\"}": {
2021-07-18T14:14:21.0485762Z [cluster1] ".": {},
2021-07-18T14:14:21.0486239Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0486717Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0487174Z [cluster1] },
2021-07-18T14:14:21.0487771Z [cluster1] "k:{\"name\":\"BROKER_K8S_REMOTENAMESPACE\"}": {
2021-07-18T14:14:21.0488367Z [cluster1] ".": {},
2021-07-18T14:14:21.0488829Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0489293Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0489744Z [cluster1] },
2021-07-18T14:14:21.0490417Z [cluster1] "k:{\"name\":\"CE_IPSEC_DEBUG\"}": {
2021-07-18T14:14:21.0490942Z [cluster1] ".": {},
2021-07-18T14:14:21.0491402Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0491867Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0492319Z [cluster1] },
2021-07-18T14:14:21.0492855Z [cluster1] "k:{\"name\":\"CE_IPSEC_FORCEENCAPS\"}": {
2021-07-18T14:14:21.0493419Z [cluster1] ".": {},
2021-07-18T14:14:21.0493868Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0494485Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0494924Z [cluster1] },
2021-07-18T14:14:21.0495440Z [cluster1] "k:{\"name\":\"CE_IPSEC_IKEPORT\"}": {
2021-07-18T14:14:21.0495973Z [cluster1] ".": {},
2021-07-18T14:14:21.0496417Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0496896Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0497333Z [cluster1] },
2021-07-18T14:14:21.0497856Z [cluster1] "k:{\"name\":\"CE_IPSEC_NATTPORT\"}": {
2021-07-18T14:14:21.0498381Z [cluster1] ".": {},
2021-07-18T14:14:21.0498924Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0499402Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0499845Z [cluster1] },
2021-07-18T14:14:21.0500425Z [cluster1] "k:{\"name\":\"CE_IPSEC_PREFERREDSERVER\"}": {
2021-07-18T14:14:21.0500998Z [cluster1] ".": {},
2021-07-18T14:14:21.0501461Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0501926Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0502374Z [cluster1] },
2021-07-18T14:14:21.0502865Z [cluster1] "k:{\"name\":\"CE_IPSEC_PSK\"}": {
2021-07-18T14:14:21.0503374Z [cluster1] ".": {},
2021-07-18T14:14:21.0503833Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0504295Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0505029Z [cluster1] },
2021-07-18T14:14:21.0505554Z [cluster1] "k:{\"name\":\"NODE_NAME\"}": {
2021-07-18T14:14:21.0506090Z [cluster1] ".": {},
2021-07-18T14:14:21.0506572Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0507120Z [cluster1] "f:valueFrom": {
2021-07-18T14:14:21.0507634Z [cluster1] ".": {},
2021-07-18T14:14:21.0508161Z [cluster1] "f:fieldRef": {
2021-07-18T14:14:21.0508689Z [cluster1] ".": {},
2021-07-18T14:14:21.0509225Z [cluster1] "f:apiVersion": {},
2021-07-18T14:14:21.0509826Z [cluster1] "f:fieldPath": {}
2021-07-18T14:14:21.0510349Z [cluster1] }
2021-07-18T14:14:21.0510814Z [cluster1] }
2021-07-18T14:14:21.0511264Z [cluster1] },
2021-07-18T14:14:21.0511794Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-18T14:14:21.0512323Z [cluster1] ".": {},
2021-07-18T14:14:21.0512886Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0513437Z [cluster1] "f:valueFrom": {
2021-07-18T14:14:21.0513950Z [cluster1] ".": {},
2021-07-18T14:14:21.0514473Z [cluster1] "f:fieldRef": {
2021-07-18T14:14:21.0514991Z [cluster1] ".": {},
2021-07-18T14:14:21.0515542Z [cluster1] "f:apiVersion": {},
2021-07-18T14:14:21.0516126Z [cluster1] "f:fieldPath": {}
2021-07-18T14:14:21.0516658Z [cluster1] }
2021-07-18T14:14:21.0517127Z [cluster1] }
2021-07-18T14:14:21.0517671Z [cluster1] },
2021-07-18T14:14:21.0518213Z [cluster1] "k:{\"name\":\"SUBMARINER_BROKER\"}": {
2021-07-18T14:14:21.0518743Z [cluster1] ".": {},
2021-07-18T14:14:21.0519204Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0519666Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0520116Z [cluster1] },
2021-07-18T14:14:21.0520681Z [cluster1] "k:{\"name\":\"SUBMARINER_CABLEDRIVER\"}": {
2021-07-18T14:14:21.0521503Z [cluster1] ".": {},
2021-07-18T14:14:21.0522001Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0522594Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0523095Z [cluster1] },
2021-07-18T14:14:21.0523646Z [cluster1] "k:{\"name\":\"SUBMARINER_CLUSTERCIDR\"}": {
2021-07-18T14:14:21.0524218Z [cluster1] ".": {},
2021-07-18T14:14:21.0524660Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0525138Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0525585Z [cluster1] },
2021-07-18T14:14:21.0526165Z [cluster1] "k:{\"name\":\"SUBMARINER_CLUSTERID\"}": {
2021-07-18T14:14:21.0526733Z [cluster1] ".": {},
2021-07-18T14:14:21.0527187Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0527673Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0528113Z [cluster1] },
2021-07-18T14:14:21.0528675Z [cluster1] "k:{\"name\":\"SUBMARINER_COLORCODES\"}": {
2021-07-18T14:14:21.0529243Z [cluster1] ".": {},
2021-07-18T14:14:21.0529694Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0530172Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0530611Z [cluster1] },
2021-07-18T14:14:21.0531141Z [cluster1] "k:{\"name\":\"SUBMARINER_DEBUG\"}": {
2021-07-18T14:14:21.0531670Z [cluster1] ".": {},
2021-07-18T14:14:21.0532131Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0556823Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0557442Z [cluster1] },
2021-07-18T14:14:21.0558018Z [cluster1] "k:{\"name\":\"SUBMARINER_GLOBALCIDR\"}": {
2021-07-18T14:14:21.0558585Z [cluster1] ".": {},
2021-07-18T14:14:21.0559052Z [cluster1] "f:name": {}
2021-07-18T14:14:21.0559651Z [cluster1] },
2021-07-18T14:14:21.0560290Z [cluster1] "k:{\"name\":\"SUBMARINER_HEALTHCHECKENABLED\"}": {
2021-07-18T14:14:21.0560918Z [cluster1] ".": {},
2021-07-18T14:14:21.0561384Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0561869Z [cluster1] "f:value": {}
2021-07-18T14:14:21.0562320Z [cluster1] },
2021-07-18T14:14:21.0562964Z [cluster1] "k:{\"name\":\"SUBMARINER_HEALTHCHECKINTERVAL\"}": {
2021-07-18T14:14:21.0563596Z [cluster1] ".": {},
2021-07-18T14:14:21.0564062Z [cluster1] "f:name": {},
2021-07-18T14:14:21.0564526Z [cluster1]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment