Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 29, 2021 17:46
Show Gist options
  • Save dfarrell07/01e177c53fea5e0199f362d60aa43090 to your computer and use it in GitHub Desktop.
Save dfarrell07/01e177c53fea5e0199f362d60aa43090 to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210723
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-23T01:25:27.2561841Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-23T01:25:27.2561908Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-23T01:25:34.7477672Z Current runner version: '2.278.0'
2021-07-23T01:25:34.7504981Z ##[group]Operating System
2021-07-23T01:25:34.7506679Z Ubuntu
2021-07-23T01:25:34.7507274Z 20.04.2
2021-07-23T01:25:34.7507745Z LTS
2021-07-23T01:25:34.7508309Z ##[endgroup]
2021-07-23T01:25:34.7508939Z ##[group]Virtual Environment
2021-07-23T01:25:34.7509691Z Environment: ubuntu-20.04
2021-07-23T01:25:34.7510293Z Version: 20210718.1
2021-07-23T01:25:34.7511479Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210718.1/images/linux/Ubuntu2004-README.md
2021-07-23T01:25:34.7512982Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210718.1
2021-07-23T01:25:34.7514017Z ##[endgroup]
2021-07-23T01:25:34.7516205Z ##[group]GITHUB_TOKEN Permissions
2021-07-23T01:25:34.7517617Z Actions: write
2021-07-23T01:25:34.7518189Z Checks: write
2021-07-23T01:25:34.7518769Z Contents: write
2021-07-23T01:25:34.7519315Z Deployments: write
2021-07-23T01:25:34.7520011Z Discussions: write
2021-07-23T01:25:34.7520639Z Issues: write
2021-07-23T01:25:34.7521210Z Metadata: read
2021-07-23T01:25:34.7521740Z Packages: write
2021-07-23T01:25:34.7522374Z PullRequests: write
2021-07-23T01:25:34.7523013Z RepositoryProjects: write
2021-07-23T01:25:34.7523946Z SecurityEvents: write
2021-07-23T01:25:34.7524570Z Statuses: write
2021-07-23T01:25:34.7525269Z ##[endgroup]
2021-07-23T01:25:34.7528654Z Prepare workflow directory
2021-07-23T01:25:34.8192231Z Prepare all required actions
2021-07-23T01:25:34.8204136Z Getting action download info
2021-07-23T01:25:35.2046914Z Download action repository 'actions/checkout@v2'
2021-07-23T01:25:36.8653577Z Download action repository 'submariner-io/shipyard@devel'
2021-07-23T01:25:37.3334822Z ##[group]Run actions/checkout@v2
2021-07-23T01:25:37.3335435Z with:
2021-07-23T01:25:37.3336025Z repository: submariner-io/submariner-operator
2021-07-23T01:25:37.3337047Z token: ***
2021-07-23T01:25:37.3337447Z ssh-strict: true
2021-07-23T01:25:37.3337946Z persist-credentials: true
2021-07-23T01:25:37.3338455Z clean: true
2021-07-23T01:25:37.3338855Z fetch-depth: 1
2021-07-23T01:25:37.3339236Z lfs: false
2021-07-23T01:25:37.3339633Z submodules: false
2021-07-23T01:25:37.3340035Z ##[endgroup]
2021-07-23T01:25:37.5564348Z Syncing repository: submariner-io/submariner-operator
2021-07-23T01:25:37.5565399Z ##[group]Getting Git version info
2021-07-23T01:25:37.5566563Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-23T01:25:37.5741512Z [command]/usr/bin/git version
2021-07-23T01:25:37.5924587Z git version 2.32.0
2021-07-23T01:25:37.5946137Z ##[endgroup]
2021-07-23T01:25:37.5954278Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-23T01:25:37.5958175Z ##[group]Initializing the repository
2021-07-23T01:25:37.5963233Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-23T01:25:37.6047212Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-23T01:25:37.6048453Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-23T01:25:37.6049497Z hint: of your new repositories, which will suppress this warning, call:
2021-07-23T01:25:37.6050262Z hint:
2021-07-23T01:25:37.6051220Z hint: git config --global init.defaultBranch <name>
2021-07-23T01:25:37.6051969Z hint:
2021-07-23T01:25:37.6052894Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-23T01:25:37.6054147Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-23T01:25:37.6054945Z hint:
2021-07-23T01:25:37.6055739Z hint: git branch -m <name>
2021-07-23T01:25:37.6067867Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-23T01:25:37.6079914Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-23T01:25:37.6122845Z ##[endgroup]
2021-07-23T01:25:37.6123789Z ##[group]Disabling automatic garbage collection
2021-07-23T01:25:37.6127805Z [command]/usr/bin/git config --local gc.auto 0
2021-07-23T01:25:37.6159599Z ##[endgroup]
2021-07-23T01:25:38.0431059Z ##[group]Setting up auth
2021-07-23T01:25:38.0432350Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-23T01:25:38.0434139Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-23T01:25:38.0435927Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-23T01:25:38.0438107Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-23T01:25:38.0440231Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-23T01:25:38.0441305Z ##[endgroup]
2021-07-23T01:25:38.0441967Z ##[group]Fetching the repository
2021-07-23T01:25:38.0443842Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +daeaed8188609258eb2de35213a76de353c5b83f:refs/remotes/origin/devel
2021-07-23T01:25:38.0445487Z remote: Enumerating objects: 485, done.
2021-07-23T01:25:38.0446117Z remote: Counting objects: 0% (1/485)
2021-07-23T01:25:38.0446806Z remote: Counting objects: 1% (5/485)
2021-07-23T01:25:38.0447508Z remote: Counting objects: 2% (10/485)
2021-07-23T01:25:38.0448203Z remote: Counting objects: 3% (15/485)
2021-07-23T01:25:38.0449058Z remote: Counting objects: 4% (20/485)
2021-07-23T01:25:38.0449780Z remote: Counting objects: 5% (25/485)
2021-07-23T01:25:38.0450466Z remote: Counting objects: 6% (30/485)
2021-07-23T01:25:38.0451158Z remote: Counting objects: 7% (34/485)
2021-07-23T01:25:38.0451865Z remote: Counting objects: 8% (39/485)
2021-07-23T01:25:38.0452540Z remote: Counting objects: 9% (44/485)
2021-07-23T01:25:38.0453233Z remote: Counting objects: 10% (49/485)
2021-07-23T01:25:38.0453904Z remote: Counting objects: 11% (54/485)
2021-07-23T01:25:38.0454592Z remote: Counting objects: 12% (59/485)
2021-07-23T01:25:38.0455283Z remote: Counting objects: 13% (64/485)
2021-07-23T01:25:38.0455955Z remote: Counting objects: 14% (68/485)
2021-07-23T01:25:38.0456645Z remote: Counting objects: 15% (73/485)
2021-07-23T01:25:38.0457316Z remote: Counting objects: 16% (78/485)
2021-07-23T01:25:38.0458022Z remote: Counting objects: 17% (83/485)
2021-07-23T01:25:38.0458717Z remote: Counting objects: 18% (88/485)
2021-07-23T01:25:38.0459440Z remote: Counting objects: 19% (93/485)
2021-07-23T01:25:38.0460129Z remote: Counting objects: 20% (97/485)
2021-07-23T01:25:38.0460923Z remote: Counting objects: 21% (102/485)
2021-07-23T01:25:38.0461572Z remote: Counting objects: 22% (107/485)
2021-07-23T01:25:38.0462667Z remote: Counting objects: 23% (112/485)
2021-07-23T01:25:38.0463318Z remote: Counting objects: 24% (117/485)
2021-07-23T01:25:38.0463943Z remote: Counting objects: 25% (122/485)
2021-07-23T01:25:38.0464588Z remote: Counting objects: 26% (127/485)
2021-07-23T01:25:38.0465335Z remote: Counting objects: 27% (131/485)
2021-07-23T01:25:38.0465998Z remote: Counting objects: 28% (136/485)
2021-07-23T01:25:38.0466645Z remote: Counting objects: 29% (141/485)
2021-07-23T01:25:38.0467287Z remote: Counting objects: 30% (146/485)
2021-07-23T01:25:38.0467933Z remote: Counting objects: 31% (151/485)
2021-07-23T01:25:38.0468561Z remote: Counting objects: 32% (156/485)
2021-07-23T01:25:38.0469208Z remote: Counting objects: 33% (161/485)
2021-07-23T01:25:38.0470048Z remote: Counting objects: 34% (165/485)
2021-07-23T01:25:38.0470896Z remote: Counting objects: 35% (170/485)
2021-07-23T01:25:38.0471595Z remote: Counting objects: 36% (175/485)
2021-07-23T01:25:38.0472271Z remote: Counting objects: 37% (180/485)
2021-07-23T01:25:38.0472960Z remote: Counting objects: 38% (185/485)
2021-07-23T01:25:38.0473646Z remote: Counting objects: 39% (190/485)
2021-07-23T01:25:38.0474321Z remote: Counting objects: 40% (194/485)
2021-07-23T01:25:38.0475011Z remote: Counting objects: 41% (199/485)
2021-07-23T01:25:38.0475693Z remote: Counting objects: 42% (204/485)
2021-07-23T01:25:38.0476372Z remote: Counting objects: 43% (209/485)
2021-07-23T01:25:38.0477063Z remote: Counting objects: 44% (214/485)
2021-07-23T01:25:38.0477733Z remote: Counting objects: 45% (219/485)
2021-07-23T01:25:38.0478424Z remote: Counting objects: 46% (224/485)
2021-07-23T01:25:38.0479111Z remote: Counting objects: 47% (228/485)
2021-07-23T01:25:38.0479793Z remote: Counting objects: 48% (233/485)
2021-07-23T01:25:38.0480508Z remote: Counting objects: 49% (238/485)
2021-07-23T01:25:38.0481274Z remote: Counting objects: 50% (243/485)
2021-07-23T01:25:38.0481970Z remote: Counting objects: 51% (248/485)
2021-07-23T01:25:38.0482659Z remote: Counting objects: 52% (253/485)
2021-07-23T01:25:38.0483332Z remote: Counting objects: 53% (258/485)
2021-07-23T01:25:38.0484019Z remote: Counting objects: 54% (262/485)
2021-07-23T01:25:38.0484687Z remote: Counting objects: 55% (267/485)
2021-07-23T01:25:38.0485473Z remote: Counting objects: 56% (272/485)
2021-07-23T01:25:38.0486177Z remote: Counting objects: 57% (277/485)
2021-07-23T01:25:38.0486847Z remote: Counting objects: 58% (282/485)
2021-07-23T01:25:38.0487534Z remote: Counting objects: 59% (287/485)
2021-07-23T01:25:38.0488218Z remote: Counting objects: 60% (291/485)
2021-07-23T01:25:38.0488904Z remote: Counting objects: 61% (296/485)
2021-07-23T01:25:38.0489595Z remote: Counting objects: 62% (301/485)
2021-07-23T01:25:38.0490262Z remote: Counting objects: 63% (306/485)
2021-07-23T01:25:38.0490948Z remote: Counting objects: 64% (311/485)
2021-07-23T01:25:38.0491635Z remote: Counting objects: 65% (316/485)
2021-07-23T01:25:38.0492301Z remote: Counting objects: 66% (321/485)
2021-07-23T01:25:38.0492985Z remote: Counting objects: 67% (325/485)
2021-07-23T01:25:38.0493656Z remote: Counting objects: 68% (330/485)
2021-07-23T01:25:38.0494339Z remote: Counting objects: 69% (335/485)
2021-07-23T01:25:38.0495034Z remote: Counting objects: 70% (340/485)
2021-07-23T01:25:38.0495711Z remote: Counting objects: 71% (345/485)
2021-07-23T01:25:38.0496398Z remote: Counting objects: 72% (350/485)
2021-07-23T01:25:38.0497133Z remote: Counting objects: 73% (355/485)
2021-07-23T01:25:38.0497836Z remote: Counting objects: 74% (359/485)
2021-07-23T01:25:38.0498522Z remote: Counting objects: 75% (364/485)
2021-07-23T01:25:38.0499195Z remote: Counting objects: 76% (369/485)
2021-07-23T01:25:38.0499880Z remote: Counting objects: 77% (374/485)
2021-07-23T01:25:38.0500547Z remote: Counting objects: 78% (379/485)
2021-07-23T01:25:38.0501233Z remote: Counting objects: 79% (384/485)
2021-07-23T01:25:38.0501926Z remote: Counting objects: 80% (388/485)
2021-07-23T01:25:38.0502596Z remote: Counting objects: 81% (393/485)
2021-07-23T01:25:38.0503284Z remote: Counting objects: 82% (398/485)
2021-07-23T01:25:38.0503980Z remote: Counting objects: 83% (403/485)
2021-07-23T01:25:38.0504651Z remote: Counting objects: 84% (408/485)
2021-07-23T01:25:38.0505469Z remote: Counting objects: 85% (413/485)
2021-07-23T01:25:38.0506451Z remote: Counting objects: 86% (418/485)
2021-07-23T01:25:38.0507431Z remote: Counting objects: 87% (422/485)
2021-07-23T01:25:38.0508126Z remote: Counting objects: 88% (427/485)
2021-07-23T01:25:38.0508803Z remote: Counting objects: 89% (432/485)
2021-07-23T01:25:38.0509495Z remote: Counting objects: 90% (437/485)
2021-07-23T01:25:38.0510182Z remote: Counting objects: 91% (442/485)
2021-07-23T01:25:38.0510859Z remote: Counting objects: 92% (447/485)
2021-07-23T01:25:38.0511547Z remote: Counting objects: 93% (452/485)
2021-07-23T01:25:38.0512231Z remote: Counting objects: 94% (456/485)
2021-07-23T01:25:38.0512907Z remote: Counting objects: 95% (461/485)
2021-07-23T01:25:38.0513604Z remote: Counting objects: 96% (466/485)
2021-07-23T01:25:38.0514278Z remote: Counting objects: 97% (471/485)
2021-07-23T01:25:38.0514968Z remote: Counting objects: 98% (476/485)
2021-07-23T01:25:38.0515654Z remote: Counting objects: 99% (481/485)
2021-07-23T01:25:38.0516327Z remote: Counting objects: 100% (485/485)
2021-07-23T01:25:38.0517057Z remote: Counting objects: 100% (485/485), done.
2021-07-23T01:25:38.0517793Z remote: Compressing objects: 0% (1/349)
2021-07-23T01:25:38.0518531Z remote: Compressing objects: 1% (4/349)
2021-07-23T01:25:38.0524612Z remote: Compressing objects: 2% (7/349)
2021-07-23T01:25:38.0525394Z remote: Compressing objects: 3% (11/349)
2021-07-23T01:25:38.0526155Z remote: Compressing objects: 4% (14/349)
2021-07-23T01:25:38.0526911Z remote: Compressing objects: 5% (18/349)
2021-07-23T01:25:38.0527639Z remote: Compressing objects: 6% (21/349)
2021-07-23T01:25:38.0528490Z remote: Compressing objects: 7% (25/349)
2021-07-23T01:25:38.0529239Z remote: Compressing objects: 8% (28/349)
2021-07-23T01:25:38.0529990Z remote: Compressing objects: 9% (32/349)
2021-07-23T01:25:38.0530737Z remote: Compressing objects: 10% (35/349)
2021-07-23T01:25:38.0531479Z remote: Compressing objects: 11% (39/349)
2021-07-23T01:25:38.0532219Z remote: Compressing objects: 12% (42/349)
2021-07-23T01:25:38.0532954Z remote: Compressing objects: 13% (46/349)
2021-07-23T01:25:38.0533678Z remote: Compressing objects: 14% (49/349)
2021-07-23T01:25:38.0534417Z remote: Compressing objects: 15% (53/349)
2021-07-23T01:25:38.0535135Z remote: Compressing objects: 16% (56/349)
2021-07-23T01:25:38.0535877Z remote: Compressing objects: 17% (60/349)
2021-07-23T01:25:38.0536612Z remote: Compressing objects: 18% (63/349)
2021-07-23T01:25:38.0537344Z remote: Compressing objects: 19% (67/349)
2021-07-23T01:25:38.0538087Z remote: Compressing objects: 20% (70/349)
2021-07-23T01:25:38.0538801Z remote: Compressing objects: 21% (74/349)
2021-07-23T01:25:38.0539538Z remote: Compressing objects: 22% (77/349)
2021-07-23T01:25:38.0540274Z remote: Compressing objects: 23% (81/349)
2021-07-23T01:25:38.0541004Z remote: Compressing objects: 24% (84/349)
2021-07-23T01:25:38.0541748Z remote: Compressing objects: 25% (88/349)
2021-07-23T01:25:38.0542485Z remote: Compressing objects: 26% (91/349)
2021-07-23T01:25:38.0543209Z remote: Compressing objects: 27% (95/349)
2021-07-23T01:25:38.0543944Z remote: Compressing objects: 28% (98/349)
2021-07-23T01:25:38.0544671Z remote: Compressing objects: 29% (102/349)
2021-07-23T01:25:38.0545700Z remote: Compressing objects: 30% (105/349)
2021-07-23T01:25:38.0546451Z remote: Compressing objects: 31% (109/349)
2021-07-23T01:25:38.0547207Z remote: Compressing objects: 32% (112/349)
2021-07-23T01:25:38.0547952Z remote: Compressing objects: 33% (116/349)
2021-07-23T01:25:38.0548678Z remote: Compressing objects: 34% (119/349)
2021-07-23T01:25:38.0549423Z remote: Compressing objects: 35% (123/349)
2021-07-23T01:25:38.0550166Z remote: Compressing objects: 36% (126/349)
2021-07-23T01:25:38.0551014Z remote: Compressing objects: 37% (130/349)
2021-07-23T01:25:38.0551764Z remote: Compressing objects: 38% (133/349)
2021-07-23T01:25:38.0552492Z remote: Compressing objects: 39% (137/349)
2021-07-23T01:25:38.0553233Z remote: Compressing objects: 40% (140/349)
2021-07-23T01:25:38.0553978Z remote: Compressing objects: 41% (144/349)
2021-07-23T01:25:38.0554702Z remote: Compressing objects: 42% (147/349)
2021-07-23T01:25:38.0555442Z remote: Compressing objects: 43% (151/349)
2021-07-23T01:25:38.0556192Z remote: Compressing objects: 44% (154/349)
2021-07-23T01:25:38.0556920Z remote: Compressing objects: 45% (158/349)
2021-07-23T01:25:38.0557663Z remote: Compressing objects: 46% (161/349)
2021-07-23T01:25:38.0558392Z remote: Compressing objects: 47% (165/349)
2021-07-23T01:25:38.0559167Z remote: Compressing objects: 48% (168/349)
2021-07-23T01:25:38.0559924Z remote: Compressing objects: 49% (172/349)
2021-07-23T01:25:38.0560655Z remote: Compressing objects: 50% (175/349)
2021-07-23T01:25:38.0561393Z remote: Compressing objects: 51% (178/349)
2021-07-23T01:25:38.0562115Z remote: Compressing objects: 52% (182/349)
2021-07-23T01:25:38.0562860Z remote: Compressing objects: 53% (185/349)
2021-07-23T01:25:38.0563600Z remote: Compressing objects: 54% (189/349)
2021-07-23T01:25:38.0564324Z remote: Compressing objects: 55% (192/349)
2021-07-23T01:25:38.0565068Z remote: Compressing objects: 56% (196/349)
2021-07-23T01:25:38.0565804Z remote: Compressing objects: 57% (199/349)
2021-07-23T01:25:38.0566609Z remote: Compressing objects: 58% (203/349)
2021-07-23T01:25:38.0567372Z remote: Compressing objects: 59% (206/349)
2021-07-23T01:25:38.0568100Z remote: Compressing objects: 60% (210/349)
2021-07-23T01:25:38.0568841Z remote: Compressing objects: 61% (213/349)
2021-07-23T01:25:38.0569591Z remote: Compressing objects: 62% (217/349)
2021-07-23T01:25:38.0570317Z remote: Compressing objects: 63% (220/349)
2021-07-23T01:25:38.0571056Z remote: Compressing objects: 64% (224/349)
2021-07-23T01:25:38.0571783Z remote: Compressing objects: 65% (227/349)
2021-07-23T01:25:38.0572523Z remote: Compressing objects: 66% (231/349)
2021-07-23T01:25:38.0573367Z remote: Compressing objects: 67% (234/349)
2021-07-23T01:25:38.0574043Z remote: Compressing objects: 68% (238/349)
2021-07-23T01:25:38.0574732Z remote: Compressing objects: 69% (241/349)
2021-07-23T01:25:38.0575421Z remote: Compressing objects: 70% (245/349)
2021-07-23T01:25:38.0576101Z remote: Compressing objects: 71% (248/349)
2021-07-23T01:25:38.0576790Z remote: Compressing objects: 72% (252/349)
2021-07-23T01:25:38.0577462Z remote: Compressing objects: 73% (255/349)
2021-07-23T01:25:38.0578226Z remote: Compressing objects: 74% (259/349)
2021-07-23T01:25:38.0578921Z remote: Compressing objects: 75% (262/349)
2021-07-23T01:25:38.0579592Z remote: Compressing objects: 76% (266/349)
2021-07-23T01:25:38.0580283Z remote: Compressing objects: 77% (269/349)
2021-07-23T01:25:38.0580953Z remote: Compressing objects: 78% (273/349)
2021-07-23T01:25:38.0581640Z remote: Compressing objects: 79% (276/349)
2021-07-23T01:25:38.0582329Z remote: Compressing objects: 80% (280/349)
2021-07-23T01:25:38.0583171Z remote: Compressing objects: 81% (283/349)
2021-07-23T01:25:38.0583910Z remote: Compressing objects: 82% (287/349)
2021-07-23T01:25:38.0584639Z remote: Compressing objects: 83% (290/349)
2021-07-23T01:25:38.0585691Z remote: Compressing objects: 84% (294/349)
2021-07-23T01:25:38.0586442Z remote: Compressing objects: 85% (297/349)
2021-07-23T01:25:38.0587174Z remote: Compressing objects: 86% (301/349)
2021-07-23T01:25:38.0588046Z remote: Compressing objects: 87% (304/349)
2021-07-23T01:25:38.0588792Z remote: Compressing objects: 88% (308/349)
2021-07-23T01:25:38.0589520Z remote: Compressing objects: 89% (311/349)
2021-07-23T01:25:38.0590262Z remote: Compressing objects: 90% (315/349)
2021-07-23T01:25:38.0590994Z remote: Compressing objects: 91% (318/349)
2021-07-23T01:25:38.0591739Z remote: Compressing objects: 92% (322/349)
2021-07-23T01:25:38.0592482Z remote: Compressing objects: 93% (325/349)
2021-07-23T01:25:38.0593209Z remote: Compressing objects: 94% (329/349)
2021-07-23T01:25:38.0593956Z remote: Compressing objects: 95% (332/349)
2021-07-23T01:25:38.0594680Z remote: Compressing objects: 96% (336/349)
2021-07-23T01:25:38.0595418Z remote: Compressing objects: 97% (339/349)
2021-07-23T01:25:38.0596162Z remote: Compressing objects: 98% (343/349)
2021-07-23T01:25:38.0596887Z remote: Compressing objects: 99% (346/349)
2021-07-23T01:25:38.0597640Z remote: Compressing objects: 100% (349/349)
2021-07-23T01:25:38.0598410Z remote: Compressing objects: 100% (349/349), done.
2021-07-23T01:25:38.0599110Z Receiving objects: 0% (1/485)
2021-07-23T01:25:38.0599745Z Receiving objects: 1% (5/485)
2021-07-23T01:25:38.0600471Z Receiving objects: 2% (10/485)
2021-07-23T01:25:38.0601066Z Receiving objects: 3% (15/485)
2021-07-23T01:25:38.0601649Z Receiving objects: 4% (20/485)
2021-07-23T01:25:38.0602225Z Receiving objects: 5% (25/485)
2021-07-23T01:25:38.0602816Z Receiving objects: 6% (30/485)
2021-07-23T01:25:38.0603392Z Receiving objects: 7% (34/485)
2021-07-23T01:25:38.0604055Z Receiving objects: 8% (39/485)
2021-07-23T01:25:38.0604661Z Receiving objects: 9% (44/485)
2021-07-23T01:25:38.0605233Z Receiving objects: 10% (49/485)
2021-07-23T01:25:38.0605838Z Receiving objects: 11% (54/485)
2021-07-23T01:25:38.0606433Z Receiving objects: 12% (59/485)
2021-07-23T01:25:38.0607005Z Receiving objects: 13% (64/485)
2021-07-23T01:25:38.0607793Z Receiving objects: 14% (68/485)
2021-07-23T01:25:38.0608420Z Receiving objects: 15% (73/485)
2021-07-23T01:25:38.0609036Z Receiving objects: 16% (78/485)
2021-07-23T01:25:38.0609668Z Receiving objects: 17% (83/485)
2021-07-23T01:25:38.0610279Z Receiving objects: 18% (88/485)
2021-07-23T01:25:38.0610902Z Receiving objects: 19% (93/485)
2021-07-23T01:25:38.0611529Z Receiving objects: 20% (97/485)
2021-07-23T01:25:38.0612144Z Receiving objects: 21% (102/485)
2021-07-23T01:25:38.0612777Z Receiving objects: 22% (107/485)
2021-07-23T01:25:38.0613393Z Receiving objects: 23% (112/485)
2021-07-23T01:25:38.0614037Z Receiving objects: 24% (117/485)
2021-07-23T01:25:38.0614672Z Receiving objects: 25% (122/485)
2021-07-23T01:25:38.0615291Z Receiving objects: 26% (127/485)
2021-07-23T01:25:38.0615926Z Receiving objects: 27% (131/485)
2021-07-23T01:25:38.0616538Z Receiving objects: 28% (136/485)
2021-07-23T01:25:38.0617172Z Receiving objects: 29% (141/485)
2021-07-23T01:25:38.0617818Z Receiving objects: 30% (146/485)
2021-07-23T01:25:38.0618439Z Receiving objects: 31% (151/485)
2021-07-23T01:25:38.0619069Z Receiving objects: 32% (156/485)
2021-07-23T01:25:38.0619687Z Receiving objects: 33% (161/485)
2021-07-23T01:25:38.0620326Z Receiving objects: 34% (165/485)
2021-07-23T01:25:38.0620955Z Receiving objects: 35% (170/485)
2021-07-23T01:25:38.0621567Z Receiving objects: 36% (175/485)
2021-07-23T01:25:38.0622195Z Receiving objects: 37% (180/485)
2021-07-23T01:25:38.0622806Z Receiving objects: 38% (185/485)
2021-07-23T01:25:38.0623435Z Receiving objects: 39% (190/485)
2021-07-23T01:25:38.0624064Z Receiving objects: 40% (194/485)
2021-07-23T01:25:38.0624680Z Receiving objects: 41% (199/485)
2021-07-23T01:25:38.0625422Z Receiving objects: 42% (204/485)
2021-07-23T01:25:38.0686868Z Receiving objects: 43% (209/485)
2021-07-23T01:25:38.0690308Z Receiving objects: 44% (214/485)
2021-07-23T01:25:38.0691960Z Receiving objects: 45% (219/485)
2021-07-23T01:25:38.0693690Z Receiving objects: 46% (224/485)
2021-07-23T01:25:38.0695170Z Receiving objects: 47% (228/485)
2021-07-23T01:25:38.0696712Z Receiving objects: 48% (233/485)
2021-07-23T01:25:38.0698173Z Receiving objects: 49% (238/485)
2021-07-23T01:25:38.0699656Z Receiving objects: 50% (243/485)
2021-07-23T01:25:38.0701112Z Receiving objects: 51% (248/485)
2021-07-23T01:25:38.0703165Z Receiving objects: 52% (253/485)
2021-07-23T01:25:38.0704461Z Receiving objects: 53% (258/485)
2021-07-23T01:25:38.0705410Z Receiving objects: 54% (262/485)
2021-07-23T01:25:38.0706789Z Receiving objects: 55% (267/485)
2021-07-23T01:25:38.0707514Z Receiving objects: 56% (272/485)
2021-07-23T01:25:38.0708030Z Receiving objects: 57% (277/485)
2021-07-23T01:25:38.0710245Z Receiving objects: 58% (282/485)
2021-07-23T01:25:38.0710771Z Receiving objects: 59% (287/485)
2021-07-23T01:25:38.0711302Z Receiving objects: 60% (291/485)
2021-07-23T01:25:38.0711813Z Receiving objects: 61% (296/485)
2021-07-23T01:25:38.0712338Z Receiving objects: 62% (301/485)
2021-07-23T01:25:38.0712878Z Receiving objects: 63% (306/485)
2021-07-23T01:25:38.0713388Z Receiving objects: 64% (311/485)
2021-07-23T01:25:38.0713917Z Receiving objects: 65% (316/485)
2021-07-23T01:25:38.0714429Z Receiving objects: 66% (321/485)
2021-07-23T01:25:38.0714951Z Receiving objects: 67% (325/485)
2021-07-23T01:25:38.0715460Z Receiving objects: 68% (330/485)
2021-07-23T01:25:38.0715982Z Receiving objects: 69% (335/485)
2021-07-23T01:25:38.0716492Z Receiving objects: 70% (340/485)
2021-07-23T01:25:38.0717012Z Receiving objects: 71% (345/485)
2021-07-23T01:25:38.0717516Z Receiving objects: 72% (350/485)
2021-07-23T01:25:38.0718190Z Receiving objects: 73% (355/485)
2021-07-23T01:25:38.0718729Z Receiving objects: 74% (359/485)
2021-07-23T01:25:38.0719239Z Receiving objects: 75% (364/485)
2021-07-23T01:25:38.0719765Z Receiving objects: 76% (369/485)
2021-07-23T01:25:38.0720273Z Receiving objects: 77% (374/485)
2021-07-23T01:25:38.0720802Z Receiving objects: 78% (379/485)
2021-07-23T01:25:38.0721320Z Receiving objects: 79% (384/485)
2021-07-23T01:25:38.0721844Z Receiving objects: 80% (388/485)
2021-07-23T01:25:38.0722351Z Receiving objects: 81% (393/485)
2021-07-23T01:25:38.0722877Z Receiving objects: 82% (398/485)
2021-07-23T01:25:38.0723386Z Receiving objects: 83% (403/485)
2021-07-23T01:25:38.0723914Z Receiving objects: 84% (408/485)
2021-07-23T01:25:38.0724422Z Receiving objects: 85% (413/485)
2021-07-23T01:25:38.0724944Z Receiving objects: 86% (418/485)
2021-07-23T01:25:38.0725465Z Receiving objects: 87% (422/485)
2021-07-23T01:25:38.0725975Z Receiving objects: 88% (427/485)
2021-07-23T01:25:38.0726505Z Receiving objects: 89% (432/485)
2021-07-23T01:25:38.0727015Z Receiving objects: 90% (437/485)
2021-07-23T01:25:38.0727537Z Receiving objects: 91% (442/485)
2021-07-23T01:25:38.0728049Z Receiving objects: 92% (447/485)
2021-07-23T01:25:38.0728574Z Receiving objects: 93% (452/485)
2021-07-23T01:25:38.0729085Z Receiving objects: 94% (456/485)
2021-07-23T01:25:38.0729617Z Receiving objects: 95% (461/485)
2021-07-23T01:25:38.0730126Z Receiving objects: 96% (466/485)
2021-07-23T01:25:38.0730648Z Receiving objects: 97% (471/485)
2021-07-23T01:25:38.0731935Z remote: Total 485 (delta 151), reused 300 (delta 90), pack-reused 0
2021-07-23T01:25:38.0732591Z Receiving objects: 98% (476/485)
2021-07-23T01:25:38.0733123Z Receiving objects: 99% (481/485)
2021-07-23T01:25:38.0733637Z Receiving objects: 100% (485/485)
2021-07-23T01:25:38.0734237Z Receiving objects: 100% (485/485), 349.04 KiB | 7.93 MiB/s, done.
2021-07-23T01:25:38.0734815Z Resolving deltas: 0% (0/151)
2021-07-23T01:25:38.0735325Z Resolving deltas: 1% (2/151)
2021-07-23T01:25:38.0735831Z Resolving deltas: 2% (4/151)
2021-07-23T01:25:38.0736338Z Resolving deltas: 3% (5/151)
2021-07-23T01:25:38.0736848Z Resolving deltas: 4% (7/151)
2021-07-23T01:25:38.0737343Z Resolving deltas: 5% (8/151)
2021-07-23T01:25:38.0737851Z Resolving deltas: 6% (10/151)
2021-07-23T01:25:38.0738346Z Resolving deltas: 7% (11/151)
2021-07-23T01:25:38.0738982Z Resolving deltas: 8% (13/151)
2021-07-23T01:25:38.0739480Z Resolving deltas: 9% (14/151)
2021-07-23T01:25:38.0739995Z Resolving deltas: 10% (16/151)
2021-07-23T01:25:38.0740494Z Resolving deltas: 11% (17/151)
2021-07-23T01:25:38.0741004Z Resolving deltas: 12% (19/151)
2021-07-23T01:25:38.0741500Z Resolving deltas: 13% (20/151)
2021-07-23T01:25:38.0742011Z Resolving deltas: 14% (22/151)
2021-07-23T01:25:38.0742506Z Resolving deltas: 15% (23/151)
2021-07-23T01:25:38.0743017Z Resolving deltas: 16% (25/151)
2021-07-23T01:25:38.0743528Z Resolving deltas: 17% (26/151)
2021-07-23T01:25:38.0744022Z Resolving deltas: 18% (28/151)
2021-07-23T01:25:38.0744537Z Resolving deltas: 19% (29/151)
2021-07-23T01:25:38.0745032Z Resolving deltas: 20% (31/151)
2021-07-23T01:25:38.0745748Z Resolving deltas: 21% (32/151)
2021-07-23T01:25:38.0746250Z Resolving deltas: 22% (34/151)
2021-07-23T01:25:38.0746758Z Resolving deltas: 23% (35/151)
2021-07-23T01:25:38.0747264Z Resolving deltas: 24% (37/151)
2021-07-23T01:25:38.0747772Z Resolving deltas: 25% (38/151)
2021-07-23T01:25:38.0748269Z Resolving deltas: 26% (40/151)
2021-07-23T01:25:38.0748779Z Resolving deltas: 27% (41/151)
2021-07-23T01:25:38.0749289Z Resolving deltas: 28% (43/151)
2021-07-23T01:25:38.0749783Z Resolving deltas: 29% (44/151)
2021-07-23T01:25:38.0750286Z Resolving deltas: 30% (46/151)
2021-07-23T01:25:38.0750783Z Resolving deltas: 31% (47/151)
2021-07-23T01:25:38.0751291Z Resolving deltas: 32% (49/151)
2021-07-23T01:25:38.0751783Z Resolving deltas: 33% (50/151)
2021-07-23T01:25:38.0752289Z Resolving deltas: 34% (52/151)
2021-07-23T01:25:38.0752871Z Resolving deltas: 35% (53/151)
2021-07-23T01:25:38.0753386Z Resolving deltas: 36% (55/151)
2021-07-23T01:25:38.0753880Z Resolving deltas: 37% (56/151)
2021-07-23T01:25:38.0754387Z Resolving deltas: 38% (58/151)
2021-07-23T01:25:38.0754883Z Resolving deltas: 39% (59/151)
2021-07-23T01:25:38.0755397Z Resolving deltas: 40% (61/151)
2021-07-23T01:25:38.0755916Z Resolving deltas: 41% (62/151)
2021-07-23T01:25:38.0756409Z Resolving deltas: 42% (64/151)
2021-07-23T01:25:38.0756921Z Resolving deltas: 43% (65/151)
2021-07-23T01:25:38.0757413Z Resolving deltas: 44% (67/151)
2021-07-23T01:25:38.0757924Z Resolving deltas: 45% (68/151)
2021-07-23T01:25:38.0758416Z Resolving deltas: 46% (70/151)
2021-07-23T01:25:38.0758924Z Resolving deltas: 47% (71/151)
2021-07-23T01:25:38.0759421Z Resolving deltas: 48% (73/151)
2021-07-23T01:25:38.0759965Z Resolving deltas: 49% (74/151)
2021-07-23T01:25:38.0760464Z Resolving deltas: 50% (76/151)
2021-07-23T01:25:38.0760968Z Resolving deltas: 51% (78/151)
2021-07-23T01:25:38.0761468Z Resolving deltas: 52% (79/151)
2021-07-23T01:25:38.0761978Z Resolving deltas: 53% (81/151)
2021-07-23T01:25:38.0762486Z Resolving deltas: 54% (82/151)
2021-07-23T01:25:38.0762978Z Resolving deltas: 55% (84/151)
2021-07-23T01:25:38.0763489Z Resolving deltas: 56% (85/151)
2021-07-23T01:25:38.0763985Z Resolving deltas: 57% (87/151)
2021-07-23T01:25:38.0764500Z Resolving deltas: 58% (88/151)
2021-07-23T01:25:38.0764991Z Resolving deltas: 59% (90/151)
2021-07-23T01:25:38.0765498Z Resolving deltas: 60% (91/151)
2021-07-23T01:25:38.0765994Z Resolving deltas: 61% (93/151)
2021-07-23T01:25:38.0766502Z Resolving deltas: 62% (94/151)
2021-07-23T01:25:38.0766995Z Resolving deltas: 63% (96/151)
2021-07-23T01:25:38.0767501Z Resolving deltas: 64% (97/151)
2021-07-23T01:25:38.0768010Z Resolving deltas: 65% (99/151)
2021-07-23T01:25:38.0768505Z Resolving deltas: 66% (100/151)
2021-07-23T01:25:38.0769021Z Resolving deltas: 67% (102/151)
2021-07-23T01:25:38.0769519Z Resolving deltas: 68% (103/151)
2021-07-23T01:25:38.0770037Z Resolving deltas: 69% (105/151)
2021-07-23T01:25:38.0770536Z Resolving deltas: 70% (106/151)
2021-07-23T01:25:38.0771049Z Resolving deltas: 71% (108/151)
2021-07-23T01:25:38.0771548Z Resolving deltas: 72% (109/151)
2021-07-23T01:25:38.0772059Z Resolving deltas: 73% (111/151)
2021-07-23T01:25:38.0772556Z Resolving deltas: 74% (112/151)
2021-07-23T01:25:38.0773148Z Resolving deltas: 75% (114/151)
2021-07-23T01:25:38.0773654Z Resolving deltas: 76% (115/151)
2021-07-23T01:25:38.0774167Z Resolving deltas: 77% (117/151)
2021-07-23T01:25:38.0774680Z Resolving deltas: 78% (118/151)
2021-07-23T01:25:38.0775177Z Resolving deltas: 79% (120/151)
2021-07-23T01:25:38.0775692Z Resolving deltas: 80% (121/151)
2021-07-23T01:25:38.0776191Z Resolving deltas: 81% (123/151)
2021-07-23T01:25:38.0776706Z Resolving deltas: 82% (124/151)
2021-07-23T01:25:38.0777209Z Resolving deltas: 83% (126/151)
2021-07-23T01:25:38.0777719Z Resolving deltas: 84% (127/151)
2021-07-23T01:25:38.0778222Z Resolving deltas: 85% (129/151)
2021-07-23T01:25:38.0778733Z Resolving deltas: 86% (130/151)
2021-07-23T01:25:38.0779230Z Resolving deltas: 87% (132/151)
2021-07-23T01:25:38.0779737Z Resolving deltas: 88% (133/151)
2021-07-23T01:25:38.0780234Z Resolving deltas: 89% (135/151)
2021-07-23T01:25:38.0780746Z Resolving deltas: 90% (136/151)
2021-07-23T01:25:38.0781261Z Resolving deltas: 91% (138/151)
2021-07-23T01:25:38.0781761Z Resolving deltas: 92% (139/151)
2021-07-23T01:25:38.0782274Z Resolving deltas: 93% (141/151)
2021-07-23T01:25:38.0782771Z Resolving deltas: 94% (142/151)
2021-07-23T01:25:38.0783280Z Resolving deltas: 95% (144/151)
2021-07-23T01:25:38.0783778Z Resolving deltas: 96% (145/151)
2021-07-23T01:25:38.0784289Z Resolving deltas: 97% (147/151)
2021-07-23T01:25:38.0784786Z Resolving deltas: 98% (148/151)
2021-07-23T01:25:38.0785404Z Resolving deltas: 99% (150/151)
2021-07-23T01:25:38.0785909Z Resolving deltas: 100% (151/151)
2021-07-23T01:25:38.0786452Z Resolving deltas: 100% (151/151), done.
2021-07-23T01:25:38.0787714Z From https://github.com/submariner-io/submariner-operator
2021-07-23T01:25:38.0789124Z * [new ref] daeaed8188609258eb2de35213a76de353c5b83f -> origin/devel
2021-07-23T01:25:38.0790035Z ##[endgroup]
2021-07-23T01:25:38.0790598Z ##[group]Determining the checkout info
2021-07-23T01:25:38.0791169Z ##[endgroup]
2021-07-23T01:25:38.0791659Z ##[group]Checking out the ref
2021-07-23T01:25:38.0792648Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-23T01:25:38.0793568Z Switched to a new branch 'devel'
2021-07-23T01:25:38.0794433Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-23T01:25:38.0795059Z ##[endgroup]
2021-07-23T01:25:38.0795719Z [command]/usr/bin/git log -1 --format='%H'
2021-07-23T01:25:38.0796652Z 'daeaed8188609258eb2de35213a76de353c5b83f'
2021-07-23T01:25:38.0878235Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-23T01:25:38.0878952Z ##[endgroup]
2021-07-23T01:25:38.1086737Z ##[group]Reclaiming free space
2021-07-23T01:25:50.0020545Z Filesystem Size Used Avail Use% Mounted on
2021-07-23T01:25:50.0021430Z /dev/root 84G 42G 42G 51% /
2021-07-23T01:25:50.0068202Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-23T01:25:50.0070922Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-23T01:25:50.0073728Z tmpfs 696M 1.1M 695M 1% /run
2021-07-23T01:25:50.0075950Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-23T01:25:50.0077970Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-23T01:25:50.0079178Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-23T01:25:50.0080300Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-23T01:25:50.0081374Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-23T01:25:50.0082530Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-23T01:25:50.0083566Z /dev/loop2 71M 71M 0 100% /snap/lxd/21029
2021-07-23T01:25:50.0084604Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-23T01:25:50.0085792Z /dev/loop5 68M 68M 0 100% /snap/lxd/20326
2021-07-23T01:25:50.0086815Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-23T01:25:50.0088403Z ##[endgroup]
2021-07-23T01:25:50.0245015Z ##[group]Disable swap
2021-07-23T01:25:50.0566785Z ##[endgroup]
2021-07-23T01:25:50.0711879Z ##[group]Report available RAM
2021-07-23T01:25:50.0935020Z total used free shared buff/cache available
2021-07-23T01:25:50.0937503Z Mem: 6.8Gi 493Mi 5.0Gi 7.0Mi 1.3Gi 6.0Gi
2021-07-23T01:25:50.0938232Z Swap: 0B 0B 0B
2021-07-23T01:25:50.0938963Z ##[endgroup]
2021-07-23T01:25:50.1158658Z Downloading Makefile.dapper
2021-07-23T01:25:50.1571956Z Downloading dapper
2021-07-23T01:25:50.3388315Z .dapper.tmp version v0.5.6
2021-07-23T01:25:50.3436166Z Downloading Dockerfile.dapper
2021-07-23T01:25:50.3799427Z docker network create -d bridge kind
2021-07-23T01:25:50.7011899Z 28bc61126d99c96ba7bf21ce9e6f7624390a49e4eaa12453248e8ae65b819d2a
2021-07-23T01:25:50.7033644Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-23T01:25:50.9551234Z Sending build context to Docker daemon 7.517MB
2021-07-23T01:25:50.9552379Z
2021-07-23T01:25:50.9626497Z Step 1/8 : ARG BASE_BRANCH
2021-07-23T01:25:50.9631613Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-23T01:25:51.2868668Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-23T01:25:51.2874278Z b1495d80d526: Pulling fs layer
2021-07-23T01:25:51.2875473Z 0cd08c770017: Pulling fs layer
2021-07-23T01:25:51.2876445Z 9884fc44d09c: Pulling fs layer
2021-07-23T01:25:51.2877915Z 6bc473dec104: Pulling fs layer
2021-07-23T01:25:51.2878931Z dc52fc659531: Pulling fs layer
2021-07-23T01:25:51.2880083Z b98e33fef4d7: Pulling fs layer
2021-07-23T01:25:51.2881126Z 0351e7a74eeb: Pulling fs layer
2021-07-23T01:25:51.2882192Z 8ae55f3150c3: Pulling fs layer
2021-07-23T01:25:51.2883661Z 6bc473dec104: Waiting
2021-07-23T01:25:51.2884547Z dc52fc659531: Waiting
2021-07-23T01:25:51.2885551Z b98e33fef4d7: Waiting
2021-07-23T01:25:51.2886516Z 0351e7a74eeb: Waiting
2021-07-23T01:25:51.2887449Z 8ae55f3150c3: Waiting
2021-07-23T01:25:51.9345815Z b1495d80d526: Verifying Checksum
2021-07-23T01:25:51.9346844Z b1495d80d526: Download complete
2021-07-23T01:25:52.0031819Z 9884fc44d09c: Verifying Checksum
2021-07-23T01:25:52.0032696Z 9884fc44d09c: Download complete
2021-07-23T01:25:52.0777257Z 6bc473dec104: Verifying Checksum
2021-07-23T01:25:52.0777927Z 6bc473dec104: Download complete
2021-07-23T01:25:52.1219558Z dc52fc659531: Verifying Checksum
2021-07-23T01:25:52.1250148Z dc52fc659531: Download complete
2021-07-23T01:25:52.1918826Z b98e33fef4d7: Verifying Checksum
2021-07-23T01:25:52.1950689Z b98e33fef4d7: Download complete
2021-07-23T01:25:52.2284804Z 0351e7a74eeb: Download complete
2021-07-23T01:25:52.3339269Z 8ae55f3150c3: Verifying Checksum
2021-07-23T01:25:52.3340061Z 8ae55f3150c3: Download complete
2021-07-23T01:25:54.6235559Z b1495d80d526: Pull complete
2021-07-23T01:26:00.1033349Z 0cd08c770017: Verifying Checksum
2021-07-23T01:26:00.1035497Z 0cd08c770017: Download complete
2021-07-23T01:26:11.0333655Z 0cd08c770017: Pull complete
2021-07-23T01:26:12.4738666Z 9884fc44d09c: Pull complete
2021-07-23T01:26:12.5420923Z 6bc473dec104: Pull complete
2021-07-23T01:26:12.6110647Z dc52fc659531: Pull complete
2021-07-23T01:26:12.7828719Z b98e33fef4d7: Pull complete
2021-07-23T01:26:12.8596371Z 0351e7a74eeb: Pull complete
2021-07-23T01:26:12.9407905Z 8ae55f3150c3: Pull complete
2021-07-23T01:26:12.9469875Z Digest: sha256:ca3c180cc9c941a68b314fa4ff8c7ab2608aa727a9bb36c01b64c2b262d47a44
2021-07-23T01:26:12.9498256Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-23T01:26:12.9551635Z ---> bcbbdc39e994
2021-07-23T01:26:12.9552266Z Step 3/8 : ARG PROJECT
2021-07-23T01:26:12.9766882Z ---> Running in 2e27d18d09b0
2021-07-23T01:26:13.9358635Z Removing intermediate container 2e27d18d09b0
2021-07-23T01:26:13.9359810Z ---> 4fd5b74f0e9c
2021-07-23T01:26:13.9361396Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-23T01:26:13.9520948Z ---> Running in 837991a73f5d
2021-07-23T01:26:14.9467935Z Removing intermediate container 837991a73f5d
2021-07-23T01:26:14.9469136Z ---> 66a734d4f853
2021-07-23T01:26:14.9469707Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-23T01:26:14.9661628Z ---> Running in 9c6a377166bb
2021-07-23T01:26:15.9118193Z Removing intermediate container 9c6a377166bb
2021-07-23T01:26:15.9119420Z ---> 8c938e4caddc
2021-07-23T01:26:15.9119933Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-23T01:26:15.9346223Z ---> Running in 0877c90987da
2021-07-23T01:26:16.8891258Z Removing intermediate container 0877c90987da
2021-07-23T01:26:16.8892888Z ---> b8e13a241923
2021-07-23T01:26:16.8894180Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-23T01:26:16.9096060Z ---> Running in dda9d7688874
2021-07-23T01:26:17.8527363Z Removing intermediate container dda9d7688874
2021-07-23T01:26:17.8528561Z ---> 6e525b93d2f8
2021-07-23T01:26:17.8529005Z Step 8/8 : CMD ["sh"]
2021-07-23T01:26:17.8708016Z ---> Running in 5ae51ad81b9c
2021-07-23T01:26:18.8389284Z Removing intermediate container 5ae51ad81b9c
2021-07-23T01:26:18.8391264Z ---> d4e77f05edd4
2021-07-23T01:26:18.8506305Z Successfully built d4e77f05edd4
2021-07-23T01:26:18.8535834Z Successfully tagged submariner-operator:devel
2021-07-23T01:26:19.3478833Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-23T01:26:19.3482064Z [submariner-operator]$ mkdir -p bin dist output
2021-07-23T01:26:19.3528701Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-23T01:26:19.3536012Z GNU Make 4.3
2021-07-23T01:26:19.3536974Z Built for x86_64-redhat-linux-gnu
2021-07-23T01:26:19.3537850Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-23T01:26:19.3538742Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-23T01:26:19.3539660Z This is free software: you are free to change and redistribute it.
2021-07-23T01:26:19.3540457Z There is NO WARRANTY, to the extent permitted by law.
2021-07-23T01:26:19.3541125Z Reading makefiles...
2021-07-23T01:26:19.4807083Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-23T01:26:19.4808255Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-23T01:26:19.7140701Z Updating makefiles....
2021-07-23T01:26:19.7155652Z Updating goal targets....
2021-07-23T01:26:19.7157007Z File 'upgrade-e2e' does not exist.
2021-07-23T01:26:19.7162339Z File 'deploy-latest' does not exist.
2021-07-23T01:26:19.7163341Z Must remake target 'deploy-latest'.
2021-07-23T01:26:19.7164162Z curl -L get.submariner.io | VERSION=latest bash
2021-07-23T01:26:19.7227751Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-23T01:26:19.7228581Z Dload Upload Total Spent Left Speed
2021-07-23T01:26:19.7228995Z
2021-07-23T01:26:19.7712460Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-23T01:26:19.7718263Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-23T01:26:19.8393221Z
2021-07-23T01:26:19.8432388Z 100 4155 0 4155 0 0 35818 0 --:--:-- --:--:-- --:--:-- 35818
2021-07-23T01:26:19.9469427Z Installing subctl version latest
2021-07-23T01:26:19.9470530Z OS detected: linux
2021-07-23T01:26:19.9473562Z Architecture detected: amd64
2021-07-23T01:26:19.9479462Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-23T01:26:19.9482765Z
2021-07-23T01:26:19.9483496Z Downloading...
2021-07-23T01:26:21.1973853Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-23T01:26:21.2337769Z This provides subctl version: v0.9.1
2021-07-23T01:26:21.2358375Z
2021-07-23T01:26:21.2359116Z please update your path (and consider adding it to ~/.profile):
2021-07-23T01:26:21.2359814Z export PATH=$PATH:/root/.local/bin
2021-07-23T01:26:21.2360281Z
2021-07-23T01:26:21.2434430Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-23T01:26:21.2468699Z GNU Make 4.3
2021-07-23T01:26:21.2469664Z Built for x86_64-redhat-linux-gnu
2021-07-23T01:26:21.2470537Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-23T01:26:21.2471504Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-23T01:26:21.2472362Z This is free software: you are free to change and redistribute it.
2021-07-23T01:26:21.2473103Z There is NO WARRANTY, to the extent permitted by law.
2021-07-23T01:26:21.2473704Z Reading makefiles...
2021-07-23T01:26:21.2474674Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-23T01:26:21.3704285Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-23T01:26:21.3706634Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-23T01:26:21.6084299Z Updating makefiles....
2021-07-23T01:26:21.6093037Z Updating goal targets....
2021-07-23T01:26:21.6094226Z File 'clusters' does not exist.
2021-07-23T01:26:21.6094956Z Must remake target 'clusters'.
2021-07-23T01:26:21.6096371Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:26:21.6123568Z Downloading shflags 1.0.3
2021-07-23T01:26:21.6183939Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-23T01:26:21.6184725Z Dload Upload Total Spent Left Speed
2021-07-23T01:26:21.6185273Z
2021-07-23T01:26:21.6512777Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-23T01:26:21.6513604Z 100 31091 100 31091 0 0 920k 0 --:--:-- --:--:-- --:--:-- 920k
2021-07-23T01:26:21.7166106Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-23T01:26:21.7192622Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-23T01:26:21.7205601Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:26:21.7216506Z [submariner-operator]$ script_name=utils
2021-07-23T01:26:21.7227451Z [submariner-operator]$ exec_name=clusters.sh
2021-07-23T01:26:21.7244991Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-23T01:26:21.7254718Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:26:21.7266605Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:26:21.7279417Z [submariner-operator]$ exec_name=clusters.sh
2021-07-23T01:26:21.7300560Z [submariner-operator]$ broker=cluster1
2021-07-23T01:26:21.7313077Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-23T01:26:21.7326323Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-23T01:26:21.7339450Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-23T01:26:21.7352770Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-23T01:26:21.7365320Z [submariner-operator]$ declare -gA cluster_subm
2021-07-23T01:26:21.7378184Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-23T01:26:21.7390676Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-23T01:26:21.7402605Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-23T01:26:21.7414662Z [submariner-operator]$ declare -gA cluster_cni
2021-07-23T01:26:21.7427855Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-23T01:26:21.7440173Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-23T01:26:21.7453628Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:26:21.7467306Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:26:21.7480883Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:26:21.7493848Z [submariner-operator]$ exec_name=clusters.sh
2021-07-23T01:26:21.7515704Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-23T01:26:21.7529078Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-23T01:26:21.7559474Z [submariner-operator]$ cat <<EOM
2021-07-23T01:26:21.7560837Z Cluster settings::
2021-07-23T01:26:21.7561498Z broker - ${broker@Q}
2021-07-23T01:26:21.7562154Z clusters - ${clusters[*]@Q}
2021-07-23T01:26:21.7562887Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-23T01:26:21.7563846Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-23T01:26:21.7564753Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-23T01:26:21.7565387Z EOM
2021-07-23T01:26:21.7586089Z [submariner-operator]$ typeset -p cluster_cni
2021-07-23T01:26:21.7599411Z [submariner-operator]$ cut -f 2- -d=
2021-07-23T01:26:21.7631209Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-23T01:26:21.7646243Z [submariner-operator]$ cut -f 2- -d=
2021-07-23T01:26:21.7676302Z [submariner-operator]$ typeset -p cluster_subm
2021-07-23T01:26:21.7691145Z [submariner-operator]$ cut -f 2- -d=
2021-07-23T01:26:21.7714262Z Cluster settings::
2021-07-23T01:26:21.7715126Z broker - 'cluster1'
2021-07-23T01:26:21.7715811Z clusters - 'cluster1' 'cluster2'
2021-07-23T01:26:21.7716609Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-23T01:26:21.7718024Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-23T01:26:21.7719397Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-23T01:26:21.7739679Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-23T01:26:21.7761346Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-23T01:26:21.7785952Z [submariner-operator]$ run_local_registry
2021-07-23T01:26:21.7798859Z [submariner-operator]$ run_local_registry
2021-07-23T01:26:21.7811357Z [submariner-operator]$ registry_running
2021-07-23T01:26:21.7823795Z [submariner-operator]$ registry_running
2021-07-23T01:26:21.7837107Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-23T01:26:21.7852379Z [submariner-operator]$ grep kind-registry
2021-07-23T01:26:22.0552445Z [submariner-operator]$ return 0
2021-07-23T01:26:22.0554643Z Deploying local registry kind-registry to serve images centrally.
2021-07-23T01:26:22.0568438Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-23T01:26:22.0578342Z [submariner-operator]$ selinuxenabled
2021-07-23T01:26:22.0603023Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-23T01:26:22.3354722Z Unable to find image 'registry:2' locally
2021-07-23T01:26:22.5843420Z 2: Pulling from library/registry
2021-07-23T01:26:22.6570720Z ddad3d7c1e96: Already exists
2021-07-23T01:26:22.6644948Z 6eda6749503f: Pulling fs layer
2021-07-23T01:26:22.6645529Z 363ab70c2143: Pulling fs layer
2021-07-23T01:26:22.6646027Z 5b94580856e6: Pulling fs layer
2021-07-23T01:26:22.6646514Z 12008541203a: Pulling fs layer
2021-07-23T01:26:22.6649913Z 12008541203a: Waiting
2021-07-23T01:26:22.7586088Z 5b94580856e6: Verifying Checksum
2021-07-23T01:26:22.7591488Z 5b94580856e6: Download complete
2021-07-23T01:26:22.7675455Z 6eda6749503f: Download complete
2021-07-23T01:26:22.8259815Z 363ab70c2143: Verifying Checksum
2021-07-23T01:26:22.8260527Z 363ab70c2143: Download complete
2021-07-23T01:26:22.8506382Z 12008541203a: Verifying Checksum
2021-07-23T01:26:22.8507068Z 12008541203a: Download complete
2021-07-23T01:26:23.2243554Z 6eda6749503f: Pull complete
2021-07-23T01:26:23.5174918Z 363ab70c2143: Pull complete
2021-07-23T01:26:23.5833414Z 5b94580856e6: Pull complete
2021-07-23T01:26:23.6521411Z 12008541203a: Pull complete
2021-07-23T01:26:23.6571979Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-23T01:26:23.6582753Z Status: Downloaded newer image for registry:2
2021-07-23T01:26:23.6774854Z 31d86802e99554a959e9c691344780987f90ec985de34b58f66ad2747cf9c9d2
2021-07-23T01:26:24.0111946Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-23T01:26:24.4109173Z [submariner-operator]$ declare_cidrs
2021-07-23T01:26:24.4121785Z [submariner-operator]$ declare_cidrs
2021-07-23T01:26:24.4131328Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-23T01:26:24.4147362Z [submariner-operator]$ i=1
2021-07-23T01:26:24.4148415Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:26:24.4162015Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:26:24.4172782Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-23T01:26:24.4173902Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-23T01:26:24.4181525Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-23T01:26:24.4188128Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:26:24.4204259Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:26:24.4215031Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-23T01:26:24.4223272Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-23T01:26:24.4235490Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-23T01:26:24.4254920Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-23T01:26:24.4259945Z [submariner-operator]$ [cluster2] wait 288
2021-07-23T01:26:24.4265964Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-23T01:26:24.4278721Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-23T01:26:24.4291280Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-23T01:26:24.4302875Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-23T01:26:24.4320676Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-23T01:26:24.4343082Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-23T01:26:24.4344191Z [submariner-operator]$ [cluster1] pids[cluster1]=297
2021-07-23T01:26:24.4358271Z [submariner-operator]$ [cluster2] pids[cluster2]=300
2021-07-23T01:26:24.4365050Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-23T01:26:24.4374208Z [submariner-operator]$ [cluster2] wait 300
2021-07-23T01:26:24.4388060Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-23T01:26:24.4398494Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-23T01:26:24.4426588Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-23T01:26:24.4441447Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-23T01:28:24.8742969Z [submariner-operator]$ [cluster2] with_retries
2021-07-23T01:28:24.8744567Z [submariner-operator]$ [cluster2] iteration=1
2021-07-23T01:28:24.8746326Z [submariner-operator]$ [cluster2] wait 324
2021-07-23T01:28:24.8748059Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-23T01:28:24.8749168Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-23T01:28:24.8750909Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:24.8753133Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:24.8754686Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-23T01:28:24.8755737Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-23T01:28:24.8756473Z [cluster2] No kind clusters found.
2021-07-23T01:28:24.8757068Z [cluster2] Creating KIND cluster...
2021-07-23T01:28:24.8758029Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-23T01:28:24.8759144Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-23T01:28:24.8760228Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-23T01:28:24.8761201Z [submariner-operator]$ [cluster2] nodes=
2021-07-23T01:28:24.8762064Z [cluster2] - role: control-plane
2021-07-23T01:28:24.8762939Z [submariner-operator]$ [cluster2] nodes=
2021-07-23T01:28:24.8763763Z [cluster2] - role: control-plane
2021-07-23T01:28:24.8764485Z [cluster2] - role: worker
2021-07-23T01:28:24.8765293Z [submariner-operator]$ [cluster2] nodes=
2021-07-23T01:28:24.8766134Z [cluster2] - role: control-plane
2021-07-23T01:28:24.8766814Z [cluster2] - role: worker
2021-07-23T01:28:24.8767468Z [cluster2] - role: worker
2021-07-23T01:28:24.8768068Z [cluster2] 
2021-07-23T01:28:24.8768635Z [cluster2] 
2021-07-23T01:28:24.8769465Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-23T01:28:24.8771034Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-23T01:28:24.8772866Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-23T01:28:24.8773973Z [submariner-operator]$ [cluster2] kind version
2021-07-23T01:28:24.8774703Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-23T01:28:24.8775893Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-23T01:28:24.8777109Z [cluster2] ---
2021-07-23T01:28:24.8777578Z [cluster2] kind: Cluster
2021-07-23T01:28:24.8778390Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-23T01:28:24.8779017Z [cluster2] networking:
2021-07-23T01:28:24.8779643Z [cluster2] disableDefaultCNI: true
2021-07-23T01:28:24.8780279Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-23T01:28:24.8780849Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-23T01:28:24.8781581Z [cluster2] containerdConfigPatches:
2021-07-23T01:28:24.8782342Z [cluster2] - |-
2021-07-23T01:28:24.8783222Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-23T01:28:24.8784506Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-23T01:28:24.8796084Z [cluster2] kubeadmConfigPatches:
2021-07-23T01:28:24.8800054Z [cluster2] - |
2021-07-23T01:28:24.8800693Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-23T01:28:24.8801454Z [cluster2] kind: ClusterConfiguration
2021-07-23T01:28:24.8802114Z [cluster2] metadata:
2021-07-23T01:28:24.8802619Z [cluster2] name: config
2021-07-23T01:28:24.8803475Z [cluster2] networking:
2021-07-23T01:28:24.8804032Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-23T01:28:24.8804608Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-23T01:28:24.8805264Z [cluster2] dnsDomain: cluster2.local
2021-07-23T01:28:24.8805818Z [cluster2] nodes:
2021-07-23T01:28:24.8806555Z [cluster2] - role: control-plane
2021-07-23T01:28:24.8807246Z [cluster2] - role: worker
2021-07-23T01:28:24.8808082Z [cluster2] - role: worker
2021-07-23T01:28:24.8809593Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-23T01:28:24.8813437Z [cluster2] Creating cluster "cluster2" ...
2021-07-23T01:28:24.8815783Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-23T01:28:24.8818693Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-23T01:28:24.8820578Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-23T01:28:24.8821429Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-23T01:28:24.8822240Z [cluster2] • Writing configuration 📜 ...
2021-07-23T01:28:24.8823041Z [cluster2] ✓ Writing configuration 📜
2021-07-23T01:28:24.8823965Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-23T01:28:24.8824739Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-23T01:28:24.8825631Z [cluster2] • Installing StorageClass 💾 ...
2021-07-23T01:28:24.8826432Z [cluster2] ✓ Installing StorageClass 💾
2021-07-23T01:28:24.8828869Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-23T01:28:24.8829585Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-23T01:28:24.8830361Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-23T01:28:24.8831016Z [cluster2] You can now use your cluster with:
2021-07-23T01:28:24.8831491Z [cluster2]
2021-07-23T01:28:24.8832242Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-23T01:28:24.8832989Z [cluster2]
2021-07-23T01:28:24.8834005Z [cluster2] Not sure what to do next? 😅 Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-23T01:28:24.8835154Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-23T01:28:24.8836144Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-23T01:28:24.8837686Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-23T01:28:24.8839466Z [submariner-operator]$ [cluster2] head -n 1
2021-07-23T01:28:30.8114379Z [sub[submariner-operator]$ [cluster1] with_retries
2021-07-23T01:28:30.8117308Z [submariner-operator]$ [cluster1] iteration=1
2021-07-23T01:28:30.8119172Z [submariner-operator]$ [cluster1] wait 312
2021-07-23T01:28:30.8121106Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-23T01:28:30.8123462Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-23T01:28:30.8126258Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:28:30.8128786Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:28:30.8130595Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-23T01:28:30.8131911Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-23T01:28:30.8132879Z [cluster1] No kind clusters found.
2021-07-23T01:28:30.8133703Z [cluster1] Creating KIND cluster...
2021-07-23T01:28:30.8134880Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-23T01:28:30.8136241Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-23T01:28:30.8137567Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-23T01:28:30.8139502Z [submariner-operator]$ [cluster1] nodes=
2021-07-23T01:28:30.8140620Z [cluster1] - role: control-plane
2021-07-23T01:28:30.8141680Z [submariner-operator]$ [cluster1] nodes=
2021-07-23T01:28:30.8142684Z [cluster1] - role: control-plane
2021-07-23T01:28:30.8143534Z [cluster1] - role: worker
2021-07-23T01:28:30.8144504Z [submariner-operator]$ [cluster1] nodes=
2021-07-23T01:28:30.8145802Z [cluster1] - role: control-plane
2021-07-23T01:28:30.8147844Z [cluster1] - role: worker
2021-07-23T01:28:30.8150134Z [cluster1] - role: worker
2021-07-23T01:28:30.8152140Z [cluster1] 
2021-07-23T01:28:30.8153849Z [cluster1] 
2021-07-23T01:28:30.8155160Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-23T01:28:30.8158341Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-23T01:28:30.8160076Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-23T01:28:30.8163503Z [submariner-operator]$ [cluster1] kind version
2021-07-23T01:28:30.8164456Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-23T01:28:30.8165910Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-23T01:28:30.8168687Z [cluster1] ---
2021-07-23T01:28:30.8169337Z [cluster1] kind: Cluster
2021-07-23T01:28:30.8170955Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-23T01:28:30.8172003Z [cluster1] networking:
2021-07-23T01:28:30.8174404Z [cluster1] disableDefaultCNI: true
2021-07-23T01:28:30.8175234Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-23T01:28:30.8175946Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-23T01:28:30.8176809Z [cluster1] containerdConfigPatches:
2021-07-23T01:28:30.8178603Z [cluster1] - |-
2021-07-23T01:28:30.8180551Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-23T01:28:30.8183368Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-23T01:28:30.8184215Z [cluster1] kubeadmConfigPatches:
2021-07-23T01:28:30.8184979Z [cluster1] - |
2021-07-23T01:28:30.8185835Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-23T01:28:30.8190352Z [cluster1] kind: ClusterConfiguration
2021-07-23T01:28:30.8190976Z [cluster1] metadata:
2021-07-23T01:28:30.8191484Z [cluster1] name: config
2021-07-23T01:28:30.8191992Z [cluster1] networking:
2021-07-23T01:28:30.8192541Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-23T01:28:30.8193195Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-23T01:28:30.8193869Z [cluster1] dnsDomain: cluster1.local
2021-07-23T01:28:30.8194419Z [cluster1] nodes:
2021-07-23T01:28:30.8195203Z [cluster1] - role: control-plane
2021-07-23T01:28:30.8195892Z [cluster1] - role: worker
2021-07-23T01:28:30.8196540Z [cluster1] - role: worker
2021-07-23T01:28:30.8198136Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-23T01:28:30.8199608Z [cluster1] Creating cluster "cluster1" ...
2021-07-23T01:28:30.8200802Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-23T01:28:30.8201788Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-23T01:28:30.8202734Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-23T01:28:30.8203741Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-23T01:28:30.8204558Z [cluster1] • Writing configuration 📜 ...
2021-07-23T01:28:30.8205378Z [cluster1] ✓ Writing configuration 📜
2021-07-23T01:28:30.8206250Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-23T01:28:30.8207101Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-23T01:28:30.8207943Z [cluster1] • Installing StorageClass 💾 ...
2021-07-23T01:28:30.8208797Z [cluster1] ✓ Installing StorageClass 💾
2021-07-23T01:28:30.8209595Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-23T01:28:30.8210351Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-23T01:28:30.8211220Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-23T01:28:30.8211961Z [cluster1] You can now use your cluster with:
2021-07-23T01:28:30.8212479Z [cluster1]
2021-07-23T01:28:30.8213289Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-23T01:28:30.8213928Z [cluster1]
2021-07-23T01:28:30.8214525Z [cluster1] Have a nice day! 👋
2021-07-23T01:28:30.8215408Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-23T01:28:30.8216461Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-23T01:28:30.8218127Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-23T01:28:30.8219794Z [submariner-operator]$ [cluster1] head -n 1
2021-07-23T01:28:51.6501427Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\mariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:51.6504420Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:51.6507628Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:51.6510376Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:51.6513015Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:51.6515534Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:28:51.6517075Z [submariner-operator]$ [cluster2] wait 1562
2021-07-23T01:28:51.6518191Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-23T01:28:51.6519422Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-23T01:28:51.6520533Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-23T01:28:51.6521533Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-23T01:28:51.6522606Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-23T01:28:51.6523769Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-23T01:28:51.6524836Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-23T01:28:51.6525606Z [cluster2] Applying weave network...
2021-07-23T01:28:51.6527110Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-23T01:28:51.6529345Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-23T01:28:51.6531514Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-23T01:28:51.6533053Z [cluster2] serviceaccount/weave-net created
2021-07-23T01:28:51.6534357Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:28:51.6536274Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:28:51.6537933Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:28:51.6539416Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:28:51.6540697Z [cluster2] daemonset.apps/weave-net created
2021-07-23T01:28:51.6541629Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-23T01:28:51.6543053Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-23T01:28:51.6544623Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-23T01:28:51.6547882Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-23T01:28:51.6549177Z [cluster2] pod/weave-net-59gvn condition met
2021-07-23T01:28:51.6550023Z [cluster2] pod/weave-net-d5hj4 condition met
2021-07-23T01:28:51.6551292Z [cluster2] pod/weave-net-ddbz2 condition met
2021-07-23T01:28:51.6552250Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-23T01:28:51.6553543Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-23T01:28:51.6555070Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-23T01:28:51.6556783Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-23T01:28:51.6558141Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-23T01:28:51.6559289Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-23T01:28:51.6560281Z [cluster2] deployment "coredns" successfully rolled out
2021-07-23T01:28:51.6561273Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:28:51.6594658Z [submariner-operator]$ [cluster2] wait 297
2021-07-23T01:29:01.5764445Z /\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:29:01.5766600Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:29:01.5768990Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:29:01.5771320Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:29:01.5773792Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:29:01.5776171Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:29:01.5777615Z [submariner-operator]$ [cluster1] wait 1672
2021-07-23T01:29:01.5778653Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-23T01:29:01.5779998Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-23T01:29:01.5781059Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-23T01:29:01.5781991Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-23T01:29:01.5782996Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-23T01:29:01.5783998Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-23T01:29:01.5784995Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-23T01:29:01.5785886Z [cluster1] Applying weave network...
2021-07-23T01:29:01.5787101Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-23T01:29:01.5788801Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-23T01:29:01.5790827Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-23T01:29:01.5792249Z [cluster1] serviceaccount/weave-net created
2021-07-23T01:29:01.5793434Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:29:01.5795108Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:29:01.5796628Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:29:01.5797983Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-23T01:29:01.5799309Z [cluster1] daemonset.apps/weave-net created
2021-07-23T01:29:01.5800354Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-23T01:29:01.5801818Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-23T01:29:01.5803580Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-23T01:29:01.5805508Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-23T01:29:01.5806899Z [cluster1] pod/weave-net-7gf6g condition met
2021-07-23T01:29:01.5807799Z [cluster1] pod/weave-net-87x72 condition met
2021-07-23T01:29:01.5808719Z [cluster1] pod/weave-net-rdrz9 condition met
2021-07-23T01:29:01.5809662Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-23T01:29:01.5810936Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-23T01:29:01.5812458Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-23T01:29:01.5815150Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-23T01:29:01.5816561Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-23T01:29:01.5817813Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-23T01:29:01.5818820Z [cluster1] deployment "coredns" successfully rolled out
2021-07-23T01:29:01.5819841Z [submariner-operator]$ [cluster1] return 0
2021-07-23T01:29:01.5861006Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-23T01:29:01.5879496Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-23T01:29:01.5896284Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-23T01:29:01.5897053Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-23T01:29:01.5897521Z
2021-07-23T01:29:01.5898333Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-23T01:29:01.5898884Z
2021-07-23T01:29:01.5899525Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-23T01:29:01.5899922Z
2021-07-23T01:29:01.5900893Z To clean everthing up, just run: make clean-clusters
2021-07-23T01:29:01.5907300Z EOM
2021-07-23T01:29:01.5937052Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-23T01:29:01.5937611Z
2021-07-23T01:29:01.5938684Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-23T01:29:01.5939303Z
2021-07-23T01:29:01.5940047Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-23T01:29:01.5940531Z
2021-07-23T01:29:01.5941184Z To clean everthing up, just run: make clean-clusters
2021-07-23T01:29:01.6007545Z Successfully remade target file 'clusters'.
2021-07-23T01:29:01.6008372Z File 'bin/subctl' does not exist.
2021-07-23T01:29:01.6009323Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-23T01:29:01.6021078Z File 'generate-embeddedyamls' does not exist.
2021-07-23T01:29:01.6021997Z File 'generate' does not exist.
2021-07-23T01:29:01.6023273Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-23T01:29:01.6024434Z File 'vendor/modules.txt' does not exist.
2021-07-23T01:29:01.6025836Z Must remake target 'vendor/modules.txt'.
2021-07-23T01:29:01.6026572Z go mod download
2021-07-23T01:29:59.4669198Z go mod vendor
2021-07-23T01:30:01.5249030Z go mod tidy
2021-07-23T01:30:02.2153813Z Successfully remade target file 'vendor/modules.txt'.
2021-07-23T01:30:02.2155383Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-23T01:30:02.2156665Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-23T01:30:02.2186035Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-23T01:30:22.9084026Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-23T01:30:22.9085392Z Must remake target 'generate'.
2021-07-23T01:30:22.9120677Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-23T01:30:36.2322131Z Successfully remade target file 'generate'.
2021-07-23T01:30:36.2323271Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-23T01:30:36.2327435Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-23T01:30:36.2330639Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-23T01:30:36.2332521Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-23T01:30:38.5445054Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-23T01:30:38.5452790Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-23T01:30:38.5454183Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-23T01:30:38.5459025Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-23T01:30:39.8660226Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-23T01:30:39.8764512Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-23T01:30:39.8765626Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-23T01:30:40.6282841Z Generating yamls.go
2021-07-23T01:30:40.6291665Z deploy/crds/submariner.io_brokers.yaml
2021-07-23T01:30:40.6295430Z deploy/crds/submariner.io_submariners.yaml
2021-07-23T01:30:40.6325834Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-23T01:30:40.6330136Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-23T01:30:40.6334059Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-23T01:30:40.6338343Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-23T01:30:40.6343728Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-23T01:30:40.6349547Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-23T01:30:40.6358520Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-23T01:30:40.6365322Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-23T01:30:40.6373402Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-23T01:30:40.6381181Z config/broker/broker-admin/service_account.yaml
2021-07-23T01:30:40.6384738Z config/broker/broker-admin/role.yaml
2021-07-23T01:30:40.6390105Z config/broker/broker-admin/role_binding.yaml
2021-07-23T01:30:40.6393521Z config/broker/broker-client/service_account.yaml
2021-07-23T01:30:40.6399886Z config/broker/broker-client/role.yaml
2021-07-23T01:30:40.6402740Z config/broker/broker-client/role_binding.yaml
2021-07-23T01:30:40.6405746Z config/rbac/submariner-operator/service_account.yaml
2021-07-23T01:30:40.6408752Z config/rbac/submariner-operator/role.yaml
2021-07-23T01:30:40.6411601Z config/rbac/submariner-operator/role_binding.yaml
2021-07-23T01:30:40.6412787Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-23T01:30:40.6415743Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-23T01:30:40.6421254Z config/rbac/submariner-gateway/service_account.yaml
2021-07-23T01:30:40.6422340Z config/rbac/submariner-gateway/role.yaml
2021-07-23T01:30:40.6426860Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-23T01:30:40.6428119Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-23T01:30:40.6431848Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-23T01:30:40.6436139Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-23T01:30:40.6440161Z config/rbac/submariner-route-agent/role.yaml
2021-07-23T01:30:40.6445378Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-23T01:30:40.6446799Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-23T01:30:40.6450636Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-23T01:30:40.6454339Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-23T01:30:40.6458307Z config/rbac/submariner-globalnet/role.yaml
2021-07-23T01:30:40.6462397Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-23T01:30:40.6467010Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-23T01:30:40.6471739Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-23T01:30:40.6475469Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-23T01:30:40.6479096Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-23T01:30:40.6485272Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-23T01:30:40.6502167Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-23T01:30:40.6503315Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-23T01:30:40.6504390Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-23T01:30:40.6537265Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-23T01:30:40.6560905Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-23T01:30:40.6567545Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-23T01:30:40.6569796Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-23T01:30:40.6571040Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-23T01:30:40.6645688Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-23T01:30:40.6647250Z Must remake target 'generate-embeddedyamls'.
2021-07-23T01:30:40.6648627Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-23T01:30:40.6888878Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-23T01:30:40.6889713Z mkdir -p bin
2021-07-23T01:30:40.6916900Z target=bin/subctl-latest-linux-amd64; \
2021-07-23T01:30:40.6917610Z target=${target%.exe}; \
2021-07-23T01:30:40.6918632Z components=($(echo ${target//-/ })); \
2021-07-23T01:30:40.6919315Z GOOS=${components[-2]}; \
2021-07-23T01:30:40.6919970Z GOARCH=${components[-1]}; \
2021-07-23T01:30:40.6920471Z export GOARCH GOOS; \
2021-07-23T01:30:40.6921038Z /opt/shipyard/scripts/compile.sh \
2021-07-23T01:30:40.6922467Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-23T01:30:40.6924802Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-23T01:30:40.6926758Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-23T01:30:40.7642009Z [submariner-operator]$ mkdir -p bin
2021-07-23T01:30:40.7658437Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-23T01:30:40.7676683Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-23T01:30:40.7692204Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-23T01:32:39.2014206Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-23T01:32:39.2018110Z Must remake target 'bin/subctl'.
2021-07-23T01:32:39.2019039Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-23T01:32:39.2067075Z Successfully remade target file 'bin/subctl'.
2021-07-23T01:32:39.2068336Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-23T01:32:39.2069322Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-23T01:32:39.2070125Z Must remake target 'deploy'.
2021-07-23T01:32:39.2072454Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:32:39.3165881Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-23T01:32:39.3196212Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-23T01:32:39.3209139Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:32:39.3221172Z [submariner-operator]$ script_name=utils
2021-07-23T01:32:39.3233206Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:32:39.3254871Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-23T01:32:39.3272329Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:32:39.3284154Z [submariner-operator]$ script_name=deploy_funcs
2021-07-23T01:32:39.3297909Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:32:39.3314919Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-23T01:32:39.3328657Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:32:39.3339066Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:32:39.3350436Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:32:39.3371292Z [submariner-operator]$ broker=cluster1
2021-07-23T01:32:39.3387131Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-23T01:32:39.3395936Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-23T01:32:39.3409783Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-23T01:32:39.3424562Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-23T01:32:39.3438808Z [submariner-operator]$ declare -gA cluster_subm
2021-07-23T01:32:39.3453157Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-23T01:32:39.3467691Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-23T01:32:39.3479397Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-23T01:32:39.3493546Z [submariner-operator]$ declare -gA cluster_cni
2021-07-23T01:32:39.3504618Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-23T01:32:39.3519288Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-23T01:32:39.3535217Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:32:39.3550460Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:32:39.3565549Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:32:39.3579477Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:32:39.3605728Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-23T01:32:39.3621246Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-23T01:32:39.3650282Z [submariner-operator]$ declare_cidrs
2021-07-23T01:32:39.3664608Z [submariner-operator]$ declare_cidrs
2021-07-23T01:32:39.3678623Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-23T01:32:39.3694244Z [submariner-operator]$ i=1
2021-07-23T01:32:39.3711998Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:32:39.3724741Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:32:39.3741342Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-23T01:32:39.3756285Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-23T01:32:39.3771448Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-23T01:32:39.3787102Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:32:39.3801375Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:32:39.3817705Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-23T01:32:39.3840295Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-23T01:32:39.3853558Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-23T01:32:39.3868119Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-23T01:32:39.3881384Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-23T01:32:39.3893884Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-23T01:32:39.3917048Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-23T01:32:39.3930013Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-23T01:32:39.3950212Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-23T01:32:39.3992862Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-23T01:32:39.6924111Z Installing subctl version latest
2021-07-23T01:32:39.6924782Z OS detected: linux
2021-07-23T01:32:39.6927565Z Architecture detected: amd64
2021-07-23T01:32:39.6932938Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-23T01:32:39.6933901Z
2021-07-23T01:32:39.6934321Z Downloading...
2021-07-23T01:32:41.0373387Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-23T01:32:41.0768979Z This provides subctl version: v0.9.1
2021-07-23T01:32:41.0796165Z
2021-07-23T01:32:41.0796891Z please update your path (and consider adding it to ~/.profile):
2021-07-23T01:32:41.0797549Z export PATH=$PATH:/go/bin
2021-07-23T01:32:41.0798003Z
2021-07-23T01:32:41.0908748Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-23T01:32:41.0922609Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-23T01:32:41.0930922Z Will deploy submariner using operator
2021-07-23T01:32:41.0944797Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-23T01:32:41.0959304Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:32:41.0971146Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-23T01:32:41.0982782Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-23T01:32:41.1002287Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-23T01:32:41.1019435Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-23T01:32:41.1033349Z 
2021-07-23T01:32:41.1047141Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-23T01:32:41.2836067Z subctl version: v0.9.1
2021-07-23T01:32:41.2865735Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-23T01:32:41.2879038Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-23T01:32:41.2895555Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-23T01:32:41.2913598Z [submariner-operator]$ [cluster2] grep -q function
2021-07-23T01:32:41.2943053Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:32:41.2964685Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-23T01:32:41.2977326Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-23T01:32:41.2992526Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-23T01:32:41.3029461Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-23T01:32:41.3044730Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-23T01:32:41.3062568Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-23T01:32:41.3119250Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-23T01:32:41.3144152Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-23T01:32:41.3151227Z [submariner-operator]$ [cluster1] pids[cluster1]=6333
2021-07-23T01:32:41.3159027Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-23T01:32:41.3180366Z [submariner-operator]$ [cluster2] pids[cluster2]=6337
2021-07-23T01:32:41.3185774Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-23T01:32:41.3211532Z [submariner-operator]$ [cluster2] wait 6337
2021-07-23T01:32:41.3228334Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-23T01:32:41.3244336Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-23T01:32:41.3269366Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-23T01:32:41.7485689Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-23T01:32:41.7487052Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-23T01:32:41.7488145Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-23T01:32:41.7489767Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-23T01:32:41.7491785Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-23T01:32:41.7493813Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-23T01:32:41.7495091Z [cluster2] node/cluster2-worker labeled
2021-07-23T01:32:41.7512351Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-23T01:32:41.7513681Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-23T01:32:41.7514937Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-23T01:32:41.7516382Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-23T01:32:41.7518107Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-23T01:32:41.7519973Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-23T01:32:41.7521340Z [cluster1] node/cluster1-worker labeled
2021-07-23T01:32:41.7528727Z [submariner-operator]$ [cluster2] wait 6333
2021-07-23T01:32:41.7543988Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-23T01:32:41.7557963Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-23T01:32:41.7574642Z [submariner-operator]$ [cluster1] setup_broker
2021-07-23T01:32:41.7587312Z [submariner-operator]$ [cluster1] setup_broker
2021-07-23T01:32:41.7593603Z Installing broker...
2021-07-23T01:32:41.7605992Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-23T01:32:41.7625896Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-23T01:32:41.7649805Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:32:41.8154143Z • Setting up broker RBAC ...
2021-07-23T01:32:41.9580265Z ✓ Setting up broker RBAC
2021-07-23T01:32:41.9581087Z • Deploying the Submariner operator ...
2021-07-23T01:32:52.4568474Z ✓ Deploying the Submariner operator
2021-07-23T01:32:52.4569779Z ✓ Created operator CRDs
2021-07-23T01:32:52.4571494Z ✓ Created operator namespace: submariner-operator
2021-07-23T01:32:52.4573742Z ✓ Created operator service account and role
2021-07-23T01:32:52.4574730Z ✓ Created lighthouse service account and role
2021-07-23T01:32:52.4575689Z ✓ Created Lighthouse service accounts and roles
2021-07-23T01:32:52.4576534Z ✓ Deployed the operator successfully
2021-07-23T01:32:52.4577283Z • Deploying the broker ...
2021-07-23T01:32:52.4703576Z ✓ Deploying the broker
2021-07-23T01:32:52.4704750Z ✓ The broker has been deployed
2021-07-23T01:32:52.4705811Z • Creating broker-info.subm file ...
2021-07-23T01:32:52.4775083Z ✓ Creating broker-info.subm file
2021-07-23T01:32:52.4776413Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-23T01:32:52.4826657Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-23T01:32:52.4843646Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-23T01:32:52.4856718Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-23T01:32:52.4872525Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-23T01:32:52.4903073Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-23T01:32:52.4941387Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-23T01:32:52.4958720Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-23T01:32:52.4974752Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-23T01:32:52.4996876Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-23T01:32:52.5022038Z [submariner-operator]$ [cluster1] pids[cluster1]=6397
2021-07-23T01:32:52.5043948Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-23T01:32:52.5049964Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-23T01:32:52.5056995Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-23T01:32:52.5071400Z [submariner-operator]$ [cluster2] pids[cluster2]=6400
2021-07-23T01:32:52.5088948Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-23T01:32:52.5108402Z [submariner-operator]$ [cluster2] wait 6400
2021-07-23T01:32:52.5118979Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-23T01:32:52.5138264Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-23T01:32:58.4232446Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-23T01:32:58.4233876Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-23T01:32:58.4235078Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-23T01:32:58.4238212Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-23T01:32:58.4241726Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-23T01:32:58.4243025Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-23T01:32:58.4243894Z [cluster1] - cluster1-worker
2021-07-23T01:32:58.4244835Z [cluster1] • Discovering network details ...
2021-07-23T01:32:58.4245602Z [cluster1] Discovered network details:
2021-07-23T01:32:58.4246597Z [cluster1] Network plugin: weave-net
2021-07-23T01:32:58.4247255Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-23T01:32:58.4248021Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-23T01:32:58.4248794Z [cluster1] ✓ Discovering network details
2021-07-23T01:32:58.4249732Z [cluster1] • Discovering multi cluster details ...
2021-07-23T01:32:58.4250702Z [cluster1] • Validating Globalnet configurations ...
2021-07-23T01:32:58.4251632Z [cluster1] ✓ Validating Globalnet configurations
2021-07-23T01:32:58.4252763Z [cluster1] ✓ Discovering multi cluster details
2021-07-23T01:32:58.4253705Z [cluster1] • Deploying the Submariner operator ...
2021-07-23T01:32:58.4254747Z [cluster1] ✓ Deploying the Submariner operator
2021-07-23T01:32:58.4255845Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-23T01:32:58.4256820Z [cluster1] • Creating SA for cluster ...
2021-07-23T01:32:58.4257612Z [cluster1] ✓ Creating SA for cluster
2021-07-23T01:32:58.4258503Z [cluster1] • Deploying Submariner ...
2021-07-23T01:32:58.4259415Z [cluster1] ✓ Deploying Submariner
2021-07-23T01:32:58.4260255Z [cluster1] ✓ Submariner is up and running
2021-07-23T01:33:03.7405329Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-23T01:33:03.7406734Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-23T01:33:03.7408088Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-23T01:33:03.7411789Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-23T01:33:03.7415090Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-23T01:33:03.7416775Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-23T01:33:03.7418272Z [cluster2] - cluster2-worker
2021-07-23T01:33:03.7419146Z [cluster2] • Discovering network details ...
2021-07-23T01:33:03.7419823Z [cluster2] Discovered network details:
2021-07-23T01:33:03.7420654Z [cluster2] Network plugin: weave-net
2021-07-23T01:33:03.7421266Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-23T01:33:03.7421843Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-23T01:33:03.7422663Z [cluster2] ✓ Discovering network details
2021-07-23T01:33:03.7423521Z [cluster2] • Discovering multi cluster details ...
2021-07-23T01:33:03.7424700Z [cluster2] • Validating Globalnet configurations ...
2021-07-23T01:33:03.7426208Z [cluster2] ✓ Validating Globalnet configurations
2021-07-23T01:33:03.7427374Z [cluster2] ✓ Discovering multi cluster details
2021-07-23T01:33:03.7428265Z [cluster2] • Deploying the Submariner operator ...
2021-07-23T01:33:03.7429218Z [cluster2] ✓ Deploying the Submariner operator
2021-07-23T01:33:03.7430025Z [cluster2] ✓ Created operator CRDs
2021-07-23T01:33:03.7431007Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-23T01:33:03.7432272Z [cluster2] ✓ Created operator service account and role
2021-07-23T01:33:03.7433239Z [cluster2] ✓ Created lighthouse service account and role
2021-07-23T01:33:03.7434758Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-23T01:33:03.7435731Z [cluster2] ✓ Deployed the operator successfully
2021-07-23T01:33:03.7436786Z [cluster2] • Creating SA for cluster ...
2021-07-23T01:33:03.7437541Z [cluster2] ✓ Creating SA for cluster
2021-07-23T01:33:03.7453012Z [cluster2] • Deploying Submariner ...
2021-07-23T01:33:03.7454234Z [cluster2] ✓ Deploying Submariner
2021-07-23T01:33:03.7455076Z [cluster2] ✓ Submariner is up and running
2021-07-23T01:33:03.7456059Z [submariner-operator]$ [cluster2] wait 6397
2021-07-23T01:33:03.7490022Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-23T01:33:03.7555754Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-23T01:33:03.7644974Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-23T01:33:03.7680151Z [submariner-operator]$ [cluster2] with_retries
2021-07-23T01:33:03.7737914Z [submariner-operator]$ [cluster2] iteration=1
2021-07-23T01:33:03.7801130Z [submariner-operator]$ [cluster2] wait 6439
2021-07-23T01:33:03.7816894Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:03.7840429Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:03.7877238Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:03.7911756Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:03.7926463Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:04.0402999Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:04.0422983Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:04.2035248Z • Showing Connections ...
2021-07-23T01:33:04.2330431Z ✗ Showing Connections
2021-07-23T01:33:04.2331205Z ✗ There are no gateways detected
2021-07-23T01:33:04.2366148Z • Showing Connections ...
2021-07-23T01:33:04.2386750Z ✗ Showing Connections
2021-07-23T01:33:04.2387475Z ✗ There are no gateways detected
2021-07-23T01:33:04.2430407Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:04.2443467Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:10.2490418Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:10.2628713Z [submariner-operator]$ [cluster2] wait 6466
2021-07-23T01:33:10.2696392Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:10.2742835Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:10.2815232Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:10.2866979Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:10.2897113Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:10.4609031Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:10.4635964Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:10.5813804Z • Showing Connections ...
2021-07-23T01:33:10.5911974Z ✗ Showing Connections
2021-07-23T01:33:10.5940814Z ✗ There are no gateways detected
2021-07-23T01:33:10.6135223Z • Showing Connections ...
2021-07-23T01:33:10.6172002Z ✗ Showing Connections
2021-07-23T01:33:10.6172754Z ✗ There are no gateways detected
2021-07-23T01:33:10.6209100Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:10.6210339Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:16.6250813Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:16.6359210Z [submariner-operator]$ [cluster2] wait 6494
2021-07-23T01:33:16.6373095Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:16.6450714Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:16.6493076Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:16.6508336Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:16.6605812Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:17.5055154Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:17.5075084Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:18.0987242Z • Showing Connections ...
2021-07-23T01:33:18.4919593Z ✗ Showing Connections
2021-07-23T01:33:18.4920366Z ✗ There are no gateways detected
2021-07-23T01:33:18.5456704Z • Showing Connections ...
2021-07-23T01:33:18.5756700Z ✗ Showing Connections
2021-07-23T01:33:18.5757493Z ✗ There are no gateways detected
2021-07-23T01:33:18.5775699Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:18.5793217Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:24.5829006Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:24.5879506Z [submariner-operator]$ [cluster2] wait 6521
2021-07-23T01:33:24.5895876Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:24.5909595Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:24.5920444Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:24.5930892Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:24.5945828Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:24.7203934Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:24.7307553Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:24.8509699Z • Showing Connections ...
2021-07-23T01:33:24.8536977Z ✗ Showing Connections
2021-07-23T01:33:24.8537931Z ✗ There are no gateways detected
2021-07-23T01:33:24.8576214Z • Showing Connections ...
2021-07-23T01:33:24.8597064Z ✗ Showing Connections
2021-07-23T01:33:24.8597796Z ✗ There are no gateways detected
2021-07-23T01:33:24.8625767Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:24.8639579Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:30.8670008Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:30.8716802Z [submariner-operator]$ [cluster2] wait 6547
2021-07-23T01:33:30.8730717Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:30.8746784Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:30.8785397Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:30.8853475Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:30.9017596Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:31.2480941Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:31.2520090Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:31.8142547Z • Showing Connections ...
2021-07-23T01:33:31.8691915Z ✗ Showing Connections
2021-07-23T01:33:31.8693077Z ✗ No connections found
2021-07-23T01:33:31.8916321Z • Showing Connections ...
2021-07-23T01:33:31.9070286Z ✗ Showing Connections
2021-07-23T01:33:31.9071080Z ✗ There are no gateways detected
2021-07-23T01:33:31.9091896Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:31.9104246Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:37.9132521Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:37.9177322Z [submariner-operator]$ [cluster2] wait 6573
2021-07-23T01:33:37.9199494Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:37.9220927Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:37.9257363Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:37.9302218Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:37.9339126Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:38.1361197Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:38.1376070Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:38.2367975Z • Showing Connections ...
2021-07-23T01:33:38.2521909Z ✗ Showing Connections
2021-07-23T01:33:38.2535719Z ✗ No connections found
2021-07-23T01:33:38.2814233Z • Showing Connections ...
2021-07-23T01:33:38.2904760Z ✗ Showing Connections
2021-07-23T01:33:38.2905655Z ✗ There are no gateways detected
2021-07-23T01:33:38.2928616Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:38.2944873Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:44.2971902Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:44.3016924Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:44.3029103Z [submariner-operator]$ [cluster2] wait 6600
2021-07-23T01:33:44.3033186Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:44.3043851Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:44.3054148Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:44.3070169Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:44.4579742Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:44.4655598Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:44.5686651Z • Showing Connections ...
2021-07-23T01:33:44.5726238Z ✗ Showing Connections
2021-07-23T01:33:44.5726985Z ✗ There are no gateways detected
2021-07-23T01:33:44.5794810Z • Showing Connections ...
2021-07-23T01:33:44.5861842Z ✗ Showing Connections
2021-07-23T01:33:44.5862502Z ✗ No connections found
2021-07-23T01:33:44.5884751Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:44.5898120Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:50.5924077Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:50.5964327Z [submariner-operator]$ [cluster2] wait 6627
2021-07-23T01:33:50.5969615Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:50.5978548Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:50.5990421Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:50.6001226Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:50.6021398Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:50.6636311Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:50.6653224Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:50.7076102Z • Showing Connections ...
2021-07-23T01:33:50.7104469Z ✗ Showing Connections
2021-07-23T01:33:50.7105540Z ✗ No connections found
2021-07-23T01:33:50.7212671Z • Showing Connections ...
2021-07-23T01:33:50.7233956Z ✗ Showing Connections
2021-07-23T01:33:50.7234637Z ✗ No connections found
2021-07-23T01:33:50.7257594Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:33:50.7271536Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:33:56.7299209Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:33:56.7337371Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:56.7342964Z [submariner-operator]$ [cluster2] wait 6653
2021-07-23T01:33:56.7351250Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:33:56.7364416Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:33:56.7376206Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:56.7390960Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:33:56.8075502Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:33:56.8090976Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:33:56.8537639Z • Showing Connections ...
2021-07-23T01:33:56.8569730Z ✓ Showing Connections
2021-07-23T01:33:56.8682341Z • Showing Connections ...
2021-07-23T01:33:56.8708066Z ✓ Showing Connections
2021-07-23T01:33:56.8737663Z cluster2-worker cluster2 172.18.0.8 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 233.302µs
2021-07-23T01:33:56.8739162Z cluster1-worker cluster1 172.18.0.7 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 248.601µs
2021-07-23T01:33:56.8749701Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:33:56.8765352Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:33:56.8779213Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-23T01:33:56.8796954Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-23T01:33:56.8811343Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-23T01:33:56.8821833Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-23T01:33:56.8837371Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-23T01:33:56.8853919Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-23T01:33:56.8867025Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-23T01:33:56.8884739Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-23T01:33:57.2100081Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-23T01:33:57.2154967Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-23T01:33:57.8044837Z latest: Pulling from submariner/nettest
2021-07-23T01:33:57.8069308Z df20fa9351a1: Pulling fs layer
2021-07-23T01:33:57.8070298Z 741138c6c583: Pulling fs layer
2021-07-23T01:33:57.8074692Z d34ea735672c: Pulling fs layer
2021-07-23T01:33:57.8081721Z c91acd455ec9: Pulling fs layer
2021-07-23T01:33:57.8082293Z c91acd455ec9: Waiting
2021-07-23T01:33:57.9984260Z 741138c6c583: Verifying Checksum
2021-07-23T01:33:57.9984919Z 741138c6c583: Download complete
2021-07-23T01:33:58.0080308Z df20fa9351a1: Verifying Checksum
2021-07-23T01:33:58.0081004Z df20fa9351a1: Download complete
2021-07-23T01:33:58.1132870Z d34ea735672c: Verifying Checksum
2021-07-23T01:33:58.1133555Z d34ea735672c: Download complete
2021-07-23T01:33:58.2217698Z c91acd455ec9: Verifying Checksum
2021-07-23T01:33:58.2218439Z c91acd455ec9: Download complete
2021-07-23T01:33:58.4906119Z df20fa9351a1: Pull complete
2021-07-23T01:33:58.6220489Z 741138c6c583: Pull complete
2021-07-23T01:33:59.0644224Z d34ea735672c: Pull complete
2021-07-23T01:33:59.1471428Z c91acd455ec9: Pull complete
2021-07-23T01:33:59.1577416Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-23T01:33:59.1601649Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-23T01:33:59.1636614Z quay.io/submariner/nettest:latest
2021-07-23T01:33:59.1668049Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-23T01:33:59.4834671Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-23T01:33:59.7906792Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-23T01:34:00.0953701Z The push refers to repository [localhost:5000/nettest]
2021-07-23T01:34:00.1268492Z 7497bfb0ae54: Preparing
2021-07-23T01:34:00.1269205Z 17de069c349e: Preparing
2021-07-23T01:34:00.1269687Z b85398c91342: Preparing
2021-07-23T01:34:00.1270164Z 50644c29ef5a: Preparing
2021-07-23T01:34:00.6945935Z b85398c91342: Pushed
2021-07-23T01:34:00.6946436Z 7497bfb0ae54: Pushed
2021-07-23T01:34:00.7090623Z 50644c29ef5a: Pushed
2021-07-23T01:34:01.8882443Z 17de069c349e: Pushed
2021-07-23T01:34:01.9112025Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-23T01:34:01.9180360Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:01.9197139Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:01.9213559Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-23T01:34:01.9233582Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-23T01:34:01.9255568Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:01.9272355Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:01.9290392Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:02.4658294Z deployment.apps/netshoot created
2021-07-23T01:34:02.4719658Z Waiting for netshoot pods to be ready.
2021-07-23T01:34:02.4736109Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-23T01:34:02.4752650Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-23T01:34:02.4770030Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-23T01:34:02.8132914Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-23T01:34:03.8130989Z deployment "netshoot" successfully rolled out
2021-07-23T01:34:03.8192367Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:03.8210325Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:03.8226000Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:03.8246258Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-23T01:34:03.8263043Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-23T01:34:03.8287112Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-23T01:34:03.8320584Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:03.8336273Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:03.8352629Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:04.4078143Z deployment.apps/nginx-demo created
2021-07-23T01:34:04.4152315Z service/nginx-demo created
2021-07-23T01:34:04.5349239Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-23T01:34:04.5417654Z Waiting for nginx-demo pods to be ready.
2021-07-23T01:34:04.5430779Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-23T01:34:04.5445461Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-23T01:34:04.5457750Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-23T01:34:05.0144602Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-23T01:34:11.2238511Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-23T01:34:11.3566239Z deployment "nginx-demo" successfully rolled out
2021-07-23T01:34:11.3627487Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-23T01:34:11.3649707Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-23T01:34:11.3668508Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-23T01:34:11.3677883Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-23T01:34:11.3693127Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-23T01:34:11.8392676Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-23T01:34:11.8417256Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-23T01:34:11.8433598Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-23T01:34:11.8449452Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-23T01:34:11.8464572Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-23T01:34:11.8483219Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-23T01:34:11.8504477Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-23T01:34:11.8521047Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-23T01:34:11.8528201Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-23T01:34:11.8557138Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-23T01:34:12.2094253Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-mnrh9 100.1.193.187
2021-07-23T01:34:12.2110141Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-mnrh9 100.1.193.187
2021-07-23T01:34:12.2123614Z [submariner-operator]$ [cluster2] iteration=1
2021-07-23T01:34:12.2150350Z [submariner-operator]$ [cluster2] wait 6805
2021-07-23T01:34:12.2151692Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-mnrh9 100.1.193.187
2021-07-23T01:34:12.2164855Z [submariner-operator]$ [cluster2] test_connection
2021-07-23T01:34:12.2172990Z Attempting connectivity between clusters - netshoot-57677568b8-mnrh9 --> 100.1.193.187
2021-07-23T01:34:12.2181874Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-23T01:34:12.2194222Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-23T01:34:12.2215971Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:34:12.2252266Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-mnrh9 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.193.187
2021-07-23T01:34:12.2265530Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-mnrh9 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.193.187
2021-07-23T01:34:12.2281929Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-mnrh9 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.193.187
2021-07-23T01:34:12.6574119Z Connection test was successful!
2021-07-23T01:34:12.6589604Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:34:12.6603922Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:12.6616559Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:12.6630566Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:12.6643562Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:12.6657512Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:34:12.9634733Z deployment.apps "netshoot" deleted
2021-07-23T01:34:12.9777159Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:12.9792112Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:12.9806986Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:12.9820738Z [submariner-operator]$ [cluster1] remove_resource
2021-07-23T01:34:12.9849602Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:12.9895617Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:12.9910403Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:34:13.3049890Z deployment.apps "nginx-demo" deleted
2021-07-23T01:34:13.3529047Z service "nginx-demo" deleted
2021-07-23T01:34:13.4217262Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-23T01:34:13.5008745Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-23T01:34:13.5021301Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-23T01:34:13.5040673Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-23T01:34:13.5127142Z [submariner-operator]$ [cluster2] grep -q function
2021-07-23T01:34:13.5259747Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:34:13.5295179Z Successfully remade target file 'deploy'.
2021-07-23T01:34:13.5314639Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-23T01:34:13.5395856Z Successfully remade target file 'deploy-latest'.
2021-07-23T01:34:13.5397771Z File 'clusters' does not exist.
2021-07-23T01:34:13.5398535Z Must remake target 'clusters'.
2021-07-23T01:34:13.5400079Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:34:13.7592349Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-23T01:34:13.7652550Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-23T01:34:13.7680664Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:34:13.7697652Z [submariner-operator]$ script_name=utils
2021-07-23T01:34:13.7723037Z [submariner-operator]$ exec_name=clusters.sh
2021-07-23T01:34:13.7801094Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-23T01:34:13.7840006Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:34:13.7852332Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:34:13.7864254Z [submariner-operator]$ exec_name=clusters.sh
2021-07-23T01:34:13.7896297Z [submariner-operator]$ broker=cluster1
2021-07-23T01:34:13.7911997Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-23T01:34:13.7928320Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-23T01:34:13.7950368Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-23T01:34:13.7963031Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-23T01:34:13.7975081Z [submariner-operator]$ declare -gA cluster_subm
2021-07-23T01:34:13.7989493Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-23T01:34:13.8027100Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-23T01:34:13.8040396Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-23T01:34:13.8053125Z [submariner-operator]$ declare -gA cluster_cni
2021-07-23T01:34:13.8070281Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-23T01:34:13.8118657Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-23T01:34:13.8132523Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:34:13.8152408Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:34:13.8164173Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:34:13.8237945Z [submariner-operator]$ exec_name=clusters.sh
2021-07-23T01:34:13.8262643Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-23T01:34:13.8279355Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-23T01:34:13.8347910Z [submariner-operator]$ cat <<EOM
2021-07-23T01:34:13.8350649Z Cluster settings::
2021-07-23T01:34:13.8351389Z broker - ${broker@Q}
2021-07-23T01:34:13.8352116Z clusters - ${clusters[*]@Q}
2021-07-23T01:34:13.8352939Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-23T01:34:13.8357597Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-23T01:34:13.8358627Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-23T01:34:13.8359333Z EOM
2021-07-23T01:34:13.8376301Z [submariner-operator]$ typeset -p cluster_cni
2021-07-23T01:34:13.8392190Z [submariner-operator]$ cut -f 2- -d=
2021-07-23T01:34:13.8493186Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-23T01:34:13.8494318Z [submariner-operator]$ cut -f 2- -d=
2021-07-23T01:34:13.8568602Z [submariner-operator]$ typeset -p cluster_subm
2021-07-23T01:34:13.8588217Z [submariner-operator]$ cut -f 2- -d=
2021-07-23T01:34:13.8623918Z Cluster settings::
2021-07-23T01:34:13.8624735Z broker - 'cluster1'
2021-07-23T01:34:13.8625877Z clusters - 'cluster1' 'cluster2'
2021-07-23T01:34:13.8626664Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-23T01:34:13.8628080Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-23T01:34:13.8629639Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-23T01:34:13.8657306Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-23T01:34:13.8739577Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-23T01:34:13.8774981Z [submariner-operator]$ run_local_registry
2021-07-23T01:34:13.8788617Z [submariner-operator]$ run_local_registry
2021-07-23T01:34:13.8801686Z [submariner-operator]$ registry_running
2021-07-23T01:34:13.8812625Z [submariner-operator]$ registry_running
2021-07-23T01:34:13.8824173Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-23T01:34:13.8841429Z [submariner-operator]$ grep kind-registry
2021-07-23T01:34:14.2073381Z 31d86802e995 registry:2 "/entrypoint.sh /etc…" 7 minutes ago Up 7 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-23T01:34:14.2091864Z [submariner-operator]$ return 0
2021-07-23T01:34:14.2092919Z Local registry kind-registry already running.
2021-07-23T01:34:14.2103800Z [submariner-operator]$ declare_cidrs
2021-07-23T01:34:14.2124598Z [submariner-operator]$ declare_cidrs
2021-07-23T01:34:14.2156123Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-23T01:34:14.2178537Z [submariner-operator]$ i=1
2021-07-23T01:34:14.2193792Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:34:14.2204952Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:34:14.2218902Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-23T01:34:14.2230568Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-23T01:34:14.2246906Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-23T01:34:14.2262295Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:34:14.2276097Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:34:14.2290624Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-23T01:34:14.2306242Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-23T01:34:14.2318421Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-23T01:34:14.2335550Z [submariner-operator]$ [cluster2] wait 7015
2021-07-23T01:34:14.2352011Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-23T01:34:14.2371046Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-23T01:34:14.2383524Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-23T01:34:14.2404992Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-23T01:34:14.2416044Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-23T01:34:14.2433993Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-23T01:34:14.2458772Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-23T01:34:14.2475129Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-23T01:34:14.2487891Z [submariner-operator]$ [cluster1] pids[cluster1]=7024
2021-07-23T01:34:14.2506733Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-23T01:34:14.2512701Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-23T01:34:14.2540449Z [submariner-operator]$ [cluster2] pids[cluster2]=7031
2021-07-23T01:34:14.2555354Z [submariner-operator]$ [cluster2] wait 7031
2021-07-23T01:34:14.2601271Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-23T01:34:14.2637883Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-23T01:34:22.3383821Z [submariner-operator]$ [cluster2] with_retries
2021-07-23T01:34:22.3385734Z [submariner-operator]$ [cluster2] iteration=1
2021-07-23T01:34:22.3387059Z [submariner-operator]$ [cluster2] wait 7052
2021-07-23T01:34:22.3388287Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-23T01:34:22.3389659Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-23T01:34:22.3391865Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3394273Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3395992Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-23T01:34:22.3397244Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-23T01:34:22.3398395Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-23T01:34:22.3399724Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-23T01:34:22.3400969Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-23T01:34:22.3402125Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-23T01:34:22.3403333Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-23T01:34:22.3405523Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-23T01:34:22.3407208Z [submariner-operator]$ [cluster2] head -n 1
2021-07-23T01:34:22.3409145Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3411851Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3415490Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3418052Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3420688Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3425256Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-23T01:34:22.3427026Z [submariner-operator]$ [cluster2] return
2021-07-23T01:34:22.3427992Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:34:22.3429262Z [submariner-operator]$ [cluster2] wait 7024
2021-07-23T01:34:22.3585380Z [submariner-operator]$ [cluster1] with_retries
2021-07-23T01:34:22.3586491Z [submariner-operator]$ [cluster1] iteration=1
2021-07-23T01:34:22.3587492Z [submariner-operator]$ [cluster1] wait 7038
2021-07-23T01:34:22.3588518Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-23T01:34:22.3589627Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-23T01:34:22.3591362Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3593561Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3595446Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-23T01:34:22.3596529Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-23T01:34:22.3597435Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-23T01:34:22.3598605Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-23T01:34:22.3599706Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-23T01:34:22.3600696Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-23T01:34:22.3601740Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-23T01:34:22.3603394Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-23T01:34:22.3604897Z [submariner-operator]$ [cluster1] head -n 1
2021-07-23T01:34:22.3609067Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3611022Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3612964Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3615536Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3617922Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3622999Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-23T01:34:22.3624627Z [submariner-operator]$ [cluster1] return
2021-07-23T01:34:22.3625721Z [submariner-operator]$ [cluster1] return 0
2021-07-23T01:34:22.3626954Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-23T01:34:22.3628168Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-23T01:34:22.3638596Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-23T01:34:22.3639570Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-23T01:34:22.3640127Z
2021-07-23T01:34:22.3641162Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-23T01:34:22.3641839Z
2021-07-23T01:34:22.3642689Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-23T01:34:22.3643197Z
2021-07-23T01:34:22.3643921Z To clean everthing up, just run: make clean-clusters
2021-07-23T01:34:22.3648934Z EOM
2021-07-23T01:34:22.3673842Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-23T01:34:22.3674479Z
2021-07-23T01:34:22.3675647Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-23T01:34:22.3676319Z
2021-07-23T01:34:22.3677121Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-23T01:34:22.3677613Z
2021-07-23T01:34:22.3678439Z To clean everthing up, just run: make clean-clusters
2021-07-23T01:34:22.3688314Z Successfully remade target file 'clusters'.
2021-07-23T01:34:22.3691848Z File 'preload-images' does not exist.
2021-07-23T01:34:22.3695789Z File 'images' does not exist.
2021-07-23T01:34:22.3702222Z File 'package/.image.submariner-operator' does not exist.
2021-07-23T01:34:22.3794346Z find: 'bin/submariner-operator': No such file or directory
2021-07-23T01:34:22.7333249Z File 'bin/submariner-operator' does not exist.
2021-07-23T01:34:22.7339773Z File 'generate-embeddedyamls' does not exist.
2021-07-23T01:34:22.7340781Z File 'generate' does not exist.
2021-07-23T01:34:22.7341538Z Must remake target 'generate'.
2021-07-23T01:34:22.7367517Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-23T01:34:26.1405411Z Successfully remade target file 'generate'.
2021-07-23T01:34:26.1524406Z Must remake target 'generate-embeddedyamls'.
2021-07-23T01:34:26.1525663Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-23T01:34:26.1526892Z Must remake target 'bin/submariner-operator'.
2021-07-23T01:34:26.1527634Z /opt/shipyard/scripts/compile.sh \
2021-07-23T01:34:26.1528955Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8" \
2021-07-23T01:34:26.1530180Z bin/submariner-operator main.go
2021-07-23T01:34:26.2198866Z [submariner-operator]$ mkdir -p bin
2021-07-23T01:34:26.2209809Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8')
2021-07-23T01:34:26.2225536Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8
2021-07-23T01:34:26.2235912Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8 -o bin/submariner-operator main.go
2021-07-23T01:34:43.1964315Z [submariner-operator]$ upx bin/submariner-operator
2021-07-23T01:34:49.2874515Z Ultimate Packer for eXecutables
2021-07-23T01:34:49.2876365Z Copyright (C) 1996 - 2020
2021-07-23T01:34:49.2877525Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-23T01:34:49.2878230Z
2021-07-23T01:34:49.2879171Z File size Ratio Format Name
2021-07-23T01:34:49.2880380Z -------------------- ------ ----------- -----------
2021-07-23T01:34:49.2881300Z 34463744 -> 9933196 28.82% linux/amd64 submariner-operator
2021-07-23T01:34:49.2881943Z
2021-07-23T01:34:49.2884905Z Packed 1 file.
2021-07-23T01:34:49.2893298Z Successfully remade target file 'bin/submariner-operator'.
2021-07-23T01:34:49.2894946Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-23T01:34:49.2898706Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-23T01:34:49.2900927Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-23T01:34:49.2902556Z File 'FORCE_IMAGE' does not exist.
2021-07-23T01:34:49.2903544Z Must remake target 'FORCE_IMAGE'.
2021-07-23T01:34:49.2904364Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-23T01:34:49.2905964Z Must remake target 'package/.image.submariner-operator'.
2021-07-23T01:34:49.2907860Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-23T01:34:49.3421115Z flags:WARN flag short name (h) already defined
2021-07-23T01:34:49.4063812Z [submariner-operator]$ set -e
2021-07-23T01:34:49.4085025Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:49.4099753Z [submariner-operator]$ cache_flag=
2021-07-23T01:34:49.4115439Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:49.4134776Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:49.7233894Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:50.3334324Z devel: Pulling from submariner/submariner-operator
2021-07-23T01:34:50.3338077Z 942b94cdb625: Pulling fs layer
2021-07-23T01:34:50.5049264Z 942b94cdb625: Verifying Checksum
2021-07-23T01:34:50.5049876Z 942b94cdb625: Download complete
2021-07-23T01:34:50.7529715Z 942b94cdb625: Pull complete
2021-07-23T01:34:50.7571639Z Digest: sha256:e840d03df669b4d576d26619d3f1d7b05349f974676de398aba4f1a8ed1866e6
2021-07-23T01:34:50.7606158Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:50.7677467Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-23T01:34:50.7678975Z quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:50.7704944Z [submariner-operator]$ cut -f2 -d 
2021-07-23T01:34:50.7720775Z [submariner-operator]$ grep -v scratch
2021-07-23T01:34:50.7749550Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-23T01:34:50.7763001Z 
2021-07-23T01:34:51.6890476Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-23T01:34:52.6101503Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-23T01:34:52.6179700Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-23T01:34:53.4966493Z buildx_builder
2021-07-23T01:34:53.5051176Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-23T01:34:54.3966645Z #1 [internal] booting buildkit
2021-07-23T01:34:54.3967894Z #1 sha256:fe8eb6fef755a11923eb18da61ada73a6d65da82556df630039aaaecd93efa5c
2021-07-23T01:34:54.5476668Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-23T01:34:58.4569503Z #1 pulling image moby/buildkit:buildx-stable-1 4.0s done
2021-07-23T01:34:58.4570578Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-23T01:34:59.2028155Z #1 creating container buildx_buildkit_buildx_builder0 0.7s done
2021-07-23T01:34:59.2033655Z #1 DONE 4.7s
2021-07-23T01:34:59.4992423Z
2021-07-23T01:34:59.4994471Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-23T01:34:59.4999703Z #2 sha256:372a2c5bcfc8c9cb7a78ab40608ff01127d72797df198b8f3d158d55912e3b1b
2021-07-23T01:34:59.5000943Z #2 transferring dockerfile: 230B done
2021-07-23T01:34:59.5001416Z #2 DONE 0.0s
2021-07-23T01:34:59.5001667Z
2021-07-23T01:34:59.5002092Z #3 [internal] load .dockerignore
2021-07-23T01:34:59.5003135Z #3 sha256:812ea563e5b41db1ad3de6c215b1acf8a8653931e6e36ddf246933cd03ba324f
2021-07-23T01:34:59.5004294Z #3 transferring context: 2B done
2021-07-23T01:34:59.5004725Z #3 DONE 0.0s
2021-07-23T01:34:59.5004966Z
2021-07-23T01:34:59.5005356Z #4 [internal] load build context
2021-07-23T01:34:59.5006524Z #4 sha256:5ad6ad7ed57e27925c8d8caf5dd82fafda83ceb5c597b5abf6204b88feda52bb
2021-07-23T01:34:59.5007591Z #4 DONE 0.0s
2021-07-23T01:34:59.5007815Z
2021-07-23T01:34:59.5009023Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-23T01:34:59.5010461Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-23T01:34:59.8001757Z #6 DONE 0.3s
2021-07-23T01:34:59.8006355Z
2021-07-23T01:34:59.8009422Z #4 [internal] load build context
2021-07-23T01:34:59.8013097Z #4 sha256:5ad6ad7ed57e27925c8d8caf5dd82fafda83ceb5c597b5abf6204b88feda52bb
2021-07-23T01:35:00.0971609Z #4 transferring context: 9.94MB 0.3s done
2021-07-23T01:35:00.0972224Z #4 DONE 0.3s
2021-07-23T01:35:00.0972473Z
2021-07-23T01:35:00.0973802Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-23T01:35:00.0975176Z #5 sha256:04b2bac1f1004bb451b221ad6d0266d9682d2027071beb5bb1095dbc43a60249
2021-07-23T01:35:00.0976047Z #5 CACHED
2021-07-23T01:35:00.0976391Z
2021-07-23T01:35:00.0977172Z #7 exporting to oci image format
2021-07-23T01:35:00.0978145Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-23T01:35:00.0979005Z #7 exporting layers done
2021-07-23T01:35:00.0980100Z #7 exporting manifest sha256:0cbb7b4a95ba99e6b61cd8aec4199268a55314abd782b3e1922b9540caec3552 done
2021-07-23T01:35:00.0981947Z #7 exporting config sha256:9f29b12b5c0f1cc6311fd4854c2ad9b9dd006416a6c3fc135c9fcc8a6d46a3e9 done
2021-07-23T01:35:00.2473420Z #7 ...
2021-07-23T01:35:00.2473822Z
2021-07-23T01:35:00.2475115Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-23T01:35:00.2476395Z #5 sha256:04b2bac1f1004bb451b221ad6d0266d9682d2027071beb5bb1095dbc43a60249
2021-07-23T01:35:00.2495284Z #5 sha256:942b94cdb625b307a2328d17ea4582b21722ccdabbfa76982c20c38d2391efe2 1.05MB / 9.62MB 0.2s
2021-07-23T01:35:00.2496339Z #5 CACHED
2021-07-23T01:35:00.3499981Z
2021-07-23T01:35:00.3501732Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-23T01:35:00.3503052Z #5 sha256:04b2bac1f1004bb451b221ad6d0266d9682d2027071beb5bb1095dbc43a60249
2021-07-23T01:35:00.3509210Z #5 sha256:942b94cdb625b307a2328d17ea4582b21722ccdabbfa76982c20c38d2391efe2 9.62MB / 9.62MB 0.3s done
2021-07-23T01:35:00.3510270Z #5 CACHED
2021-07-23T01:35:00.3510534Z
2021-07-23T01:35:00.3510967Z #7 exporting to oci image format
2021-07-23T01:35:00.3512045Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-23T01:35:00.3513049Z #7 sending tarball
2021-07-23T01:35:00.6796285Z #7 sending tarball 0.3s done
2021-07-23T01:35:00.6796906Z #7 DONE 0.7s
2021-07-23T01:35:00.6797178Z
2021-07-23T01:35:00.6797570Z #9 exporting cache
2021-07-23T01:35:00.6798652Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-23T01:35:00.6799716Z #9 preparing build cache for export done
2021-07-23T01:35:00.6800225Z #9 DONE 0.0s
2021-07-23T01:35:00.6800572Z
2021-07-23T01:35:00.6800962Z #8 importing to docker
2021-07-23T01:35:00.6801827Z #8 sha256:9863f712e857743206cff0235aba258295756a32a6349c7ce0cea766d7767b71
2021-07-23T01:35:00.6802586Z #8 DONE 0.0s
2021-07-23T01:35:00.6962612Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-23T01:35:01.0122727Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-23T01:35:01.0123859Z File 'build' does not exist.
2021-07-23T01:35:01.0124957Z File 'bin/subctl-devel-daeaed8-linux-amd64' does not exist.
2021-07-23T01:35:01.0367727Z Must remake target 'bin/subctl-devel-daeaed8-linux-amd64'.
2021-07-23T01:35:01.0368809Z mkdir -p bin
2021-07-23T01:35:01.0405588Z target=bin/subctl-devel-daeaed8-linux-amd64; \
2021-07-23T01:35:01.0406580Z target=${target%.exe}; \
2021-07-23T01:35:01.0407312Z components=($(echo ${target//-/ })); \
2021-07-23T01:35:01.0407984Z GOOS=${components[-2]}; \
2021-07-23T01:35:01.0408633Z GOARCH=${components[-1]}; \
2021-07-23T01:35:01.0409130Z export GOARCH GOOS; \
2021-07-23T01:35:01.0409720Z /opt/shipyard/scripts/compile.sh \
2021-07-23T01:35:01.0410965Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8 \
2021-07-23T01:35:01.0413068Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-23T01:35:01.0415026Z --noupx bin/subctl-devel-daeaed8-linux-amd64 ./pkg/subctl/main.go
2021-07-23T01:35:01.1015626Z [submariner-operator]$ mkdir -p bin
2021-07-23T01:35:01.1037887Z Building 'bin/subctl-devel-daeaed8-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8 \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-23T01:35:01.1049052Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8 -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-23T01:35:01.1066045Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-daeaed8 -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-daeaed8-linux-amd64 ./pkg/subctl/main.go
2021-07-23T01:35:04.7412393Z Successfully remade target file 'bin/subctl-devel-daeaed8-linux-amd64'.
2021-07-23T01:35:04.7415568Z Prerequisite 'bin/subctl-devel-daeaed8-linux-amd64' is newer than target 'bin/subctl'.
2021-07-23T01:35:04.7416884Z Must remake target 'bin/subctl'.
2021-07-23T01:35:04.7417879Z ln -sf subctl-devel-daeaed8-linux-amd64 bin/subctl
2021-07-23T01:35:04.7460762Z Successfully remade target file 'bin/subctl'.
2021-07-23T01:35:04.7461637Z Must remake target 'build'.
2021-07-23T01:35:04.7462514Z Successfully remade target file 'build'.
2021-07-23T01:35:04.7463303Z Must remake target 'images'.
2021-07-23T01:35:04.7464067Z Successfully remade target file 'images'.
2021-07-23T01:35:04.7464907Z Must remake target 'preload-images'.
2021-07-23T01:35:04.7465833Z set -e;\
2021-07-23T01:35:04.7466350Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-23T01:35:04.7467004Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-23T01:35:04.7468630Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-23T01:35:04.7470325Z import_image quay.io/submariner/${image};\
2021-07-23T01:35:04.7470831Z done
2021-07-23T01:35:04.7510757Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-23T01:35:04.7519886Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-23T01:35:04.7534367Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-23T01:35:05.0638849Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-23T01:35:05.3562232Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-23T01:35:05.3710198Z 8c51bc51bb0f: Preparing
2021-07-23T01:35:06.0046019Z 8c51bc51bb0f: Pushed
2021-07-23T01:35:06.0263771Z local: digest: sha256:e840d03df669b4d576d26619d3f1d7b05349f974676de398aba4f1a8ed1866e6 size: 528
2021-07-23T01:35:06.0311414Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-23T01:35:06.0318308Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-23T01:35:06.0345862Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-23T01:35:06.3326433Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-23T01:35:06.3365601Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-23T01:35:06.8793713Z devel: Pulling from submariner/submariner-gateway
2021-07-23T01:35:06.8794532Z 8c741e919b67: Pulling fs layer
2021-07-23T01:35:06.8795061Z 13495efbbac4: Pulling fs layer
2021-07-23T01:35:06.8795612Z 6df6df193f2d: Pulling fs layer
2021-07-23T01:35:06.8796407Z 0f4c4d23e4d9: Pulling fs layer
2021-07-23T01:35:06.8796913Z 0f4c4d23e4d9: Waiting
2021-07-23T01:35:06.9882895Z 13495efbbac4: Verifying Checksum
2021-07-23T01:35:06.9883567Z 13495efbbac4: Download complete
2021-07-23T01:35:07.1851598Z 6df6df193f2d: Verifying Checksum
2021-07-23T01:35:07.1865557Z 6df6df193f2d: Download complete
2021-07-23T01:35:07.2434743Z 0f4c4d23e4d9: Verifying Checksum
2021-07-23T01:35:07.2435435Z 0f4c4d23e4d9: Download complete
2021-07-23T01:35:07.5380675Z 8c741e919b67: Verifying Checksum
2021-07-23T01:35:07.5381374Z 8c741e919b67: Download complete
2021-07-23T01:35:10.6741284Z 8c741e919b67: Pull complete
2021-07-23T01:35:11.7410448Z 13495efbbac4: Pull complete
2021-07-23T01:35:13.1758361Z 6df6df193f2d: Pull complete
2021-07-23T01:35:13.3595864Z 0f4c4d23e4d9: Pull complete
2021-07-23T01:35:13.3631658Z Digest: sha256:90392103d1ff35e57f90bc0ed2299f4529e82be0f1374a588926ebeaa603ad18
2021-07-23T01:35:13.3710685Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-23T01:35:13.3744151Z quay.io/submariner/submariner-gateway:devel
2021-07-23T01:35:13.3827802Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-23T01:35:13.6804145Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-23T01:35:13.9726429Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-23T01:35:14.2624019Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-23T01:35:14.2673304Z f02a974cd676: Preparing
2021-07-23T01:35:14.2673867Z 3c7f2d60eacb: Preparing
2021-07-23T01:35:14.2674400Z 00c5f6897675: Preparing
2021-07-23T01:35:14.2674876Z b3b62c837788: Preparing
2021-07-23T01:35:14.8943915Z 00c5f6897675: Pushed
2021-07-23T01:35:15.4941289Z f02a974cd676: Pushed
2021-07-23T01:35:19.4547603Z 3c7f2d60eacb: Pushed
2021-07-23T01:35:27.2635420Z b3b62c837788: Pushed
2021-07-23T01:35:27.2910732Z local: digest: sha256:90392103d1ff35e57f90bc0ed2299f4529e82be0f1374a588926ebeaa603ad18 size: 1159
2021-07-23T01:35:27.2959993Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-23T01:35:27.2972815Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-23T01:35:27.2991527Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-23T01:35:27.6033992Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-23T01:35:27.6064005Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-23T01:35:28.1609137Z devel: Pulling from submariner/submariner-route-agent
2021-07-23T01:35:28.1617079Z 8c741e919b67: Already exists
2021-07-23T01:35:28.1632781Z 13495efbbac4: Already exists
2021-07-23T01:35:28.1653362Z 70cc6422093d: Pulling fs layer
2021-07-23T01:35:28.1653986Z bfd06df6b3bc: Pulling fs layer
2021-07-23T01:35:28.1654540Z f8595f2de1da: Pulling fs layer
2021-07-23T01:35:28.1655079Z 0367c3f6c67d: Pulling fs layer
2021-07-23T01:35:28.1655542Z 0367c3f6c67d: Waiting
2021-07-23T01:35:28.2450609Z f8595f2de1da: Verifying Checksum
2021-07-23T01:35:28.2451477Z f8595f2de1da: Download complete
2021-07-23T01:35:28.3449802Z bfd06df6b3bc: Verifying Checksum
2021-07-23T01:35:28.3450511Z bfd06df6b3bc: Download complete
2021-07-23T01:35:28.3522271Z 0367c3f6c67d: Verifying Checksum
2021-07-23T01:35:28.3523026Z 0367c3f6c67d: Download complete
2021-07-23T01:35:28.4547874Z 70cc6422093d: Verifying Checksum
2021-07-23T01:35:28.4548467Z 70cc6422093d: Download complete
2021-07-23T01:35:29.8759620Z 70cc6422093d: Pull complete
2021-07-23T01:35:30.0682769Z bfd06df6b3bc: Pull complete
2021-07-23T01:35:30.1570904Z f8595f2de1da: Pull complete
2021-07-23T01:35:30.2353314Z 0367c3f6c67d: Pull complete
2021-07-23T01:35:30.2384277Z Digest: sha256:69905edfe2dd706d1b71f76ba49a6e2ac22942d06d172c8a879424d341944ff4
2021-07-23T01:35:30.2399763Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-23T01:35:30.2433044Z quay.io/submariner/submariner-route-agent:devel
2021-07-23T01:35:30.2451185Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-23T01:35:30.5301299Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-23T01:35:30.8379074Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-23T01:35:31.1411257Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-23T01:35:31.1486493Z 684431af2398: Preparing
2021-07-23T01:35:31.1486997Z 1a1dcd6b7f7c: Preparing
2021-07-23T01:35:31.1487722Z ead954d2188a: Preparing
2021-07-23T01:35:31.1488307Z 6931e591f8e2: Preparing
2021-07-23T01:35:31.1488831Z 00c5f6897675: Preparing
2021-07-23T01:35:31.1489372Z b3b62c837788: Preparing
2021-07-23T01:35:31.1489885Z b3b62c837788: Waiting
2021-07-23T01:35:31.4799820Z 00c5f6897675: Mounted from submariner-gateway
2021-07-23T01:35:31.6562229Z 1a1dcd6b7f7c: Pushed
2021-07-23T01:35:31.9655885Z 684431af2398: Pushed
2021-07-23T01:35:31.9829107Z b3b62c837788: Mounted from submariner-gateway
2021-07-23T01:35:31.9961656Z ead954d2188a: Pushed
2021-07-23T01:35:36.1694425Z 6931e591f8e2: Pushed
2021-07-23T01:35:36.1890061Z local: digest: sha256:69905edfe2dd706d1b71f76ba49a6e2ac22942d06d172c8a879424d341944ff4 size: 1575
2021-07-23T01:35:36.1945730Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-23T01:35:36.1959089Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-23T01:35:36.1975396Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-23T01:35:36.4866141Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-23T01:35:36.4916455Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-23T01:35:37.0768435Z devel: Pulling from submariner/lighthouse-agent
2021-07-23T01:35:37.0774514Z ecd69139dc76: Pulling fs layer
2021-07-23T01:35:37.0775098Z 8261c1767de3: Pulling fs layer
2021-07-23T01:35:37.1605648Z ecd69139dc76: Verifying Checksum
2021-07-23T01:35:37.1606375Z ecd69139dc76: Download complete
2021-07-23T01:35:37.2965219Z 8261c1767de3: Verifying Checksum
2021-07-23T01:35:37.2967194Z 8261c1767de3: Download complete
2021-07-23T01:35:37.2977268Z ecd69139dc76: Pull complete
2021-07-23T01:35:37.5357638Z 8261c1767de3: Pull complete
2021-07-23T01:35:37.5402365Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-23T01:35:37.5429021Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-23T01:35:37.5489855Z quay.io/submariner/lighthouse-agent:devel
2021-07-23T01:35:37.5501340Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-23T01:35:37.8513601Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-23T01:35:38.1692927Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-23T01:35:38.4553815Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-23T01:35:38.4617683Z 83c79e393e11: Preparing
2021-07-23T01:35:38.4618359Z 0026d2f62bbf: Preparing
2021-07-23T01:35:38.5020592Z 0026d2f62bbf: Pushed
2021-07-23T01:35:39.0136133Z 83c79e393e11: Pushed
2021-07-23T01:35:39.0382070Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-23T01:35:39.0421717Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-23T01:35:39.0435301Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-23T01:35:39.0448772Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-23T01:35:39.3307238Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-23T01:35:39.3337890Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-23T01:35:39.8880319Z devel: Pulling from submariner/lighthouse-coredns
2021-07-23T01:35:39.8881098Z 088e56360f76: Pulling fs layer
2021-07-23T01:35:39.8881611Z 18aed70882d2: Pulling fs layer
2021-07-23T01:35:39.9842826Z 088e56360f76: Verifying Checksum
2021-07-23T01:35:39.9843453Z 088e56360f76: Download complete
2021-07-23T01:35:40.0832744Z 18aed70882d2: Verifying Checksum
2021-07-23T01:35:40.0833378Z 18aed70882d2: Download complete
2021-07-23T01:35:40.1249088Z 088e56360f76: Pull complete
2021-07-23T01:35:40.3283571Z 18aed70882d2: Pull complete
2021-07-23T01:35:40.3317099Z Digest: sha256:92280c8723eb4400aeadedcb1885052b0d8344fc4c3efeee4cc91d10c5d29dd6
2021-07-23T01:35:40.3337395Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-23T01:35:40.3388733Z quay.io/submariner/lighthouse-coredns:devel
2021-07-23T01:35:40.3428949Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-23T01:35:40.6259143Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-23T01:35:40.9838555Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-23T01:35:41.2744557Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-23T01:35:41.2793862Z 7fca351e51be: Preparing
2021-07-23T01:35:41.2794441Z 4fa0ece06e25: Preparing
2021-07-23T01:35:41.3700196Z 4fa0ece06e25: Pushed
2021-07-23T01:35:42.0927887Z 7fca351e51be: Pushed
2021-07-23T01:35:42.1128732Z local: digest: sha256:92280c8723eb4400aeadedcb1885052b0d8344fc4c3efeee4cc91d10c5d29dd6 size: 739
2021-07-23T01:35:42.1164109Z Successfully remade target file 'preload-images'.
2021-07-23T01:35:42.1165211Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-23T01:35:42.1166516Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-23T01:35:42.1167569Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-23T01:35:42.1168381Z Must remake target 'deploy'.
2021-07-23T01:35:42.1173395Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:35:42.2073787Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-23T01:35:42.2095309Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-23T01:35:42.2111402Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:35:42.2125424Z [submariner-operator]$ script_name=utils
2021-07-23T01:35:42.2136415Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:35:42.2157970Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-23T01:35:42.2172707Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:35:42.2187094Z [submariner-operator]$ script_name=deploy_funcs
2021-07-23T01:35:42.2200688Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:35:42.2229972Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-23T01:35:42.2245634Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:35:42.2257487Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:35:42.2269646Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:35:42.2294564Z [submariner-operator]$ broker=cluster1
2021-07-23T01:35:42.2309512Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-23T01:35:42.2322773Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-23T01:35:42.2335430Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-23T01:35:42.2348413Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-23T01:35:42.2361903Z [submariner-operator]$ declare -gA cluster_subm
2021-07-23T01:35:42.2374953Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-23T01:35:42.2389289Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-23T01:35:42.2402420Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-23T01:35:42.2416732Z [submariner-operator]$ declare -gA cluster_cni
2021-07-23T01:35:42.2430976Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-23T01:35:42.2444032Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-23T01:35:42.2457906Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-23T01:35:42.2477790Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:35:42.2493433Z [submariner-operator]$ script_name=cluster_settings
2021-07-23T01:35:42.2507227Z [submariner-operator]$ exec_name=deploy.sh
2021-07-23T01:35:42.2533715Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-23T01:35:42.2574896Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-23T01:35:42.2633419Z [submariner-operator]$ declare_cidrs
2021-07-23T01:35:42.2651421Z [submariner-operator]$ declare_cidrs
2021-07-23T01:35:42.2668747Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-23T01:35:42.2683002Z [submariner-operator]$ i=1
2021-07-23T01:35:42.2697736Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:35:42.2711268Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-23T01:35:42.2735166Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-23T01:35:42.2753588Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-23T01:35:42.2769808Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-23T01:35:42.2786283Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:35:42.2799917Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-23T01:35:42.2816374Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-23T01:35:42.2830076Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-23T01:35:42.2845483Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-23T01:35:42.2861179Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-23T01:35:42.2879360Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-23T01:35:42.2897300Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-23T01:35:42.2919864Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-23T01:35:42.2935522Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-23T01:35:42.2956777Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-23T01:35:42.2989470Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-23T01:35:42.4126342Z Installing subctl version devel
2021-07-23T01:35:42.4138087Z OS detected: linux
2021-07-23T01:35:42.4140929Z Architecture detected: amd64
2021-07-23T01:35:42.4146889Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-23T01:35:42.4148692Z
2021-07-23T01:35:42.4152545Z Downloading...
2021-07-23T01:35:43.8831032Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-23T01:35:43.9223082Z This provides subctl version: devel
2021-07-23T01:35:43.9246674Z
2021-07-23T01:35:43.9247941Z please update your path (and consider adding it to ~/.profile):
2021-07-23T01:35:43.9248650Z export PATH=$PATH:/go/bin
2021-07-23T01:35:43.9249080Z
2021-07-23T01:35:43.9358977Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-23T01:35:43.9377204Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-23T01:35:43.9386943Z Will deploy submariner using operator
2021-07-23T01:35:43.9402417Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-23T01:35:43.9432051Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:35:43.9444814Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-23T01:35:43.9457815Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-23T01:35:43.9480960Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-23T01:35:43.9492860Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-23T01:35:43.9504877Z 
2021-07-23T01:35:43.9518983Z [submariner-operator]$ [cluster2] subctl version
2021-07-23T01:35:43.9727585Z subctl version: devel-daeaed8
2021-07-23T01:35:43.9760513Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-23T01:35:43.9832772Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-23T01:35:43.9848346Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-23T01:35:43.9876947Z [submariner-operator]$ [cluster2] grep -q function
2021-07-23T01:35:43.9907463Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:35:43.9921313Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-23T01:35:43.9937952Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-23T01:35:43.9951156Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-23T01:35:43.9990315Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-23T01:35:44.0004098Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-23T01:35:44.0024442Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-23T01:35:44.0044343Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-23T01:35:44.0067291Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-23T01:35:44.0068474Z [submariner-operator]$ [cluster1] pids[cluster1]=8652
2021-07-23T01:35:44.0087086Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-23T01:35:44.0103898Z [submariner-operator]$ [cluster2] pids[cluster2]=8655
2021-07-23T01:35:44.0116403Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-23T01:35:44.0123704Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-23T01:35:44.0141061Z [submariner-operator]$ [cluster2] wait 8655
2021-07-23T01:35:44.0163413Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-23T01:35:44.0184094Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-23T01:35:44.4637020Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-23T01:35:44.4638276Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-23T01:35:44.4639391Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-23T01:35:44.4640828Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-23T01:35:44.4642574Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-23T01:35:44.4644471Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-23T01:35:44.4645980Z [cluster1] node/cluster1-worker not labeled
2021-07-23T01:35:44.4940987Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-23T01:35:44.4942260Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-23T01:35:44.4943603Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-23T01:35:44.4945522Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-23T01:35:44.4947451Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-23T01:35:44.4949185Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-23T01:35:44.4950703Z [cluster2] node/cluster2-worker not labeled
2021-07-23T01:35:44.4971931Z [submariner-operator]$ [cluster2] wait 8652
2021-07-23T01:35:44.4987969Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-23T01:35:44.5002971Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-23T01:35:44.5026974Z [submariner-operator]$ [cluster1] setup_broker
2021-07-23T01:35:44.5040884Z [submariner-operator]$ [cluster1] setup_broker
2021-07-23T01:35:44.5048229Z Installing broker...
2021-07-23T01:35:44.5061199Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-23T01:35:44.5077778Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-23T01:35:44.5097517Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-23T01:35:44.5115797Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-23T01:35:44.5363679Z • Setting up broker RBAC ...
2021-07-23T01:35:44.5793793Z ✓ Setting up broker RBAC
2021-07-23T01:35:44.5794550Z • Deploying the Submariner operator ...
2021-07-23T01:35:50.7959706Z ✓ Deploying the Submariner operator
2021-07-23T01:35:50.7965545Z ✓ Created operator service account and role
2021-07-23T01:35:50.7970255Z ✓ Created Lighthouse service accounts and roles
2021-07-23T01:35:50.7974881Z • Deploying the broker ...
2021-07-23T01:35:51.9241457Z ✓ Deploying the broker
2021-07-23T01:35:51.9242210Z ✓ The broker has been deployed
2021-07-23T01:35:51.9243006Z • Creating broker-info.subm file ...
2021-07-23T01:35:51.9805542Z ✓ Creating broker-info.subm file
2021-07-23T01:35:51.9806790Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-23T01_35_51Z
2021-07-23T01:35:51.9808181Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-23T01:35:51.9874852Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-23T01:35:51.9892544Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-23T01:35:51.9909264Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-23T01:35:51.9928683Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-23T01:35:51.9954932Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-23T01:35:51.9994898Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-23T01:35:52.0006066Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-23T01:35:52.0027621Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-23T01:35:52.0045918Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-23T01:35:52.0067575Z [submariner-operator]$ [cluster1] pids[cluster1]=8718
2021-07-23T01:35:52.0083417Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-23T01:35:52.0101237Z [submariner-operator]$ [cluster2] pids[cluster2]=8721
2021-07-23T01:35:52.0107110Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-23T01:35:52.0126993Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-23T01:35:52.0152144Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-23T01:35:52.0159917Z [submariner-operator]$ [cluster2] wait 8721
2021-07-23T01:35:52.0165764Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-23T01:35:52.0223371Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-23T01:36:08.1107154Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-23T01:36:08.1108768Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-23T01:36:08.1110590Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-23T01:36:08.1112166Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-23T01:36:08.1115581Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-23T01:36:08.1119980Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-23T01:36:08.1121209Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-23T01:36:08.1122039Z [cluster2] - cluster2-worker
2021-07-23T01:36:08.1122882Z [cluster2] • Discovering network details ...
2021-07-23T01:36:08.1123942Z [cluster2] Network plugin: weave-net
2021-07-23T01:36:08.1124572Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-23T01:36:08.1125143Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-23T01:36:08.1125943Z [cluster2] ✓ Discovering network details
2021-07-23T01:36:08.1126814Z [cluster2] • Discovering multi cluster details ...
2021-07-23T01:36:08.1127750Z [cluster2] • Validating Globalnet configurations ...
2021-07-23T01:36:08.1128732Z [cluster2] ✓ Validating Globalnet configurations
2021-07-23T01:36:08.1130776Z [cluster2] ✓ Discovering multi cluster details
2021-07-23T01:36:08.1131689Z [cluster2] • Deploying the Submariner operator ...
2021-07-23T01:36:08.1132595Z [cluster2] ✓ Deploying the Submariner operator
2021-07-23T01:36:08.1133524Z [cluster2] ✓ Created operator service account and role
2021-07-23T01:36:08.1134492Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-23T01:36:08.1135364Z [cluster2] • Creating SA for cluster ...
2021-07-23T01:36:08.1136129Z [cluster2] ✓ Creating SA for cluster
2021-07-23T01:36:08.1136907Z [cluster2] • Deploying Submariner ...
2021-07-23T01:36:08.1137688Z [cluster2] ✓ Deploying Submariner
2021-07-23T01:36:08.1138461Z [cluster2] ✓ Submariner is up and running
2021-07-23T01:36:08.1139398Z [submariner-operator]$ [cluster2] wait 8718
2021-07-23T01:36:16.4258415Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-23T01:36:16.4260984Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-23T01:36:16.4262906Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-23T01:36:16.4264353Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-23T01:36:16.4268006Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-23T01:36:16.4271587Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-23T01:36:16.4272959Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-23T01:36:16.4273927Z [cluster1] - cluster1-worker
2021-07-23T01:36:16.4275147Z [cluster1] • Discovering network details ...
2021-07-23T01:36:16.4276192Z [cluster1] Network plugin: weave-net
2021-07-23T01:36:16.4276953Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-23T01:36:16.4277664Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-23T01:36:16.4278579Z [cluster1] ✓ Discovering network details
2021-07-23T01:36:16.4279613Z [cluster1] • Discovering multi cluster details ...
2021-07-23T01:36:16.4280725Z [cluster1] • Validating Globalnet configurations ...
2021-07-23T01:36:16.4281853Z [cluster1] ✓ Validating Globalnet configurations
2021-07-23T01:36:16.4282929Z [cluster1] ✓ Discovering multi cluster details
2021-07-23T01:36:16.4283970Z [cluster1] • Deploying the Submariner operator ...
2021-07-23T01:36:16.4285042Z [cluster1] ✓ Deploying the Submariner operator
2021-07-23T01:36:16.4286253Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-23T01:36:16.4290105Z [cluster1] • Creating SA for cluster ...
2021-07-23T01:36:16.4290865Z [cluster1] ✓ Creating SA for cluster
2021-07-23T01:36:16.4291658Z [cluster1] • Deploying Submariner ...
2021-07-23T01:36:16.4292447Z [cluster1] ✓ Deploying Submariner
2021-07-23T01:36:16.4293224Z [cluster1] ✓ Submariner is up and running
2021-07-23T01:36:16.4327327Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-23T01:36:16.4344989Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-23T01:36:16.4392553Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-23T01:36:16.4422122Z [submariner-operator]$ [cluster2] with_retries
2021-07-23T01:36:16.4506793Z [submariner-operator]$ [cluster2] iteration=1
2021-07-23T01:36:16.4551588Z [submariner-operator]$ [cluster2] wait 8763
2021-07-23T01:36:16.4644926Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:16.4729318Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:16.4744367Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:36:16.4836209Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:16.4855694Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:36:16.9927750Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:16.9946421Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:36:17.2803792Z • Showing Connections ...
2021-07-23T01:36:17.3009985Z ✗ Showing Connections
2021-07-23T01:36:17.3010807Z ✗ There are no gateways detected
2021-07-23T01:36:17.5057774Z • Showing Connections ...
2021-07-23T01:36:17.6929847Z ✗ Showing Connections
2021-07-23T01:36:17.6934448Z ✗ There are no gateways detected
2021-07-23T01:36:17.6962749Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:36:17.6979063Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:36:23.7012635Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:36:23.7051724Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:23.7062624Z [submariner-operator]$ [cluster2] wait 8789
2021-07-23T01:36:23.7071285Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:23.7085576Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:36:23.7100441Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:23.7192168Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:36:24.2833329Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:24.2851783Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:36:24.4708161Z • Showing Connections ...
2021-07-23T01:36:24.4766767Z ✗ Showing Connections
2021-07-23T01:36:24.4767557Z ✗ There are no gateways detected
2021-07-23T01:36:24.4993851Z • Showing Connections ...
2021-07-23T01:36:24.5082913Z ✗ Showing Connections
2021-07-23T01:36:24.5086804Z ✗ There are no gateways detected
2021-07-23T01:36:24.5122267Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:36:24.5136786Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:36:30.5165310Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:36:30.5216632Z [submariner-operator]$ [cluster2] wait 8816
2021-07-23T01:36:30.5233835Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:30.5255515Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:30.5268385Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:36:30.5280192Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:30.5422633Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:36:30.7774255Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:30.7796350Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:36:30.8921621Z • Showing Connections ...
2021-07-23T01:36:30.8966386Z ✗ Showing Connections
2021-07-23T01:36:30.8967094Z ✗ No connections found
2021-07-23T01:36:31.2239913Z • Showing Connections ...
2021-07-23T01:36:31.2270794Z ✗ Showing Connections
2021-07-23T01:36:31.2271864Z ✗ There are no gateways detected
2021-07-23T01:36:31.2299189Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:36:31.2313915Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:36:37.2340230Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:36:37.2380263Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:37.2383397Z [submariner-operator]$ [cluster2] wait 8842
2021-07-23T01:36:37.2396004Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:37.2407177Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:36:37.2423099Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:37.2441126Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:36:37.3175014Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:37.3192742Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:36:37.3694307Z • Showing Connections ...
2021-07-23T01:36:37.3725091Z ✓ Showing Connections
2021-07-23T01:36:37.3828529Z • Showing Connections ...
2021-07-23T01:36:37.3854704Z ✗ Showing Connections
2021-07-23T01:36:37.3855442Z ✗ No connections found
2021-07-23T01:36:37.3885640Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-23T01:36:37.3898124Z [submariner-operator]$ [cluster2] sleep 6
2021-07-23T01:36:43.3945656Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:36:43.3992556Z [submariner-operator]$ [cluster2] wait 8868
2021-07-23T01:36:43.3999522Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:43.4014013Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-23T01:36:43.4024757Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-23T01:36:43.4041815Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:43.4054773Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-23T01:36:43.4809425Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-23T01:36:43.4858942Z [submariner-operator]$ [cluster2] grep connected
2021-07-23T01:36:43.5282746Z • Showing Connections ...
2021-07-23T01:36:43.5315838Z ✓ Showing Connections
2021-07-23T01:36:43.5424420Z • Showing Connections ...
2021-07-23T01:36:43.5451978Z ✓ Showing Connections
2021-07-23T01:36:43.5476143Z cluster2-worker cluster2 172.18.0.8 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 199.244µs
2021-07-23T01:36:43.5477613Z cluster1-worker cluster1 172.18.0.7 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 0s
2021-07-23T01:36:43.5490852Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:36:43.5509949Z [submariner-operator]$ [cluster2] return 0
2021-07-23T01:36:43.5524762Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-23T01:36:43.5539015Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-23T01:36:43.5564931Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-23T01:36:43.5576013Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-23T01:36:43.5587382Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-23T01:36:43.5599503Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-23T01:36:43.5612007Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-23T01:36:43.5627299Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-23T01:36:43.8736268Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-23T01:36:43.8796274Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-23T01:36:44.4246044Z devel: Pulling from submariner/nettest
2021-07-23T01:36:44.4256199Z 5843afab3874: Already exists
2021-07-23T01:36:44.4272902Z 2f9ee08e07bc: Pulling fs layer
2021-07-23T01:36:44.4281259Z 35de94ac9c6f: Pulling fs layer
2021-07-23T01:36:44.4287042Z a339bcd1def5: Pulling fs layer
2021-07-23T01:36:44.5259728Z 2f9ee08e07bc: Download complete
2021-07-23T01:36:44.5407488Z a339bcd1def5: Verifying Checksum
2021-07-23T01:36:44.5408124Z a339bcd1def5: Download complete
2021-07-23T01:36:44.6515068Z 35de94ac9c6f: Verifying Checksum
2021-07-23T01:36:44.6515802Z 35de94ac9c6f: Download complete
2021-07-23T01:36:44.6554254Z 2f9ee08e07bc: Pull complete
2021-07-23T01:36:45.0826598Z 35de94ac9c6f: Pull complete
2021-07-23T01:36:45.1862055Z a339bcd1def5: Pull complete
2021-07-23T01:36:45.1901289Z Digest: sha256:00f8f803d538fcd48a221fa475b63aaaae80cc3b0770dd58b059a1e13e02cafd
2021-07-23T01:36:45.1919148Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-23T01:36:45.1926583Z quay.io/submariner/nettest:devel
2021-07-23T01:36:45.1988715Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-23T01:36:45.5315329Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-23T01:36:45.8394285Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-23T01:36:46.1356571Z The push refers to repository [localhost:5000/nettest]
2021-07-23T01:36:46.1402403Z 759c12f589e4: Preparing
2021-07-23T01:36:46.1409415Z c302bf42e436: Preparing
2021-07-23T01:36:46.1410062Z 0b74185e1b24: Preparing
2021-07-23T01:36:46.1413010Z 72e830a4dff5: Preparing
2021-07-23T01:36:46.8755807Z 759c12f589e4: Pushed
2021-07-23T01:36:46.8788370Z 0b74185e1b24: Pushed
2021-07-23T01:36:46.8917138Z 72e830a4dff5: Pushed
2021-07-23T01:36:47.3809151Z c302bf42e436: Pushed
2021-07-23T01:36:47.3995833Z local: digest: sha256:00f8f803d538fcd48a221fa475b63aaaae80cc3b0770dd58b059a1e13e02cafd size: 1155
2021-07-23T01:36:47.4067073Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:36:47.4085077Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:36:47.4102410Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-23T01:36:47.4122320Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-23T01:36:47.4142871Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:36:47.4159294Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:36:47.4175282Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-23T01:36:47.9239552Z deployment.apps/netshoot created
2021-07-23T01:36:47.9300606Z Waiting for netshoot pods to be ready.
2021-07-23T01:36:47.9319359Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-23T01:36:47.9339075Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-23T01:36:47.9360825Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-23T01:36:48.2596876Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-23T01:36:49.4042398Z deployment "netshoot" successfully rolled out
2021-07-23T01:36:49.4094640Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:36:49.4111767Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:36:49.4128971Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:36:49.4144281Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-23T01:36:49.4160704Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-23T01:36:49.4181815Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-23T01:36:49.4202927Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:36:49.4216887Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:36:49.4232685Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-23T01:36:50.0384443Z deployment.apps/nginx-demo created
2021-07-23T01:36:50.0957252Z service/nginx-demo created
2021-07-23T01:36:50.1964374Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-23T01:36:50.2023642Z Waiting for nginx-demo pods to be ready.
2021-07-23T01:36:50.2040596Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-23T01:36:50.2056178Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-23T01:36:50.2073677Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-23T01:36:50.8409495Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-23T01:36:51.0851626Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-23T01:36:51.6707309Z deployment "nginx-demo" successfully rolled out
2021-07-23T01:36:51.6779089Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-23T01:36:51.6801238Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-23T01:36:51.6823674Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-23T01:36:51.6839994Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-23T01:36:51.6854873Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-23T01:36:52.0917868Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-23T01:36:52.0939269Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-23T01:36:52.0958324Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-23T01:36:52.0974654Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-23T01:36:52.0989520Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-23T01:36:52.1013126Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-23T01:36:52.1031868Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-23T01:36:52.1047974Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-23T01:36:52.1060495Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-23T01:36:52.1081146Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-23T01:36:52.4137128Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:36:52.4156377Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:36:52.4169153Z [submariner-operator]$ [cluster2] iteration=1
2021-07-23T01:36:52.4202187Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:36:52.4203378Z [submariner-operator]$ [cluster2] wait 9019
2021-07-23T01:36:52.4212118Z [submariner-operator]$ [cluster2] test_connection
2021-07-23T01:36:52.4220507Z Attempting connectivity between clusters - netshoot-57677568b8-fr6t7 --> 100.1.223.109
2021-07-23T01:36:52.4278470Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-23T01:36:52.4299630Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-23T01:36:52.4318544Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:36:52.4372092Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:36:52.4385099Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:36:52.4399124Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:36:55.9066723Z command terminated with exit code 7
2021-07-23T01:36:55.9114571Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-23T01:36:55.9129978Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:36:55.9152075Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-23T01:36:55.9166512Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-23T01:36:55.9172151Z curl returned too soon. Sleeping for 27 secs
2021-07-23T01:36:55.9184362Z [submariner-operator]$ [cluster2] sleep 27
2021-07-23T01:37:22.9209843Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:37:22.9261567Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:37:22.9262925Z [submariner-operator]$ [cluster2] wait 9045
2021-07-23T01:37:22.9278266Z [submariner-operator]$ [cluster2] test_connection
2021-07-23T01:37:22.9285735Z Attempting connectivity between clusters - netshoot-57677568b8-fr6t7 --> 100.1.223.109
2021-07-23T01:37:22.9299066Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-23T01:37:22.9312565Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-23T01:37:22.9331193Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:37:22.9353750Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:37:22.9369511Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:37:22.9386993Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:37:26.3700189Z command terminated with exit code 7
2021-07-23T01:37:26.3752042Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-23T01:37:26.3768913Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:37:26.3794753Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-23T01:37:26.3807631Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-23T01:37:26.3809559Z curl returned too soon. Sleeping for 26 secs
2021-07-23T01:37:26.3821509Z [submariner-operator]$ [cluster2] sleep 26
2021-07-23T01:37:52.3849627Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:37:52.3891920Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:37:52.3897131Z [submariner-operator]$ [cluster2] wait 9071
2021-07-23T01:37:52.3900168Z [submariner-operator]$ [cluster2] test_connection
2021-07-23T01:37:52.3903873Z Attempting connectivity between clusters - netshoot-57677568b8-fr6t7 --> 100.1.223.109
2021-07-23T01:37:52.3912502Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-23T01:37:52.3925239Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-23T01:37:52.3942516Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:37:52.3965356Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:37:52.3979869Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:37:52.3995688Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:37:55.8786891Z command terminated with exit code 7
2021-07-23T01:37:55.8837780Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-23T01:37:55.8855000Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:37:55.8878327Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-23T01:37:55.8890889Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-23T01:37:55.8893490Z curl returned too soon. Sleeping for 27 secs
2021-07-23T01:37:55.8906682Z [submariner-operator]$ [cluster2] sleep 27
2021-07-23T01:38:22.8933708Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:38:22.8981815Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:38:22.8983075Z [submariner-operator]$ [cluster2] wait 9097
2021-07-23T01:38:22.8995663Z [submariner-operator]$ [cluster2] test_connection
2021-07-23T01:38:22.9004219Z Attempting connectivity between clusters - netshoot-57677568b8-fr6t7 --> 100.1.223.109
2021-07-23T01:38:22.9018399Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-23T01:38:22.9033140Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-23T01:38:22.9049397Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:38:22.9072131Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:38:22.9087169Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:38:22.9108932Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:38:26.4020360Z command terminated with exit code 7
2021-07-23T01:38:26.4069055Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-23T01:38:26.4085779Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:38:26.4107792Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-23T01:38:26.4123925Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-23T01:38:26.4126395Z curl returned too soon. Sleeping for 26 secs
2021-07-23T01:38:26.4138537Z [submariner-operator]$ [cluster2] sleep 26
2021-07-23T01:38:52.4167465Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:38:52.4206214Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-fr6t7 100.1.223.109
2021-07-23T01:38:52.4212487Z [submariner-operator]$ [cluster2] wait 9123
2021-07-23T01:38:52.4218607Z [submariner-operator]$ [cluster2] test_connection
2021-07-23T01:38:52.4225996Z Attempting connectivity between clusters - netshoot-57677568b8-fr6t7 --> 100.1.223.109
2021-07-23T01:38:52.4240112Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-23T01:38:52.4250204Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-23T01:38:52.4269634Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:38:52.4294370Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:38:52.4310596Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:38:52.4326075Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-fr6t7 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.223.109
2021-07-23T01:38:56.0016171Z command terminated with exit code 7
2021-07-23T01:38:56.0065531Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-23T01:38:56.0082947Z [submariner-operator]$ [cluster2] date +%s
2021-07-23T01:38:56.0107507Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-23T01:38:56.0122725Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-23T01:38:56.0127586Z curl returned too soon. Sleeping for 26 secs
2021-07-23T01:38:56.0139963Z [submariner-operator]$ [cluster2] sleep 26
2021-07-23T01:39:22.0167402Z [submariner-operator]$ [cluster2] return 1
2021-07-23T01:39:22.0195844Z Max attempts reached, failed to run 'test_connection netshoot-57677568b8-fr6t7 100.1.223.109'!
2021-07-23T01:39:22.0215989Z [submariner-operator]$ [cluster2] exit 1
2021-07-23T01:39:22.0221404Z make: *** [/opt/shipyard/Makefile.inc:101: deploy] Error 1
2021-07-23T01:39:22.0277265Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-23T01:39:36.0623371Z time="2021-07-23T01:39:35Z" level=fatal msg="exit status 2"
2021-07-23T01:39:36.0624616Z make: *** [Makefile.dapper:28: upgrade-e2e] Error 1
2021-07-23T01:39:36.0658976Z ##[error]Process completed with exit code 2.
2021-07-23T01:39:36.0922951Z ##[group]Run submariner-io/shipyard/gh-actions/post-mortem@devel
2021-07-23T01:39:36.0923714Z ##[endgroup]
2021-07-23T01:39:36.1676167Z ##[group]Report available disk space
2021-07-23T01:39:36.1702553Z Filesystem Size Used Avail Use% Mounted on
2021-07-23T01:39:36.1703147Z /dev/root 84G 54G 30G 65% /
2021-07-23T01:39:36.1703637Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-23T01:39:36.1704125Z tmpfs 3.4G 166M 3.3G 5% /dev/shm
2021-07-23T01:39:36.1704603Z tmpfs 696M 1.7M 694M 1% /run
2021-07-23T01:39:36.1705079Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-23T01:39:36.1706116Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-23T01:39:36.1706669Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-23T01:39:36.1707335Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-23T01:39:36.1707897Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-23T01:39:36.1708549Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-23T01:39:36.1709071Z /dev/loop2 71M 71M 0 100% /snap/lxd/21029
2021-07-23T01:39:36.1709611Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-23T01:39:36.1710136Z /dev/loop5 68M 68M 0 100% /snap/lxd/20326
2021-07-23T01:39:36.1710636Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-23T01:39:36.1711777Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/269a6f360197a2850ebb8c7d1f3895ae29e04f7f9e407a2a2f0a90d58b2bfccf/merged
2021-07-23T01:39:36.1713791Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/4e2e7876eae21d79d9e070c6f9ad50e8f3158b1ae622ce8cba8c0e33cc95f20a/merged
2021-07-23T01:39:36.1715870Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/94e4c5be664b0d0f44f421e632ddaa86955ff60796b360f2a0643ea8477ab9d5/merged
2021-07-23T01:39:36.1717753Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/539fbc5c101fd083813a3ca8ad629b2b1ab0d863444f6657cbeb28b021c22206/merged
2021-07-23T01:39:36.1719794Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/47e602f9a36da56219c135cda5e836583e9bf3b8b4d489c52aa795b35e39c670/merged
2021-07-23T01:39:36.1721964Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/9eb8e4d8f4ea0f1e5d92680fa88aca6f3beb7dc1fa2e5d09558b2b580f7941fc/merged
2021-07-23T01:39:36.1724161Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/a7c9b780e43e52f71549b1c6ffb5c1eea86a3b2689da7287659f87e5a02f8ecf/merged
2021-07-23T01:39:36.1726469Z overlay 84G 54G 30G 65% /var/lib/docker/overlay2/ff949970c125eeb4fed905cbce132460fac9a054cd2cd93d7b67f4ea612a2e2a/merged
2021-07-23T01:39:36.1727822Z ##[endgroup]
2021-07-23T01:39:36.1728354Z ##[group]Report available RAM
2021-07-23T01:39:36.1735124Z total used free shared buff/cache available
2021-07-23T01:39:36.1735961Z Mem: 6.8Gi 3.8Gi 393Mi 226Mi 2.6Gi 2.7Gi
2021-07-23T01:39:36.1736458Z Swap: 0B 0B 0B
2021-07-23T01:39:36.1737675Z ##[endgroup]
2021-07-23T01:39:36.1870138Z ##[group]Running post mortem
2021-07-23T01:39:36.1932131Z docker network create -d bridge kind
2021-07-23T01:39:36.2351488Z Error response from daemon: network with name kind already exists
2021-07-23T01:39:36.2392880Z make: [Makefile.dapper:27: post-mortem] Error 1 (ignored)
2021-07-23T01:39:36.2393840Z ./.dapper -m bind make --debug=b post-mortem
2021-07-23T01:39:39.0712140Z Sending build context to Docker daemon 204.2MB
2021-07-23T01:39:39.0713301Z
2021-07-23T01:39:39.0820634Z Step 1/8 : ARG BASE_BRANCH
2021-07-23T01:39:39.0822354Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-23T01:39:39.0833785Z ---> bcbbdc39e994
2021-07-23T01:39:39.0834716Z Step 3/8 : ARG PROJECT
2021-07-23T01:39:39.0854203Z ---> Using cache
2021-07-23T01:39:39.0855012Z ---> 4fd5b74f0e9c
2021-07-23T01:39:39.0857105Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-23T01:39:39.0861713Z ---> Using cache
2021-07-23T01:39:39.0862444Z ---> 66a734d4f853
2021-07-23T01:39:39.0863109Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-23T01:39:39.0869582Z ---> Using cache
2021-07-23T01:39:39.0870216Z ---> 8c938e4caddc
2021-07-23T01:39:39.0870713Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-23T01:39:39.0878903Z ---> Using cache
2021-07-23T01:39:39.0879482Z ---> b8e13a241923
2021-07-23T01:39:39.0880078Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-23T01:39:39.0891804Z ---> Using cache
2021-07-23T01:39:39.0892723Z ---> 6e525b93d2f8
2021-07-23T01:39:39.0893315Z Step 8/8 : CMD ["sh"]
2021-07-23T01:39:39.0987871Z ---> Using cache
2021-07-23T01:39:39.0991890Z ---> d4e77f05edd4
2021-07-23T01:39:39.2612835Z Successfully built d4e77f05edd4
2021-07-23T01:39:39.2681037Z Successfully tagged submariner-operator:devel
2021-07-23T01:39:40.0344243Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-23T01:39:40.0353727Z [submariner-operator]$ mkdir -p bin dist output
2021-07-23T01:39:40.0395523Z [submariner-operator]$ make --debug=b post-mortem
2021-07-23T01:39:40.0504109Z GNU Make 4.3
2021-07-23T01:39:40.0506708Z Built for x86_64-redhat-linux-gnu
2021-07-23T01:39:40.0507541Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-23T01:39:40.0508453Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-23T01:39:40.0509315Z This is free software: you are free to change and redistribute it.
2021-07-23T01:39:40.0510230Z There is NO WARRANTY, to the extent permitted by law.
2021-07-23T01:39:40.0526381Z Reading makefiles...
2021-07-23T01:39:40.2045228Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-23T01:39:40.2047228Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-23T01:39:40.4510556Z Updating makefiles....
2021-07-23T01:39:40.4520051Z Updating goal targets....
2021-07-23T01:39:40.4521433Z File 'post-mortem' does not exist.
2021-07-23T01:39:40.4522194Z Must remake target 'post-mortem'.
2021-07-23T01:39:40.4522826Z /opt/shipyard/scripts/post_mortem.sh
2021-07-23T01:39:40.4586433Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-23T01:39:40.4596959Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-23T01:39:40.4606639Z [submariner-operator]$ script_name=utils
2021-07-23T01:39:40.4616029Z [submariner-operator]$ exec_name=post_mortem.sh
2021-07-23T01:39:40.4636633Z [submariner-operator]$ declare_kubeconfig
2021-07-23T01:39:40.4646537Z [submariner-operator]$ declare_kubeconfig
2021-07-23T01:39:40.4659012Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-23T01:39:40.4673463Z [submariner-operator]$ export KUBECONFIG
2021-07-23T01:39:40.4684015Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-23T01:39:40.4701033Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-23T01:39:40.4730411Z [submariner-operator]$ kind get clusters
2021-07-23T01:39:41.1633207Z [submariner-operator]$ [cluster1] post_analyze
2021-07-23T01:39:41.1644398Z [submariner-operator]$ [cluster1] post_analyze
2021-07-23T01:39:41.1656303Z [submariner-operator]$ [cluster1] print_section * Kubernetes client and server versions in cluster1 *
2021-07-23T01:39:41.1669814Z [submariner-operator]$ [cluster1] print_section * Kubernetes client and server versions in cluster1 *
2021-07-23T01:39:41.1674726Z ====================================================================
2021-07-23T01:39:41.1679097Z ##[endgroup]
2021-07-23T01:39:41.1683227Z ##[group]* Kubernetes client and server versions in cluster1 *
2021-07-23T01:39:41.1687661Z ======================= * Kubernetes client and server versions in cluster1 * =======================
2021-07-23T01:39:41.1699941Z [submariner-operator]$ [cluster1] kubectl version
2021-07-23T01:39:41.1712058Z [submariner-operator]$ [cluster1] kubectl version
2021-07-23T01:39:41.1725642Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 version
2021-07-23T01:39:41.4842883Z Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.5", GitCommit:"6b1d87acf3c8253c123756b9e61dac642678305f", GitTreeState:"archive", BuildDate:"2021-03-30T00:00:00Z", GoVersion:"go1.16", Compiler:"gc", Platform:"linux/amd64"}
2021-07-23T01:39:41.4845494Z Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.7", GitCommit:"132a687512d7fb058d0f5890f07d4121b3f0a2e2", GitTreeState:"clean", BuildDate:"2021-05-27T23:27:49Z", GoVersion:"go1.15.12", Compiler:"gc", Platform:"linux/amd64"}
2021-07-23T01:39:41.4892276Z [submariner-operator]$ [cluster1] print_section * Overview of all resources in cluster1 *
2021-07-23T01:39:41.4903953Z [submariner-operator]$ [cluster1] print_section * Overview of all resources in cluster1 *
2021-07-23T01:39:41.4907920Z ====================================================================
2021-07-23T01:39:41.4911270Z ##[endgroup]
2021-07-23T01:39:41.4914795Z ##[group]* Overview of all resources in cluster1 *
2021-07-23T01:39:41.4919724Z ======================= * Overview of all resources in cluster1 * =======================
2021-07-23T01:39:41.4931792Z [submariner-operator]$ [cluster1] kubectl api-resources --verbs=list -o name
2021-07-23T01:39:41.4946494Z [submariner-operator]$ [cluster1] xargs -n 1 kubectl get --show-kind -o wide --ignore-not-found
2021-07-23T01:39:41.4954690Z [submariner-operator]$ [cluster1] kubectl api-resources --verbs=list -o name
2021-07-23T01:39:41.4975384Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources --verbs=list -o name
2021-07-23T01:39:42.1927165Z Warning: v1 ComponentStatus is deprecated in v1.19+
2021-07-23T01:39:42.1936340Z NAME STATUS MESSAGE ERROR
2021-07-23T01:39:42.1938387Z componentstatus/controller-manager Unhealthy Get "http://127.0.0.1:10252/healthz": dial tcp 127.0.0.1:10252: connect: connection refused
2021-07-23T01:39:42.1939889Z componentstatus/scheduler Unhealthy Get "http://127.0.0.1:10251/healthz": dial tcp 127.0.0.1:10251: connect: connection refused
2021-07-23T01:39:42.1941327Z componentstatus/etcd-0 Healthy {"health":"true"}
2021-07-23T01:39:42.4895121Z NAME DATA AGE
2021-07-23T01:39:42.4896394Z configmap/kube-root-ca.crt 1 11m
2021-07-23T01:39:42.7896906Z NAME ENDPOINTS AGE
2021-07-23T01:39:42.7897610Z endpoints/kubernetes 172.18.0.9:6443 11m
2021-07-23T01:39:42.7898810Z endpoints/nginx-demo 10.1.0.5:8080,10.1.128.4:8080 2m52s
2021-07-23T01:39:43.1486878Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-23T01:39:43.1490166Z 11m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 11m 1 event/cluster1-control-plane.1694473abfe5142b
2021-07-23T01:39:43.1493910Z 11m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 11m 1 event/cluster1-control-plane.1694473ac7102218
2021-07-23T01:39:43.1498027Z 11m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 11m 1 event/cluster1-control-plane.1694473ac7103b18
2021-07-23T01:39:43.1541056Z 11m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 11m 1 event/cluster1-control-plane.1694473ac7104ab8
2021-07-23T01:39:43.1544946Z 11m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 11m 1 event/cluster1-control-plane.1694473adcc30cad
2021-07-23T01:39:43.1549200Z 11m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 11m 1 event/cluster1-control-plane.1694473cc27ed69b
2021-07-23T01:39:43.1552991Z 11m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 11m 1 event/cluster1-control-plane.1694473d58e869dc
2021-07-23T01:39:43.1556401Z 10m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 10m 1 event/cluster1-control-plane.16944746732fe574
2021-07-23T01:39:43.1559458Z 11m Normal Starting node/cluster1-worker kubelet, cluster1-worker Starting kubelet. 11m 1 event/cluster1-worker.1694473f317843a9
2021-07-23T01:39:43.1562482Z 11m Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 11m 1 event/cluster1-worker.1694473f3a05b885
2021-07-23T01:39:43.1566257Z 11m Normal NodeHasNoDiskPressure node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasNoDiskPressure 11m 1 event/cluster1-worker.1694473f3a05d0bd
2021-07-23T01:39:43.1569553Z 11m Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 11m 1 event/cluster1-worker.1694473f3a05e571
2021-07-23T01:39:43.1572720Z 11m Normal NodeAllocatableEnforced node/cluster1-worker kubelet, cluster1-worker Updated Node Allocatable limit across pods 11m 1 event/cluster1-worker.1694473f43a21ae7
2021-07-23T01:39:43.1575547Z 11m Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 11m 1 event/cluster1-worker.1694474030e72a3a
2021-07-23T01:39:43.1578421Z 11m Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 11m 1 event/cluster1-worker.1694474040a6e1d6
2021-07-23T01:39:43.1581447Z 11m Normal NodeReady node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeReady 11m 1 event/cluster1-worker.16944744037da17e
2021-07-23T01:39:43.1584162Z 11m Normal Starting node/cluster1-worker2 kubelet, cluster1-worker2 Starting kubelet. 11m 1 event/cluster1-worker2.1694473f00de0d6e
2021-07-23T01:39:43.1603811Z 11m Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 11m 1 event/cluster1-worker2.1694473f138a1314
2021-07-23T01:39:43.1607526Z 11m Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 11m 1 event/cluster1-worker2.1694473f138a2cdd
2021-07-23T01:39:43.1611110Z 11m Normal NodeHasSufficientPID node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientPID 11m 1 event/cluster1-worker2.1694473f138a3f9d
2021-07-23T01:39:43.1614392Z 11m Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 11m 1 event/cluster1-worker2.1694473f169cdceb
2021-07-23T01:39:43.1617553Z 11m Normal NodeAllocatableEnforced node/cluster1-worker2 kubelet, cluster1-worker2 Updated Node Allocatable limit across pods 11m 1 event/cluster1-worker2.1694473f1ef880f4
2021-07-23T01:39:43.1620483Z 11m Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 11m 1 event/cluster1-worker2.1694473ffacf5e52
2021-07-23T01:39:43.1623264Z 10m Normal NodeReady node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeReady 10m 1 event/cluster1-worker2.1694474623c46fba
2021-07-23T01:39:43.1626765Z 2m53s Normal Scheduled pod/nginx-demo-b8f8b4fc6-6pk9n default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-6pk9n to cluster1-worker2 2m53s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5772f1816
2021-07-23T01:39:43.1630572Z 2m53s Normal Pulling pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 2m53s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b59e316f98
2021-07-23T01:39:43.1636515Z 2m53s Normal Pulled pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 99.109281ms 2m53s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5a41a143e
2021-07-23T01:39:43.1640118Z 2m53s Normal Created pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 2m53s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5a5e93662
2021-07-23T01:39:43.1643735Z 2m53s Normal Started pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 2m53s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5aaddc1ee
2021-07-23T01:39:43.1647433Z 5m39s Normal Scheduled pod/nginx-demo-b8f8b4fc6-ct55c default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-ct55c to cluster1-worker2 5m39s 1 event/nginx-demo-b8f8b4fc6-ct55c.1694478eefed7f53
2021-07-23T01:39:43.1651106Z 5m38s Normal Pulling pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 5m38s 1 event/nginx-demo-b8f8b4fc6-ct55c.1694478f1133f9f4
2021-07-23T01:39:43.1654664Z 5m34s Normal Pulled pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.147359692s 5m34s 1 event/nginx-demo-b8f8b4fc6-ct55c.16944790086807e4
2021-07-23T01:39:43.1658215Z 5m33s Normal Created pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 5m33s 1 event/nginx-demo-b8f8b4fc6-ct55c.1694479043aa906a
2021-07-23T01:39:43.1661738Z 5m33s Normal Started pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 5m33s 1 event/nginx-demo-b8f8b4fc6-ct55c.169447904bf4a4ff
2021-07-23T01:39:43.1673293Z 5m30s Normal Killing pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Stopping container nginx-demo 5m30s 1 event/nginx-demo-b8f8b4fc6-ct55c.16944790fb1986d1
2021-07-23T01:39:43.1676988Z 5m39s Normal Scheduled pod/nginx-demo-b8f8b4fc6-d2rms default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-d2rms to cluster1-worker 5m39s 1 event/nginx-demo-b8f8b4fc6-d2rms.1694478eefeb682a
2021-07-23T01:39:43.1681590Z 5m38s Normal Pulling pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 5m38s 1 event/nginx-demo-b8f8b4fc6-d2rms.1694478f10a1883e
2021-07-23T01:39:43.1686185Z 5m33s Normal Pulled pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.960547211s 5m33s 1 event/nginx-demo-b8f8b4fc6-d2rms.16944790384db0dd
2021-07-23T01:39:43.1689748Z 5m33s Normal Created pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 5m33s 1 event/nginx-demo-b8f8b4fc6-d2rms.1694479043a6d48d
2021-07-23T01:39:43.1693226Z 5m33s Normal Started pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 5m33s 1 event/nginx-demo-b8f8b4fc6-d2rms.16944790494bb123
2021-07-23T01:39:43.1696711Z 5m30s Normal Killing pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Stopping container nginx-demo 5m30s 1 event/nginx-demo-b8f8b4fc6-d2rms.16944790fae609dd
2021-07-23T01:39:43.1700369Z 2m53s Normal Scheduled pod/nginx-demo-b8f8b4fc6-kxvdm default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-kxvdm to cluster1-worker 2m53s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b57941e30d
2021-07-23T01:39:43.1704059Z 2m53s Normal Pulling pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 2m53s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b59c987a4c
2021-07-23T01:39:43.1708081Z 2m53s Normal Pulled pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 188.803198ms 2m53s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b5a7d99592
2021-07-23T01:39:43.1711679Z 2m53s Normal Created pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 2m53s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b5a948bbab
2021-07-23T01:39:43.1715201Z 2m52s Normal Started pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 2m52s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b5ae418dc0
2021-07-23T01:39:43.1718775Z 5m39s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-ct55c 5m39s 1 event/nginx-demo-b8f8b4fc6.1694478eebb65a70
2021-07-23T01:39:43.1722243Z 5m39s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-d2rms 5m39s 1 event/nginx-demo-b8f8b4fc6.1694478eeee4497f
2021-07-23T01:39:43.1725679Z 2m53s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-6pk9n 2m53s 1 event/nginx-demo-b8f8b4fc6.169447b575d21629
2021-07-23T01:39:43.1729101Z 2m53s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-kxvdm 2m53s 1 event/nginx-demo-b8f8b4fc6.169447b576da6a34
2021-07-23T01:39:43.1733544Z 5m39s Warning OwnerRefInvalidNamespace endpointslice/nginx-demo-cluster1 garbage-collector-controller ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 719888ef-3013-40d8-8a00-26455c361970] does not exist in namespace "default" 5m39s 1 event/nginx-demo-cluster1.1694478efa5ffe71
2021-07-23T01:39:43.1737743Z 5m39s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 5m39s 1 event/nginx-demo.1694478ee92475bf
2021-07-23T01:39:43.1740773Z 2m53s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 2m53s 1 event/nginx-demo.169447b57412e933
2021-07-23T01:39:43.1745336Z 3m23s Warning FailedToCreateEndpoint endpoints/submariner-lighthouse-coredns endpoint-controller Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints "submariner-lighthouse-coredns" already exists 3m23s 1 event/submariner-lighthouse-coredns.169447ae7690ad4e
2021-07-23T01:39:43.8053080Z NAME STATUS AGE
2021-07-23T01:39:43.8054221Z namespace/default Active 11m
2021-07-23T01:39:43.8055966Z namespace/kube-node-lease Active 11m
2021-07-23T01:39:43.8056892Z namespace/kube-public Active 11m
2021-07-23T01:39:43.8057730Z namespace/kube-system Active 11m
2021-07-23T01:39:43.8059264Z namespace/local-path-storage Active 11m
2021-07-23T01:39:43.8060458Z namespace/submariner-k8s-broker Active 7m2s
2021-07-23T01:39:43.8061469Z namespace/submariner-operator Active 7m1s
2021-07-23T01:39:44.1055677Z NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
2021-07-23T01:39:44.1057962Z node/cluster1-control-plane Ready control-plane,master 11m v1.20.7 172.18.0.9 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-23T01:39:44.1059717Z node/cluster1-worker Ready <none> 11m v1.20.7 172.18.0.7 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-23T01:39:44.1061178Z node/cluster1-worker2 Ready <none> 11m v1.20.7 172.18.0.4 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-23T01:39:45.0194167Z NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
2021-07-23T01:39:45.0199137Z pod/nginx-demo-b8f8b4fc6-6pk9n 1/1 Running 0 2m55s 10.1.128.4 cluster1-worker2 <none> <none>
2021-07-23T01:39:45.0207044Z pod/nginx-demo-b8f8b4fc6-kxvdm 1/1 Running 0 2m55s 10.1.0.5 cluster1-worker <none> <none>
2021-07-23T01:39:46.2872539Z NAME TYPE DATA AGE
2021-07-23T01:39:46.2874266Z secret/default-token-bncmd kubernetes.io/service-account-token 3 11m
2021-07-23T01:39:46.5845520Z NAME SECRETS AGE
2021-07-23T01:39:46.5846138Z serviceaccount/default 1 11m
2021-07-23T01:39:46.8796804Z NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
2021-07-23T01:39:46.8797807Z service/kubernetes ClusterIP 100.1.0.1 <none> 443/TCP 11m <none>
2021-07-23T01:39:46.8798939Z service/nginx-demo ClusterIP 100.1.223.109 <none> 80/TCP 2m56s app=nginx-demo
2021-07-23T01:39:48.0867210Z NAME CREATED AT
2021-07-23T01:39:48.0869188Z customresourcedefinition.apiextensions.k8s.io/brokers.submariner.io 2021-07-23T01:32:42Z
2021-07-23T01:39:48.0872005Z customresourcedefinition.apiextensions.k8s.io/clusterglobalegressips.submariner.io 2021-07-23T01:36:10Z
2021-07-23T01:39:48.0874814Z customresourcedefinition.apiextensions.k8s.io/clusters.submariner.io 2021-07-23T01:32:52Z
2021-07-23T01:39:48.0877121Z customresourcedefinition.apiextensions.k8s.io/endpoints.submariner.io 2021-07-23T01:32:52Z
2021-07-23T01:39:48.0879459Z customresourcedefinition.apiextensions.k8s.io/gateways.submariner.io 2021-07-23T01:32:52Z
2021-07-23T01:39:48.0881856Z customresourcedefinition.apiextensions.k8s.io/globalegressips.submariner.io 2021-07-23T01:36:10Z
2021-07-23T01:39:48.0884390Z customresourcedefinition.apiextensions.k8s.io/globalingressips.submariner.io 2021-07-23T01:36:10Z
2021-07-23T01:39:48.0886946Z customresourcedefinition.apiextensions.k8s.io/servicediscoveries.submariner.io 2021-07-23T01:32:42Z
2021-07-23T01:39:48.0889626Z customresourcedefinition.apiextensions.k8s.io/serviceexports.multicluster.x-k8s.io 2021-07-23T01:32:50Z
2021-07-23T01:39:48.0892381Z customresourcedefinition.apiextensions.k8s.io/serviceimports.multicluster.x-k8s.io 2021-07-23T01:32:50Z
2021-07-23T01:39:48.0894941Z customresourcedefinition.apiextensions.k8s.io/submariners.submariner.io 2021-07-23T01:32:41Z
2021-07-23T01:39:48.4811501Z NAME SERVICE AVAILABLE AGE
2021-07-23T01:39:48.4812626Z apiservice.apiregistration.k8s.io/v1. Local True 11m
2021-07-23T01:39:48.4814138Z apiservice.apiregistration.k8s.io/v1.admissionregistration.k8s.io Local True 11m
2021-07-23T01:39:48.4815798Z apiservice.apiregistration.k8s.io/v1.apiextensions.k8s.io Local True 11m
2021-07-23T01:39:48.4817289Z apiservice.apiregistration.k8s.io/v1.apps Local True 11m
2021-07-23T01:39:48.4818710Z apiservice.apiregistration.k8s.io/v1.authentication.k8s.io Local True 11m
2021-07-23T01:39:48.4820579Z apiservice.apiregistration.k8s.io/v1.authorization.k8s.io Local True 11m
2021-07-23T01:39:48.4822103Z apiservice.apiregistration.k8s.io/v1.autoscaling Local True 11m
2021-07-23T01:39:48.4823424Z apiservice.apiregistration.k8s.io/v1.batch Local True 11m
2021-07-23T01:39:48.4824878Z apiservice.apiregistration.k8s.io/v1.certificates.k8s.io Local True 11m
2021-07-23T01:39:48.4826919Z apiservice.apiregistration.k8s.io/v1.coordination.k8s.io Local True 11m
2021-07-23T01:39:48.4828358Z apiservice.apiregistration.k8s.io/v1.events.k8s.io Local True 11m
2021-07-23T01:39:48.4829787Z apiservice.apiregistration.k8s.io/v1.networking.k8s.io Local True 11m
2021-07-23T01:39:48.4831182Z apiservice.apiregistration.k8s.io/v1.node.k8s.io Local True 11m
2021-07-23T01:39:48.4832662Z apiservice.apiregistration.k8s.io/v1.rbac.authorization.k8s.io Local True 11m
2021-07-23T01:39:48.4834228Z apiservice.apiregistration.k8s.io/v1.scheduling.k8s.io Local True 11m
2021-07-23T01:39:48.4835644Z apiservice.apiregistration.k8s.io/v1.storage.k8s.io Local True 11m
2021-07-23T01:39:48.4837048Z apiservice.apiregistration.k8s.io/v1.submariner.io Local True 6m56s
2021-07-23T01:39:48.4839597Z apiservice.apiregistration.k8s.io/v1alpha1.multicluster.x-k8s.io Local True 6m58s
2021-07-23T01:39:48.4841229Z apiservice.apiregistration.k8s.io/v1alpha1.submariner.io Local True 7m6s
2021-07-23T01:39:48.4842960Z apiservice.apiregistration.k8s.io/v1beta1.admissionregistration.k8s.io Local True 11m
2021-07-23T01:39:48.4844749Z apiservice.apiregistration.k8s.io/v1beta1.apiextensions.k8s.io Local True 11m
2021-07-23T01:39:48.4846426Z apiservice.apiregistration.k8s.io/v1beta1.authentication.k8s.io Local True 11m
2021-07-23T01:39:48.4848240Z apiservice.apiregistration.k8s.io/v1beta1.authorization.k8s.io Local True 11m
2021-07-23T01:39:48.4849733Z apiservice.apiregistration.k8s.io/v1beta1.batch Local True 11m
2021-07-23T01:39:48.4851229Z apiservice.apiregistration.k8s.io/v1beta1.certificates.k8s.io Local True 11m
2021-07-23T01:39:48.4852840Z apiservice.apiregistration.k8s.io/v1beta1.coordination.k8s.io Local True 11m
2021-07-23T01:39:48.4854415Z apiservice.apiregistration.k8s.io/v1beta1.discovery.k8s.io Local True 11m
2021-07-23T01:39:48.4855979Z apiservice.apiregistration.k8s.io/v1beta1.events.k8s.io Local True 11m
2021-07-23T01:39:48.4857428Z apiservice.apiregistration.k8s.io/v1beta1.extensions Local True 11m
2021-07-23T01:39:48.4859111Z apiservice.apiregistration.k8s.io/v1beta1.flowcontrol.apiserver.k8s.io Local True 11m
2021-07-23T01:39:48.4860838Z apiservice.apiregistration.k8s.io/v1beta1.networking.k8s.io Local True 11m
2021-07-23T01:39:48.4862322Z apiservice.apiregistration.k8s.io/v1beta1.node.k8s.io Local True 11m
2021-07-23T01:39:48.4863707Z apiservice.apiregistration.k8s.io/v1beta1.policy Local True 11m
2021-07-23T01:39:48.4865521Z apiservice.apiregistration.k8s.io/v1beta1.rbac.authorization.k8s.io Local True 11m
2021-07-23T01:39:48.4867300Z apiservice.apiregistration.k8s.io/v1beta1.scheduling.k8s.io Local True 11m
2021-07-23T01:39:48.4868815Z apiservice.apiregistration.k8s.io/v1beta1.storage.k8s.io Local True 11m
2021-07-23T01:39:48.4870274Z apiservice.apiregistration.k8s.io/v2beta1.autoscaling Local True 11m
2021-07-23T01:39:48.4871782Z apiservice.apiregistration.k8s.io/v2beta2.autoscaling Local True 11m
2021-07-23T01:39:49.3979570Z NAME READY UP-TO-DATE AVAILABLE AGE CONTAINERS IMAGES SELECTOR
2021-07-23T01:39:49.3981128Z deployment.apps/nginx-demo 2/2 2 2 2m59s nginx-demo quay.io/bitnami/nginx:latest app=nginx-demo
2021-07-23T01:39:49.7109758Z NAME DESIRED CURRENT READY AGE CONTAINERS IMAGES SELECTOR
2021-07-23T01:39:49.7112061Z replicaset.apps/nginx-demo-b8f8b4fc6 2 2 2 2m59s nginx-demo quay.io/bitnami/nginx:latest app=nginx-demo,pod-template-hash=b8f8b4fc6
2021-07-23T01:39:51.3351194Z NAME AGE SIGNERNAME REQUESTOR CONDITION
2021-07-23T01:39:51.3353995Z certificatesigningrequest.certificates.k8s.io/csr-2zsqp 11m kubernetes.io/kube-apiserver-client-kubelet system:bootstrap:abcdef Approved,Issued
2021-07-23T01:39:51.3391500Z certificatesigningrequest.certificates.k8s.io/csr-q7bqc 11m kubernetes.io/kube-apiserver-client-kubelet system:bootstrap:abcdef Approved,Issued
2021-07-23T01:39:52.1623640Z NAME ADDRESSTYPE PORTS ENDPOINTS AGE
2021-07-23T01:39:52.1624709Z endpointslice.discovery.k8s.io/kubernetes IPv4 6443 172.18.0.9 11m
2021-07-23T01:39:52.1627047Z endpointslice.discovery.k8s.io/nginx-demo-cluster1 IPv4 8080 10.1.0.5,10.1.128.4 3m2s
2021-07-23T01:39:52.1628631Z endpointslice.discovery.k8s.io/nginx-demo-h76l4 IPv4 8080 10.1.0.5,10.1.128.4 3m2s
2021-07-23T01:39:52.5527543Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-23T01:39:52.5530924Z 11m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 11m 1 event.events.k8s.io/cluster1-control-plane.1694473abfe5142b
2021-07-23T01:39:52.5538226Z 11m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 11m 1 event.events.k8s.io/cluster1-control-plane.1694473ac7102218
2021-07-23T01:39:52.5544608Z 11m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 11m 1 event.events.k8s.io/cluster1-control-plane.1694473ac7103b18
2021-07-23T01:39:52.5551803Z 11m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 11m 1 event.events.k8s.io/cluster1-control-plane.1694473ac7104ab8
2021-07-23T01:39:52.5560991Z 11m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 11m 1 event.events.k8s.io/cluster1-control-plane.1694473adcc30cad
2021-07-23T01:39:52.5569463Z 11m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 11m 1 event.events.k8s.io/cluster1-control-plane.1694473cc27ed69b
2021-07-23T01:39:52.5573066Z 11m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 11m 1 event.events.k8s.io/cluster1-control-plane.1694473d58e869dc
2021-07-23T01:39:52.5580478Z 10m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 10m 1 event.events.k8s.io/cluster1-control-plane.16944746732fe574
2021-07-23T01:39:52.5593952Z 11m Normal Starting node/cluster1-worker kubelet, cluster1-worker Starting kubelet. 11m 1 event.events.k8s.io/cluster1-worker.1694473f317843a9
2021-07-23T01:39:52.5597413Z 11m Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 11m 1 event.events.k8s.io/cluster1-worker.1694473f3a05b885
2021-07-23T01:39:52.5601003Z 11m Normal NodeHasNoDiskPressure node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasNoDiskPressure 11m 1 event.events.k8s.io/cluster1-worker.1694473f3a05d0bd
2021-07-23T01:39:52.5604537Z 11m Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 11m 1 event.events.k8s.io/cluster1-worker.1694473f3a05e571
2021-07-23T01:39:52.5608075Z 11m Normal NodeAllocatableEnforced node/cluster1-worker kubelet, cluster1-worker Updated Node Allocatable limit across pods 11m 1 event.events.k8s.io/cluster1-worker.1694473f43a21ae7
2021-07-23T01:39:52.5611365Z 11m Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 11m 1 event.events.k8s.io/cluster1-worker.1694474030e72a3a
2021-07-23T01:39:52.5614525Z 11m Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 11m 1 event.events.k8s.io/cluster1-worker.1694474040a6e1d6
2021-07-23T01:39:52.5617709Z 11m Normal NodeReady node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-worker.16944744037da17e
2021-07-23T01:39:52.5620668Z 11m Normal Starting node/cluster1-worker2 kubelet, cluster1-worker2 Starting kubelet. 11m 1 event.events.k8s.io/cluster1-worker2.1694473f00de0d6e
2021-07-23T01:39:52.5623958Z 11m Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 11m 1 event.events.k8s.io/cluster1-worker2.1694473f138a1314
2021-07-23T01:39:52.5627828Z 11m Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 11m 1 event.events.k8s.io/cluster1-worker2.1694473f138a2cdd
2021-07-23T01:39:52.5631337Z 11m Normal NodeHasSufficientPID node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientPID 11m 1 event.events.k8s.io/cluster1-worker2.1694473f138a3f9d
2021-07-23T01:39:52.5634815Z 11m Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 11m 1 event.events.k8s.io/cluster1-worker2.1694473f169cdceb
2021-07-23T01:39:52.5638303Z 11m Normal NodeAllocatableEnforced node/cluster1-worker2 kubelet, cluster1-worker2 Updated Node Allocatable limit across pods 11m 1 event.events.k8s.io/cluster1-worker2.1694473f1ef880f4
2021-07-23T01:39:52.5662140Z 11m Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 11m 1 event.events.k8s.io/cluster1-worker2.1694473ffacf5e52
2021-07-23T01:39:52.5665434Z 11m Normal NodeReady node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-worker2.1694474623c46fba
2021-07-23T01:39:52.5668806Z 3m2s Normal Scheduled pod/nginx-demo-b8f8b4fc6-6pk9n default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-6pk9n to cluster1-worker2 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5772f1816
2021-07-23T01:39:52.5672898Z 3m2s Normal Pulling pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b59e316f98
2021-07-23T01:39:52.5676780Z 3m2s Normal Pulled pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 99.109281ms 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5a41a143e
2021-07-23T01:39:52.5680879Z 3m2s Normal Created pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5a5e93662
2021-07-23T01:39:52.5684619Z 3m2s Normal Started pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5aaddc1ee
2021-07-23T01:39:52.5688528Z 5m48s Normal Scheduled pod/nginx-demo-b8f8b4fc6-ct55c default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-ct55c to cluster1-worker2 5m48s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.1694478eefed7f53
2021-07-23T01:39:52.5692486Z 5m47s Normal Pulling pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 5m47s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.1694478f1133f9f4
2021-07-23T01:39:52.5696314Z 5m43s Normal Pulled pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.147359692s 5m43s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.16944790086807e4
2021-07-23T01:39:52.5700096Z 5m42s Normal Created pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 5m42s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.1694479043aa906a
2021-07-23T01:39:52.5703798Z 5m42s Normal Started pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 5m42s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.169447904bf4a4ff
2021-07-23T01:39:52.5710037Z 5m39s Normal Killing pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Stopping container nginx-demo 5m39s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.16944790fb1986d1
2021-07-23T01:39:52.5713745Z 5m48s Normal Scheduled pod/nginx-demo-b8f8b4fc6-d2rms default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-d2rms to cluster1-worker 5m48s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.1694478eefeb682a
2021-07-23T01:39:52.5717562Z 5m47s Normal Pulling pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 5m47s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.1694478f10a1883e
2021-07-23T01:39:52.5721312Z 5m42s Normal Pulled pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.960547211s 5m42s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.16944790384db0dd
2021-07-23T01:39:52.5727596Z 5m42s Normal Created pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 5m42s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.1694479043a6d48d
2021-07-23T01:39:52.5731456Z 5m42s Normal Started pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 5m42s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.16944790494bb123
2021-07-23T01:39:52.5735835Z 5m39s Normal Killing pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Stopping container nginx-demo 5m39s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.16944790fae609dd
2021-07-23T01:39:52.5740117Z 3m2s Normal Scheduled pod/nginx-demo-b8f8b4fc6-kxvdm default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-kxvdm to cluster1-worker 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b57941e30d
2021-07-23T01:39:52.5744265Z 3m2s Normal Pulling pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b59c987a4c
2021-07-23T01:39:52.5748371Z 3m2s Normal Pulled pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 188.803198ms 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b5a7d99592
2021-07-23T01:39:52.5752315Z 3m2s Normal Created pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b5a948bbab
2021-07-23T01:39:52.5756058Z 3m1s Normal Started pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 3m1s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b5ae418dc0
2021-07-23T01:39:52.5760109Z 5m48s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-ct55c 5m48s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1694478eebb65a70
2021-07-23T01:39:52.5763812Z 5m48s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-d2rms 5m48s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1694478eeee4497f
2021-07-23T01:39:52.5767799Z 3m2s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-6pk9n 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.169447b575d21629
2021-07-23T01:39:52.5772005Z 3m2s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-kxvdm 3m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.169447b576da6a34
2021-07-23T01:39:52.5777799Z 5m48s Warning OwnerRefInvalidNamespace endpointslice/nginx-demo-cluster1 garbage-collector-controller ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 719888ef-3013-40d8-8a00-26455c361970] does not exist in namespace "default" 5m48s 1 event.events.k8s.io/nginx-demo-cluster1.1694478efa5ffe71
2021-07-23T01:39:52.5783352Z 5m48s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 5m48s 1 event.events.k8s.io/nginx-demo.1694478ee92475bf
2021-07-23T01:39:52.5786792Z 3m2s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 3m2s 1 event.events.k8s.io/nginx-demo.169447b57412e933
2021-07-23T01:39:52.5791574Z 3m32s Warning FailedToCreateEndpoint endpoints/submariner-lighthouse-coredns endpoint-controller Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints "submariner-lighthouse-coredns" already exists 3m32s 1 event.events.k8s.io/submariner-lighthouse-coredns.169447ae7690ad4e
2021-07-23T01:39:52.8609411Z Warning: extensions/v1beta1 Ingress is deprecated in v1.14+, unavailable in v1.22+; use networking.k8s.io/v1 Ingress
2021-07-23T01:39:53.3247696Z NAME PRIORITYLEVEL MATCHINGPRECEDENCE DISTINGUISHERMETHOD AGE MISSINGPL
2021-07-23T01:39:53.3249240Z flowschema.flowcontrol.apiserver.k8s.io/exempt exempt 1 <none> 11m False
2021-07-23T01:39:53.3250883Z flowschema.flowcontrol.apiserver.k8s.io/probes exempt 2 <none> 11m False
2021-07-23T01:39:53.3253451Z flowschema.flowcontrol.apiserver.k8s.io/system-leader-election leader-election 100 ByUser 11m False
2021-07-23T01:39:53.3255829Z flowschema.flowcontrol.apiserver.k8s.io/workload-leader-election leader-election 200 ByUser 11m False
2021-07-23T01:39:53.3257997Z flowschema.flowcontrol.apiserver.k8s.io/system-nodes system 500 ByUser 11m False
2021-07-23T01:39:53.3260291Z flowschema.flowcontrol.apiserver.k8s.io/kube-controller-manager workload-high 800 ByNamespace 11m False
2021-07-23T01:39:53.3262556Z flowschema.flowcontrol.apiserver.k8s.io/kube-scheduler workload-high 800 ByNamespace 11m False
2021-07-23T01:39:53.3265715Z flowschema.flowcontrol.apiserver.k8s.io/kube-system-service-accounts workload-high 900 ByNamespace 11m False
2021-07-23T01:39:53.3268054Z flowschema.flowcontrol.apiserver.k8s.io/service-accounts workload-low 9000 ByUser 11m False
2021-07-23T01:39:53.3270268Z flowschema.flowcontrol.apiserver.k8s.io/global-default global-default 9900 ByUser 11m False
2021-07-23T01:39:53.3272312Z flowschema.flowcontrol.apiserver.k8s.io/catch-all catch-all 10000 ByUser 11m False
2021-07-23T01:39:53.7275540Z NAME TYPE ASSUREDCONCURRENCYSHARES QUEUES HANDSIZE QUEUELENGTHLIMIT AGE
2021-07-23T01:39:53.7283085Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/catch-all Limited 5 <none> <none> <none> 11m
2021-07-23T01:39:53.7285720Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/exempt Exempt <none> <none> <none> <none> 11m
2021-07-23T01:39:53.7292447Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/global-default Limited 20 128 6 50 11m
2021-07-23T01:39:53.7299379Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/leader-election Limited 10 16 4 50 11m
2021-07-23T01:39:53.7301732Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/system Limited 30 64 6 50 11m
2021-07-23T01:39:53.7322930Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/workload-high Limited 40 128 6 50 11m
2021-07-23T01:39:53.7332659Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/workload-low Limited 100 128 6 50 11m
2021-07-23T01:39:54.1476070Z NAME AGE
2021-07-23T01:39:54.1478029Z serviceexport.multicluster.x-k8s.io/nginx-demo 3m4s
2021-07-23T01:39:57.2157628Z NAME ROLE AGE USERS GROUPS SERVICEACCOUNTS
2021-07-23T01:39:57.2178103Z clusterrolebinding.rbac.authorization.k8s.io/cluster-admin ClusterRole/cluster-admin 12m system:masters
2021-07-23T01:39:57.2193886Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:get-nodes ClusterRole/kubeadm:get-nodes 12m system:bootstrappers:kubeadm:default-node-token
2021-07-23T01:39:57.2198237Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:kubelet-bootstrap ClusterRole/system:node-bootstrapper 12m system:bootstrappers:kubeadm:default-node-token
2021-07-23T01:39:57.2202613Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-bootstrap ClusterRole/system:certificates.k8s.io:certificatesigningrequests:nodeclient 12m system:bootstrappers:kubeadm:default-node-token
2021-07-23T01:39:57.2211348Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-certificate-rotation ClusterRole/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 12m system:nodes
2021-07-23T01:39:57.2216068Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-proxier ClusterRole/system:node-proxier 12m kube-system/kube-proxy
2021-07-23T01:39:57.2220410Z clusterrolebinding.rbac.authorization.k8s.io/local-path-provisioner-bind ClusterRole/local-path-provisioner-role 11m local-path-storage/local-path-provisioner-service-account
2021-07-23T01:39:57.2224539Z clusterrolebinding.rbac.authorization.k8s.io/submariner-gateway ClusterRole/submariner-gateway 7m11s submariner-operator/submariner-gateway
2021-07-23T01:39:57.2228091Z clusterrolebinding.rbac.authorization.k8s.io/submariner-globalnet ClusterRole/submariner-globalnet 7m11s submariner-operator/submariner-globalnet
2021-07-23T01:39:57.2231875Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-agent ClusterRole/submariner-lighthouse-agent 7m10s submariner-operator/submariner-lighthouse-agent
2021-07-23T01:39:57.2235815Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-coredns ClusterRole/submariner-lighthouse-coredns 7m10s submariner-operator/submariner-lighthouse-coredns
2021-07-23T01:39:57.2240083Z clusterrolebinding.rbac.authorization.k8s.io/submariner-networkplugin-syncer ClusterRole/submariner-networkplugin-syncer 7m10s submariner-operator/submariner-networkplugin-syncer
2021-07-23T01:39:57.2243747Z clusterrolebinding.rbac.authorization.k8s.io/submariner-operator ClusterRole/submariner-operator 7m12s submariner-operator/submariner-operator
2021-07-23T01:39:57.2247029Z clusterrolebinding.rbac.authorization.k8s.io/submariner-routeagent ClusterRole/submariner-routeagent 7m11s submariner-operator/submariner-routeagent
2021-07-23T01:39:57.2249972Z clusterrolebinding.rbac.authorization.k8s.io/system:basic-user ClusterRole/system:basic-user 12m system:authenticated
2021-07-23T01:39:57.2253069Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:attachdetach-controller ClusterRole/system:controller:attachdetach-controller 12m kube-system/attachdetach-controller
2021-07-23T01:39:57.2256663Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:certificate-controller ClusterRole/system:controller:certificate-controller 12m kube-system/certificate-controller
2021-07-23T01:39:57.2260731Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller ClusterRole/system:controller:clusterrole-aggregation-controller 12m kube-system/clusterrole-aggregation-controller
2021-07-23T01:39:57.2264662Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:cronjob-controller ClusterRole/system:controller:cronjob-controller 12m kube-system/cronjob-controller
2021-07-23T01:39:57.2268156Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:daemon-set-controller ClusterRole/system:controller:daemon-set-controller 12m kube-system/daemon-set-controller
2021-07-23T01:39:57.2271596Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:deployment-controller ClusterRole/system:controller:deployment-controller 12m kube-system/deployment-controller
2021-07-23T01:39:57.2275018Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:disruption-controller ClusterRole/system:controller:disruption-controller 12m kube-system/disruption-controller
2021-07-23T01:39:57.2278397Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpoint-controller ClusterRole/system:controller:endpoint-controller 12m kube-system/endpoint-controller
2021-07-23T01:39:57.2281979Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpointslice-controller ClusterRole/system:controller:endpointslice-controller 12m kube-system/endpointslice-controller
2021-07-23T01:39:57.2286100Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpointslicemirroring-controller ClusterRole/system:controller:endpointslicemirroring-controller 12m kube-system/endpointslicemirroring-controller
2021-07-23T01:39:57.2289936Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:expand-controller ClusterRole/system:controller:expand-controller 12m kube-system/expand-controller
2021-07-23T01:39:57.2293389Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:generic-garbage-collector ClusterRole/system:controller:generic-garbage-collector 12m kube-system/generic-garbage-collector
2021-07-23T01:39:57.2297588Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler ClusterRole/system:controller:horizontal-pod-autoscaler 12m kube-system/horizontal-pod-autoscaler
2021-07-23T01:39:57.2301405Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:job-controller ClusterRole/system:controller:job-controller 12m kube-system/job-controller
2021-07-23T01:39:57.2304856Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:namespace-controller ClusterRole/system:controller:namespace-controller 12m kube-system/namespace-controller
2021-07-23T01:39:57.2308423Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:node-controller ClusterRole/system:controller:node-controller 12m kube-system/node-controller
2021-07-23T01:39:57.2313692Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:persistent-volume-binder ClusterRole/system:controller:persistent-volume-binder 12m kube-system/persistent-volume-binder
2021-07-23T01:39:57.2317543Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pod-garbage-collector ClusterRole/system:controller:pod-garbage-collector 12m kube-system/pod-garbage-collector
2021-07-23T01:39:57.2321398Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pv-protection-controller ClusterRole/system:controller:pv-protection-controller 12m kube-system/pv-protection-controller
2021-07-23T01:39:57.2325417Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pvc-protection-controller ClusterRole/system:controller:pvc-protection-controller 12m kube-system/pvc-protection-controller
2021-07-23T01:39:57.2329162Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replicaset-controller ClusterRole/system:controller:replicaset-controller 12m kube-system/replicaset-controller
2021-07-23T01:39:57.2332623Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replication-controller ClusterRole/system:controller:replication-controller 12m kube-system/replication-controller
2021-07-23T01:39:57.2336197Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:resourcequota-controller ClusterRole/system:controller:resourcequota-controller 12m kube-system/resourcequota-controller
2021-07-23T01:39:57.2339775Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:root-ca-cert-publisher ClusterRole/system:controller:root-ca-cert-publisher 12m kube-system/root-ca-cert-publisher
2021-07-23T01:39:57.2343026Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:route-controller ClusterRole/system:controller:route-controller 12m kube-system/route-controller
2021-07-23T01:39:57.2347249Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-account-controller ClusterRole/system:controller:service-account-controller 12m kube-system/service-account-controller
2021-07-23T01:39:57.2350906Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-controller ClusterRole/system:controller:service-controller 12m kube-system/service-controller
2021-07-23T01:39:57.2354296Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:statefulset-controller ClusterRole/system:controller:statefulset-controller 12m kube-system/statefulset-controller
2021-07-23T01:39:57.2357788Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:ttl-controller ClusterRole/system:controller:ttl-controller 12m kube-system/ttl-controller
2021-07-23T01:39:57.2360743Z clusterrolebinding.rbac.authorization.k8s.io/system:coredns ClusterRole/system:coredns 12m kube-system/coredns
2021-07-23T01:39:57.2362942Z clusterrolebinding.rbac.authorization.k8s.io/system:discovery ClusterRole/system:discovery 12m system:authenticated
2021-07-23T01:39:57.2365862Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-controller-manager ClusterRole/system:kube-controller-manager 12m system:kube-controller-manager
2021-07-23T01:39:57.2368968Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-dns ClusterRole/system:kube-dns 12m kube-system/kube-dns
2021-07-23T01:39:57.2371911Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-scheduler ClusterRole/system:kube-scheduler 12m system:kube-scheduler
2021-07-23T01:39:57.2374351Z clusterrolebinding.rbac.authorization.k8s.io/system:monitoring ClusterRole/system:monitoring 12m system:monitoring
2021-07-23T01:39:57.2376542Z clusterrolebinding.rbac.authorization.k8s.io/system:node ClusterRole/system:node 12m
2021-07-23T01:39:57.2378981Z clusterrolebinding.rbac.authorization.k8s.io/system:node-proxier ClusterRole/system:node-proxier 12m system:kube-proxy
2021-07-23T01:39:57.2382072Z clusterrolebinding.rbac.authorization.k8s.io/system:public-info-viewer ClusterRole/system:public-info-viewer 12m system:authenticated, system:unauthenticated
2021-07-23T01:39:57.2385737Z clusterrolebinding.rbac.authorization.k8s.io/system:service-account-issuer-discovery ClusterRole/system:service-account-issuer-discovery 12m system:serviceaccounts
2021-07-23T01:39:57.2389310Z clusterrolebinding.rbac.authorization.k8s.io/system:volume-scheduler ClusterRole/system:volume-scheduler 12m system:kube-scheduler
2021-07-23T01:39:57.2392224Z clusterrolebinding.rbac.authorization.k8s.io/weave-net ClusterRole/weave-net 11m kube-system/weave-net
2021-07-23T01:39:57.6547065Z NAME CREATED AT
2021-07-23T01:39:57.6560083Z clusterrole.rbac.authorization.k8s.io/admin 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6572654Z clusterrole.rbac.authorization.k8s.io/cluster-admin 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6584899Z clusterrole.rbac.authorization.k8s.io/edit 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6616292Z clusterrole.rbac.authorization.k8s.io/kubeadm:get-nodes 2021-07-23T01:27:57Z
2021-07-23T01:39:57.6618217Z clusterrole.rbac.authorization.k8s.io/local-path-provisioner-role 2021-07-23T01:28:01Z
2021-07-23T01:39:57.6620049Z clusterrole.rbac.authorization.k8s.io/submariner-gateway 2021-07-23T01:32:44Z
2021-07-23T01:39:57.6622081Z clusterrole.rbac.authorization.k8s.io/submariner-globalnet 2021-07-23T01:32:44Z
2021-07-23T01:39:57.6624090Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-agent 2021-07-23T01:32:47Z
2021-07-23T01:39:57.6626527Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-coredns 2021-07-23T01:32:47Z
2021-07-23T01:39:57.6629004Z clusterrole.rbac.authorization.k8s.io/submariner-networkplugin-syncer 2021-07-23T01:32:45Z
2021-07-23T01:39:57.6631055Z clusterrole.rbac.authorization.k8s.io/submariner-operator 2021-07-23T01:32:43Z
2021-07-23T01:39:57.6632937Z clusterrole.rbac.authorization.k8s.io/submariner-routeagent 2021-07-23T01:32:44Z
2021-07-23T01:39:57.6634845Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-admin 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6636779Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-edit 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6638653Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-view 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6640419Z clusterrole.rbac.authorization.k8s.io/system:auth-delegator 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6642381Z clusterrole.rbac.authorization.k8s.io/system:basic-user 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6644591Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:nodeclient 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6647103Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6649590Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:kube-apiserver-client-approver 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6652217Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:kube-apiserver-client-kubelet-approver 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6654967Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:kubelet-serving-approver 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6657354Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:legacy-unknown-approver 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6659546Z clusterrole.rbac.authorization.k8s.io/system:controller:attachdetach-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6661668Z clusterrole.rbac.authorization.k8s.io/system:controller:certificate-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6696058Z clusterrole.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6698460Z clusterrole.rbac.authorization.k8s.io/system:controller:cronjob-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6700343Z clusterrole.rbac.authorization.k8s.io/system:controller:daemon-set-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6702265Z clusterrole.rbac.authorization.k8s.io/system:controller:deployment-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6704162Z clusterrole.rbac.authorization.k8s.io/system:controller:disruption-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6706466Z clusterrole.rbac.authorization.k8s.io/system:controller:endpoint-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6708401Z clusterrole.rbac.authorization.k8s.io/system:controller:endpointslice-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6710514Z clusterrole.rbac.authorization.k8s.io/system:controller:endpointslicemirroring-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6712579Z clusterrole.rbac.authorization.k8s.io/system:controller:expand-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6714683Z clusterrole.rbac.authorization.k8s.io/system:controller:generic-garbage-collector 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6716683Z clusterrole.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6718572Z clusterrole.rbac.authorization.k8s.io/system:controller:job-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6720379Z clusterrole.rbac.authorization.k8s.io/system:controller:namespace-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6722211Z clusterrole.rbac.authorization.k8s.io/system:controller:node-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6724331Z clusterrole.rbac.authorization.k8s.io/system:controller:persistent-volume-binder 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6726412Z clusterrole.rbac.authorization.k8s.io/system:controller:pod-garbage-collector 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6728510Z clusterrole.rbac.authorization.k8s.io/system:controller:pv-protection-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6730636Z clusterrole.rbac.authorization.k8s.io/system:controller:pvc-protection-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6732756Z clusterrole.rbac.authorization.k8s.io/system:controller:replicaset-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6734829Z clusterrole.rbac.authorization.k8s.io/system:controller:replication-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6737118Z clusterrole.rbac.authorization.k8s.io/system:controller:resourcequota-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6739316Z clusterrole.rbac.authorization.k8s.io/system:controller:root-ca-cert-publisher 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6741337Z clusterrole.rbac.authorization.k8s.io/system:controller:route-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6743545Z clusterrole.rbac.authorization.k8s.io/system:controller:service-account-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6749024Z clusterrole.rbac.authorization.k8s.io/system:controller:service-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6750923Z clusterrole.rbac.authorization.k8s.io/system:controller:statefulset-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6752776Z clusterrole.rbac.authorization.k8s.io/system:controller:ttl-controller 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6754437Z clusterrole.rbac.authorization.k8s.io/system:coredns 2021-07-23T01:27:57Z
2021-07-23T01:39:57.6756043Z clusterrole.rbac.authorization.k8s.io/system:discovery 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6757644Z clusterrole.rbac.authorization.k8s.io/system:heapster 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6759282Z clusterrole.rbac.authorization.k8s.io/system:kube-aggregator 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6761056Z clusterrole.rbac.authorization.k8s.io/system:kube-controller-manager 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6795445Z clusterrole.rbac.authorization.k8s.io/system:kube-dns 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6797247Z clusterrole.rbac.authorization.k8s.io/system:kube-scheduler 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6799116Z clusterrole.rbac.authorization.k8s.io/system:kubelet-api-admin 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6801140Z clusterrole.rbac.authorization.k8s.io/system:monitoring 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6802830Z clusterrole.rbac.authorization.k8s.io/system:node 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6804487Z clusterrole.rbac.authorization.k8s.io/system:node-bootstrapper 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6806255Z clusterrole.rbac.authorization.k8s.io/system:node-problem-detector 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6807990Z clusterrole.rbac.authorization.k8s.io/system:node-proxier 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6809824Z clusterrole.rbac.authorization.k8s.io/system:persistent-volume-provisioner 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6811735Z clusterrole.rbac.authorization.k8s.io/system:public-info-viewer 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6813986Z clusterrole.rbac.authorization.k8s.io/system:service-account-issuer-discovery 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6816036Z clusterrole.rbac.authorization.k8s.io/system:volume-scheduler 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6817775Z clusterrole.rbac.authorization.k8s.io/view 2021-07-23T01:27:55Z
2021-07-23T01:39:57.6819423Z clusterrole.rbac.authorization.k8s.io/weave-net 2021-07-23T01:28:32Z
2021-07-23T01:39:58.8644654Z NAME VALUE GLOBAL-DEFAULT AGE
2021-07-23T01:39:58.8646059Z priorityclass.scheduling.k8s.io/system-cluster-critical 2000000000 false 12m
2021-07-23T01:39:58.8648163Z priorityclass.scheduling.k8s.io/system-node-critical 2000001000 false 12m
2021-07-23T01:39:59.6693624Z NAME DRIVERS AGE
2021-07-23T01:39:59.6695147Z csinode.storage.k8s.io/cluster1-control-plane 0 12m
2021-07-23T01:39:59.6696352Z csinode.storage.k8s.io/cluster1-worker 0 11m
2021-07-23T01:39:59.6697531Z csinode.storage.k8s.io/cluster1-worker2 0 11m
2021-07-23T01:40:00.0769352Z NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE
2021-07-23T01:40:00.0771736Z storageclass.storage.k8s.io/standard (default) rancher.io/local-path Delete WaitForFirstConsumer false 11m
2021-07-23T01:40:04.0548422Z [submariner-operator]$ [cluster1] print_section * Details of pods with statuses other than Running in cluster1 *
2021-07-23T01:40:04.0560901Z [submariner-operator]$ [cluster1] print_section * Details of pods with statuses other than Running in cluster1 *
2021-07-23T01:40:04.0562942Z ====================================================================
2021-07-23T01:40:04.0566284Z ##[endgroup]
2021-07-23T01:40:04.0570314Z ##[group]* Details of pods with statuses other than Running in cluster1 *
2021-07-23T01:40:04.0574410Z ======================= * Details of pods with statuses other than Running in cluster1 * =======================
2021-07-23T01:40:04.0592534Z [submariner-operator]$ [cluster1] kubectl get pods -A
2021-07-23T01:40:04.0605979Z [submariner-operator]$ [cluster1] tail -n +2
2021-07-23T01:40:04.0615719Z [submariner-operator]$ [cluster1] kubectl get pods -A
2021-07-23T01:40:04.0630585Z [submariner-operator]$ [cluster1] grep -v Running
2021-07-23T01:40:04.0639526Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -A
2021-07-23T01:40:04.0676806Z [submariner-operator]$ [cluster1] sed s/ */;/g
2021-07-23T01:40:04.3812327Z [submariner-operator]$ [cluster1] print_section * Kube-proxy pod logs for cluster1 *
2021-07-23T01:40:04.3827821Z [submariner-operator]$ [cluster1] print_section * Kube-proxy pod logs for cluster1 *
2021-07-23T01:40:04.3833828Z ====================================================================
2021-07-23T01:40:04.3841564Z ##[endgroup]
2021-07-23T01:40:04.3854893Z ##[group]* Kube-proxy pod logs for cluster1 *
2021-07-23T01:40:04.3855993Z ======================= * Kube-proxy pod logs for cluster1 * =======================
2021-07-23T01:40:04.3857201Z [submariner-operator]$ [cluster1] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-23T01:40:04.3875475Z [submariner-operator]$ [cluster1] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-23T01:40:04.3889080Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-23T01:40:04.3901368Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-23T01:40:04.3907544Z ====================================================================
2021-07-23T01:40:04.3912152Z ##[endgroup]
2021-07-23T01:40:04.3918656Z ##[group]** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-23T01:40:04.3923673Z ======================= ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' ** =======================
2021-07-23T01:40:04.3940519Z [submariner-operator]$ [cluster1] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:04.3964739Z [submariner-operator]$ [cluster1] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:04.3980689Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:04.7244757Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-8b6bl -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:04.7257630Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-8b6bl -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:04.7275831Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-8b6bl -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:05.0474780Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-8b6bl ***
2021-07-23T01:40:05.0491037Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-8b6bl ***
2021-07-23T01:40:05.0497093Z ====================================================================
2021-07-23T01:40:05.0501561Z ##[endgroup]
2021-07-23T01:40:05.0506693Z ##[group]*** kube-proxy-8b6bl ***
2021-07-23T01:40:05.0512011Z ======================= *** kube-proxy-8b6bl *** =======================
2021-07-23T01:40:05.0543955Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-8b6bl
2021-07-23T01:40:05.0560202Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-8b6bl
2021-07-23T01:40:05.0593437Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-8b6bl
2021-07-23T01:40:05.4345824Z I0723 01:28:25.467467 1 node.go:172] Successfully retrieved node IP: 172.18.0.4
2021-07-23T01:40:05.4347533Z I0723 01:28:25.467542 1 server_others.go:142] kube-proxy node IP is an IPv4 address (172.18.0.4), assume IPv4 operation
2021-07-23T01:40:05.4348469Z I0723 01:28:25.500874 1 server_others.go:185] Using iptables Proxier.
2021-07-23T01:40:05.4349359Z I0723 01:28:25.500895 1 server_others.go:192] creating dualStackProxier for iptables.
2021-07-23T01:40:05.4351070Z W0723 01:28:25.502413 1 server_others.go:498] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
2021-07-23T01:40:05.4352427Z I0723 01:28:25.502898 1 server.go:650] Version: v1.20.7
2021-07-23T01:40:05.4353557Z I0723 01:28:25.503607 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-23T01:40:05.4354863Z I0723 01:28:25.503781 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-23T01:40:05.4355794Z I0723 01:28:25.505942 1 config.go:315] Starting service config controller
2021-07-23T01:40:05.4356646Z I0723 01:28:25.505960 1 shared_informer.go:240] Waiting for caches to sync for service config
2021-07-23T01:40:05.4357513Z I0723 01:28:25.506179 1 config.go:224] Starting endpoint slice config controller
2021-07-23T01:40:05.4358429Z I0723 01:28:25.506195 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
2021-07-23T01:40:05.4359332Z I0723 01:28:25.606207 1 shared_informer.go:247] Caches are synced for service config
2021-07-23T01:40:05.4360229Z I0723 01:28:25.614702 1 shared_informer.go:247] Caches are synced for endpoint slice config
2021-07-23T01:40:05.4361836Z W0723 01:34:04.799401 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4363813Z W0723 01:34:04.827607 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4365798Z W0723 01:34:11.234187 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4367759Z W0723 01:34:11.246907 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4369680Z W0723 01:34:11.376900 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4371522Z W0723 01:34:11.410924 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4373335Z W0723 01:34:13.389712 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4375133Z W0723 01:34:13.492085 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4376945Z W0723 01:36:50.380399 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4378759Z W0723 01:36:50.411350 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4380565Z W0723 01:36:51.106154 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4382371Z W0723 01:36:51.151206 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4384222Z W0723 01:36:51.674083 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4386195Z W0723 01:36:51.691765 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:05.4445227Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-99zc7 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:05.4462254Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-99zc7 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:05.4480793Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-99zc7 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:05.7514488Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-99zc7 ***
2021-07-23T01:40:05.7525946Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-99zc7 ***
2021-07-23T01:40:05.7530938Z ====================================================================
2021-07-23T01:40:05.7535214Z ##[endgroup]
2021-07-23T01:40:05.7540992Z ##[group]*** kube-proxy-99zc7 ***
2021-07-23T01:40:05.7547535Z ======================= *** kube-proxy-99zc7 *** =======================
2021-07-23T01:40:05.7557110Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-99zc7
2021-07-23T01:40:05.7571246Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-99zc7
2021-07-23T01:40:05.7582571Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-99zc7
2021-07-23T01:40:06.0837883Z I0723 01:28:26.368298 1 node.go:172] Successfully retrieved node IP: 172.18.0.7
2021-07-23T01:40:06.0839563Z I0723 01:28:26.368360 1 server_others.go:142] kube-proxy node IP is an IPv4 address (172.18.0.7), assume IPv4 operation
2021-07-23T01:40:06.0840590Z I0723 01:28:26.408007 1 server_others.go:185] Using iptables Proxier.
2021-07-23T01:40:06.0841527Z I0723 01:28:26.408035 1 server_others.go:192] creating dualStackProxier for iptables.
2021-07-23T01:40:06.0843029Z W0723 01:28:26.410270 1 server_others.go:498] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
2021-07-23T01:40:06.0844324Z I0723 01:28:26.410733 1 server.go:650] Version: v1.20.7
2021-07-23T01:40:06.0845615Z I0723 01:28:26.411334 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-23T01:40:06.0846916Z I0723 01:28:26.411394 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-23T01:40:06.0847973Z I0723 01:28:26.412661 1 config.go:315] Starting service config controller
2021-07-23T01:40:06.0848967Z I0723 01:28:26.412683 1 shared_informer.go:240] Waiting for caches to sync for service config
2021-07-23T01:40:06.0849846Z I0723 01:28:26.413076 1 config.go:224] Starting endpoint slice config controller
2021-07-23T01:40:06.0850763Z I0723 01:28:26.413088 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
2021-07-23T01:40:06.0851653Z I0723 01:28:26.513057 1 shared_informer.go:247] Caches are synced for service config
2021-07-23T01:40:06.0852559Z I0723 01:28:26.513272 1 shared_informer.go:247] Caches are synced for endpoint slice config
2021-07-23T01:40:06.0854183Z W0723 01:34:04.797914 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0856182Z W0723 01:34:04.826041 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0858166Z W0723 01:34:11.237302 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0860154Z W0723 01:34:11.253996 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0862109Z W0723 01:34:11.381848 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0864259Z W0723 01:34:11.400778 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0866602Z W0723 01:34:13.393292 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0868568Z W0723 01:34:13.487891 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0870544Z W0723 01:36:50.381472 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0872631Z W0723 01:36:50.419991 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0874599Z W0723 01:36:51.107075 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0876575Z W0723 01:36:51.155810 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0878513Z W0723 01:36:51.674434 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0880527Z W0723 01:36:51.693965 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.0935319Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-zhbrn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:06.0947594Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-zhbrn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:06.0962640Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-zhbrn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:06.4109467Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-zhbrn ***
2021-07-23T01:40:06.4122602Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-zhbrn ***
2021-07-23T01:40:06.4123699Z ====================================================================
2021-07-23T01:40:06.4125113Z ##[endgroup]
2021-07-23T01:40:06.4131174Z ##[group]*** kube-proxy-zhbrn ***
2021-07-23T01:40:06.4132042Z ======================= *** kube-proxy-zhbrn *** =======================
2021-07-23T01:40:06.4144215Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-zhbrn
2021-07-23T01:40:06.4161012Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-zhbrn
2021-07-23T01:40:06.4173620Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-zhbrn
2021-07-23T01:40:06.7518827Z I0723 01:28:14.183048 1 node.go:172] Successfully retrieved node IP: 172.18.0.9
2021-07-23T01:40:06.7521921Z I0723 01:28:14.183133 1 server_others.go:142] kube-proxy node IP is an IPv4 address (172.18.0.9), assume IPv4 operation
2021-07-23T01:40:06.7522809Z I0723 01:28:14.195729 1 server_others.go:185] Using iptables Proxier.
2021-07-23T01:40:06.7523842Z I0723 01:28:14.195749 1 server_others.go:192] creating dualStackProxier for iptables.
2021-07-23T01:40:06.7525464Z W0723 01:28:14.196799 1 server_others.go:498] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
2021-07-23T01:40:06.7526611Z I0723 01:28:14.197234 1 server.go:650] Version: v1.20.7
2021-07-23T01:40:06.7527763Z I0723 01:28:14.197594 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-23T01:40:06.7529338Z I0723 01:28:14.197665 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-23T01:40:06.7530468Z I0723 01:28:14.198160 1 config.go:315] Starting service config controller
2021-07-23T01:40:06.7532950Z I0723 01:28:14.198174 1 shared_informer.go:240] Waiting for caches to sync for service config
2021-07-23T01:40:06.7533784Z I0723 01:28:14.198189 1 config.go:224] Starting endpoint slice config controller
2021-07-23T01:40:06.7535467Z I0723 01:28:14.198192 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
2021-07-23T01:40:06.7536356Z I0723 01:28:14.298313 1 shared_informer.go:247] Caches are synced for endpoint slice config
2021-07-23T01:40:06.7537398Z I0723 01:28:14.298380 1 shared_informer.go:247] Caches are synced for service config
2021-07-23T01:40:06.7539584Z W0723 01:34:04.836569 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7542555Z W0723 01:34:04.836602 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7545569Z W0723 01:34:11.240432 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7548284Z W0723 01:34:11.248298 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7551002Z W0723 01:34:11.375129 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7553623Z W0723 01:34:11.411459 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7556143Z W0723 01:34:13.460031 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7558101Z W0723 01:34:13.517011 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7560172Z W0723 01:36:50.380937 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7562100Z W0723 01:36:50.466319 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7564163Z W0723 01:36:51.105601 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7566261Z W0723 01:36:51.151247 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7568185Z W0723 01:36:51.673514 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7570146Z W0723 01:36:51.694260 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-23T01:40:06.7636333Z [submariner-operator]$ [cluster1] print_section * Kube-controller-manager pod logs for cluster1 *
2021-07-23T01:40:06.7648233Z [submariner-operator]$ [cluster1] print_section * Kube-controller-manager pod logs for cluster1 *
2021-07-23T01:40:06.7650539Z ====================================================================
2021-07-23T01:40:06.7654024Z ##[endgroup]
2021-07-23T01:40:06.7657663Z ##[group]* Kube-controller-manager pod logs for cluster1 *
2021-07-23T01:40:06.7660532Z ======================= * Kube-controller-manager pod logs for cluster1 * =======================
2021-07-23T01:40:06.7678106Z [submariner-operator]$ [cluster1] print_pods_logs kube-system component=kube-controller-manager
2021-07-23T01:40:06.7690199Z [submariner-operator]$ [cluster1] print_pods_logs kube-system component=kube-controller-manager
2021-07-23T01:40:06.7705110Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-23T01:40:06.7717304Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-23T01:40:06.7722083Z ====================================================================
2021-07-23T01:40:06.7725312Z ##[endgroup]
2021-07-23T01:40:06.7729617Z ##[group]** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-23T01:40:06.7743722Z ======================= ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' ** =======================
2021-07-23T01:40:06.7762731Z [submariner-operator]$ [cluster1] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:06.7775298Z [submariner-operator]$ [cluster1] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:06.7788516Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:07.0932421Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:07.0943289Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:07.0960160Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:07.3956093Z [submariner-operator]$ [cluster1] print_section *** kube-controller-manager-cluster1-control-plane ***
2021-07-23T01:40:07.3974459Z [submariner-operator]$ [cluster1] print_section *** kube-controller-manager-cluster1-control-plane ***
2021-07-23T01:40:07.3981106Z ====================================================================
2021-07-23T01:40:07.3987006Z ##[endgroup]
2021-07-23T01:40:07.3992925Z ##[group]*** kube-controller-manager-cluster1-control-plane ***
2021-07-23T01:40:07.4000880Z ======================= *** kube-controller-manager-cluster1-control-plane *** =======================
2021-07-23T01:40:07.4017688Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-23T01:40:07.4033855Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-23T01:40:07.4052716Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-23T01:40:07.7473726Z Flag --port has been deprecated, see --secure-port instead.
2021-07-23T01:40:07.7474994Z I0723 01:27:39.968496 1 serving.go:331] Generated self-signed cert in-memory
2021-07-23T01:40:07.7475859Z I0723 01:27:42.432828 1 controllermanager.go:176] Version: v1.20.7
2021-07-23T01:40:07.7477594Z I0723 01:27:42.437140 1 dynamic_cafile_content.go:167] Starting request-header::/etc/kubernetes/pki/front-proxy-ca.crt
2021-07-23T01:40:07.7479733Z I0723 01:27:42.437191 1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
2021-07-23T01:40:07.7480717Z I0723 01:27:42.437832 1 secure_serving.go:197] Serving securely on 127.0.0.1:10257
2021-07-23T01:40:07.7482123Z I0723 01:27:42.437859 1 leaderelection.go:243] attempting to acquire leader lease kube-system/kube-controller-manager...
2021-07-23T01:40:07.7483619Z I0723 01:27:42.437889 1 tlsconfig.go:240] Starting DynamicServingCertificateController
2021-07-23T01:40:07.7486371Z E0723 01:27:52.438154 1 leaderelection.go:325] error retrieving resource lock kube-system/kube-controller-manager: Get "https://172.18.0.9:6443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=10s": context deadline exceeded
2021-07-23T01:40:07.7490235Z E0723 01:27:55.558565 1 leaderelection.go:325] error retrieving resource lock kube-system/kube-controller-manager: leases.coordination.k8s.io "kube-controller-manager" is forbidden: User "system:kube-controller-manager" cannot get resource "leases" in API group "coordination.k8s.io" in the namespace "kube-system"
2021-07-23T01:40:07.7493081Z I0723 01:27:57.840542 1 leaderelection.go:253] successfully acquired lease kube-system/kube-controller-manager
2021-07-23T01:40:07.7495730Z I0723 01:27:57.843491 1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager" kind="Lease" apiVersion="coordination.k8s.io/v1" type="Normal" reason="LeaderElection" message="cluster1-control-plane_bdce9102-8f4c-4dfc-8f04-03483a48be1b became leader"
2021-07-23T01:40:07.7497675Z I0723 01:27:58.318008 1 shared_informer.go:240] Waiting for caches to sync for tokens
2021-07-23T01:40:07.7508438Z I0723 01:27:58.335080 1 controllermanager.go:554] Started "clusterrole-aggregation"
2021-07-23T01:40:07.7509778Z I0723 01:27:58.335130 1 clusterroleaggregation_controller.go:149] Starting ClusterRoleAggregator
2021-07-23T01:40:07.7517529Z I0723 01:27:58.335389 1 shared_informer.go:240] Waiting for caches to sync for ClusterRoleAggregator
2021-07-23T01:40:07.7519083Z I0723 01:27:58.343165 1 controllermanager.go:554] Started "root-ca-cert-publisher"
2021-07-23T01:40:07.7520449Z W0723 01:27:58.343182 1 controllermanager.go:546] Skipping "ephemeral-volume"
2021-07-23T01:40:07.7521496Z I0723 01:27:58.343266 1 publisher.go:98] Starting root CA certificate configmap publisher
2021-07-23T01:40:07.7540005Z I0723 01:27:58.343271 1 shared_informer.go:240] Waiting for caches to sync for crt configmap
2021-07-23T01:40:07.7541085Z I0723 01:27:58.351467 1 controllermanager.go:554] Started "replicationcontroller"
2021-07-23T01:40:07.7542187Z I0723 01:27:58.351601 1 replica_set.go:182] Starting replicationcontroller controller
2021-07-23T01:40:07.7543285Z I0723 01:27:58.351611 1 shared_informer.go:240] Waiting for caches to sync for ReplicationController
2021-07-23T01:40:07.7544353Z I0723 01:27:58.360678 1 controllermanager.go:554] Started "bootstrapsigner"
2021-07-23T01:40:07.7546082Z I0723 01:27:58.360869 1 shared_informer.go:240] Waiting for caches to sync for bootstrap_signer
2021-07-23T01:40:07.7547003Z I0723 01:27:58.367592 1 node_lifecycle_controller.go:380] Sending events to api server.
2021-07-23T01:40:07.7547846Z I0723 01:27:58.368351 1 taint_manager.go:163] Sending events to api server.
2021-07-23T01:40:07.7548710Z I0723 01:27:58.368817 1 node_lifecycle_controller.go:508] Controller will reconcile labels.
2021-07-23T01:40:07.7581862Z I0723 01:27:58.369016 1 controllermanager.go:554] Started "nodelifecycle"
2021-07-23T01:40:07.7583007Z I0723 01:27:58.369845 1 node_lifecycle_controller.go:542] Starting node controller
2021-07-23T01:40:07.7583878Z I0723 01:27:58.369862 1 shared_informer.go:240] Waiting for caches to sync for taint
2021-07-23T01:40:07.7584715Z I0723 01:27:58.373730 1 node_ipam_controller.go:91] Sending events to api server.
2021-07-23T01:40:07.7586307Z I0723 01:27:58.418174 1 shared_informer.go:247] Caches are synced for tokens
2021-07-23T01:40:07.7587120Z I0723 01:28:08.399919 1 range_allocator.go:82] Sending events to api server.
2021-07-23T01:40:07.7588199Z I0723 01:28:08.400244 1 range_allocator.go:116] No Secondary Service CIDR provided. Skipping filtering out secondary service addresses.
2021-07-23T01:40:07.7589328Z I0723 01:28:08.400379 1 controllermanager.go:554] Started "nodeipam"
2021-07-23T01:40:07.7590170Z I0723 01:28:08.400460 1 node_ipam_controller.go:159] Starting ipam controller
2021-07-23T01:40:07.7590997Z I0723 01:28:08.400714 1 shared_informer.go:240] Waiting for caches to sync for node
2021-07-23T01:40:07.7591830Z I0723 01:28:08.406125 1 controllermanager.go:554] Started "endpoint"
2021-07-23T01:40:07.7592734Z I0723 01:28:08.406774 1 endpoints_controller.go:184] Starting endpoint controller
2021-07-23T01:40:07.7593631Z I0723 01:28:08.407013 1 shared_informer.go:240] Waiting for caches to sync for endpoint
2021-07-23T01:40:07.7594561Z I0723 01:28:08.430950 1 controllermanager.go:554] Started "garbagecollector"
2021-07-23T01:40:07.7595579Z I0723 01:28:08.431342 1 garbagecollector.go:142] Starting garbage collector controller
2021-07-23T01:40:07.7596546Z I0723 01:28:08.431354 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-23T01:40:07.7597388Z I0723 01:28:08.431371 1 graph_builder.go:289] GraphBuilder running
2021-07-23T01:40:07.7598207Z I0723 01:28:08.444211 1 controllermanager.go:554] Started "daemonset"
2021-07-23T01:40:07.7599077Z I0723 01:28:08.444380 1 daemon_controller.go:285] Starting daemon sets controller
2021-07-23T01:40:07.7599944Z I0723 01:28:08.444431 1 shared_informer.go:240] Waiting for caches to sync for daemon sets
2021-07-23T01:40:07.7600844Z I0723 01:28:08.470051 1 controllermanager.go:554] Started "endpointslice"
2021-07-23T01:40:07.7601942Z I0723 01:28:08.470236 1 endpointslice_controller.go:237] Starting endpoint slice controller
2021-07-23T01:40:07.7603006Z I0723 01:28:08.470289 1 shared_informer.go:240] Waiting for caches to sync for endpoint_slice
2021-07-23T01:40:07.7604034Z I0723 01:28:08.944226 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpoints
2021-07-23T01:40:07.7605555Z I0723 01:28:08.944311 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io
2021-07-23T01:40:07.7607208Z I0723 01:28:08.944380 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for controllerrevisions.apps
2021-07-23T01:40:07.7608566Z I0723 01:28:08.944437 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for replicasets.apps
2021-07-23T01:40:07.7609856Z I0723 01:28:08.944586 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for events.events.k8s.io
2021-07-23T01:40:07.7611100Z I0723 01:28:08.944712 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for jobs.batch
2021-07-23T01:40:07.7612534Z I0723 01:28:08.944791 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io
2021-07-23T01:40:07.7614198Z I0723 01:28:08.944863 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io
2021-07-23T01:40:07.7615583Z I0723 01:28:08.944940 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for limitranges
2021-07-23T01:40:07.7616771Z I0723 01:28:08.945001 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for daemonsets.apps
2021-07-23T01:40:07.7618129Z I0723 01:28:08.945064 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for leases.coordination.k8s.io
2021-07-23T01:40:07.7619474Z I0723 01:28:08.945155 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for podtemplates
2021-07-23T01:40:07.7620802Z I0723 01:28:08.945212 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for ingresses.extensions
2021-07-23T01:40:07.7622101Z I0723 01:28:08.945282 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for deployments.apps
2021-07-23T01:40:07.7623481Z I0723 01:28:08.945369 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for statefulsets.apps
2021-07-23T01:40:07.7624860Z I0723 01:28:08.945414 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io
2021-07-23T01:40:07.7626486Z I0723 01:28:08.945479 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for poddisruptionbudgets.policy
2021-07-23T01:40:07.7628150Z W0723 01:28:08.945549 1 shared_informer.go:494] resyncPeriod 13h49m42.771835728s is smaller than resyncCheckPeriod 19h45m7.65470587s and the informer has already started. Changing it to 19h45m7.65470587s
2021-07-23T01:40:07.7629641Z I0723 01:28:08.946217 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceaccounts
2021-07-23T01:40:07.7630851Z I0723 01:28:08.946313 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for cronjobs.batch
2021-07-23T01:40:07.7632371Z I0723 01:28:08.946380 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for horizontalpodautoscalers.autoscaling
2021-07-23T01:40:07.7634124Z I0723 01:28:08.946447 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io
2021-07-23T01:40:07.7635424Z I0723 01:28:08.946541 1 resource_quota_controller.go:273] Starting resource quota controller
2021-07-23T01:40:07.7636359Z I0723 01:28:08.946563 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-23T01:40:07.7637361Z I0723 01:28:08.946502 1 controllermanager.go:554] Started "resourcequota"
2021-07-23T01:40:07.7638246Z I0723 01:28:08.946680 1 resource_quota_monitor.go:304] QuotaMonitor running
2021-07-23T01:40:07.7639127Z I0723 01:28:08.952828 1 controllermanager.go:554] Started "csrapproving"
2021-07-23T01:40:07.7642007Z I0723 01:28:08.952941 1 certificate_controller.go:118] Starting certificate controller "csrapproving"
2021-07-23T01:40:07.7643756Z I0723 01:28:08.952950 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrapproving
2021-07-23T01:40:07.7644813Z I0723 01:28:08.965142 1 controllermanager.go:554] Started "statefulset"
2021-07-23T01:40:07.7645665Z I0723 01:28:08.965247 1 stateful_set.go:146] Starting stateful set controller
2021-07-23T01:40:07.7646517Z I0723 01:28:08.965288 1 shared_informer.go:240] Waiting for caches to sync for stateful set
2021-07-23T01:40:07.7647389Z I0723 01:28:08.982061 1 controllermanager.go:554] Started "cronjob"
2021-07-23T01:40:07.7648249Z I0723 01:28:08.982464 1 cronjob_controller.go:96] Starting CronJob Manager
2021-07-23T01:40:07.7649488Z I0723 01:28:09.018649 1 controllermanager.go:554] Started "persistentvolume-binder"
2021-07-23T01:40:07.7653165Z W0723 01:28:09.018677 1 controllermanager.go:546] Skipping "ttl-after-finished"
2021-07-23T01:40:07.7654291Z I0723 01:28:09.019731 1 pv_controller_base.go:307] Starting persistent volume controller
2021-07-23T01:40:07.7655227Z I0723 01:28:09.019751 1 shared_informer.go:240] Waiting for caches to sync for persistent volume
2021-07-23T01:40:07.7656289Z I0723 01:28:09.042678 1 controllermanager.go:554] Started "endpointslicemirroring"
2021-07-23T01:40:07.7657613Z I0723 01:28:09.042880 1 endpointslicemirroring_controller.go:211] Starting EndpointSliceMirroring controller
2021-07-23T01:40:07.7658859Z I0723 01:28:09.042961 1 shared_informer.go:240] Waiting for caches to sync for endpoint_slice_mirroring
2021-07-23T01:40:07.7659793Z I0723 01:28:09.103884 1 controllermanager.go:554] Started "namespace"
2021-07-23T01:40:07.7663556Z I0723 01:28:09.103905 1 namespace_controller.go:200] Starting namespace controller
2021-07-23T01:40:07.7664517Z I0723 01:28:09.104061 1 shared_informer.go:240] Waiting for caches to sync for namespace
2021-07-23T01:40:07.7666570Z I0723 01:28:09.376699 1 controllermanager.go:554] Started "horizontalpodautoscaling"
2021-07-23T01:40:07.7667587Z I0723 01:28:09.376918 1 horizontal.go:169] Starting HPA controller
2021-07-23T01:40:07.7668307Z I0723 01:28:09.376985 1 shared_informer.go:240] Waiting for caches to sync for HPA
2021-07-23T01:40:07.7669290Z I0723 01:28:09.527650 1 controllermanager.go:554] Started "attachdetach"
2021-07-23T01:40:07.7670239Z I0723 01:28:09.528089 1 attach_detach_controller.go:328] Starting attach detach controller
2021-07-23T01:40:07.7671451Z I0723 01:28:09.528105 1 shared_informer.go:240] Waiting for caches to sync for attach detach
2021-07-23T01:40:07.7673440Z I0723 01:28:09.688044 1 controllermanager.go:554] Started "pvc-protection"
2021-07-23T01:40:07.7674629Z I0723 01:28:09.688259 1 pvc_protection_controller.go:110] Starting PVC protection controller
2021-07-23T01:40:07.7675591Z I0723 01:28:09.688294 1 shared_informer.go:240] Waiting for caches to sync for PVC protection
2021-07-23T01:40:07.7676445Z I0723 01:28:10.066071 1 controllermanager.go:554] Started "job"
2021-07-23T01:40:07.7678121Z I0723 01:28:10.067371 1 job_controller.go:148] Starting job controller
2021-07-23T01:40:07.7689176Z I0723 01:28:10.072353 1 shared_informer.go:240] Waiting for caches to sync for job
2021-07-23T01:40:07.7690420Z I0723 01:28:10.092841 1 request.go:655] Throttling request took 1.047788272s, request: GET:https://172.18.0.9:6443/apis/extensions/v1beta1?timeout=32s
2021-07-23T01:40:07.7692340Z I0723 01:28:10.097820 1 controllermanager.go:554] Started "disruption"
2021-07-23T01:40:07.7693385Z I0723 01:28:10.098152 1 disruption.go:331] Starting disruption controller
2021-07-23T01:40:07.7694273Z I0723 01:28:10.098268 1 shared_informer.go:240] Waiting for caches to sync for disruption
2021-07-23T01:40:07.7695192Z I0723 01:28:10.177977 1 controllermanager.go:554] Started "tokencleaner"
2021-07-23T01:40:07.7696099Z I0723 01:28:10.178212 1 tokencleaner.go:118] Starting token cleaner controller
2021-07-23T01:40:07.7698049Z I0723 01:28:10.178317 1 shared_informer.go:240] Waiting for caches to sync for token_cleaner
2021-07-23T01:40:07.7698920Z I0723 01:28:10.178402 1 shared_informer.go:247] Caches are synced for token_cleaner
2021-07-23T01:40:07.7700494Z I0723 01:28:10.327996 1 controllermanager.go:554] Started "persistentvolume-expander"
2021-07-23T01:40:07.7701480Z I0723 01:28:10.328045 1 expand_controller.go:310] Starting expand controller
2021-07-23T01:40:07.7703049Z I0723 01:28:10.328147 1 shared_informer.go:240] Waiting for caches to sync for expand
2021-07-23T01:40:07.7704330Z I0723 01:28:10.477239 1 controllermanager.go:554] Started "pv-protection"
2021-07-23T01:40:07.7705389Z I0723 01:28:10.477312 1 pv_protection_controller.go:83] Starting PV protection controller
2021-07-23T01:40:07.7706288Z I0723 01:28:10.477326 1 shared_informer.go:240] Waiting for caches to sync for PV protection
2021-07-23T01:40:07.7709473Z I0723 01:28:10.627382 1 controllermanager.go:554] Started "podgc"
2021-07-23T01:40:07.7710222Z I0723 01:28:10.627520 1 gc_controller.go:89] Starting GC controller
2021-07-23T01:40:07.7711153Z I0723 01:28:10.627727 1 shared_informer.go:240] Waiting for caches to sync for GC
2021-07-23T01:40:07.7712664Z I0723 01:28:10.676680 1 certificate_controller.go:118] Starting certificate controller "csrsigning-kubelet-serving"
2021-07-23T01:40:07.7714487Z I0723 01:28:10.676821 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kubelet-serving
2021-07-23T01:40:07.7716637Z I0723 01:28:10.676917 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-23T01:40:07.7719185Z I0723 01:28:10.677306 1 certificate_controller.go:118] Starting certificate controller "csrsigning-kubelet-client"
2021-07-23T01:40:07.7723148Z I0723 01:28:10.677396 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kubelet-client
2021-07-23T01:40:07.7725246Z I0723 01:28:10.677461 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-23T01:40:07.7727045Z I0723 01:28:10.677884 1 certificate_controller.go:118] Starting certificate controller "csrsigning-kube-apiserver-client"
2021-07-23T01:40:07.7729093Z I0723 01:28:10.677984 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kube-apiserver-client
2021-07-23T01:40:07.7731205Z I0723 01:28:10.678039 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-23T01:40:07.7732443Z I0723 01:28:10.678349 1 controllermanager.go:554] Started "csrsigning"
2021-07-23T01:40:07.7733865Z I0723 01:28:10.678444 1 certificate_controller.go:118] Starting certificate controller "csrsigning-legacy-unknown"
2021-07-23T01:40:07.7735905Z I0723 01:28:10.678458 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-legacy-unknown
2021-07-23T01:40:07.7737865Z I0723 01:28:10.678483 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-23T01:40:07.7738948Z I0723 01:28:10.827473 1 controllermanager.go:554] Started "ttl"
2021-07-23T01:40:07.7739733Z I0723 01:28:10.827507 1 ttl_controller.go:121] Starting TTL controller
2021-07-23T01:40:07.7740526Z I0723 01:28:10.827612 1 shared_informer.go:240] Waiting for caches to sync for TTL
2021-07-23T01:40:07.7741537Z I0723 01:28:10.979794 1 controllermanager.go:554] Started "replicaset"
2021-07-23T01:40:07.7742400Z I0723 01:28:10.979892 1 replica_set.go:182] Starting replicaset controller
2021-07-23T01:40:07.7743369Z I0723 01:28:10.979904 1 shared_informer.go:240] Waiting for caches to sync for ReplicaSet
2021-07-23T01:40:07.7744416Z E0723 01:28:11.128385 1 core.go:92] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail
2021-07-23T01:40:07.7746119Z W0723 01:28:11.128555 1 controllermanager.go:546] Skipping "service"
2021-07-23T01:40:07.7747674Z W0723 01:28:11.128642 1 core.go:246] configure-cloud-routes is set, but no cloud provider specified. Will not configure cloud provider routes.
2021-07-23T01:40:07.7748750Z W0723 01:28:11.128690 1 controllermanager.go:546] Skipping "route"
2021-07-23T01:40:07.7749783Z I0723 01:28:11.176491 1 node_lifecycle_controller.go:77] Sending events to api server
2021-07-23T01:40:07.7750774Z E0723 01:28:11.176642 1 core.go:232] failed to start cloud node lifecycle controller: no cloud provider provided
2021-07-23T01:40:07.7752669Z W0723 01:28:11.176657 1 controllermanager.go:546] Skipping "cloud-node-lifecycle"
2021-07-23T01:40:07.7753831Z I0723 01:28:11.328719 1 controllermanager.go:554] Started "serviceaccount"
2021-07-23T01:40:07.7754858Z I0723 01:28:11.328802 1 serviceaccounts_controller.go:117] Starting service account controller
2021-07-23T01:40:07.7755856Z I0723 01:28:11.329118 1 shared_informer.go:240] Waiting for caches to sync for service account
2021-07-23T01:40:07.7756753Z I0723 01:28:11.478752 1 controllermanager.go:554] Started "deployment"
2021-07-23T01:40:07.7757692Z I0723 01:28:11.478824 1 deployment_controller.go:153] Starting deployment controller
2021-07-23T01:40:07.7758600Z I0723 01:28:11.478835 1 shared_informer.go:240] Waiting for caches to sync for deployment
2021-07-23T01:40:07.7759506Z I0723 01:28:11.526455 1 controllermanager.go:554] Started "csrcleaner"
2021-07-23T01:40:07.7760483Z I0723 01:28:11.526881 1 cleaner.go:82] Starting CSR cleaner controller
2021-07-23T01:40:07.7761978Z I0723 01:28:11.551111 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-23T01:40:07.7763316Z I0723 01:28:11.639718 1 shared_informer.go:247] Caches are synced for certificate-csrapproving
2021-07-23T01:40:07.7764198Z I0723 01:28:11.657268 1 shared_informer.go:247] Caches are synced for TTL
2021-07-23T01:40:07.7766342Z W0723 01:28:11.666675 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-control-plane" does not exist
2021-07-23T01:40:07.7768477Z I0723 01:28:11.674143 1 shared_informer.go:247] Caches are synced for taint
2021-07-23T01:40:07.7769311Z I0723 01:28:11.674307 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
2021-07-23T01:40:07.7770817Z W0723 01:28:11.674407 1 node_lifecycle_controller.go:1044] Missing timestamp for Node cluster1-control-plane. Assuming now as a timestamp.
2021-07-23T01:40:07.7772653Z I0723 01:28:11.674487 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
2021-07-23T01:40:07.7773841Z I0723 01:28:11.674867 1 taint_manager.go:187] Starting NoExecuteTaintManager
2021-07-23T01:40:07.7776667Z I0723 01:28:11.676581 1 event.go:291] "Event occurred" object="cluster1-control-plane" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller"
2021-07-23T01:40:07.7779576Z I0723 01:28:11.684252 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown
2021-07-23T01:40:07.7781591Z I0723 01:28:11.684528 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving
2021-07-23T01:40:07.7782931Z I0723 01:28:11.684604 1 shared_informer.go:247] Caches are synced for HPA
2021-07-23T01:40:07.7783847Z I0723 01:28:11.685532 1 shared_informer.go:247] Caches are synced for PV protection
2021-07-23T01:40:07.7785404Z I0723 01:28:11.686238 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client
2021-07-23T01:40:07.7787631Z I0723 01:28:11.686313 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client
2021-07-23T01:40:07.7808203Z I0723 01:28:11.686383 1 shared_informer.go:247] Caches are synced for deployment
2021-07-23T01:40:07.7809211Z I0723 01:28:11.688453 1 shared_informer.go:247] Caches are synced for ReplicaSet
2021-07-23T01:40:07.7812266Z I0723 01:28:11.688817 1 shared_informer.go:247] Caches are synced for PVC protection
2021-07-23T01:40:07.7815226Z I0723 01:28:11.703897 1 shared_informer.go:247] Caches are synced for disruption
2021-07-23T01:40:07.7820998Z I0723 01:28:11.704020 1 disruption.go:339] Sending events to api server.
2021-07-23T01:40:07.7821836Z I0723 01:28:11.704113 1 shared_informer.go:247] Caches are synced for namespace
2021-07-23T01:40:07.7822634Z I0723 01:28:11.704228 1 shared_informer.go:247] Caches are synced for node
2021-07-23T01:40:07.7823431Z I0723 01:28:11.704309 1 range_allocator.go:172] Starting range CIDR allocator
2021-07-23T01:40:07.7824305Z I0723 01:28:11.704355 1 shared_informer.go:240] Waiting for caches to sync for cidrallocator
2021-07-23T01:40:07.7825847Z I0723 01:28:11.704412 1 shared_informer.go:247] Caches are synced for cidrallocator
2021-07-23T01:40:07.7826667Z I0723 01:28:11.707684 1 shared_informer.go:247] Caches are synced for endpoint
2021-07-23T01:40:07.7827515Z I0723 01:28:11.720831 1 shared_informer.go:247] Caches are synced for persistent volume
2021-07-23T01:40:07.7828287Z I0723 01:28:11.738572 1 shared_informer.go:247] Caches are synced for GC
2021-07-23T01:40:07.7829034Z I0723 01:28:11.740151 1 shared_informer.go:247] Caches are synced for attach detach
2021-07-23T01:40:07.7833033Z I0723 01:28:11.740571 1 shared_informer.go:247] Caches are synced for service account
2021-07-23T01:40:07.7833914Z I0723 01:28:11.747188 1 shared_informer.go:247] Caches are synced for crt configmap
2021-07-23T01:40:07.7834730Z I0723 01:28:11.740749 1 shared_informer.go:247] Caches are synced for expand
2021-07-23T01:40:07.7835550Z I0723 01:28:11.748819 1 shared_informer.go:247] Caches are synced for daemon sets
2021-07-23T01:40:07.7836573Z I0723 01:28:11.752510 1 shared_informer.go:247] Caches are synced for ReplicationController
2021-07-23T01:40:07.7837549Z I0723 01:28:11.766577 1 shared_informer.go:247] Caches are synced for stateful set
2021-07-23T01:40:07.7838407Z I0723 01:28:11.766721 1 shared_informer.go:247] Caches are synced for bootstrap_signer
2021-07-23T01:40:07.7839825Z I0723 01:28:11.838766 1 range_allocator.go:373] Set node cluster1-control-plane PodCIDR to [10.1.0.0/24]
2021-07-23T01:40:07.7845062Z I0723 01:28:11.870395 1 shared_informer.go:247] Caches are synced for endpoint_slice
2021-07-23T01:40:07.7845857Z I0723 01:28:11.872503 1 shared_informer.go:247] Caches are synced for job
2021-07-23T01:40:07.7846884Z I0723 01:28:11.935487 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
2021-07-23T01:40:07.7847827Z I0723 01:28:11.943115 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
2021-07-23T01:40:07.7848670Z I0723 01:28:11.947379 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-23T01:40:07.7849464Z I0723 01:28:11.954402 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-23T01:40:07.7850280Z I0723 01:28:12.029837 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-23T01:40:07.7852683Z I0723 01:28:12.138941 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
2021-07-23T01:40:07.7855418Z I0723 01:28:12.138982 1 event.go:291] "Event occurred" object="local-path-storage/local-path-provisioner" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set local-path-provisioner-547f784dff to 1"
2021-07-23T01:40:07.7857480Z I0723 01:28:12.239480 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-23T01:40:07.7862425Z I0723 01:28:12.265244 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-zhbrn"
2021-07-23T01:40:07.7863958Z I0723 01:28:12.331492 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-23T01:40:07.7865394Z I0723 01:28:12.331510 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
2021-07-23T01:40:07.7867736Z I0723 01:28:12.532743 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-4m8j4"
2021-07-23T01:40:07.7870308Z I0723 01:28:12.543436 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-hl6hl"
2021-07-23T01:40:07.7883421Z I0723 01:28:12.547836 1 event.go:291] "Event occurred" object="local-path-storage/local-path-provisioner-547f784dff" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: local-path-provisioner-547f784dff-5b8gq"
2021-07-23T01:40:07.7886279Z W0723 01:28:21.675586 1 node_lifecycle_controller.go:1044] Missing timestamp for Node cluster1-worker2. Assuming now as a timestamp.
2021-07-23T01:40:07.7888668Z I0723 01:28:21.675803 1 event.go:291] "Event occurred" object="cluster1-worker2" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller"
2021-07-23T01:40:07.7891292Z W0723 01:28:21.683697 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-worker2" does not exist
2021-07-23T01:40:07.7893728Z I0723 01:28:21.784886 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-8b6bl"
2021-07-23T01:40:07.7895425Z I0723 01:28:21.869188 1 range_allocator.go:373] Set node cluster1-worker2 PodCIDR to [10.1.1.0/24]
2021-07-23T01:40:07.7975376Z E0723 01:28:21.980265 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"9185df40-88c8-4467-b2a8-69b0832ec361", ResourceVersion:"460", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600477, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc00106b500), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00106b520)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc00106b540), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00106b560)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc00106b580), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc001382b40), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00106b5a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00106b5c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.7", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc00106b600)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc00031ce40), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0018fcb78), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000393dc0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc00067e420)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc0018fcbd8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:1, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:1, ObservedGeneration:1, UpdatedNumberScheduled:1, NumberAvailable:1, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
2021-07-23T01:40:07.8039471Z W0723 01:28:22.280466 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-worker" does not exist
2021-07-23T01:40:07.8042515Z I0723 01:28:22.319429 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-99zc7"
2021-07-23T01:40:07.8044957Z I0723 01:28:22.324355 1 range_allocator.go:373] Set node cluster1-worker PodCIDR to [10.1.2.0/24]
2021-07-23T01:40:07.8046591Z W0723 01:28:26.675824 1 node_lifecycle_controller.go:1044] Missing timestamp for Node cluster1-worker. Assuming now as a timestamp.
2021-07-23T01:40:07.8048792Z I0723 01:28:26.676270 1 event.go:291] "Event occurred" object="cluster1-worker" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node cluster1-worker event: Registered Node cluster1-worker in Controller"
2021-07-23T01:40:07.8051865Z I0723 01:28:33.106789 1 event.go:291] "Event occurred" object="kube-system/weave-net" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: weave-net-87x72"
2021-07-23T01:40:07.8054558Z I0723 01:28:33.150227 1 event.go:291] "Event occurred" object="kube-system/weave-net" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: weave-net-rdrz9"
2021-07-23T01:40:07.8057231Z I0723 01:28:33.150253 1 event.go:291] "Event occurred" object="kube-system/weave-net" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: weave-net-7gf6g"
2021-07-23T01:40:07.8059279Z I0723 01:28:46.679179 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
2021-07-23T01:40:07.8060881Z I0723 01:32:46.077950 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for submariners.submariner.io
2021-07-23T01:40:07.8062605Z I0723 01:32:46.077999 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for servicediscoveries.submariner.io
2021-07-23T01:40:07.8064713Z I0723 01:32:46.078164 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for brokers.submariner.io
2021-07-23T01:40:07.8066203Z I0723 01:32:46.078669 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-23T01:40:07.8067104Z I0723 01:32:46.278842 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-23T01:40:07.8068198Z I0723 01:32:46.864234 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-23T01:40:07.8069668Z I0723 01:32:46.864414 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-23T01:40:07.8072118Z I0723 01:32:47.426997 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-operator-586cb56578 to 1"
2021-07-23T01:40:07.8076084Z I0723 01:32:47.442887 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator-586cb56578" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-operator-586cb56578-jdrkc"
2021-07-23T01:40:07.8080058Z I0723 01:33:02.748493 1 event.go:291] "Event occurred" object="submariner-operator/submariner-gateway" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-gateway-wq4fw"
2021-07-23T01:40:07.8918149Z E0723 01:33:02.804171 1 daemon_controller.go:320] submariner-operator/submariner-gateway failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"submariner-gateway", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"991e6d3f-50ed-45d8-a6eb-c74fb29d7458", ResourceVersion:"1377", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600782, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-gateway", "component":"gateway"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"submariner.io/v1alpha1", Kind:"Submariner", Name:"submariner", UID:"da71de59-8932-4796-aee0-0d625f41d2f3", Controller:(*bool)(0xc00240b077), BlockOwnerDeletion:(*bool)(0xc00240b078)}}, Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-operator", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0002fe000), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0002fe020)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0002fe0c0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-gateway"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume(nil), InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"submariner-gateway", Image:"quay.io/submariner/submariner-gateway:0.9.1", Command:[]string{"submariner.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"SUBMARINER_NAMESPACE", Value:"submariner-operator", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERCIDR", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_SERVICECIDR", Value:"100.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_GLOBALCIDR", Value:"", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERID", Value:"cluster1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_COLORCODES", Value:"blue", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_NATENABLED", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_BROKER", Value:"k8s", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CABLEDRIVER", Value:"libreswan", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_APISERVER", Value:"172.18.0.9:6443", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_APISERVERTOKEN", Value:"***", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_REMOTENAMESPACE", Value:"submariner-k8s-broker", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_CA", Value:"LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNekF4TWpjeU0xb1hEVE14TURjeU1UQXhNamN5TTFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBS1B0CjNHUWRTOWt1aUJncENzYy96QUxISm5heVBoM2pKRDFMUlppbTlJVkhrOHdqd0Q4L01LTFJHc1lRS2ZYUk5qbXcKR2JMRVhadTdUdHNQbHFvT3JCNnltNmFIa1hWRUFNNktJRGMrZFhFWW0rcHNJV0p3dzJBRzRwN1loSndaNlNQbwpkTmtmSFh5TXY4MEZ6Y3RnaDFZK0JDRjlZTThNVjlVOHRob0tlVTJpV25PeEZmbmJhbVE2dmV3eG9zTmc1dDFkCmxOMW1lejlVRjFyajd6WmRkZmR3c3BaUkhOc1YrajBpQTNRSGRuMmJWcmxia3JwSUhuZEo0T2RMQ2Nua3NaU3oKU25YVDJDVFg1RmhlY3VwaXJacDNKd2UxUUxXOENPSHB1MkZaZXphalNrV1pTaWs2RlJWdnJYbGZ1OUZHSXRvWgpyRE9TVUFjaURCQmxoVExIaFRrQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLZ3N2M3lNdHp2R1lvaGhsMTNldXlLdm94TTBNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBUlI2V0ZNU1RNemlzaXZwTDNQMVE2cVI4V0VZRXdESHJldUppOE5xaWpSYmdKS0pCNgpYemh3Y1hsMnZ4bkh5cmVBblVGYzg1MDI0ZDFGenRXQ3UrQVRTYXdubnF0K2V5YlE5Ujd0U1A3NTF4Ly8yOVFvCk5YKy96TDI2QWxVbUZiRTd4RE5hQzJSWGp1N2ovMUU4Zmo5dXFEQ3o5Tk4vNDFyakxMU21sWnBJMExiVlFKU1UKaEJ5ckFsRDdpUnFKS1JVZkdlM05UdTRKWmxobWJwb3FoWXA4YlJFUUxwYUxmOXF4cTJob245YUxzcWtQanRUSQpmNk55VnI1cVpCeHkzZXJveldIRDk0QTRRaGtLSjJkbEVqZjE5QXR2RVBuRTlIZ0xZZU5DaENIQXJScHNWTnBPCjdsdnc2d0tlb01MZGVXSXFucUJmU1lLMXRwUUpKRXJTdDdwVwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_PSK", Value:"EwiJv2WW80U2zlVba9YdeI8KF84TqeCxbxbwuXuj/2NKgrWPLoXfUEgjtuXaqD3u", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKENABLED", Value:"true", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKINTERVAL", Value:"1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT", Value:"5", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0002fe0e0)}, v1.EnvVar{Name:"CE_IPSEC_IKEPORT", Value:"500", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_NATTPORT", Value:"4500", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_PREFERREDSERVER", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_FORCEENCAPS", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount(nil), VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc000198a20), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc00240b1d0), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"submariner.io/gateway":"true"}, ServiceAccountName:"submariner-gateway", DeprecatedServiceAccount:"submariner-gateway", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0005c2a80), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(0xc0002fe160), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc000a28a58)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc00240b1f8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "submariner-gateway": the object has been modified; please apply your changes to the latest version and try again
2021-07-23T01:40:07.9544568Z I0723 01:33:04.429628 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-cz655"
2021-07-23T01:40:07.9548818Z I0723 01:33:04.476127 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-nzdxf"
2021-07-23T01:40:07.9551926Z I0723 01:33:04.507713 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-q82wm"
2021-07-23T01:40:07.9555700Z I0723 01:33:04.994086 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-agent-684b95b94c to 1"
2021-07-23T01:40:07.9560302Z I0723 01:33:05.039867 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent-684b95b94c" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-agent-684b95b94c-dc6kb"
2021-07-23T01:40:07.9564647Z I0723 01:33:06.017754 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-coredns-86867f4988 to 2"
2021-07-23T01:40:07.9568906Z I0723 01:33:06.185698 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-86867f4988" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-86867f4988-7wrgk"
2021-07-23T01:40:07.9573376Z I0723 01:33:06.412123 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-86867f4988" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-86867f4988-w8mtb"
2021-07-23T01:40:07.9576240Z I0723 01:33:17.026431 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for gateways.submariner.io
2021-07-23T01:40:07.9578164Z I0723 01:33:17.026484 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceimports.multicluster.x-k8s.io
2021-07-23T01:40:07.9579808Z I0723 01:33:17.026511 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpoints.submariner.io
2021-07-23T01:40:07.9581196Z I0723 01:33:17.030260 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for clusters.submariner.io
2021-07-23T01:40:07.9583075Z I0723 01:33:17.030296 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceexports.multicluster.x-k8s.io
2021-07-23T01:40:07.9584452Z I0723 01:33:17.030352 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-23T01:40:07.9585495Z I0723 01:33:18.227851 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-23T01:40:07.9586420Z I0723 01:33:18.528827 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-23T01:40:07.9587285Z I0723 01:33:18.530436 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-23T01:40:07.9589166Z I0723 01:34:04.515856 1 event.go:291] "Event occurred" object="default/nginx-demo" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set nginx-demo-b8f8b4fc6 to 2"
2021-07-23T01:40:07.9591741Z I0723 01:34:04.553425 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-ct55c"
2021-07-23T01:40:07.9594503Z I0723 01:34:04.606847 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-d2rms"
2021-07-23T01:40:07.9598493Z I0723 01:34:04.799903 1 event.go:291] "Event occurred" object="default/nginx-demo-cluster1" kind="EndpointSlice" apiVersion="discovery.k8s.io/v1beta1" type="Warning" reason="OwnerRefInvalidNamespace" message="ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 719888ef-3013-40d8-8a00-26455c361970] does not exist in namespace \"default\""
2021-07-23T01:40:07.9602553Z I0723 01:35:50.796809 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-operator-5bfdb87494 to 1"
2021-07-23T01:40:07.9606005Z I0723 01:35:50.822978 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator-5bfdb87494" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-operator-5bfdb87494-j6drp"
2021-07-23T01:40:07.9609439Z I0723 01:35:52.545819 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set submariner-operator-586cb56578 to 0"
2021-07-23T01:40:07.9612830Z I0723 01:35:52.647516 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator-586cb56578" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: submariner-operator-586cb56578-jdrkc"
2021-07-23T01:40:07.9622227Z E0723 01:36:01.651913 1 garbagecollector.go:350] error syncing item &garbagecollector.node{identity:garbagecollector.objectReference{OwnerReference:v1.OwnerReference{APIVersion:"v1", Kind:"Pod", Name:"submariner-routeagent-cz655", UID:"c27268a3-4c2b-4212-a913-51a4bb084de9", Controller:(*bool)(nil), BlockOwnerDeletion:(*bool)(nil)}, Namespace:"submariner-operator"}, dependentsLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:1, readerWait:0}, dependents:map[*garbagecollector.node]struct {}{}, deletingDependents:false, deletingDependentsLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, beingDeleted:true, beingDeletedLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, virtual:false, virtualLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, owners:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"DaemonSet", Name:"submariner-routeagent", UID:"79468337-f973-4261-8747-ac64a8577722", Controller:(*bool)(0xc0011eabf0), BlockOwnerDeletion:(*bool)(0xc0011eabf1)}}}: pods "submariner-routeagent-cz655" not found
2021-07-23T01:40:07.9633670Z I0723 01:36:03.587664 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent-metrics" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint submariner-operator/submariner-lighthouse-agent-metrics: Operation cannot be fulfilled on endpoints \"submariner-lighthouse-agent-metrics\": the object has been modified; please apply your changes to the latest version and try again"
2021-07-23T01:40:07.9638421Z I0723 01:36:16.784017 1 event.go:291] "Event occurred" object="submariner-operator/submariner-gateway" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-gateway-r5kdz"
2021-07-23T01:40:07.9641404Z I0723 01:36:17.684024 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-25l5c"
2021-07-23T01:40:07.9644583Z I0723 01:36:18.146780 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-8bh95"
2021-07-23T01:40:07.9647653Z I0723 01:36:18.157616 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-r4gss"
2021-07-23T01:40:07.9651099Z I0723 01:36:18.502767 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-agent-68bcd78fd5 to 1"
2021-07-23T01:40:07.9657154Z I0723 01:36:18.743985 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent-68bcd78fd5" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-agent-68bcd78fd5-wmhxl"
2021-07-23T01:40:07.9662167Z I0723 01:36:19.375984 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-coredns-68766559c4 to 2"
2021-07-23T01:40:07.9667985Z I0723 01:36:19.511573 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-68766559c4" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-68766559c4-x77zk"
2021-07-23T01:40:07.9672729Z I0723 01:36:19.767299 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-68766559c4" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-68766559c4-g4wgh"
2021-07-23T01:40:07.9678260Z I0723 01:36:20.027066 1 event.go:291] "Event occurred" object="submariner-lighthouse-coredns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToCreateEndpoint" message="Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints \"submariner-lighthouse-coredns\" already exists"
2021-07-23T01:40:07.9681830Z I0723 01:36:22.162392 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for globalingressips.submariner.io
2021-07-23T01:40:07.9683467Z I0723 01:36:22.162463 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for globalegressips.submariner.io
2021-07-23T01:40:07.9686076Z I0723 01:36:22.162499 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-23T01:40:07.9687015Z I0723 01:36:23.128353 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-23T01:40:07.9687919Z I0723 01:36:23.743409 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-23T01:40:07.9688807Z I0723 01:36:23.765722 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-23T01:40:07.9690772Z I0723 01:36:50.049869 1 event.go:291] "Event occurred" object="default/nginx-demo" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set nginx-demo-b8f8b4fc6 to 2"
2021-07-23T01:40:07.9693356Z I0723 01:36:50.079372 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-6pk9n"
2021-07-23T01:40:07.9696043Z I0723 01:36:50.102305 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-kxvdm"
2021-07-23T01:40:07.9698189Z [submariner-operator]$ [cluster1] print_section * Submariner-operator pod logs for cluster1 *
2021-07-23T01:40:07.9699864Z [submariner-operator]$ [cluster1] print_section * Submariner-operator pod logs for cluster1 *
2021-07-23T01:40:07.9701339Z [submariner-operator]$ [cluster1] print_pods_logs submariner-operator
2021-07-23T01:40:07.9702701Z [submariner-operator]$ [cluster1] print_pods_logs submariner-operator
2021-07-23T01:40:07.9704220Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-23T01:40:07.9705977Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-23T01:40:07.9708044Z [submariner-operator]$ [cluster1] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:07.9711885Z [submariner-operator]$ [cluster1] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:07.9714159Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-23T01:40:07.9715295Z ====================================================================
2021-07-23T01:40:07.9716124Z ##[endgroup]
2021-07-23T01:40:07.9717202Z ##[group]* Submariner-operator pod logs for cluster1 *
2021-07-23T01:40:07.9718569Z ======================= * Submariner-operator pod logs for cluster1 * =======================
2021-07-23T01:40:07.9719225Z ====================================================================
2021-07-23T01:40:07.9726700Z ##[endgroup]
2021-07-23T01:40:07.9742211Z ##[group]** Pods logs for NS submariner-operator using selector '' **
2021-07-23T01:40:07.9743648Z ======================= ** Pods logs for NS submariner-operator using selector '' ** =======================
2021-07-23T01:40:08.1554601Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-gateway-r5kdz -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:08.1583218Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-gateway-r5kdz -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:08.1599646Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-gateway-r5kdz -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:08.4576838Z [submariner-operator]$ [cluster1] print_section *** submariner-gateway-r5kdz ***
2021-07-23T01:40:08.4589428Z [submariner-operator]$ [cluster1] print_section *** submariner-gateway-r5kdz ***
2021-07-23T01:40:08.4596322Z ====================================================================
2021-07-23T01:40:08.4597148Z ##[endgroup]
2021-07-23T01:40:08.4598489Z ##[group]*** submariner-gateway-r5kdz ***
2021-07-23T01:40:08.4599553Z ======================= *** submariner-gateway-r5kdz *** =======================
2021-07-23T01:40:08.4613189Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-gateway-r5kdz
2021-07-23T01:40:08.4626631Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-gateway-r5kdz
2021-07-23T01:40:08.4642362Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-gateway-r5kdz
2021-07-23T01:40:08.7747164Z + trap 'exit 1' SIGTERM SIGINT
2021-07-23T01:40:08.7766039Z + export CHARON_PID_FILE=/var/run/charon.pid
2021-07-23T01:40:08.7766821Z + CHARON_PID_FILE=/var/run/charon.pid
2021-07-23T01:40:08.7767775Z + rm -f /var/run/charon.pid
2021-07-23T01:40:08.7768301Z + SUBMARINER_VERBOSITY=2
2021-07-23T01:40:08.7768918Z + '[' false == true ']'
2021-07-23T01:40:08.7769460Z + DEBUG=-v=2
2021-07-23T01:40:08.7769979Z ++ cat /proc/sys/net/ipv4/conf/all/send_redirects
2021-07-23T01:40:08.7770479Z + [[ 0 = 0 ]]
2021-07-23T01:40:08.7771239Z + exec submariner-gateway -v=2 -alsologtostderr
2021-07-23T01:40:08.7772310Z I0723 01:36:27.193992 1 main.go:93] Starting the submariner gateway engine
2021-07-23T01:40:08.7773719Z W0723 01:36:27.196132 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:08.7774775Z I0723 01:36:27.202180 1 main.go:121] Creating the cable engine
2021-07-23T01:40:08.7775680Z I0723 01:36:27.750116 1 local_endpoint.go:211] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:08.7776477Z I0723 01:36:27.750262 1 local_endpoint.go:211] Interface "weave" has "10.1.0.1" address
2021-07-23T01:40:08.7777419Z I0723 01:36:27.750269 1 local_endpoint.go:216] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:08.7778402Z I0723 01:36:27.750301 1 natdiscovery.go:116] NAT discovery server starting on port 4490
2021-07-23T01:40:08.7779235Z I0723 01:36:28.224071 1 syncer.go:84] CableEngine syncer started
2021-07-23T01:40:08.7780383Z I0723 01:36:28.234762 1 main.go:323] Gateway leader election config values: main.leaderConfig{LeaseDuration:10, RenewDeadline:5, RetryPeriod:2}
2021-07-23T01:40:08.7781977Z I0723 01:36:28.234920 1 main.go:340] Using namespace "submariner-operator" for the leader election lock
2021-07-23T01:40:08.7783662Z I0723 01:36:28.234933 1 leaderelection.go:243] attempting to acquire leader lease submariner-operator/submariner-gateway-lock...
2021-07-23T01:40:08.7785734Z I0723 01:36:28.259280 1 leaderelection.go:253] successfully acquired lease submariner-operator/submariner-gateway-lock
2021-07-23T01:40:08.7786894Z I0723 01:36:28.259385 1 main.go:189] Creating the datastore syncer
2021-07-23T01:40:08.7787602Z I0723 01:36:28.259440 1 libreswan.go:98] Using NATT UDP port 4500
2021-07-23T01:40:08.7788272Z I0723 01:36:28.259504 1 libreswan.go:525] Starting Pluto
2021-07-23T01:40:08.7791080Z I0723 01:36:28.260387 1 event.go:282] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"submariner-operator", Name:"submariner-gateway-lock", UID:"5c5efdb1-d998-4712-8e16-301470af7c7f", APIVersion:"v1", ResourceVersion:"2449", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster1-worker-submariner-gateway became leader
2021-07-23T01:40:08.7793549Z /usr/libexec/ipsec/_stackmanager: line 111: pidof: command not found
2021-07-23T01:40:08.7794247Z Initializing NSS database
2021-07-23T01:40:08.7794606Z
2021-07-23T01:40:08.7795111Z /usr/sbin/ipsec: line 175: iptables: command not found
2021-07-23T01:40:08.7795737Z nflog ipsec capture disabled
2021-07-23T01:40:08.7796555Z I0723 01:36:31.273201 1 cableengine.go:96] CableEngine controller started, driver: "libreswan"
2021-07-23T01:40:08.7797444Z I0723 01:36:31.273520 1 tunnel.go:37] Starting the tunnel controller
2021-07-23T01:40:08.7798276Z I0723 01:36:31.273716 1 datastoresyncer.go:66] Starting the datastore syncer
2021-07-23T01:40:08.7799473Z I0723 01:36:31.373690 1 healthchecker.go:108] CableEngine HealthChecker started with PingInterval: 1, MaxPacketLossCount: 5
2021-07-23T01:40:08.7800587Z I0723 01:36:31.374148 1 pinger.go:81] Starting pinger for IP "10.2.0.1"
2021-07-23T01:40:08.7802419Z I0723 01:36:31.374172 1 healthchecker.go:158] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster2-172-18-0-8" with HealthCheckIP "10.2.0.1"
2021-07-23T01:40:08.7803805Z 002 listening for IKE messages
2021-07-23T01:40:08.7804332Z 002 forgetting secrets
2021-07-23T01:40:08.7805029Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-23T01:40:08.7805775Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-23T01:40:08.7807054Z 002 "submariner-cable-cluster2-172-18-0-8-0-0": added IKEv2 connection
2021-07-23T01:40:08.7815471Z I0723 01:36:31.626447 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"ee2569c9-accf-442f-8a6b-edeaa6cf4811", ResourceVersion:"1613", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600822, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000028e58), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000028e70)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-23T01:40:08.7821912Z I0723 01:36:31.626530 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.7842121Z I0723 01:36:31.626603 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"65194722-b5ac-4fb1-9538-a91d6a44fdc7", ResourceVersion:"1646", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600832, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000029218), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000029278)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-23T01:40:08.7850316Z I0723 01:36:31.626651 1 remote_endpoint.go:129] using NAT legacy settings for endpoint "submariner-cable-cluster2-172-18-0-8", using private IP "172.18.0.8"
2021-07-23T01:40:08.7852319Z I0723 01:36:31.626672 1 cableengine.go:190] Installing Endpoint cable "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.7859481Z I0723 01:36:31.639274 1 libreswan.go:309] Creating connection(s) for {"metadata":{"name":"cluster2-submariner-cable-cluster2-172-18-0-8","namespace":"submariner-operator","uid":"65194722-b5ac-4fb1-9538-a91d6a44fdc7","resourceVersion":"1646","generation":1,"creationTimestamp":"2021-07-23T01:33:52Z","labels":{"submariner-io/clusterID":"cluster2"},"managedFields":[{"manager":"submariner-gateway","operation":"Update","apiVersion":"submariner.io/v1","time":"2021-07-23T01:33:52Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:submariner-io/clusterID":{}}},"f:spec":{".":{},"f:backend":{},"f:backend_config":{".":{},"f:preferred-server":{}},"f:cable_name":{},"f:cluster_id":{},"f:healthCheckIP":{},"f:hostname":{},"f:nat_enabled":{},"f:private_ip":{},"f:public_ip":{},"f:subnets":{}}}}]},"spec":{"cluster_id":"cluster2","cable_name":"submariner-cable-cluster2-172-18-0-8","healthCheckIP":"10.2.0.1","hostname":"cluster2-worker","subnets":["100.2.0.0/16","10.2.0.0/16"],"private_ip":"172.18.0.8","public_ip":"104.208.158.205","nat_enabled":false,"backend":"libreswan","backend_config":{"preferred-server":"false"}}} in bi-directional mode
2021-07-23T01:40:08.7866313Z I0723 01:36:31.639436 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-0-0 --id 172.18.0.7 --host 172.18.0.7 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 100.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.7867986Z I0723 01:36:31.723016 1 datastoresyncer.go:88] Starting the broker syncer
2021-07-23T01:40:08.7868986Z I0723 01:36:31.933337 1 datastoresyncer.go:141] Ensuring we are the only endpoint active for this cluster
2021-07-23T01:40:08.7871020Z I0723 01:36:31.962484 1 datastoresyncer.go:169] Successfully deleted existing submariner Endpoint "cluster1-submariner-cable-cluster1-172-18-0-7"
2021-07-23T01:40:08.7873489Z I0723 01:36:31.962510 1 datastoresyncer.go:220] Creating local submariner Cluster: types.SubmarinerCluster{ID:"cluster1", Spec:v1.ClusterSpec{ClusterID:"cluster1", ColorCodes:[]string{"blue"}, ServiceCIDR:[]string{"100.1.0.0/16"}, ClusterCIDR:[]string{"10.1.0.0/16"}, GlobalCIDR:[]string{}}}
2021-07-23T01:40:08.7888548Z I0723 01:36:31.985641 1 tunnel.go:88] Tunnel controller processing removed submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"ee2569c9-accf-442f-8a6b-edeaa6cf4811", ResourceVersion:"2469", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600822, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0003448d0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0003448e8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-23T01:40:08.7906675Z I0723 01:36:31.985717 1 cableengine.go:226] Cables are not added/removed for the local cluster, skipping removal
2021-07-23T01:40:08.7908719Z I0723 01:36:31.985723 1 tunnel.go:95] Tunnel controller successfully removed Endpoint cable submariner-cable-cluster1-172-18-0-7 from the engine
2021-07-23T01:40:08.7910640Z 181 "submariner-cable-cluster2-172-18-0-8-0-0" #1: initiating IKEv2 connection
2021-07-23T01:40:08.7913082Z I0723 01:36:32.000440 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-0-1 --id 172.18.0.7 --host 172.18.0.7 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 10.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.7918684Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-agent-68bcd78fd5-wmhxl -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:08.7921941Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-agent-68bcd78fd5-wmhxl -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:08.7924334Z 002 "submariner-cable-cluster2-172-18-0-8-0-1": added IKEv2 connection
2021-07-23T01:40:08.7928328Z I0723 01:36:32.044038 1 datastoresyncer.go:233] Creating local submariner Endpoint: types.SubmarinerEndpoint{Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.7931220Z I0723 01:36:32.116583 1 datastoresyncer.go:115] Datastore syncer started
2021-07-23T01:40:08.7950519Z I0723 01:36:32.122362 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00059ce70), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00059ce88)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.7958434Z I0723 01:36:32.122443 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.7960940Z 000 "submariner-cable-cluster2-172-18-0-8-0-1": queuing pending IPsec SA negotiating with 172.18.0.8 IKE SA #1 "submariner-cable-cluster2-172-18-0-8-0-0"
2021-07-23T01:40:08.7963208Z 002 "submariner-cable-cluster2-172-18-0-8-1-0": added IKEv2 connection
2021-07-23T01:40:08.7965523Z 000 "submariner-cable-cluster2-172-18-0-8-1-0": queuing pending IPsec SA negotiating with 172.18.0.8 IKE SA #1 "submariner-cable-cluster2-172-18-0-8-0-0"
2021-07-23T01:40:08.7970136Z I0723 01:36:32.411808 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-1-0 --id 172.18.0.7 --host 172.18.0.7 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 100.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.7974159Z I0723 01:36:32.421090 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-1-1 --id 172.18.0.7 --host 172.18.0.7 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 10.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.7976315Z 002 "submariner-cable-cluster2-172-18-0-8-1-1": added IKEv2 connection
2021-07-23T01:40:08.8026263Z 000 "submariner-cable-cluster2-172-18-0-8-1-1": queuing pending IPsec SA negotiating with 172.18.0.8 IKE SA #1 "submariner-cable-cluster2-172-18-0-8-0-0"
2021-07-23T01:40:08.8029107Z I0723 01:36:32.442589 1 cableengine.go:197] Successfully installed Endpoint cable "submariner-cable-cluster2-172-18-0-8" with remote IP 172.18.0.8
2021-07-23T01:40:08.8031414Z I0723 01:36:33.313737 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-8-0-0" not found in active connections obtained from whack: map[], map[]
2021-07-23T01:40:08.8033738Z I0723 01:36:33.313761 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-8-0-1" not found in active connections obtained from whack: map[], map[]
2021-07-23T01:40:08.8036215Z I0723 01:36:33.313769 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-8-1-0" not found in active connections obtained from whack: map[], map[]
2021-07-23T01:40:08.8038558Z I0723 01:36:33.313777 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-8-1-1" not found in active connections obtained from whack: map[], map[]
2021-07-23T01:40:08.8040989Z I0723 01:36:33.313814 1 libreswan.go:229] Connection "submariner-cable-cluster2-172-18-0-8" not found in active connections obtained from whack: map[], map[]
2021-07-23T01:40:08.8050261Z I0723 01:36:35.992710 1 tunnel.go:88] Tunnel controller processing removed submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"65194722-b5ac-4fb1-9538-a91d6a44fdc7", ResourceVersion:"2517", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600832, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00056e4f8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00056e510)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-23T01:40:08.8057868Z I0723 01:36:35.993184 1 cableengine.go:230] Removing Endpoint cable "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.8060278Z I0723 01:36:35.993239 1 libreswan.go:477] Deleting connection to {{cluster2 submariner-cable-cluster2-172-18-0-8 10.2.0.1 cluster2-worker [100.2.0.0/16 10.2.0.0/16] 172.18.0.8 104.208.158.205 false libreswan map[preferred-server:false]}}
2021-07-23T01:40:08.8062588Z I0723 01:36:35.993398 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-8-0-0]
2021-07-23T01:40:08.8063887Z I0723 01:36:36.030161 1 pinger.go:81] Starting pinger for IP "10.2.0.1"
2021-07-23T01:40:08.8065935Z I0723 01:36:36.031623 1 healthchecker.go:158] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster2-172-18-0-8" with HealthCheckIP "10.2.0.1"
2021-07-23T01:40:08.8068088Z 002 "submariner-cable-cluster2-172-18-0-8-0-0": terminating SAs using this connection
2021-07-23T01:40:08.8070053Z 002 "submariner-cable-cluster2-172-18-0-8-0-0" #1: deleting state (STATE_PARENT_I1) aged 4.049059s and NOT sending notification
2021-07-23T01:40:08.8072053Z I0723 01:36:36.072296 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-8-0-1]
2021-07-23T01:40:08.8073912Z 002 "submariner-cable-cluster2-172-18-0-8-0-1": terminating SAs using this connection
2021-07-23T01:40:08.8075777Z I0723 01:36:36.089544 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-8-1-0]
2021-07-23T01:40:08.8077634Z 002 "submariner-cable-cluster2-172-18-0-8-1-0": terminating SAs using this connection
2021-07-23T01:40:08.8079513Z I0723 01:36:36.183266 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-8-1-1]
2021-07-23T01:40:08.8081355Z 002 "submariner-cable-cluster2-172-18-0-8-1-1": terminating SAs using this connection
2021-07-23T01:40:08.8083260Z I0723 01:36:36.235116 1 cableengine.go:250] Successfully removed Endpoint cable "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.8085347Z I0723 01:36:36.235247 1 tunnel.go:95] Tunnel controller successfully removed Endpoint cable submariner-cable-cluster2-172-18-0-8 from the engine
2021-07-23T01:40:08.8094967Z I0723 01:36:36.235473 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00056ea20), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00056ea50)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8102846Z I0723 01:36:36.235641 1 natdiscovery.go:158] Starting NAT discovery for endpoint "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.8116949Z I0723 01:36:36.354534 1 request_handle.go:54] Received request from 172.18.0.8:4490 - REQUEST_NUMBER: 0x5f9fab3c24895973, SENDER: "submariner-cable-cluster2-172-18-0-8", RECEIVER: "submariner-cable-cluster1-172-18-0-7"
2021-07-23T01:40:08.8120655Z I0723 01:36:36.354603 1 request_handle.go:118] Sending response to 172.18.0.8:4490 - REQUEST_NUMBER: 0x5f9fab3c24895973, RESPONSE: OK, SENDER: "submariner-cable-cluster1-172-18-0-7", RECEIVER: "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.8123727Z I0723 01:36:36.788007 1 request_send.go:118] Sending request - REQUEST_NUMBER: 0x2a0f246e39f631a4, SENDER: "submariner-cable-cluster1-172-18-0-7", RECEIVER: "submariner-cable-cluster2-172-18-0-8", USING_SRC: 172.18.0.7:4490, USING_DST: 172.18.0.8:4490
2021-07-23T01:40:08.8126938Z I0723 01:36:36.788144 1 request_send.go:118] Sending request - REQUEST_NUMBER: 0x2a0f246e39f631a5, SENDER: "submariner-cable-cluster1-172-18-0-7", RECEIVER: "submariner-cable-cluster2-172-18-0-8", USING_SRC: 172.18.0.7:4490, USING_DST: 104.208.158.205:4490
2021-07-23T01:40:08.8130002Z I0723 01:36:36.788662 1 response_handle.go:33] Received response from 172.18.0.8:4490 - REQUEST_NUMBER: 0x2a0f246e39f631a4, RESPONSE: OK, SENDER: "submariner-cable-cluster2-172-18-0-8", RECEIVER: "submariner-cable-cluster1-172-18-0-7"
2021-07-23T01:40:08.8132651Z I0723 01:36:36.788693 1 remote_endpoint.go:180] selected private IP "172.18.0.8" for endpoint "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.8134671Z I0723 01:36:36.788711 1 cableengine.go:190] Installing Endpoint cable "submariner-cable-cluster2-172-18-0-8"
2021-07-23T01:40:08.8135762Z 002 listening for IKE messages
2021-07-23T01:40:08.8136298Z 002 forgetting secrets
2021-07-23T01:40:08.8136901Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-23T01:40:08.8137714Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-23T01:40:08.8145055Z I0723 01:36:36.790178 1 libreswan.go:309] Creating connection(s) for {"metadata":{"name":"cluster2-submariner-cable-cluster2-172-18-0-8","namespace":"submariner-operator","uid":"188cdecc-1d2d-4f85-943d-f176eede618f","resourceVersion":"2519","generation":1,"creationTimestamp":"2021-07-23T01:36:36Z","labels":{"submariner-io/clusterID":"cluster2"},"managedFields":[{"manager":"submariner-gateway","operation":"Update","apiVersion":"submariner.io/v1","time":"2021-07-23T01:36:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:submariner-io/clusterID":{}}},"f:spec":{".":{},"f:backend":{},"f:backend_config":{".":{},"f:natt-discovery-port":{},"f:preferred-server":{}},"f:cable_name":{},"f:cluster_id":{},"f:healthCheckIP":{},"f:hostname":{},"f:nat_enabled":{},"f:private_ip":{},"f:public_ip":{},"f:subnets":{}}}}]},"spec":{"cluster_id":"cluster2","cable_name":"submariner-cable-cluster2-172-18-0-8","healthCheckIP":"10.2.0.1","hostname":"cluster2-worker","subnets":["100.2.0.0/16","10.2.0.0/16"],"private_ip":"172.18.0.8","public_ip":"104.208.158.205","nat_enabled":false,"backend":"libreswan","backend_config":{"natt-discovery-port":"4490","preferred-server":"false"}}} in bi-directional mode
2021-07-23T01:40:08.8152135Z I0723 01:36:36.790252 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-0-0 --id 172.18.0.7 --host 172.18.0.7 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 100.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.8154290Z 002 "submariner-cable-cluster2-172-18-0-8-0-0": added IKEv2 connection
2021-07-23T01:40:08.8155980Z 181 "submariner-cable-cluster2-172-18-0-8-0-0" #4: initiating IKEv2 connection
2021-07-23T01:40:08.8158426Z I0723 01:36:36.829185 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-0-1 --id 172.18.0.7 --host 172.18.0.7 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 10.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.8160561Z 002 "submariner-cable-cluster2-172-18-0-8-0-1": added IKEv2 connection
2021-07-23T01:40:08.8162874Z 000 "submariner-cable-cluster2-172-18-0-8-0-1": queuing pending IPsec SA negotiating with 172.18.0.8 IKE SA #4 "submariner-cable-cluster2-172-18-0-8-0-0"
2021-07-23T01:40:08.8165751Z I0723 01:36:36.869999 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-1-0 --id 172.18.0.7 --host 172.18.0.7 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 100.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.8167718Z 002 "submariner-cable-cluster2-172-18-0-8-1-0": added IKEv2 connection
2021-07-23T01:40:08.8169861Z 000 "submariner-cable-cluster2-172-18-0-8-1-0": queuing pending IPsec SA negotiating with 172.18.0.8 IKE SA #4 "submariner-cable-cluster2-172-18-0-8-0-0"
2021-07-23T01:40:08.8172673Z I0723 01:36:36.877845 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-8-1-1 --id 172.18.0.7 --host 172.18.0.7 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.8 --host 172.18.0.8 --client 10.2.0.0/16 --ikeport 4500]
2021-07-23T01:40:08.8174635Z 002 "submariner-cable-cluster2-172-18-0-8-1-1": added IKEv2 connection
2021-07-23T01:40:08.8176781Z 000 "submariner-cable-cluster2-172-18-0-8-1-1": queuing pending IPsec SA negotiating with 172.18.0.8 IKE SA #4 "submariner-cable-cluster2-172-18-0-8-0-0"
2021-07-23T01:40:08.8179125Z I0723 01:36:36.881907 1 cableengine.go:197] Successfully installed Endpoint cable "submariner-cable-cluster2-172-18-0-8" with remote IP 172.18.0.8
2021-07-23T01:40:08.8191961Z I0723 01:37:01.565146 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0001229d8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0001229f0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8199129Z I0723 01:37:01.565224 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8208036Z I0723 01:37:01.565297 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000122dc8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000122de0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8216119Z I0723 01:37:01.565370 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8218753Z I0723 01:37:01.565390 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8229371Z I0723 01:37:31.566208 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00056e5d0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00056e5e8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8236487Z I0723 01:37:31.566270 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8245946Z I0723 01:37:31.566356 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00056e990), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00056e9a8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8254861Z I0723 01:37:31.566440 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8257731Z I0723 01:37:31.566461 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8267613Z I0723 01:38:01.566699 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0000be0d8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0000be0f0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8275118Z I0723 01:38:01.566770 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8285764Z I0723 01:38:01.566855 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0000be468), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0000be480)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8294542Z I0723 01:38:01.566948 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8297401Z I0723 01:38:01.566964 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8307297Z I0723 01:38:31.567597 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00059cb28), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00059cb40)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8314558Z I0723 01:38:31.567662 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8323500Z I0723 01:38:31.567740 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00059ce88), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00059cea0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8331715Z I0723 01:38:31.567797 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8334674Z I0723 01:38:31.567825 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8344393Z I0723 01:39:01.567879 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000029d70), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000029da0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8352149Z I0723 01:39:01.567950 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8362001Z I0723 01:39:01.568021 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0003122e8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000312318)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8370430Z I0723 01:39:01.568084 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8373301Z I0723 01:39:01.568105 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8383050Z I0723 01:39:31.568113 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0003aa690), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0003aa6a8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8390843Z I0723 01:39:31.568193 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8399741Z I0723 01:39:31.568264 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0003aaa08), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0003aaa20)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8408068Z I0723 01:39:31.568313 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8410932Z I0723 01:39:31.568349 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8423163Z I0723 01:40:01.568478 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"d3eee00a-71c6-4eda-bd0b-588e128bb624", ResourceVersion:"2471", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600992, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00056e7e0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00056e7f8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8429862Z I0723 01:40:01.568546 1 cableengine.go:206] Not installing cable for local cluster
2021-07-23T01:40:08.8480809Z I0723 01:40:01.568637 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-8", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"188cdecc-1d2d-4f85-943d-f176eede618f", ResourceVersion:"2519", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762600996, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00056eb88), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00056eba0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-23T01:40:08.8489329Z I0723 01:40:01.568707 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-8" with timestamp "2021-07-23 01:36:36 +0000 UTC" that belongs to this cluster cluster2
2021-07-23T01:40:08.8492214Z I0723 01:40:01.568729 1 cableengine.go:172] Connection info (IP: 172.18.0.8, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-8" is unchanged - not re-installing
2021-07-23T01:40:08.8495892Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-agent-68bcd78fd5-wmhxl -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:09.1289428Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-agent-68bcd78fd5-wmhxl ***
2021-07-23T01:40:09.1306989Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-agent-68bcd78fd5-wmhxl ***
2021-07-23T01:40:09.1315665Z ====================================================================
2021-07-23T01:40:09.1317623Z ##[endgroup]
2021-07-23T01:40:09.1319212Z ##[group]*** submariner-lighthouse-agent-68bcd78fd5-wmhxl ***
2021-07-23T01:40:09.1321027Z ======================= *** submariner-lighthouse-agent-68bcd78fd5-wmhxl *** =======================
2021-07-23T01:40:09.1334234Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-agent-68bcd78fd5-wmhxl
2021-07-23T01:40:09.1347794Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-agent-68bcd78fd5-wmhxl
2021-07-23T01:40:09.1363109Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-agent-68bcd78fd5-wmhxl
2021-07-23T01:40:09.4876693Z I0723 01:36:35.395695 1 main.go:70] Arguments: [/usr/local/bin/lighthouse-agent -alsologtostderr -v=2]
2021-07-23T01:40:09.4878121Z I0723 01:36:35.395830 1 main.go:71] AgentSpec: {cluster1 submariner-operator false}
2021-07-23T01:40:09.4879637Z W0723 01:36:35.396015 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:09.4881343Z I0723 01:36:35.435309 1 main.go:98] Starting submariner-lighthouse-agent {cluster1 submariner-operator false}
2021-07-23T01:40:09.4882694Z I0723 01:36:35.491420 1 agent.go:163] Starting Agent controller
2021-07-23T01:40:09.4883398Z I0723 01:36:36.004480 1 agent.go:207] Agent controller started
2021-07-23T01:40:09.4884439Z I0723 01:36:50.178894 1 agent.go:233] ServiceExport default/nginx-demo created
2021-07-23T01:40:09.4886329Z I0723 01:36:50.179014 1 agent.go:387] updateExportedServiceStatus for (default/nginx-demo) - Type: "Valid", Status: "False", Reason: "AwaitingSync", Message: "Awaiting sync of the ServiceImport to the broker"
2021-07-23T01:40:09.4895943Z I0723 01:36:50.249055 1 agent.go:316] Returning ServiceImport: &v1alpha1.ServiceImport{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"nginx-demo-default-cluster1", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"lighthouse.submariner.io/sourceCluster":"cluster1", "lighthouse.submariner.io/sourceName":"nginx-demo", "lighthouse.submariner.io/sourceNamespace":"default"}, Annotations:map[string]string{"cluster-ip":"100.1.223.109", "origin-name":"nginx-demo", "origin-namespace":"default"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1alpha1.ServiceImportSpec{Ports:[]v1alpha1.ServicePort{v1alpha1.ServicePort{Name:"", Protocol:"TCP", AppProtocol:(*string)(nil), Port:80}}, IPs:[]string{"100.1.223.109"}, Type:"ClusterSetIP", SessionAffinity:"", SessionAffinityConfig:(*v1.SessionAffinityConfig)(0xc0003704a0)}, Status:v1alpha1.ServiceImportStatus{Clusters:[]v1alpha1.ClusterStatus{v1alpha1.ClusterStatus{Cluster:"cluster1"}}}}
2021-07-23T01:40:09.4904041Z I0723 01:36:50.264010 1 agent.go:387] updateExportedServiceStatus for (default/nginx-demo) - Type: "Valid", Status: "True", Reason: "", Message: "Service was successfully synced to the broker"
2021-07-23T01:40:09.4906932Z I0723 01:36:50.269856 1 serviceimport.go:160] ServiceImport "submariner-operator/nginx-demo-default-cluster1" created
2021-07-23T01:40:09.4908546Z I0723 01:36:50.270177 1 endpoint.go:46] Starting Endpoints controller for service default/nginx-demo
2021-07-23T01:40:09.4909759Z I0723 01:36:50.338777 1 agent.go:233] ServiceExport default/nginx-demo updated
2021-07-23T01:40:09.4910861Z I0723 01:36:50.359385 1 agent.go:233] ServiceExport default/nginx-demo updated
2021-07-23T01:40:09.4911945Z I0723 01:36:50.371011 1 endpoint.go:126] Endpoints default/nginx-demo created
2021-07-23T01:40:09.4919397Z I0723 01:36:50.371165 1 endpoint.go:179] Returning EndpointSlice: &v1beta1.EndpointSlice{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"nginx-demo-cluster1", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"endpointslice.kubernetes.io/managed-by":"lighthouse-agent.submariner.io", "lighthouse.submariner.io/sourceCluster":"cluster1", "lighthouse.submariner.io/sourceName":"nginx-demo", "lighthouse.submariner.io/sourceNamespace":"default", "multicluster.kubernetes.io/service-name":"nginx-demo-default-cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, AddressType:"IPv4", Endpoints:[]v1beta1.Endpoint(nil), Ports:[]v1beta1.EndpointPort(nil)}
2021-07-23T01:40:09.4984575Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-g4wgh -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:09.5008305Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-g4wgh -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:09.5025884Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-g4wgh -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:09.8198572Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-g4wgh ***
2021-07-23T01:40:09.8212507Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-g4wgh ***
2021-07-23T01:40:09.8217760Z ====================================================================
2021-07-23T01:40:09.8222560Z ##[endgroup]
2021-07-23T01:40:09.8228657Z ##[group]*** submariner-lighthouse-coredns-68766559c4-g4wgh ***
2021-07-23T01:40:09.8235038Z ======================= *** submariner-lighthouse-coredns-68766559c4-g4wgh *** =======================
2021-07-23T01:40:09.8248644Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-g4wgh
2021-07-23T01:40:09.8263630Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-g4wgh
2021-07-23T01:40:09.8281481Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-g4wgh
2021-07-23T01:40:10.1803160Z W0723 01:36:35.990715 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:10.1804457Z I0723 01:36:35.992901 1 controller.go:65] Starting ServiceImport Controller
2021-07-23T01:40:10.1805389Z I0723 01:36:36.095869 1 controller.go:69] Starting EndpointSlice Controller
2021-07-23T01:40:10.1806344Z I0723 01:36:36.096726 1 controller.go:69] Setting localClusterID from env: "cluster1"
2021-07-23T01:40:10.1807280Z I0723 01:36:36.144997 1 controller.go:97] Starting Gateway status Controller
2021-07-23T01:40:10.1808400Z I0723 01:36:36.246051 1 controller.go:56] Starting Services Controller
2021-07-23T01:40:10.1809079Z clusterset.local.:53
2021-07-23T01:40:10.1809793Z CoreDNS-1.8.3
2021-07-23T01:40:10.1810236Z linux/amd64, go1.16.5,
2021-07-23T01:40:10.1811005Z I0723 01:36:36.247907 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true}
2021-07-23T01:40:10.1812080Z I0723 01:36:38.371970 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true}
2021-07-23T01:40:10.1871888Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-x77zk -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:10.1888569Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-x77zk -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:10.1906615Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-x77zk -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:10.4859782Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-x77zk ***
2021-07-23T01:40:10.4877355Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-x77zk ***
2021-07-23T01:40:10.4878878Z ====================================================================
2021-07-23T01:40:10.4884311Z ##[endgroup]
2021-07-23T01:40:10.4890186Z ##[group]*** submariner-lighthouse-coredns-68766559c4-x77zk ***
2021-07-23T01:40:10.4892196Z ======================= *** submariner-lighthouse-coredns-68766559c4-x77zk *** =======================
2021-07-23T01:40:10.4903484Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-x77zk
2021-07-23T01:40:10.4922123Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-x77zk
2021-07-23T01:40:10.4940839Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-x77zk
2021-07-23T01:40:10.8075041Z W0723 01:36:32.519680 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:10.8076364Z I0723 01:36:32.520202 1 controller.go:65] Starting ServiceImport Controller
2021-07-23T01:40:10.8077418Z I0723 01:36:32.621141 1 controller.go:69] Starting EndpointSlice Controller
2021-07-23T01:40:10.8078361Z I0723 01:36:32.622134 1 controller.go:69] Setting localClusterID from env: "cluster1"
2021-07-23T01:40:10.8079280Z I0723 01:36:32.662875 1 controller.go:97] Starting Gateway status Controller
2021-07-23T01:40:10.8080128Z I0723 01:36:32.766764 1 controller.go:56] Starting Services Controller
2021-07-23T01:40:10.8080839Z clusterset.local.:53
2021-07-23T01:40:10.8081527Z CoreDNS-1.8.3
2021-07-23T01:40:10.8081990Z linux/amd64, go1.16.5,
2021-07-23T01:40:10.8082734Z I0723 01:36:32.779044 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true}
2021-07-23T01:40:10.8083828Z I0723 01:36:38.373903 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true}
2021-07-23T01:40:10.8149254Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-operator-5bfdb87494-j6drp -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:10.8162253Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-operator-5bfdb87494-j6drp -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:10.8175520Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-operator-5bfdb87494-j6drp -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:11.1242192Z [submariner-operator]$ [cluster1] print_section *** submariner-operator-5bfdb87494-j6drp ***
2021-07-23T01:40:11.1258348Z [submariner-operator]$ [cluster1] print_section *** submariner-operator-5bfdb87494-j6drp ***
2021-07-23T01:40:11.1260601Z ====================================================================
2021-07-23T01:40:11.1264633Z ##[endgroup]
2021-07-23T01:40:11.1268990Z ##[group]*** submariner-operator-5bfdb87494-j6drp ***
2021-07-23T01:40:11.1272430Z ======================= *** submariner-operator-5bfdb87494-j6drp *** =======================
2021-07-23T01:40:11.1284208Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-operator-5bfdb87494-j6drp
2021-07-23T01:40:11.1299034Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-operator-5bfdb87494-j6drp
2021-07-23T01:40:11.1315097Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-operator-5bfdb87494-j6drp
2021-07-23T01:40:11.4368784Z I0723 01:35:51.932311 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-23T01:40:11.4372750Z I0723 01:35:51.932363 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-23T01:40:11.4378700Z I0723 01:35:51.932370 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-23T01:40:11.4379919Z I0723 01:35:51.932376 1 main.go:80] cmd "msg"="Submariner operator version: devel-daeaed8"
2021-07-23T01:40:11.4381845Z I0723 01:35:51.932578 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-23T01:40:11.4383366Z I0723 01:35:52.641933 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-jdrkc"
2021-07-23T01:40:11.4386737Z I0723 01:35:52.840140 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-23T01:40:11.4387735Z I0723 01:35:53.972598 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-23T01:40:11.4388538Z I0723 01:35:56.359519 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-23T01:40:11.4391059Z I0723 01:36:01.025189 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-23T01:40:11.4391849Z I0723 01:36:09.730641 1 leader.go:149] leader "msg"="Became the leader."
2021-07-23T01:40:11.4394969Z I0723 01:36:10.333779 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-23T01:40:11.4396145Z I0723 01:36:10.334079 1 main.go:129] cmd "msg"="Registering Components."
2021-07-23T01:40:11.4396936Z I0723 01:36:10.334164 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-23T01:40:11.4399882Z I0723 01:36:14.204901 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4403212Z I0723 01:36:14.204928 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4404466Z I0723 01:36:14.204969 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-23T01:40:11.4407761Z I0723 01:36:14.205182 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-23T01:40:11.4417430Z I0723 01:36:14.205757 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-23T01:40:11.4431409Z I0723 01:36:14.205929 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-23T01:40:11.4438324Z I0723 01:36:14.206053 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-23T01:40:11.4443213Z I0723 01:36:14.206151 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-23T01:40:11.4485383Z I0723 01:36:14.206261 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-23T01:40:11.4487847Z I0723 01:36:14.306627 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4489999Z I0723 01:36:14.306833 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-23T01:40:11.4492326Z I0723 01:36:14.306998 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-23T01:40:11.4494838Z I0723 01:36:14.307069 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-23T01:40:11.4498659Z I0723 01:36:14.310704 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-23T01:40:11.4502938Z I0723 01:36:14.315090 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-23T01:40:11.4506821Z I0723 01:36:14.315237 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-23T01:40:11.4509686Z I0723 01:36:14.415751 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-23T01:40:11.4511732Z I0723 01:36:14.415957 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-23T01:40:11.4514918Z I0723 01:36:14.416142 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-23T01:40:11.4517929Z I0723 01:36:14.420096 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-23T01:40:11.4519911Z I0723 01:36:14.517102 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-23T01:40:11.4521781Z I0723 01:36:14.517154 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-23T01:40:11.4523896Z I0723 01:36:14.521392 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-23T01:40:11.4526868Z E0723 01:36:14.599415 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4530316Z E0723 01:36:14.651096 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4533755Z E0723 01:36:14.703198 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4537166Z E0723 01:36:14.776912 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4540565Z E0723 01:36:14.889329 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4544030Z E0723 01:36:15.058747 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4561832Z E0723 01:36:15.376014 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4579054Z E0723 01:36:15.831600 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4581883Z I0723 01:36:16.419972 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4584136Z I0723 01:36:16.420256 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4585985Z I0723 01:36:16.538504 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-23T01:40:11.4587796Z I0723 01:36:16.538673 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-23T01:40:11.4589270Z I0723 01:36:16.538697 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4590630Z I0723 01:36:16.538713 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4591981Z I0723 01:36:16.621230 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-23T01:40:11.4593718Z I0723 01:36:16.621268 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-23T01:40:11.4595360Z I0723 01:36:16.621280 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4596743Z I0723 01:36:16.621289 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4599391Z I0723 01:36:16.658590 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4638938Z E0723 01:36:16.658667 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-23T01:40:11.4682666Z I0723 01:36:16.658939 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4684398Z I0723 01:36:16.658989 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4685852Z I0723 01:36:16.659000 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4689052Z E0723 01:36:16.732649 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-23T01:40:11.4692877Z I0723 01:36:16.732861 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4695896Z I0723 01:36:16.738445 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4697562Z I0723 01:36:16.738483 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4698933Z I0723 01:36:16.738493 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4701450Z I0723 01:36:16.800718 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4704811Z E0723 01:36:16.819721 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4708316Z I0723 01:36:16.916802 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4712205Z E0723 01:36:17.061438 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-23T01:40:11.4715519Z I0723 01:36:17.061505 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4717183Z I0723 01:36:17.061571 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4718526Z I0723 01:36:17.061587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4721046Z I0723 01:36:17.157908 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4724377Z I0723 01:36:17.216807 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4727636Z I0723 01:36:17.521653 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4730878Z I0723 01:36:17.533244 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4751025Z I0723 01:36:17.583911 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-23T01:40:11.4754409Z I0723 01:36:17.601565 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4757379Z I0723 01:36:17.602069 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4760801Z I0723 01:36:17.635617 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.4765545Z E0723 01:36:17.759244 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-23T01:40:11.4769827Z I0723 01:36:17.765231 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4772462Z I0723 01:36:17.871271 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4810948Z I0723 01:36:17.871317 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4812398Z I0723 01:36:17.871340 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4815764Z I0723 01:36:17.929055 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4819551Z I0723 01:36:17.947004 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.4823140Z I0723 01:36:17.975177 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4826756Z I0723 01:36:18.269341 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4830447Z I0723 01:36:18.277985 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4834067Z I0723 01:36:18.532951 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4853805Z I0723 01:36:18.731039 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4858220Z E0723 01:36:18.731379 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4875470Z I0723 01:36:18.731584 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4877230Z I0723 01:36:18.731758 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4878626Z I0723 01:36:18.731779 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4881454Z I0723 01:36:18.732131 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4888212Z I0723 01:36:19.172781 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-23T01:40:11.4903735Z I0723 01:36:19.187976 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4907693Z I0723 01:36:19.220926 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4911573Z I0723 01:36:19.359130 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.4915447Z I0723 01:36:19.439733 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4919747Z E0723 01:36:19.440006 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: deployments.apps \"submariner-lighthouse-coredns\" already exists"
2021-07-23T01:40:11.4928126Z E0723 01:36:19.440042 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: deployments.apps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-23T01:40:11.4932156Z I0723 01:36:19.440072 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4935307Z I0723 01:36:19.517806 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4938900Z I0723 01:36:19.543010 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4944868Z I0723 01:36:19.761585 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4950124Z I0723 01:36:19.795855 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.4955109Z I0723 01:36:20.011412 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4959079Z I0723 01:36:20.216921 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.4963505Z I0723 01:36:20.217116 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.4965921Z I0723 01:36:20.217381 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.4969889Z I0723 01:36:20.226169 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.4975132Z I0723 01:36:20.232452 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.4980347Z I0723 01:36:20.353380 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4989994Z I0723 01:36:20.360463 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.4995566Z E0723 01:36:20.512236 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.4999713Z I0723 01:36:20.598270 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5024669Z E0723 01:36:20.796409 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5032837Z I0723 01:36:20.796485 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5035600Z I0723 01:36:20.796527 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5037522Z I0723 01:36:20.796537 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5041431Z I0723 01:36:20.916268 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5046872Z I0723 01:36:20.916778 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5051376Z I0723 01:36:20.917325 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5055327Z I0723 01:36:21.298192 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5060473Z I0723 01:36:21.298239 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.239.190\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-23T01:40:11.5064912Z I0723 01:36:21.436042 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5068263Z I0723 01:36:21.534357 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5071612Z I0723 01:36:21.575465 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5075030Z I0723 01:36:21.575873 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5078733Z I0723 01:36:21.855456 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5082524Z I0723 01:36:22.313783 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5085985Z I0723 01:36:22.486739 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5089546Z I0723 01:36:22.532287 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5093094Z I0723 01:36:22.580117 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5097898Z I0723 01:36:22.580159 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.239.190\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-23T01:40:11.5101855Z I0723 01:36:22.684791 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5140462Z I0723 01:36:23.623218 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5145286Z I0723 01:36:23.833855 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5148968Z I0723 01:36:24.482104 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5152949Z I0723 01:36:24.494574 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5156915Z I0723 01:36:24.523754 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5161791Z E0723 01:36:24.966139 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.5165350Z I0723 01:36:25.139892 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5169647Z I0723 01:36:25.149111 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5174437Z I0723 01:36:25.149155 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.239.190\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-23T01:40:11.5177901Z I0723 01:36:26.107417 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5179666Z I0723 01:36:26.107468 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5181055Z I0723 01:36:26.107479 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5183906Z I0723 01:36:26.190982 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5187595Z I0723 01:36:26.218128 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5191870Z I0723 01:36:26.821247 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5196592Z I0723 01:36:26.864717 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5200008Z I0723 01:36:26.907616 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5202002Z I0723 01:36:26.907659 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5203286Z I0723 01:36:26.907669 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5205474Z I0723 01:36:26.941569 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5207561Z I0723 01:36:26.941623 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5209256Z I0723 01:36:26.941633 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5212629Z I0723 01:36:26.977583 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5223480Z I0723 01:36:27.040843 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5227264Z I0723 01:36:27.081930 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5230683Z I0723 01:36:27.196895 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5254285Z I0723 01:36:27.695457 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5258297Z I0723 01:36:27.717327 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5261633Z I0723 01:36:27.835762 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5266152Z I0723 01:36:27.902882 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5270558Z I0723 01:36:28.285893 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5272754Z I0723 01:36:28.285942 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5276176Z I0723 01:36:28.285964 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5278827Z I0723 01:36:28.426500 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5282435Z I0723 01:36:28.440816 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5286396Z I0723 01:36:29.085683 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5289690Z I0723 01:36:29.146202 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5292457Z I0723 01:36:29.208107 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5294138Z I0723 01:36:29.208151 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5295632Z I0723 01:36:29.208161 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5297788Z I0723 01:36:29.209291 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5299437Z I0723 01:36:29.209317 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5300796Z I0723 01:36:29.209326 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5303293Z I0723 01:36:29.251672 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5307469Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-25l5c -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:11.5310040Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-25l5c -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:11.5312719Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-25l5c -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:11.5315967Z I0723 01:36:29.304530 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5320078Z I0723 01:36:29.305041 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5323487Z I0723 01:36:29.344222 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5326786Z I0723 01:36:29.945234 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5330601Z I0723 01:36:30.023394 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5333374Z I0723 01:36:30.205511 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5335047Z I0723 01:36:30.205561 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5336426Z I0723 01:36:30.205571 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5386804Z I0723 01:36:30.238005 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5390324Z I0723 01:36:30.305879 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5393811Z I0723 01:36:30.306060 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5397134Z I0723 01:36:30.403802 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5401022Z E0723 01:36:30.404824 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5404152Z I0723 01:36:30.404874 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5405794Z I0723 01:36:30.404913 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5407175Z I0723 01:36:30.404939 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5409670Z I0723 01:36:30.468614 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5455556Z I0723 01:36:30.584486 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5459119Z E0723 01:36:30.603298 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.5462795Z I0723 01:36:31.005859 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5466351Z I0723 01:36:31.018116 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5470144Z E0723 01:36:31.040490 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5473336Z I0723 01:36:31.040663 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5474986Z I0723 01:36:31.040806 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5476375Z I0723 01:36:31.040879 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5479024Z I0723 01:36:31.077031 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5482332Z I0723 01:36:31.083178 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5485654Z I0723 01:36:31.185391 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5489052Z I0723 01:36:31.190870 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5492329Z I0723 01:36:31.684463 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5495583Z I0723 01:36:31.701400 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5498605Z I0723 01:36:32.694304 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5502039Z I0723 01:36:32.713148 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5512129Z I0723 01:36:32.759367 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5516489Z I0723 01:36:32.981209 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5518354Z I0723 01:36:33.024257 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5520169Z I0723 01:36:33.024337 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5523319Z I0723 01:36:33.059718 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5527818Z I0723 01:36:33.094736 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5532322Z I0723 01:36:33.364420 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5536962Z I0723 01:36:33.387973 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5541771Z I0723 01:36:33.399345 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5545763Z I0723 01:36:33.709912 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5549778Z I0723 01:36:33.718021 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5552871Z I0723 01:36:33.770729 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5554539Z I0723 01:36:33.770926 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5555893Z I0723 01:36:33.771007 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5557873Z I0723 01:36:33.772582 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5560658Z I0723 01:36:33.772907 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5562057Z I0723 01:36:33.773035 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5564814Z I0723 01:36:33.818405 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5568062Z I0723 01:36:33.822914 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5571846Z I0723 01:36:33.848158 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5575419Z I0723 01:36:33.849948 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5578843Z I0723 01:36:34.005001 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5582111Z I0723 01:36:34.009669 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5586930Z I0723 01:36:34.009716 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.239.190\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-23T01:40:11.5591417Z I0723 01:36:34.450553 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5595174Z I0723 01:36:34.454376 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5598511Z I0723 01:36:34.469320 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5602125Z I0723 01:36:34.469547 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5605026Z I0723 01:36:35.077080 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5609189Z I0723 01:36:35.093582 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5613036Z I0723 01:36:35.101081 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5615861Z I0723 01:36:35.146058 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5617779Z I0723 01:36:35.146641 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5619232Z I0723 01:36:35.146783 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5621750Z I0723 01:36:35.161532 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5625030Z I0723 01:36:35.166247 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5629280Z I0723 01:36:35.703461 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5633768Z I0723 01:36:35.708558 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5638318Z I0723 01:36:35.715403 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5642374Z I0723 01:36:35.768868 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5645673Z I0723 01:36:35.776919 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5650217Z I0723 01:36:35.789128 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5653252Z I0723 01:36:35.789337 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5654811Z I0723 01:36:35.789412 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5659167Z I0723 01:36:35.791203 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5660879Z I0723 01:36:35.791322 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5662696Z I0723 01:36:35.791403 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5666291Z I0723 01:36:35.803148 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5670177Z I0723 01:36:35.804151 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5674320Z I0723 01:36:35.831019 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5679275Z I0723 01:36:35.831581 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5683596Z I0723 01:36:36.317457 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5687741Z I0723 01:36:36.321040 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5693560Z I0723 01:36:36.321193 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.239.190\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-23T01:40:11.5699132Z I0723 01:36:36.333062 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5703588Z I0723 01:36:36.339258 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5708859Z I0723 01:36:36.342662 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5713226Z I0723 01:36:36.433518 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5717122Z I0723 01:36:36.433533 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5721051Z I0723 01:36:36.441106 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5724402Z I0723 01:36:36.443319 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5728612Z I0723 01:36:36.944839 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5733208Z I0723 01:36:36.950874 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-23T01:40:11.5738983Z I0723 01:36:36.955853 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5745062Z I0723 01:36:37.558133 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5749742Z I0723 01:36:37.559927 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5755159Z I0723 01:36:37.559968 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.239.190\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-23T01:40:11.5759727Z I0723 01:36:38.366463 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5762079Z I0723 01:36:38.366610 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5763349Z I0723 01:36:38.366622 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5766404Z I0723 01:36:38.377768 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5770326Z I0723 01:36:38.381091 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5774065Z I0723 01:36:38.982933 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5779979Z I0723 01:36:38.988391 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5784207Z I0723 01:36:38.997713 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5786246Z I0723 01:36:38.997757 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5787637Z I0723 01:36:38.997768 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5789620Z I0723 01:36:39.002979 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5791685Z I0723 01:36:39.003080 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5793037Z I0723 01:36:39.003151 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5800023Z I0723 01:36:39.010857 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5804285Z I0723 01:36:39.014385 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5808870Z I0723 01:36:39.015657 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5812716Z I0723 01:36:39.028912 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5816912Z I0723 01:36:39.616378 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5826611Z I0723 01:36:39.621853 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5830138Z I0723 01:36:39.630997 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5833436Z I0723 01:36:39.635752 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5837601Z E0723 01:36:40.904098 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.5841220Z I0723 01:36:43.383673 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5842814Z I0723 01:36:43.383724 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5844069Z I0723 01:36:43.383735 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5847071Z I0723 01:36:43.395891 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5850757Z I0723 01:36:43.403306 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5862381Z I0723 01:36:44.006089 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5866072Z I0723 01:36:44.013222 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5870078Z I0723 01:36:44.028344 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5873732Z I0723 01:36:44.028394 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5874996Z I0723 01:36:44.028405 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5877880Z I0723 01:36:44.030826 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5880422Z I0723 01:36:44.030974 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5881689Z I0723 01:36:44.031068 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5884843Z I0723 01:36:44.050610 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5888208Z I0723 01:36:44.060304 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5892265Z I0723 01:36:44.060663 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5904918Z I0723 01:36:44.065340 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5908708Z I0723 01:36:44.663168 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5912880Z I0723 01:36:44.667109 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5926320Z I0723 01:36:44.681698 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5929863Z I0723 01:36:44.683058 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5932417Z I0723 01:36:48.428704 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5942922Z I0723 01:36:48.428757 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.5944213Z I0723 01:36:48.428768 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.5946866Z I0723 01:36:48.436343 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5950121Z I0723 01:36:48.440848 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.5955261Z I0723 01:36:49.042883 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.5959744Z I0723 01:36:49.050121 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.5963552Z I0723 01:36:49.058504 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.5999282Z I0723 01:36:49.058597 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6000881Z I0723 01:36:49.058608 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6003026Z I0723 01:36:49.058638 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6004952Z I0723 01:36:49.058675 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6006353Z I0723 01:36:49.058684 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6008883Z I0723 01:36:49.068984 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6012197Z I0723 01:36:49.072406 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6015531Z I0723 01:36:49.073922 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6018851Z I0723 01:36:49.083661 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6022128Z I0723 01:36:49.674065 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6025519Z I0723 01:36:49.682241 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6028811Z I0723 01:36:49.691392 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6032180Z I0723 01:36:49.699038 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6034919Z I0723 01:36:53.439642 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6048068Z I0723 01:36:53.439691 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6049468Z I0723 01:36:53.439701 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6091850Z I0723 01:36:53.456389 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6095461Z I0723 01:36:53.464408 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6098786Z I0723 01:36:54.066121 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6102227Z I0723 01:36:54.072713 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6105003Z I0723 01:36:54.084247 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6107465Z I0723 01:36:54.084408 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6109152Z I0723 01:36:54.084556 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6110532Z I0723 01:36:54.084574 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6111902Z I0723 01:36:54.085790 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6113294Z I0723 01:36:54.085818 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6115796Z I0723 01:36:54.094912 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6119139Z I0723 01:36:54.097371 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6122547Z I0723 01:36:54.100015 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6126048Z I0723 01:36:54.101390 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6129322Z I0723 01:36:54.701472 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6132520Z I0723 01:36:54.704289 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6135919Z I0723 01:36:54.709248 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6155737Z I0723 01:36:54.712309 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6158507Z I0723 01:36:58.477407 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6160174Z I0723 01:36:58.477458 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6161705Z I0723 01:36:58.477468 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6164366Z I0723 01:36:58.485288 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6167688Z I0723 01:36:58.489147 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6171160Z I0723 01:36:59.091056 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6174419Z I0723 01:36:59.096706 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6177172Z I0723 01:36:59.106882 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6178825Z I0723 01:36:59.106924 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6180182Z I0723 01:36:59.106934 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6182163Z I0723 01:36:59.107132 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6183903Z I0723 01:36:59.107293 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6187910Z I0723 01:36:59.107424 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6190568Z I0723 01:36:59.114890 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6194619Z I0723 01:36:59.115471 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6198135Z I0723 01:36:59.118762 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6202382Z I0723 01:36:59.119646 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6206279Z I0723 01:36:59.720495 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6209848Z I0723 01:36:59.721200 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6213850Z I0723 01:36:59.727521 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6218918Z I0723 01:36:59.728140 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6222847Z E0723 01:37:01.433739 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.6225954Z I0723 01:37:03.498193 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6228423Z I0723 01:37:03.498241 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6229812Z I0723 01:37:03.498251 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6233854Z I0723 01:37:03.508195 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6238604Z I0723 01:37:03.519886 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6244171Z I0723 01:37:04.121610 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6248338Z I0723 01:37:04.127133 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6251104Z I0723 01:37:04.136611 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6254578Z I0723 01:37:04.136693 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6255970Z I0723 01:37:04.136726 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6258673Z I0723 01:37:04.136808 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6260532Z I0723 01:37:04.136891 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6262157Z I0723 01:37:04.136962 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6265870Z I0723 01:37:04.143692 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6269730Z I0723 01:37:04.144840 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6273628Z I0723 01:37:04.147503 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6277281Z I0723 01:37:04.149399 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6280614Z I0723 01:37:04.749541 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6283850Z I0723 01:37:04.753133 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6287103Z I0723 01:37:04.761528 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6290386Z I0723 01:37:04.762201 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6293021Z I0723 01:37:08.519709 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6294565Z I0723 01:37:08.519755 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6296047Z I0723 01:37:08.519767 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6298562Z I0723 01:37:08.532445 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6301875Z I0723 01:37:08.538452 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6305295Z I0723 01:37:09.140429 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6308580Z I0723 01:37:09.146135 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6311346Z I0723 01:37:09.154278 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6313110Z I0723 01:37:09.154319 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6314472Z I0723 01:37:09.154329 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6316454Z I0723 01:37:09.155402 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6318100Z I0723 01:37:09.155433 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6319471Z I0723 01:37:09.155443 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6321995Z I0723 01:37:09.163511 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6325251Z I0723 01:37:09.164778 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6328550Z I0723 01:37:09.167077 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6331918Z I0723 01:37:09.171182 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6335304Z I0723 01:37:09.769224 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6338504Z I0723 01:37:09.773582 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6341796Z I0723 01:37:09.775048 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6345233Z I0723 01:37:09.780736 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6348001Z I0723 01:37:13.549116 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6349645Z I0723 01:37:13.549166 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6351018Z I0723 01:37:13.549176 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6353514Z I0723 01:37:13.557847 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6357251Z I0723 01:37:13.562946 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6360576Z I0723 01:37:14.164685 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6364147Z I0723 01:37:14.172973 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6369015Z I0723 01:37:14.181717 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6370710Z I0723 01:37:14.181753 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6372058Z I0723 01:37:14.181763 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6374035Z I0723 01:37:14.181793 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6375694Z I0723 01:37:14.181839 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6394156Z I0723 01:37:14.181849 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6396971Z I0723 01:37:14.189079 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6400408Z I0723 01:37:14.190372 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6403725Z I0723 01:37:14.194266 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6407100Z I0723 01:37:14.196269 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6410809Z I0723 01:37:14.795893 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6414026Z I0723 01:37:14.800559 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6417510Z I0723 01:37:14.804354 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6421502Z I0723 01:37:14.817352 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6424348Z I0723 01:37:18.575100 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6426152Z I0723 01:37:18.575164 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6427518Z I0723 01:37:18.575175 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6430030Z I0723 01:37:18.593309 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6433355Z I0723 01:37:18.597004 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6436967Z I0723 01:37:19.198879 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6440261Z I0723 01:37:19.204253 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6443053Z I0723 01:37:19.212777 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6444823Z I0723 01:37:19.212827 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6446270Z I0723 01:37:19.212838 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6449727Z I0723 01:37:19.214448 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6451420Z I0723 01:37:19.214489 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6452798Z I0723 01:37:19.214500 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6455359Z I0723 01:37:19.220088 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6462609Z I0723 01:37:19.223909 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6467378Z I0723 01:37:19.224201 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6472024Z I0723 01:37:19.234622 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6476122Z I0723 01:37:19.826249 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6483408Z I0723 01:37:19.833398 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6487428Z I0723 01:37:19.838577 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6491424Z I0723 01:37:19.849524 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6494897Z I0723 01:37:23.592012 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6496829Z I0723 01:37:23.593136 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6498485Z I0723 01:37:23.593153 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6510984Z I0723 01:37:23.600136 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6514488Z I0723 01:37:23.603126 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6517782Z I0723 01:37:24.205108 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6521059Z I0723 01:37:24.210454 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6523819Z I0723 01:37:24.220494 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6525486Z I0723 01:37:24.220535 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6526857Z I0723 01:37:24.220546 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6528830Z I0723 01:37:24.221557 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6530479Z I0723 01:37:24.221590 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6531978Z I0723 01:37:24.221599 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6534498Z I0723 01:37:24.230938 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6537724Z I0723 01:37:24.232864 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6541042Z I0723 01:37:24.235177 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6544421Z I0723 01:37:24.236672 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6558579Z I0723 01:37:24.836417 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6563163Z I0723 01:37:24.838162 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6566755Z I0723 01:37:24.842989 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6586745Z I0723 01:37:24.843001 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6589508Z I0723 01:37:28.616332 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6591179Z I0723 01:37:28.616530 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6592542Z I0723 01:37:28.616543 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6595087Z I0723 01:37:28.630970 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6598511Z I0723 01:37:28.643695 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6601807Z I0723 01:37:29.245993 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6611360Z I0723 01:37:29.252030 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6614199Z I0723 01:37:29.262324 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6616435Z I0723 01:37:29.262382 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6619444Z I0723 01:37:29.262439 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6620930Z I0723 01:37:29.262455 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6622307Z I0723 01:37:29.263002 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6623682Z I0723 01:37:29.263021 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6628650Z I0723 01:37:29.274628 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6634216Z I0723 01:37:29.275159 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6637542Z I0723 01:37:29.278826 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6641140Z I0723 01:37:29.280529 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6644439Z I0723 01:37:29.882866 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6647647Z I0723 01:37:29.888733 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6652189Z I0723 01:37:29.895273 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6655523Z I0723 01:37:29.895986 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6658659Z I0723 01:37:33.635587 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6660510Z I0723 01:37:33.635649 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6662001Z I0723 01:37:33.635659 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6665399Z I0723 01:37:33.644942 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6668954Z I0723 01:37:33.655578 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6672441Z I0723 01:37:34.257502 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6675725Z I0723 01:37:34.263726 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6679298Z I0723 01:37:34.274159 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6681551Z I0723 01:37:34.275037 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6683422Z I0723 01:37:34.275077 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6684830Z I0723 01:37:34.275188 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6686311Z I0723 01:37:34.275153 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6687685Z I0723 01:37:34.276381 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6690237Z I0723 01:37:34.282603 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6693487Z I0723 01:37:34.284918 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6696785Z I0723 01:37:34.286088 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6700154Z I0723 01:37:34.292978 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6703414Z I0723 01:37:34.892196 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6706870Z I0723 01:37:34.896068 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6710353Z I0723 01:37:34.899130 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6713713Z I0723 01:37:34.902593 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6716471Z I0723 01:37:38.659393 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6718157Z I0723 01:37:38.659458 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6719812Z I0723 01:37:38.659469 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6722377Z I0723 01:37:38.666829 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6725685Z I0723 01:37:38.670180 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6728995Z I0723 01:37:39.271733 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6732346Z I0723 01:37:39.277422 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6735099Z I0723 01:37:39.287384 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6736773Z I0723 01:37:39.287567 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6738144Z I0723 01:37:39.287653 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6740115Z I0723 01:37:39.287435 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6741834Z I0723 01:37:39.287863 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6744784Z I0723 01:37:39.287881 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6747985Z I0723 01:37:39.295256 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6751218Z I0723 01:37:39.295738 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6754868Z I0723 01:37:39.299135 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6758276Z I0723 01:37:39.299559 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6761651Z I0723 01:37:39.901368 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6764886Z I0723 01:37:39.902778 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6768488Z I0723 01:37:39.908419 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6771872Z I0723 01:37:39.908546 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6775172Z E0723 01:37:42.449469 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.6778642Z I0723 01:37:43.673458 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6782814Z I0723 01:37:43.673509 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6786896Z I0723 01:37:43.673520 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6789708Z I0723 01:37:43.683379 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6793586Z I0723 01:37:43.686694 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6797006Z I0723 01:37:44.288801 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6801655Z I0723 01:37:44.294756 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6804618Z I0723 01:37:44.304823 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6806445Z I0723 01:37:44.304909 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6808060Z I0723 01:37:44.304946 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6810047Z I0723 01:37:44.307907 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6811709Z I0723 01:37:44.307996 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6813092Z I0723 01:37:44.308014 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6815597Z I0723 01:37:44.312550 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6818851Z I0723 01:37:44.316435 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6822162Z I0723 01:37:44.317832 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6825635Z I0723 01:37:44.322249 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6828939Z I0723 01:37:44.920087 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6832265Z I0723 01:37:44.923325 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6835528Z I0723 01:37:44.929553 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6838839Z I0723 01:37:44.929628 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6841604Z I0723 01:37:48.698272 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6843322Z I0723 01:37:48.698336 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6844692Z I0723 01:37:48.698346 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6847194Z I0723 01:37:48.708452 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6850558Z I0723 01:37:48.711880 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6853907Z I0723 01:37:49.314207 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6857149Z I0723 01:37:49.320030 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6859910Z I0723 01:37:49.330687 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6861573Z I0723 01:37:49.330945 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6862950Z I0723 01:37:49.331072 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6865460Z I0723 01:37:49.330884 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6867005Z I0723 01:37:49.331215 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6868289Z I0723 01:37:49.331225 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6870893Z I0723 01:37:49.338509 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6875945Z I0723 01:37:49.342219 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6879282Z I0723 01:37:49.352624 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6882653Z I0723 01:37:49.366139 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6885973Z I0723 01:37:49.954775 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6889246Z I0723 01:37:49.965465 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6892495Z I0723 01:37:49.968413 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6896667Z I0723 01:37:49.972861 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6899479Z I0723 01:37:53.714360 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6901152Z I0723 01:37:53.714411 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6904005Z I0723 01:37:53.714421 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6906691Z I0723 01:37:53.722295 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6910004Z I0723 01:37:53.725547 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6913293Z I0723 01:37:54.327771 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6916560Z I0723 01:37:54.333591 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6919332Z I0723 01:37:54.343310 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6921708Z I0723 01:37:54.343354 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.6923342Z I0723 01:37:54.343360 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6924701Z I0723 01:37:54.343371 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6926080Z I0723 01:37:54.343395 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.6927425Z I0723 01:37:54.343405 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.6929943Z I0723 01:37:54.351125 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6933549Z I0723 01:37:54.352494 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6937074Z I0723 01:37:54.356390 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6940511Z I0723 01:37:54.356838 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.6986874Z I0723 01:37:54.960414 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6990155Z I0723 01:37:54.962998 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.6993430Z I0723 01:37:54.973454 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6996956Z I0723 01:37:54.981306 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.6999838Z I0723 01:37:58.736301 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7001484Z I0723 01:37:58.736372 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7002880Z I0723 01:37:58.736384 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7005190Z I0723 01:37:58.746092 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7008436Z I0723 01:37:58.749144 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7011511Z I0723 01:37:59.350435 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7014871Z I0723 01:37:59.356742 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7017627Z I0723 01:37:59.365118 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7019277Z I0723 01:37:59.365167 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7020634Z I0723 01:37:59.365178 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7022601Z I0723 01:37:59.366848 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7024274Z I0723 01:37:59.366887 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7025803Z I0723 01:37:59.366899 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7028156Z I0723 01:37:59.373308 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7031953Z I0723 01:37:59.385636 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7034995Z I0723 01:37:59.387744 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7038168Z I0723 01:37:59.402060 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7041222Z I0723 01:37:59.986987 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7044292Z I0723 01:37:59.995629 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7047286Z I0723 01:38:00.004059 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7050392Z I0723 01:38:00.008692 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7063710Z I0723 01:38:03.751890 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7065426Z I0723 01:38:03.751939 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7066728Z I0723 01:38:03.751950 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7069151Z I0723 01:38:03.769898 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7072217Z I0723 01:38:03.776905 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7075288Z I0723 01:38:04.378780 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7078421Z I0723 01:38:04.385029 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7080968Z I0723 01:38:04.396756 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7083064Z I0723 01:38:04.396859 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7084611Z I0723 01:38:04.396914 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7085868Z I0723 01:38:04.396930 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7087130Z I0723 01:38:04.398067 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7088404Z I0723 01:38:04.398109 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7090707Z I0723 01:38:04.404407 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7093717Z I0723 01:38:04.404934 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7096784Z I0723 01:38:04.408054 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7099960Z I0723 01:38:04.408225 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7103002Z I0723 01:38:05.010419 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7106257Z I0723 01:38:05.010735 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7111980Z I0723 01:38:05.018937 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7116161Z I0723 01:38:05.023211 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7118926Z I0723 01:38:08.789076 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7120587Z I0723 01:38:08.789128 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7122103Z I0723 01:38:08.789139 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7124631Z I0723 01:38:08.804512 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7127899Z I0723 01:38:08.810257 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7131587Z I0723 01:38:09.412439 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7135101Z I0723 01:38:09.418005 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7137886Z I0723 01:38:09.426173 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7139530Z I0723 01:38:09.426216 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7141041Z I0723 01:38:09.426226 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7143271Z I0723 01:38:09.426821 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7144946Z I0723 01:38:09.426861 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7146542Z I0723 01:38:09.426971 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7149047Z I0723 01:38:09.435150 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7152290Z I0723 01:38:09.437291 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7156578Z I0723 01:38:09.439337 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7160163Z I0723 01:38:09.441246 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7163503Z I0723 01:38:10.043240 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7166866Z I0723 01:38:10.051805 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7170391Z I0723 01:38:10.058618 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7173709Z I0723 01:38:10.062105 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7176443Z I0723 01:38:13.817601 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7178109Z I0723 01:38:13.817657 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7179470Z I0723 01:38:13.817667 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7181978Z I0723 01:38:13.825871 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7185438Z I0723 01:38:13.829089 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7188728Z I0723 01:38:14.430943 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7192086Z I0723 01:38:14.436669 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7194831Z I0723 01:38:14.452579 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7196478Z I0723 01:38:14.452653 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7197831Z I0723 01:38:14.452679 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7199809Z I0723 01:38:14.455095 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7201470Z I0723 01:38:14.455162 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7202816Z I0723 01:38:14.455185 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7205315Z I0723 01:38:14.462757 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7208565Z I0723 01:38:14.463210 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7211899Z I0723 01:38:14.467769 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7215277Z I0723 01:38:14.467876 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7218586Z I0723 01:38:15.070107 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7222016Z I0723 01:38:15.070111 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7225695Z I0723 01:38:15.081658 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7229064Z I0723 01:38:15.086459 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7232041Z I0723 01:38:18.836959 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7233728Z I0723 01:38:18.837039 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7235845Z I0723 01:38:18.837051 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7241268Z I0723 01:38:18.848170 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7244674Z I0723 01:38:18.852649 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7248004Z I0723 01:38:19.454439 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7251291Z I0723 01:38:19.460312 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7254713Z I0723 01:38:19.469887 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7257082Z I0723 01:38:19.470011 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7258899Z I0723 01:38:19.470119 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7262681Z I0723 01:38:19.471208 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7265727Z I0723 01:38:19.471265 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7268063Z I0723 01:38:19.471329 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7271665Z I0723 01:38:19.478862 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7276986Z I0723 01:38:19.479481 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7325843Z I0723 01:38:19.483610 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7329440Z I0723 01:38:19.484138 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7332829Z I0723 01:38:20.086142 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7336062Z I0723 01:38:20.087109 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7339504Z I0723 01:38:20.095202 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7342613Z I0723 01:38:20.096695 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7345258Z I0723 01:38:23.855942 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7346811Z I0723 01:38:23.855994 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7348087Z I0723 01:38:23.856004 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7350585Z I0723 01:38:23.880237 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7353878Z I0723 01:38:23.894568 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7357269Z I0723 01:38:24.496935 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7360655Z I0723 01:38:24.502999 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7363505Z I0723 01:38:24.513637 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7365176Z I0723 01:38:24.513828 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7366623Z I0723 01:38:24.513847 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7368591Z I0723 01:38:24.513644 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7370256Z I0723 01:38:24.515066 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7371630Z I0723 01:38:24.515086 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7374115Z I0723 01:38:24.521580 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7377393Z I0723 01:38:24.524527 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7380790Z I0723 01:38:24.525680 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7384160Z I0723 01:38:24.535727 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7387285Z I0723 01:38:25.128665 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7390266Z I0723 01:38:25.137389 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7393674Z I0723 01:38:25.140621 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7396980Z I0723 01:38:25.145692 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7399787Z I0723 01:38:28.885254 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7401438Z I0723 01:38:28.885326 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7402857Z I0723 01:38:28.885343 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7405409Z I0723 01:38:28.894644 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7408700Z I0723 01:38:28.898120 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7463073Z I0723 01:38:29.500156 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7466662Z I0723 01:38:29.506543 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7469223Z I0723 01:38:29.517173 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7471028Z I0723 01:38:29.517221 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7472405Z I0723 01:38:29.517232 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7474545Z I0723 01:38:29.517403 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7476201Z I0723 01:38:29.517450 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7477566Z I0723 01:38:29.517461 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7480076Z I0723 01:38:29.524536 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7483387Z I0723 01:38:29.526309 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7486681Z I0723 01:38:29.529825 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7490116Z I0723 01:38:29.531552 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7493507Z I0723 01:38:30.132645 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7496752Z I0723 01:38:30.136068 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7500008Z I0723 01:38:30.143747 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7503313Z I0723 01:38:30.144420 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7506182Z I0723 01:38:33.902696 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7507848Z I0723 01:38:33.902744 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7509212Z I0723 01:38:33.902754 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7511740Z I0723 01:38:33.909601 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7515042Z I0723 01:38:33.914603 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7518548Z I0723 01:38:34.517177 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7521814Z I0723 01:38:34.523965 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7524570Z I0723 01:38:34.533804 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7526216Z I0723 01:38:34.533842 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7527589Z I0723 01:38:34.533852 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7529551Z I0723 01:38:34.533923 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7531180Z I0723 01:38:34.534064 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7532549Z I0723 01:38:34.534078 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7557886Z I0723 01:38:34.541095 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7561484Z I0723 01:38:34.546632 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7564882Z I0723 01:38:34.556900 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7568342Z I0723 01:38:34.567645 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7571600Z I0723 01:38:35.158791 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7574662Z I0723 01:38:35.164194 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7578109Z I0723 01:38:35.169344 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7581365Z I0723 01:38:35.175533 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7584207Z I0723 01:38:38.919407 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7585991Z I0723 01:38:38.919478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7587364Z I0723 01:38:38.919490 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7589879Z I0723 01:38:38.926987 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7593176Z I0723 01:38:38.929974 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7596455Z I0723 01:38:39.531325 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7599724Z I0723 01:38:39.536688 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7602475Z I0723 01:38:39.545340 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7604211Z I0723 01:38:39.545525 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7605571Z I0723 01:38:39.545603 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7607606Z I0723 01:38:39.545493 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7633515Z I0723 01:38:39.545848 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7634934Z I0723 01:38:39.545866 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7637610Z I0723 01:38:39.558267 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7640887Z I0723 01:38:39.561515 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7644368Z I0723 01:38:39.563261 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7647835Z I0723 01:38:39.565854 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7651241Z I0723 01:38:40.165195 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7654646Z I0723 01:38:40.168151 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7657935Z I0723 01:38:40.174396 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7661257Z I0723 01:38:40.178785 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7664091Z I0723 01:38:43.936523 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7665844Z I0723 01:38:43.936576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7667211Z I0723 01:38:43.936588 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7669727Z I0723 01:38:43.948689 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7673123Z I0723 01:38:43.952029 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7676425Z I0723 01:38:44.553523 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7679757Z I0723 01:38:44.559877 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7682493Z I0723 01:38:44.568793 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7684154Z I0723 01:38:44.568841 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7685511Z I0723 01:38:44.568851 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7687481Z I0723 01:38:44.570929 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7689135Z I0723 01:38:44.571102 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7690473Z I0723 01:38:44.571121 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7692973Z I0723 01:38:44.583304 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7696310Z I0723 01:38:44.583805 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7699600Z I0723 01:38:44.586681 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7702930Z I0723 01:38:44.588012 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7734074Z I0723 01:38:45.189964 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7737627Z I0723 01:38:45.190252 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7740917Z I0723 01:38:45.200193 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7744569Z I0723 01:38:45.203318 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7747551Z I0723 01:38:48.962716 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7749214Z I0723 01:38:48.962762 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7750585Z I0723 01:38:48.962772 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7753080Z I0723 01:38:48.971582 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7756408Z I0723 01:38:48.975100 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7759715Z I0723 01:38:49.577438 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7762985Z I0723 01:38:49.583161 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7765637Z I0723 01:38:49.592969 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7767945Z I0723 01:38:49.592985 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7769467Z I0723 01:38:49.593006 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7770737Z I0723 01:38:49.593017 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7771993Z I0723 01:38:49.593030 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7773487Z I0723 01:38:49.593041 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7776077Z I0723 01:38:49.603944 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7779421Z I0723 01:38:49.605751 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7782687Z I0723 01:38:49.612068 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7806497Z I0723 01:38:49.616472 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7809935Z I0723 01:38:50.213496 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7812919Z I0723 01:38:50.217494 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7816448Z I0723 01:38:50.222348 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7819787Z I0723 01:38:50.222986 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7822549Z I0723 01:38:53.979465 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7824208Z I0723 01:38:53.979532 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7826339Z I0723 01:38:53.979547 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7828955Z I0723 01:38:53.987942 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7832408Z I0723 01:38:53.999336 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7835693Z I0723 01:38:54.601797 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7839066Z I0723 01:38:54.607646 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7841773Z I0723 01:38:54.616127 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7843552Z I0723 01:38:54.616188 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7844819Z I0723 01:38:54.616205 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7846640Z I0723 01:38:54.618257 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7848171Z I0723 01:38:54.618294 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7849514Z I0723 01:38:54.618409 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7851850Z I0723 01:38:54.625176 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7855320Z I0723 01:38:54.626664 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7858632Z I0723 01:38:54.630382 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7875109Z I0723 01:38:54.630498 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7878567Z I0723 01:38:55.233220 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7881878Z I0723 01:38:55.233223 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7885136Z I0723 01:38:55.239356 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7888736Z I0723 01:38:55.250533 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7891498Z I0723 01:38:59.003425 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7893147Z I0723 01:38:59.003476 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7894527Z I0723 01:38:59.003486 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7897122Z I0723 01:38:59.011081 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7900506Z I0723 01:38:59.014107 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7903942Z I0723 01:38:59.615716 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7907418Z I0723 01:38:59.621293 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7910213Z I0723 01:38:59.629763 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7911738Z I0723 01:38:59.629937 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7913005Z I0723 01:38:59.629957 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7914810Z I0723 01:38:59.635516 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7916566Z I0723 01:38:59.635581 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7918059Z I0723 01:38:59.635602 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7920576Z I0723 01:38:59.637461 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7923913Z I0723 01:38:59.642817 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7927185Z I0723 01:38:59.643160 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7930576Z I0723 01:38:59.654017 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7933867Z I0723 01:39:00.244959 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7937125Z I0723 01:39:00.252773 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7940426Z I0723 01:39:00.254976 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7943722Z I0723 01:39:00.260931 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7946612Z I0723 01:39:04.021979 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7948658Z I0723 01:39:04.022030 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7950122Z I0723 01:39:04.022041 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7952503Z I0723 01:39:04.030466 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7955577Z I0723 01:39:04.035651 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7959289Z E0723 01:39:04.420818 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-23T01:40:11.7962377Z I0723 01:39:04.637700 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7965504Z I0723 01:39:04.649214 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7968163Z I0723 01:39:04.660126 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7969690Z I0723 01:39:04.660170 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7970960Z I0723 01:39:04.660181 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7973117Z I0723 01:39:04.661286 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.7974755Z I0723 01:39:04.661325 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.7976129Z I0723 01:39:04.661335 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.7978626Z I0723 01:39:04.673747 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7981881Z I0723 01:39:04.673953 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.7985818Z I0723 01:39:04.678554 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7989102Z I0723 01:39:04.679620 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.7992231Z I0723 01:39:05.281020 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7995238Z I0723 01:39:05.282635 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.7998988Z I0723 01:39:05.288743 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8002309Z I0723 01:39:05.288749 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8005073Z I0723 01:39:09.046985 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8006742Z I0723 01:39:09.047203 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8008073Z I0723 01:39:09.047236 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8010424Z I0723 01:39:09.054827 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8013673Z I0723 01:39:09.062555 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8026551Z I0723 01:39:09.665967 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8029620Z I0723 01:39:09.671702 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8050101Z I0723 01:39:09.679650 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8051765Z I0723 01:39:09.679691 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8053177Z I0723 01:39:09.679703 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8055181Z I0723 01:39:09.682281 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8056851Z I0723 01:39:09.682344 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8058234Z I0723 01:39:09.682380 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8060919Z I0723 01:39:09.688192 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8064268Z I0723 01:39:09.692459 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8068409Z I0723 01:39:09.695879 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8071462Z I0723 01:39:09.710372 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8074526Z I0723 01:39:10.293761 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8077567Z I0723 01:39:10.299643 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8080806Z I0723 01:39:10.311802 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8084051Z I0723 01:39:10.316559 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8086898Z I0723 01:39:14.059899 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8088564Z I0723 01:39:14.059956 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8089923Z I0723 01:39:14.059967 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8092414Z I0723 01:39:14.069719 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8095720Z I0723 01:39:14.073095 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8099011Z I0723 01:39:14.675053 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8102282Z I0723 01:39:14.680650 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8106265Z I0723 01:39:14.689715 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8108045Z I0723 01:39:14.689756 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8109928Z I0723 01:39:14.689877 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8111836Z I0723 01:39:14.689921 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8113243Z I0723 01:39:14.689937 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8114498Z I0723 01:39:14.690613 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8117571Z I0723 01:39:14.697428 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8121067Z I0723 01:39:14.698137 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8124102Z I0723 01:39:14.702034 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8127228Z I0723 01:39:14.703381 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8130301Z I0723 01:39:15.303755 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8134042Z I0723 01:39:15.304848 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8137366Z I0723 01:39:15.311922 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8140669Z I0723 01:39:15.318902 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8143489Z I0723 01:39:19.085540 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8145613Z I0723 01:39:19.085592 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8147007Z I0723 01:39:19.085604 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8149520Z I0723 01:39:19.094023 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8152918Z I0723 01:39:19.098483 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8156252Z I0723 01:39:19.700385 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8159530Z I0723 01:39:19.705750 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8162272Z I0723 01:39:19.714370 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8164038Z I0723 01:39:19.714413 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8165311Z I0723 01:39:19.714423 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8167135Z I0723 01:39:19.715906 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8168687Z I0723 01:39:19.715945 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8169959Z I0723 01:39:19.715955 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8172280Z I0723 01:39:19.723949 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8175724Z I0723 01:39:19.730041 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8179037Z I0723 01:39:19.730256 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8182401Z I0723 01:39:19.745565 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8186090Z I0723 01:39:20.332193 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8189425Z I0723 01:39:20.338157 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8192671Z I0723 01:39:20.351253 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8196026Z I0723 01:39:20.359609 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8198796Z I0723 01:39:24.109598 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8200459Z I0723 01:39:24.109647 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8201826Z I0723 01:39:24.109657 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8204346Z I0723 01:39:24.119782 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8207649Z I0723 01:39:24.125853 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8210938Z I0723 01:39:24.728482 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8214208Z I0723 01:39:24.734054 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8217014Z I0723 01:39:24.747006 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8218646Z I0723 01:39:24.747059 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8220117Z I0723 01:39:24.747266 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8234932Z I0723 01:39:24.748489 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8236806Z I0723 01:39:24.748607 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8238195Z I0723 01:39:24.748625 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8240872Z I0723 01:39:24.756863 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8244276Z I0723 01:39:24.764003 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8247561Z I0723 01:39:24.778789 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8251010Z I0723 01:39:24.785345 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8254332Z I0723 01:39:25.366077 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8257669Z I0723 01:39:25.373053 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8260704Z I0723 01:39:25.391245 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8263733Z I0723 01:39:25.402620 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8266446Z I0723 01:39:29.134648 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8267980Z I0723 01:39:29.134708 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8269251Z I0723 01:39:29.134719 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8271836Z I0723 01:39:29.146164 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8275988Z I0723 01:39:29.152291 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8279703Z I0723 01:39:29.754580 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8282705Z I0723 01:39:29.761890 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8285264Z I0723 01:39:29.777660 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8286886Z I0723 01:39:29.777704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8288152Z I0723 01:39:29.777714 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8289986Z I0723 01:39:29.786309 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8291504Z I0723 01:39:29.786349 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8292855Z I0723 01:39:29.786359 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8295181Z I0723 01:39:29.789820 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8298877Z I0723 01:39:29.797159 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8301947Z I0723 01:39:29.807497 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8305809Z I0723 01:39:29.815222 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8309188Z I0723 01:39:30.398931 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8312547Z I0723 01:39:30.405514 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8315885Z I0723 01:39:30.417271 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8319004Z I0723 01:39:30.421792 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8321555Z I0723 01:39:34.161176 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8323946Z I0723 01:39:34.163029 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8325223Z I0723 01:39:34.163053 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8327818Z I0723 01:39:34.186941 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8331103Z I0723 01:39:34.195458 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8334147Z I0723 01:39:34.797795 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8337464Z I0723 01:39:34.803337 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8340241Z I0723 01:39:34.822116 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8342008Z I0723 01:39:34.822158 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8343389Z I0723 01:39:34.822168 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8345478Z I0723 01:39:34.822741 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8347133Z I0723 01:39:34.822810 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8348511Z I0723 01:39:34.822833 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8351022Z I0723 01:39:34.834319 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8354216Z I0723 01:39:34.838029 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8357586Z I0723 01:39:34.842128 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8361217Z I0723 01:39:34.843616 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8364500Z I0723 01:39:35.443994 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8367718Z I0723 01:39:35.448244 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8371020Z I0723 01:39:35.456660 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8374373Z I0723 01:39:35.461674 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8377114Z I0723 01:39:39.208058 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8378771Z I0723 01:39:39.208129 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8380182Z I0723 01:39:39.208141 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8382708Z I0723 01:39:39.236545 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8386579Z I0723 01:39:39.252338 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8389686Z I0723 01:39:39.854663 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8392739Z I0723 01:39:39.861204 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8395264Z I0723 01:39:39.872178 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8396816Z I0723 01:39:39.872224 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8398070Z I0723 01:39:39.872235 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8399905Z I0723 01:39:39.873749 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8401419Z I0723 01:39:39.873790 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8402782Z I0723 01:39:39.873801 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8405116Z I0723 01:39:39.882814 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8408244Z I0723 01:39:39.892755 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8411303Z I0723 01:39:39.894345 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8414428Z I0723 01:39:39.899595 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8417454Z I0723 01:39:40.496425 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8420422Z I0723 01:39:40.501346 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8423901Z I0723 01:39:40.507753 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8427327Z I0723 01:39:40.510153 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8430080Z I0723 01:39:44.249844 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8431741Z I0723 01:39:44.249907 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8433119Z I0723 01:39:44.249919 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8435666Z I0723 01:39:44.264649 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8438895Z I0723 01:39:44.269269 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8442235Z I0723 01:39:44.871626 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8445500Z I0723 01:39:44.879095 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8448340Z I0723 01:39:44.897401 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8449996Z I0723 01:39:44.897557 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8451343Z I0723 01:39:44.897650 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8453300Z I0723 01:39:44.900191 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8455851Z I0723 01:39:44.900341 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8457309Z I0723 01:39:44.900580 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8459869Z I0723 01:39:44.913846 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8468551Z I0723 01:39:44.914703 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8472234Z I0723 01:39:44.920459 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8475594Z I0723 01:39:44.923695 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8479171Z I0723 01:39:45.524195 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8482398Z I0723 01:39:45.528357 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8485434Z I0723 01:39:45.536141 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8488510Z I0723 01:39:45.540914 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8491066Z I0723 01:39:49.296510 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8492615Z I0723 01:39:49.296576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8493979Z I0723 01:39:49.296587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8496297Z I0723 01:39:49.321059 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8499696Z I0723 01:39:49.330074 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8503177Z I0723 01:39:49.932506 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8506557Z I0723 01:39:49.939992 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8509303Z I0723 01:39:49.952310 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8510971Z I0723 01:39:49.952493 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8512358Z I0723 01:39:49.952596 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8514386Z I0723 01:39:49.960574 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8516059Z I0723 01:39:49.960772 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8517406Z I0723 01:39:49.960865 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8519922Z I0723 01:39:49.964949 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8523231Z I0723 01:39:49.973012 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8526507Z I0723 01:39:49.975930 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8529794Z I0723 01:39:49.990479 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8533095Z I0723 01:39:50.575296 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8536360Z I0723 01:39:50.586503 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8539701Z I0723 01:39:50.593610 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8543016Z I0723 01:39:50.606067 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8546497Z I0723 01:39:54.336383 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8548162Z I0723 01:39:54.336447 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8549535Z I0723 01:39:54.336473 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8552104Z I0723 01:39:54.348952 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8556351Z I0723 01:39:54.352747 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8560413Z I0723 01:39:54.954587 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8563758Z I0723 01:39:54.966783 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8566510Z I0723 01:39:54.984454 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8568179Z I0723 01:39:54.984546 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8569560Z I0723 01:39:54.984625 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8571513Z I0723 01:39:54.990986 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8573262Z I0723 01:39:54.991026 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8574631Z I0723 01:39:54.991088 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8577126Z I0723 01:39:55.002492 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8580379Z I0723 01:39:55.010106 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8583766Z I0723 01:39:55.012777 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8588171Z I0723 01:39:55.032664 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8591711Z I0723 01:39:55.616711 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8594985Z I0723 01:39:55.624301 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8598232Z I0723 01:39:55.634123 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8601489Z I0723 01:39:55.641872 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8604331Z I0723 01:39:59.380792 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8605983Z I0723 01:39:59.380838 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8607357Z I0723 01:39:59.380850 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8609870Z I0723 01:39:59.395507 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8613155Z I0723 01:39:59.400460 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8616456Z I0723 01:40:00.002736 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8619712Z I0723 01:40:00.008946 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8622461Z I0723 01:40:00.021838 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8624116Z I0723 01:40:00.022007 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8626091Z I0723 01:40:00.022220 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8628123Z I0723 01:40:00.027751 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8629861Z I0723 01:40:00.027883 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8631222Z I0723 01:40:00.027965 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8633712Z I0723 01:40:00.036929 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8636962Z I0723 01:40:00.038147 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8640259Z I0723 01:40:00.046660 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8643865Z I0723 01:40:00.051266 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8647225Z I0723 01:40:00.648991 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8650476Z I0723 01:40:00.653479 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8653742Z I0723 01:40:00.664396 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8657073Z I0723 01:40:00.670272 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8659951Z I0723 01:40:04.405720 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8661499Z I0723 01:40:04.405782 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8662951Z I0723 01:40:04.405791 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8666239Z I0723 01:40:04.415404 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8669578Z I0723 01:40:04.420308 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8672971Z I0723 01:40:05.022301 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8676230Z I0723 01:40:05.029711 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8679104Z I0723 01:40:05.039617 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8680752Z I0723 01:40:05.039782 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8682119Z I0723 01:40:05.039864 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8684101Z I0723 01:40:05.042841 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8685747Z I0723 01:40:05.042974 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8687115Z I0723 01:40:05.043055 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8689698Z I0723 01:40:05.057308 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8697184Z I0723 01:40:05.061050 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8700464Z I0723 01:40:05.078773 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8703529Z I0723 01:40:05.082892 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8706957Z I0723 01:40:05.662610 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8712574Z I0723 01:40:05.669722 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8715867Z I0723 01:40:05.684277 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8719134Z I0723 01:40:05.689787 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8722937Z I0723 01:40:09.436878 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8724927Z I0723 01:40:09.436943 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8726454Z I0723 01:40:09.436960 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8729495Z I0723 01:40:09.453990 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8733640Z I0723 01:40:09.465064 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8737643Z I0723 01:40:10.066941 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8741678Z I0723 01:40:10.074759 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8745343Z I0723 01:40:10.083751 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8747191Z I0723 01:40:10.084136 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8748569Z I0723 01:40:10.084243 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8750581Z I0723 01:40:10.088646 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-23T01:40:11.8752245Z I0723 01:40:10.088838 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-23T01:40:11.8753603Z I0723 01:40:10.088932 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-23T01:40:11.8756094Z I0723 01:40:10.093496 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8759393Z I0723 01:40:10.100065 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8762630Z I0723 01:40:10.100865 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8765674Z I0723 01:40:10.127217 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-23T01:40:11.8769125Z I0723 01:40:10.702452 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8772248Z I0723 01:40:10.711546 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:11.8775276Z I0723 01:40:10.729363 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-23T01:40:11.8779500Z I0723 01:40:10.734293 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-23T01:40:12.0121765Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-25l5c ***
2021-07-23T01:40:12.0131920Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-25l5c ***
2021-07-23T01:40:12.0137548Z ====================================================================
2021-07-23T01:40:12.0139906Z ##[endgroup]
2021-07-23T01:40:12.0143429Z ##[group]*** submariner-routeagent-25l5c ***
2021-07-23T01:40:12.0145816Z ======================= *** submariner-routeagent-25l5c *** =======================
2021-07-23T01:40:12.0159904Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-25l5c
2021-07-23T01:40:12.0171561Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-25l5c
2021-07-23T01:40:12.0188592Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-25l5c
2021-07-23T01:40:12.3314336Z + trap 'exit 1' SIGTERM SIGINT
2021-07-23T01:40:12.3314936Z + SUBMARINER_VERBOSITY=2
2021-07-23T01:40:12.3315564Z + '[' false == true ']'
2021-07-23T01:40:12.3316109Z + DEBUG=-v=2
2021-07-23T01:40:12.3316961Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-23T01:40:12.3318249Z I0723 01:36:33.301997 1 main.go:55] Starting submariner-route-agent using the event framework
2021-07-23T01:40:12.3319814Z W0723 01:36:33.302633 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:12.3320865Z I0723 01:36:33.304070 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:12.3321603Z I0723 01:36:33.304314 1 cni_iface.go:75] Interface "weave" has "10.1.224.0" address
2021-07-23T01:40:12.3322483Z I0723 01:36:33.304596 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.224.0" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:12.3323929Z I0723 01:36:33.389935 1 cni_iface.go:117] Successfully annotated node "cluster1-control-plane" with cniIfaceIP "10.1.224.0"
2021-07-23T01:40:12.3325104Z I0723 01:36:33.536296 1 registry.go:68] Event handler "logger" added to registry "routeagent_driver".
2021-07-23T01:40:12.3325946Z I0723 01:36:33.536829 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:12.3326676Z I0723 01:36:33.536897 1 cni_iface.go:75] Interface "weave" has "10.1.224.0" address
2021-07-23T01:40:12.3327526Z I0723 01:36:33.536908 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.224.0" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:12.3328803Z I0723 01:36:33.543203 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-23T01:40:12.3330286Z I0723 01:36:33.557377 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-23T01:40:12.3332041Z I0723 01:36:33.561398 1 iptables.go:114] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
2021-07-23T01:40:12.3333553Z I0723 01:36:33.561415 1 iptables.go:135] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
2021-07-23T01:40:12.3334909Z I0723 01:36:33.561422 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-23T01:40:12.3336178Z I0723 01:36:33.575491 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-23T01:40:12.3337574Z I0723 01:36:33.581496 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-23T01:40:12.3338986Z I0723 01:36:33.584251 1 iptables.go:114] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 1.
2021-07-23T01:40:12.3340384Z I0723 01:36:33.584270 1 iptables.go:135] In filter table, iptables rule "-o vx-submariner -j ACCEPT", already exists.
2021-07-23T01:40:12.3341946Z I0723 01:36:33.584279 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.224.0
2021-07-23T01:40:12.3343632Z I0723 01:36:33.586769 1 registry.go:68] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-23T01:40:12.3345412Z I0723 01:36:33.586789 1 registry.go:70] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-23T01:40:12.3346548Z I0723 01:36:33.586795 1 registry.go:68] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-23T01:40:12.3347602Z I0723 01:36:33.586800 1 registry.go:68] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-23T01:40:12.3349164Z W0723 01:36:33.586963 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:12.3350449Z I0723 01:36:33.771594 1 controller.go:142] Starting the Event controller...
2021-07-23T01:40:12.3353708Z I0723 01:36:33.926198 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-23T01:40:12.3356723Z I0723 01:36:33.926251 1 endpoint_handler.go:57] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.7
2021-07-23T01:40:12.3357789Z I0723 01:36:33.926485 1 vxlan.go:91] VxLAN interface already exists with same configuration.
2021-07-23T01:40:12.3358663Z I0723 01:36:33.926585 1 routes_iface.go:176] Reconciling routes to gw: 240.18.0.7
2021-07-23T01:40:12.3359560Z I0723 01:36:33.926701 1 routes_iface.go:192] Processing route {Ifindex: 9 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.3360537Z I0723 01:36:33.926740 1 routes_iface.go:200] Removing route {Ifindex: 9 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.3361692Z I0723 01:36:33.926809 1 routes_iface.go:192] Processing route {Ifindex: 9 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.3362664Z I0723 01:36:33.926829 1 routes_iface.go:200] Removing route {Ifindex: 9 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.3363672Z I0723 01:36:33.926856 1 routes_iface.go:192] Processing route {Ifindex: 9 Dst: 240.0.0.0/8 Src: 240.18.0.9 Gw: <nil> Flags: [] Table: 254}
2021-07-23T01:40:12.3364492Z I0723 01:36:33.926870 1 routes_iface.go:195] Found nil gw or dst
2021-07-23T01:40:12.3367492Z I0723 01:36:33.927019 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:12.3370474Z I0723 01:36:33.941322 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3371830Z I0723 01:36:33.958161 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3373195Z I0723 01:36:33.973665 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3374663Z I0723 01:36:33.984850 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3375599Z I0723 01:36:34.025908 1 controller.go:149] Event controller started
2021-07-23T01:40:12.3377537Z I0723 01:36:34.089425 1 handler.go:90] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-23T01:40:12.3380258Z I0723 01:36:34.097500 1 node_handler.go:31] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-23T01:40:12.3382090Z I0723 01:36:34.111024 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.4, isGatewayNode false
2021-07-23T01:40:12.3384361Z I0723 01:36:34.154864 1 handler.go:90] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.7"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-23T01:40:12.3387170Z I0723 01:36:34.154900 1 node_handler.go:31] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.7"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-23T01:40:12.3388963Z I0723 01:36:34.154911 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.7, isGatewayNode false
2021-07-23T01:40:12.3391347Z I0723 01:36:34.170684 1 handler.go:90] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-23T01:40:12.3394375Z I0723 01:36:34.170713 1 node_handler.go:31] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-23T01:40:12.3401042Z I0723 01:36:34.170729 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode false
2021-07-23T01:40:12.3404569Z I0723 01:36:35.987361 1 handler.go:84] A new Endpoint for remote cluster "cluster2" has been removed: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:12.3407236Z W0723 01:36:35.988760 1 iptables_iface.go:94] Handle the delete use-case
2021-07-23T01:40:12.3408209Z W0723 01:36:35.990348 1 iptables_iface.go:94] Handle the delete use-case
2021-07-23T01:40:12.3412010Z I0723 01:36:36.032252 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-23T01:40:12.3415046Z I0723 01:36:36.040307 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3416966Z I0723 01:36:36.056702 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3418362Z I0723 01:36:36.092126 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3419713Z I0723 01:36:36.106297 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.3476512Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-8bh95 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:12.3479272Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-8bh95 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:12.3491959Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-8bh95 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:12.6505594Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-8bh95 ***
2021-07-23T01:40:12.6523184Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-8bh95 ***
2021-07-23T01:40:12.6525410Z ====================================================================
2021-07-23T01:40:12.6526008Z ##[endgroup]
2021-07-23T01:40:12.6528774Z ##[group]*** submariner-routeagent-8bh95 ***
2021-07-23T01:40:12.6533308Z ======================= *** submariner-routeagent-8bh95 *** =======================
2021-07-23T01:40:12.6545662Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-8bh95
2021-07-23T01:40:12.6559214Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-8bh95
2021-07-23T01:40:12.6574344Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-8bh95
2021-07-23T01:40:12.9609137Z + trap 'exit 1' SIGTERM SIGINT
2021-07-23T01:40:12.9619073Z + SUBMARINER_VERBOSITY=2
2021-07-23T01:40:12.9636150Z + '[' false == true ']'
2021-07-23T01:40:12.9638014Z + DEBUG=-v=2
2021-07-23T01:40:12.9638932Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-23T01:40:12.9640350Z I0723 01:36:30.618875 1 main.go:55] Starting submariner-route-agent using the event framework
2021-07-23T01:40:12.9641878Z W0723 01:36:30.619264 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:12.9642966Z I0723 01:36:30.638186 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:12.9643777Z I0723 01:36:30.638270 1 cni_iface.go:75] Interface "weave" has "10.1.128.0" address
2021-07-23T01:40:12.9644662Z I0723 01:36:30.638276 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.128.0" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:12.9646016Z I0723 01:36:30.827478 1 cni_iface.go:117] Successfully annotated node "cluster1-worker2" with cniIfaceIP "10.1.128.0"
2021-07-23T01:40:12.9647111Z I0723 01:36:31.321706 1 registry.go:68] Event handler "logger" added to registry "routeagent_driver".
2021-07-23T01:40:12.9647985Z I0723 01:36:31.322512 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:12.9648963Z I0723 01:36:31.323755 1 cni_iface.go:75] Interface "weave" has "10.1.128.0" address
2021-07-23T01:40:12.9649837Z I0723 01:36:31.323992 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.128.0" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:12.9651145Z I0723 01:36:31.326819 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-23T01:40:12.9652607Z I0723 01:36:31.398838 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-23T01:40:12.9654251Z I0723 01:36:31.410480 1 iptables.go:114] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
2021-07-23T01:40:12.9655759Z I0723 01:36:31.410495 1 iptables.go:135] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
2021-07-23T01:40:12.9657119Z I0723 01:36:31.410501 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-23T01:40:12.9658405Z I0723 01:36:31.437362 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-23T01:40:12.9659837Z I0723 01:36:31.447585 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-23T01:40:12.9661258Z I0723 01:36:31.464053 1 iptables.go:114] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 1.
2021-07-23T01:40:12.9662662Z I0723 01:36:31.464070 1 iptables.go:135] In filter table, iptables rule "-o vx-submariner -j ACCEPT", already exists.
2021-07-23T01:40:12.9664331Z I0723 01:36:31.464079 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.128.0
2021-07-23T01:40:12.9667660Z I0723 01:36:31.474023 1 registry.go:68] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-23T01:40:12.9669373Z I0723 01:36:31.474047 1 registry.go:70] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-23T01:40:12.9670466Z I0723 01:36:31.474053 1 registry.go:68] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-23T01:40:12.9671449Z I0723 01:36:31.474058 1 registry.go:68] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-23T01:40:12.9672912Z W0723 01:36:31.474223 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:12.9673956Z I0723 01:36:31.694069 1 controller.go:142] Starting the Event controller...
2021-07-23T01:40:12.9677079Z I0723 01:36:31.806691 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:12.9691559Z I0723 01:36:31.806755 1 endpoint_handler.go:57] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.7
2021-07-23T01:40:12.9695828Z I0723 01:36:31.807906 1 vxlan.go:91] VxLAN interface already exists with same configuration.
2021-07-23T01:40:12.9699747Z I0723 01:36:31.808112 1 routes_iface.go:176] Reconciling routes to gw: 240.18.0.7
2021-07-23T01:40:12.9701557Z I0723 01:36:31.808235 1 routes_iface.go:192] Processing route {Ifindex: 18 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.9707601Z I0723 01:36:31.808280 1 routes_iface.go:200] Removing route {Ifindex: 18 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.9711347Z I0723 01:36:31.808322 1 routes_iface.go:192] Processing route {Ifindex: 18 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.9715274Z I0723 01:36:31.808344 1 routes_iface.go:200] Removing route {Ifindex: 18 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.7 Flags: [] Table: 254}
2021-07-23T01:40:12.9721468Z I0723 01:36:31.808375 1 routes_iface.go:192] Processing route {Ifindex: 18 Dst: 240.0.0.0/8 Src: 240.18.0.4 Gw: <nil> Flags: [] Table: 254}
2021-07-23T01:40:12.9722310Z I0723 01:36:31.808383 1 routes_iface.go:195] Found nil gw or dst
2021-07-23T01:40:12.9725457Z I0723 01:36:31.808557 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:12.9728653Z I0723 01:36:31.812353 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9730026Z I0723 01:36:31.854046 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9731354Z I0723 01:36:31.881352 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9732701Z I0723 01:36:31.903033 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9733610Z I0723 01:36:31.911226 1 controller.go:149] Event controller started
2021-07-23T01:40:12.9735857Z I0723 01:36:31.926864 1 handler.go:90] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-23T01:40:12.9738919Z I0723 01:36:31.927626 1 node_handler.go:31] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-23T01:40:12.9740917Z I0723 01:36:31.939473 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode false
2021-07-23T01:40:12.9743130Z I0723 01:36:31.947905 1 handler.go:90] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-23T01:40:12.9746036Z I0723 01:36:31.947985 1 node_handler.go:31] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-23T01:40:12.9747886Z I0723 01:36:31.948014 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.4, isGatewayNode false
2021-07-23T01:40:12.9750357Z I0723 01:36:31.948367 1 handler.go:90] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.7"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-23T01:40:12.9753314Z I0723 01:36:31.948412 1 node_handler.go:31] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.7"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-23T01:40:12.9755143Z I0723 01:36:31.948435 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.7, isGatewayNode false
2021-07-23T01:40:12.9758414Z I0723 01:36:31.965707 1 handler.go:67] The Endpoint for the local cluster has been removed: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:12.9769240Z I0723 01:36:32.118729 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-23T01:40:12.9772287Z I0723 01:36:32.118837 1 endpoint_handler.go:57] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.7
2021-07-23T01:40:12.9781086Z I0723 01:36:32.119367 1 routes_iface.go:176] Reconciling routes to gw: 240.18.0.7
2021-07-23T01:40:12.9782002Z I0723 01:36:32.119937 1 routes_iface.go:192] Processing route {Ifindex: 25 Dst: 240.0.0.0/8 Src: 240.18.0.4 Gw: <nil> Flags: [] Table: 254}
2021-07-23T01:40:12.9782843Z I0723 01:36:32.120005 1 routes_iface.go:195] Found nil gw or dst
2021-07-23T01:40:12.9786220Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-r4gss -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:12.9790406Z I0723 01:36:35.985705 1 handler.go:84] A new Endpoint for remote cluster "cluster2" has been removed: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:12.9793086Z W0723 01:36:35.986020 1 iptables_iface.go:94] Handle the delete use-case
2021-07-23T01:40:12.9794072Z W0723 01:36:35.986083 1 iptables_iface.go:94] Handle the delete use-case
2021-07-23T01:40:12.9797301Z I0723 01:36:36.025430 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-23T01:40:12.9801581Z I0723 01:36:36.028231 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9802932Z I0723 01:36:36.030542 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9804281Z I0723 01:36:36.057589 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9805610Z I0723 01:36:36.080757 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:12.9807588Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-r4gss -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:12.9815312Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-r4gss -o jsonpath={.status.containerStatuses[*].ready}
2021-07-23T01:40:13.3139826Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-r4gss ***
2021-07-23T01:40:13.3177156Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-r4gss ***
2021-07-23T01:40:13.3184565Z ====================================================================
2021-07-23T01:40:13.3191763Z ##[endgroup]
2021-07-23T01:40:13.3198246Z ##[group]*** submariner-routeagent-r4gss ***
2021-07-23T01:40:13.3204487Z ======================= *** submariner-routeagent-r4gss *** =======================
2021-07-23T01:40:13.3223691Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-r4gss
2021-07-23T01:40:13.3247827Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-r4gss
2021-07-23T01:40:13.3270734Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-r4gss
2021-07-23T01:40:13.6600220Z + trap 'exit 1' SIGTERM SIGINT
2021-07-23T01:40:13.6601621Z + SUBMARINER_VERBOSITY=2
2021-07-23T01:40:13.6602533Z + '[' false == true ']'
2021-07-23T01:40:13.6603128Z + DEBUG=-v=2
2021-07-23T01:40:13.6604067Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-23T01:40:13.6605933Z I0723 01:36:34.792084 1 main.go:55] Starting submariner-route-agent using the event framework
2021-07-23T01:40:13.6607778Z W0723 01:36:34.792435 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:13.6609079Z I0723 01:36:34.798050 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:13.6609872Z I0723 01:36:34.798237 1 cni_iface.go:75] Interface "weave" has "10.1.0.1" address
2021-07-23T01:40:13.6610820Z I0723 01:36:34.798282 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:13.6612253Z I0723 01:36:34.846895 1 cni_iface.go:117] Successfully annotated node "cluster1-worker" with cniIfaceIP "10.1.0.1"
2021-07-23T01:40:13.6613611Z I0723 01:36:35.026012 1 registry.go:68] Event handler "logger" added to registry "routeagent_driver".
2021-07-23T01:40:13.6614606Z I0723 01:36:35.026662 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-23T01:40:13.6615279Z I0723 01:36:35.026726 1 cni_iface.go:75] Interface "weave" has "10.1.0.1" address
2021-07-23T01:40:13.6616097Z I0723 01:36:35.026732 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-23T01:40:13.6617313Z I0723 01:36:35.094411 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-23T01:40:13.6618900Z I0723 01:36:35.167846 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-23T01:40:13.6620335Z I0723 01:36:35.195390 1 iptables.go:114] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
2021-07-23T01:40:13.6621719Z I0723 01:36:35.195407 1 iptables.go:135] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
2021-07-23T01:40:13.6622978Z I0723 01:36:35.195413 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-23T01:40:13.6624151Z I0723 01:36:35.213958 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-23T01:40:13.6625537Z I0723 01:36:35.225592 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-23T01:40:13.6626959Z I0723 01:36:35.236108 1 iptables.go:114] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 1.
2021-07-23T01:40:13.6628240Z I0723 01:36:35.236126 1 iptables.go:135] In filter table, iptables rule "-o vx-submariner -j ACCEPT", already exists.
2021-07-23T01:40:13.6629913Z I0723 01:36:35.236184 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.0.1
2021-07-23T01:40:13.6631576Z I0723 01:36:35.242320 1 registry.go:68] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-23T01:40:13.6633415Z I0723 01:36:35.242337 1 registry.go:70] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-23T01:40:13.6634496Z I0723 01:36:35.242343 1 registry.go:68] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-23T01:40:13.6635566Z I0723 01:36:35.242348 1 registry.go:68] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-23T01:40:13.6637018Z W0723 01:36:35.242484 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-23T01:40:13.6638061Z I0723 01:36:35.327610 1 controller.go:142] Starting the Event controller...
2021-07-23T01:40:13.6641305Z I0723 01:36:35.429861 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:13.6643979Z I0723 01:36:35.441641 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6645236Z I0723 01:36:35.454349 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6646465Z I0723 01:36:35.464828 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6647706Z I0723 01:36:35.470485 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6653465Z I0723 01:36:35.485704 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-7", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-23T01:40:13.6656094Z I0723 01:36:35.485737 1 handler.go:52] The current node has become a Gateway
2021-07-23T01:40:13.6656924Z I0723 01:36:35.485808 1 gw_transition.go:48] The current node has become a Gateway
2021-07-23T01:40:13.6657864Z I0723 01:36:35.486195 1 routes_iface.go:161] Processing route {Ifindex: 15 Dst: 240.0.0.0/8 Src: 240.18.0.7 Gw: <nil> Flags: [] Table: 254}
2021-07-23T01:40:13.6658681Z I0723 01:36:35.486276 1 routes_iface.go:164] Found nil gw or dst
2021-07-23T01:40:13.6661601Z I0723 01:36:35.486296 1 gw_transition.go:56] Creating the vxlan interface: vx-submariner on the gateway node
2021-07-23T01:40:13.6662675Z I0723 01:36:35.486571 1 vxlan.go:91] VxLAN interface already exists with same configuration.
2021-07-23T01:40:13.6680923Z I0723 01:36:35.486724 1 vxlan.go:274] Successfully configured reverse path filter to loose mode on "vx-submariner"
2021-07-23T01:40:13.6682082Z I0723 01:36:35.529595 1 controller.go:149] Event controller started
2021-07-23T01:40:13.6684234Z I0723 01:36:35.530826 1 handler.go:90] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-23T01:40:13.6687093Z I0723 01:36:35.530857 1 node_handler.go:31] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-23T01:40:13.6697957Z I0723 01:36:35.530870 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode true
2021-07-23T01:40:13.6699390Z I0723 01:36:35.531017 1 vxlan.go:189] Successfully added the bridge fdb entry 172.18.0.9 00:00:00:00:00:00
2021-07-23T01:40:13.6705808Z I0723 01:36:35.531326 1 handler.go:90] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-23T01:40:13.6713604Z I0723 01:36:35.531341 1 node_handler.go:31] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-23T01:40:13.6716109Z I0723 01:36:35.531349 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.4, isGatewayNode true
2021-07-23T01:40:13.6717480Z I0723 01:36:35.531381 1 vxlan.go:189] Successfully added the bridge fdb entry 172.18.0.4 00:00:00:00:00:00
2021-07-23T01:40:13.6720020Z I0723 01:36:35.535431 1 handler.go:90] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.7"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-23T01:40:13.6723367Z I0723 01:36:35.535483 1 node_handler.go:31] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.7"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-23T01:40:13.6725625Z I0723 01:36:35.535518 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.7, isGatewayNode true
2021-07-23T01:40:13.6727208Z I0723 01:36:35.535596 1 vxlan.go:189] Successfully added the bridge fdb entry 172.18.0.7 00:00:00:00:00:00
2021-07-23T01:40:13.6731117Z I0723 01:36:35.993531 1 handler.go:84] A new Endpoint for remote cluster "cluster2" has been removed: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-23T01:40:13.6734810Z I0723 01:36:35.993573 1 routes_iface.go:252] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-23T01:40:13.6736893Z W0723 01:36:35.995400 1 iptables_iface.go:94] Handle the delete use-case
2021-07-23T01:40:13.6738132Z W0723 01:36:35.995412 1 iptables_iface.go:94] Handle the delete use-case
2021-07-23T01:40:13.6741361Z I0723 01:36:36.030483 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-8", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.8", PublicIP:"104.208.158.205", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-23T01:40:13.6744486Z I0723 01:36:36.030622 1 routes_iface.go:252] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-23T01:40:13.6746389Z [submariner-operator]$ [cluster1] print_section * Output of 'subctl show all' in cluster1 *
2021-07-23T01:40:13.6747760Z [submariner-operator]$ [cluster1] print_section * Output of 'subctl show all' in cluster1 *
2021-07-23T01:40:13.6749156Z I0723 01:36:36.034808 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6750517Z I0723 01:36:36.038047 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6751986Z I0723 01:36:36.049054 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6753312Z I0723 01:36:36.085744 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-23T01:40:13.6754067Z ====================================================================
2021-07-23T01:40:13.6754604Z ##[endgroup]
2021-07-23T01:40:13.6755528Z ##[group]* Output of 'subctl show all' in cluster1 *
2021-07-23T01:40:13.6756407Z ======================= * Output of 'subctl show all' in cluster1 * =======================
2021-07-23T01:40:13.6767957Z [submariner-operator]$ [cluster1] subctl show all
2021-07-23T01:40:13.7211948Z Cluster "cluster1"
2021-07-23T01:40:13.7259141Z • Showing Connections ...
2021-07-23T01:40:13.7299004Z ✓ Showing Connections
2021-07-23T01:40:13.7299743Z • Showing Endpoints ...
2021-07-23T01:40:13.7300490Z GATEWAY CLUSTER REMOTE IP NAT CABLE DRIVER SUBNETS STATUS RTT avg.
2021-07-23T01:40:13.7301737Z cluster2-worker cluster2 172.18.0.8 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 205.043µs
2021-07-23T01:40:13.7302292Z
2021-07-23T01:40:13.7327235Z ✓ Showing Endpoints
2021-07-23T01:40:13.7327901Z • Showing Gateways ...
2021-07-23T01:40:13.7328584Z CLUSTER ID ENDPOINT IP PUBLIC IP CABLE DRIVER TYPE
2021-07-23T01:40:13.7329323Z cluster1 172.18.0.7 104.208.158.205 libreswan local
2021-07-23T01:40:13.7330005Z cluster2 172.18.0.8 104.208.158.205 libreswan remote
2021-07-23T01:40:13.7330422Z
2021-07-23T01:40:13.7358319Z ✓ Showing Gateways
2021-07-23T01:40:13.7358920Z NODE HA STATUS SUMMARY
2021-07-23T01:40:13.7360157Z cluster1-worker active All connections (1) are established
2021-07-23T01:40:13.7360708Z
2021-07-23T01:40:13.7361287Z Discovered network details via Submariner:
2021-07-23T01:40:13.7362123Z Network plugin: weave-net
2021-07-23T01:40:13.7362648Z Service CIDRs: [100.1.0.0/16]
2021-07-23T01:40:13.7363139Z Cluster CIDRs: [10.1.0.0/16]
2021-07-23T01:40:13.7363436Z
2021-07-23T01:40:13.7364552Z • Showing Network details ...
2021-07-23T01:40:13.7366049Z ✓ Showing Network details
2021-07-23T01:40:13.7366686Z • Showing versions ...
2021-07-23T01:40:13.7498803Z ✓ Showing versions
2021-07-23T01:40:13.7499466Z COMPONENT REPOSITORY VERSION
2021-07-23T01:40:13.7500201Z submariner localhost:5000 local
2021-07-23T01:40:13.7501262Z submariner-operator localhost:5000 local
2021-07-23T01:40:13.7502360Z service-discovery localhost:5000 local
2021-07-23T01:40:13.7502854Z
2021-07-23T01:40:13.7503248Z Cluster "cluster2"
2021-07-23T01:40:13.7628597Z • Showing Connections ...
2021-07-23T01:40:13.7652362Z ✓ Showing Connections
2021-07-23T01:40:13.7653122Z GATEWAY CLUSTER REMOTE IP NAT CABLE DRIVER SUBNETS STATUS RTT avg.
2021-07-23T01:40:13.7654038Z • Showing Endpoints ...
2021-07-23T01:40:13.7654987Z cluster1-worker cluster1 172.18.0.7 no libreswan 100.1.0.0/16, 10.1.0.0/16 error 0s
2021-07-23T01:40:13.7655512Z
2021-07-23T01:40:13.7684360Z ✓ Showing Endpoints
2021-07-23T01:40:13.7685057Z CLUSTER ID ENDPOINT IP PUBLIC IP CABLE DRIVER TYPE
2021-07-23T01:40:13.7685907Z • Showing Gateways ...
2021-07-23T01:40:13.7686533Z cluster2 172.18.0.8 104.208.158.205 libreswan local
2021-07-23T01:40:13.7687436Z cluster1 172.18.0.7 104.208.158.205 libreswan remote
2021-07-23T01:40:13.7687854Z
2021-07-23T01:40:13.7714775Z ✓ Showing Gateways
2021-07-23T01:40:13.7715344Z NODE HA STATUS SUMMARY
2021-07-23T01:40:13.7716836Z cluster2-worker active 0 connections out of 1 are established
2021-07-23T01:40:13.7717553Z
2021-07-23T01:40:13.7718268Z Discovered network details via Submariner:
2021-07-23T01:40:13.7719220Z Network plugin: weave-net
2021-07-23T01:40:13.7719902Z Service CIDRs: [100.2.0.0/16]
2021-07-23T01:40:13.7720523Z Cluster CIDRs: [10.2.0.0/16]
2021-07-23T01:40:13.7720941Z
2021-07-23T01:40:13.7721748Z • Showing Network details ...
2021-07-23T01:40:13.7722594Z ✓ Showing Network details
2021-07-23T01:40:13.7723376Z • Showing versions ...
2021-07-23T01:40:13.7760022Z ✓ Showing versions
2021-07-23T01:40:13.7760692Z COMPONENT REPOSITORY VERSION
2021-07-23T01:40:13.7761921Z submariner localhost:5000 local
2021-07-23T01:40:13.7762987Z submariner-operator localhost:5000 local
2021-07-23T01:40:13.7764132Z service-discovery localhost:5000 local
2021-07-23T01:40:13.7764589Z
2021-07-23T01:40:13.7801514Z [submariner-operator]$ [cluster1] return 0
2021-07-23T01:40:13.7815735Z [submariner-operator]$ [cluster2] post_analyze
2021-07-23T01:40:13.7829117Z [submariner-operator]$ [cluster2] post_analyze
2021-07-23T01:40:13.7849071Z [submariner-operator]$ [cluster2] print_section * Kubernetes client and server versions in cluster2 *
2021-07-23T01:40:13.7862543Z [submariner-operator]$ [cluster2] print_section * Kubernetes client and server versions in cluster2 *
2021-07-23T01:40:13.7868194Z ====================================================================
2021-07-23T01:40:13.7872382Z ##[endgroup]
2021-07-23T01:40:13.7875815Z ##[group]* Kubernetes client and server versions in cluster2 *
2021-07-23T01:40:13.7879553Z ======================= * Kubernetes client and server versions in cluster2 * =======================
2021-07-23T01:40:13.7892110Z [submariner-operator]$ [cluster2] kubectl version
2021-07-23T01:40:13.7904957Z [submariner-operator]$ [cluster2] kubectl version
2021-07-23T01:40:13.7919632Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 version
2021-07-23T01:40:14.1035137Z Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.5", GitCommit:"6b1d87acf3c8253c123756b9e61dac642678305f", GitTreeState:"archive", BuildDate:"2021-03-30T00:00:00Z", GoVersion:"go1.16", Compiler:"gc", Platform:"linux/amd64"}
2021-07-23T01:40:14.1037857Z Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.7", GitCommit:"132a687512d7fb058d0f5890f07d4121b3f0a2e2", GitTreeState:"clean", BuildDate:"2021-05-27T23:27:49Z", GoVersion:"go1.15.12", Compiler:"gc", Platform:"linux/amd64"}
2021-07-23T01:40:14.1092259Z [submariner-operator]$ [cluster2] print_section * Overview of all resources in cluster2 *
2021-07-23T01:40:14.1113646Z [submariner-operator]$ [cluster2] print_section * Overview of all resources in cluster2 *
2021-07-23T01:40:14.1116101Z ====================================================================
2021-07-23T01:40:14.1116686Z ##[endgroup]
2021-07-23T01:40:14.1117326Z ##[group]* Overview of all resources in cluster2 *
2021-07-23T01:40:14.1118040Z ======================= * Overview of all resources in cluster2 * =======================
2021-07-23T01:40:14.1127854Z [submariner-operator]$ [cluster2] kubectl api-resources --verbs=list -o name
2021-07-23T01:40:14.1146765Z [submariner-operator]$ [cluster2] kubectl api-resources --verbs=list -o name
2021-07-23T01:40:14.1148584Z [submariner-operator]$ [cluster2] xargs -n 1 kubectl get --show-kind -o wide --ignore-not-found
2021-07-23T01:40:14.1163137Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources --verbs=list -o name
2021-07-23T01:40:14.8016283Z Warning: v1 ComponentStatus is deprecated in v1.19+
2021-07-23T01:40:14.8025729Z NAME STATUS MESSAGE ERROR
2021-07-23T01:40:14.8026876Z componentstatus/scheduler Unhealthy Get "http://127.0.0.1:10251/healthz": dial tcp 127.0.0.1:10251: connect: connection refused
2021-07-23T01:40:14.8029069Z componentstatus/controller-manager Unhealthy Get "http://127.0.0.1:10252/healthz": dial tcp 127.0.0.1:10252: connect: connection refused
2021-07-23T01:40:14.8030988Z componentstatus/etcd-0 Healthy {"health":"true"}
2021-07-23T01:40:15.1132947Z NAME DATA AGE
2021-07-23T01:40:15.1134254Z configmap/kube-root-ca.crt 1 12m
2021-07-23T01:40:15.4182299Z NAME ENDPOINTS AGE
2021-07-23T01:40:15.4184279Z endpoints/kubernetes 172.18.0.9:6443 12m
2021-07-23T01:40:15.4185774Z endpoints/nginx-demo 10.1.0.5:8080,10.1.128.4:8080 3m25s
2021-07-23T01:40:15.7745592Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-23T01:40:15.7748832Z 12m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 12m 1 event/cluster1-control-plane.1694473abfe5142b
2021-07-23T01:40:15.7752580Z 12m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 12m 1 event/cluster1-control-plane.1694473ac7102218
2021-07-23T01:40:15.7756733Z 12m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 12m 1 event/cluster1-control-plane.1694473ac7103b18
2021-07-23T01:40:15.7760759Z 12m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 12m 1 event/cluster1-control-plane.1694473ac7104ab8
2021-07-23T01:40:15.7764600Z 12m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 12m 1 event/cluster1-control-plane.1694473adcc30cad
2021-07-23T01:40:15.7768550Z 12m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 12m 1 event/cluster1-control-plane.1694473cc27ed69b
2021-07-23T01:40:15.7772111Z 12m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 12m 1 event/cluster1-control-plane.1694473d58e869dc
2021-07-23T01:40:15.7775667Z 11m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 11m 1 event/cluster1-control-plane.16944746732fe574
2021-07-23T01:40:15.7778745Z 11m Normal Starting node/cluster1-worker kubelet, cluster1-worker Starting kubelet. 11m 1 event/cluster1-worker.1694473f317843a9
2021-07-23T01:40:15.7781758Z 11m Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 11m 1 event/cluster1-worker.1694473f3a05b885
2021-07-23T01:40:15.7785291Z 11m Normal NodeHasNoDiskPressure node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasNoDiskPressure 11m 1 event/cluster1-worker.1694473f3a05d0bd
2021-07-23T01:40:15.7788619Z 11m Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 11m 1 event/cluster1-worker.1694473f3a05e571
2021-07-23T01:40:15.7791770Z 11m Normal NodeAllocatableEnforced node/cluster1-worker kubelet, cluster1-worker Updated Node Allocatable limit across pods 11m 1 event/cluster1-worker.1694473f43a21ae7
2021-07-23T01:40:15.7794605Z 11m Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 11m 1 event/cluster1-worker.1694474030e72a3a
2021-07-23T01:40:15.7797479Z 11m Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 11m 1 event/cluster1-worker.1694474040a6e1d6
2021-07-23T01:40:15.7800519Z 11m Normal NodeReady node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeReady 11m 1 event/cluster1-worker.16944744037da17e
2021-07-23T01:40:15.7803217Z 11m Normal Starting node/cluster1-worker2 kubelet, cluster1-worker2 Starting kubelet. 11m 1 event/cluster1-worker2.1694473f00de0d6e
2021-07-23T01:40:15.7806258Z 11m Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 11m 1 event/cluster1-worker2.1694473f138a1314
2021-07-23T01:40:15.7809768Z 11m Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 11m 1 event/cluster1-worker2.1694473f138a2cdd
2021-07-23T01:40:15.7813152Z 11m Normal NodeHasSufficientPID node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientPID 11m 1 event/cluster1-worker2.1694473f138a3f9d
2021-07-23T01:40:15.7844539Z 11m Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 11m 1 event/cluster1-worker2.1694473f169cdceb
2021-07-23T01:40:15.7848074Z 11m Normal NodeAllocatableEnforced node/cluster1-worker2 kubelet, cluster1-worker2 Updated Node Allocatable limit across pods 11m 1 event/cluster1-worker2.1694473f1ef880f4
2021-07-23T01:40:15.7851010Z 11m Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 11m 1 event/cluster1-worker2.1694473ffacf5e52
2021-07-23T01:40:15.7853795Z 11m Normal NodeReady node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeReady 11m 1 event/cluster1-worker2.1694474623c46fba
2021-07-23T01:40:15.7857397Z 3m25s Normal Scheduled pod/nginx-demo-b8f8b4fc6-6pk9n default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-6pk9n to cluster1-worker2 3m25s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5772f1816
2021-07-23T01:40:15.7861112Z 3m25s Normal Pulling pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 3m25s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b59e316f98
2021-07-23T01:40:15.7864742Z 3m25s Normal Pulled pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 99.109281ms 3m25s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5a41a143e
2021-07-23T01:40:15.7868695Z 3m25s Normal Created pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 3m25s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5a5e93662
2021-07-23T01:40:15.7872197Z 3m25s Normal Started pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 3m25s 1 event/nginx-demo-b8f8b4fc6-6pk9n.169447b5aaddc1ee
2021-07-23T01:40:15.7875887Z 6m11s Normal Scheduled pod/nginx-demo-b8f8b4fc6-ct55c default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-ct55c to cluster1-worker2 6m11s 1 event/nginx-demo-b8f8b4fc6-ct55c.1694478eefed7f53
2021-07-23T01:40:15.7879576Z 6m10s Normal Pulling pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 6m10s 1 event/nginx-demo-b8f8b4fc6-ct55c.1694478f1133f9f4
2021-07-23T01:40:15.7883152Z 6m6s Normal Pulled pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.147359692s 6m6s 1 event/nginx-demo-b8f8b4fc6-ct55c.16944790086807e4
2021-07-23T01:40:15.7886674Z 6m5s Normal Created pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 6m5s 1 event/nginx-demo-b8f8b4fc6-ct55c.1694479043aa906a
2021-07-23T01:40:15.7890226Z 6m5s Normal Started pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 6m5s 1 event/nginx-demo-b8f8b4fc6-ct55c.169447904bf4a4ff
2021-07-23T01:40:15.7893706Z 6m2s Normal Killing pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Stopping container nginx-demo 6m2s 1 event/nginx-demo-b8f8b4fc6-ct55c.16944790fb1986d1
2021-07-23T01:40:15.7897381Z 6m11s Normal Scheduled pod/nginx-demo-b8f8b4fc6-d2rms default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-d2rms to cluster1-worker 6m11s 1 event/nginx-demo-b8f8b4fc6-d2rms.1694478eefeb682a
2021-07-23T01:40:15.7901083Z 6m10s Normal Pulling pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 6m10s 1 event/nginx-demo-b8f8b4fc6-d2rms.1694478f10a1883e
2021-07-23T01:40:15.7904729Z 6m5s Normal Pulled pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.960547211s 6m5s 1 event/nginx-demo-b8f8b4fc6-d2rms.16944790384db0dd
2021-07-23T01:40:15.7908414Z 6m5s Normal Created pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 6m5s 1 event/nginx-demo-b8f8b4fc6-d2rms.1694479043a6d48d
2021-07-23T01:40:15.7911873Z 6m5s Normal Started pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 6m5s 1 event/nginx-demo-b8f8b4fc6-d2rms.16944790494bb123
2021-07-23T01:40:15.7915333Z 6m2s Normal Killing pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Stopping container nginx-demo 6m2s 1 event/nginx-demo-b8f8b4fc6-d2rms.16944790fae609dd
2021-07-23T01:40:15.7919011Z 3m25s Normal Scheduled pod/nginx-demo-b8f8b4fc6-kxvdm default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-kxvdm to cluster1-worker 3m25s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b57941e30d
2021-07-23T01:40:15.7922784Z 3m25s Normal Pulling pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 3m25s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b59c987a4c
2021-07-23T01:40:15.7926393Z 3m25s Normal Pulled pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 188.803198ms 3m25s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b5a7d99592
2021-07-23T01:40:15.7929980Z 3m25s Normal Created pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 3m25s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b5a948bbab
2021-07-23T01:40:15.7933503Z 3m24s Normal Started pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 3m24s 1 event/nginx-demo-b8f8b4fc6-kxvdm.169447b5ae418dc0
2021-07-23T01:40:15.7946145Z 6m11s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-ct55c 6m11s 1 event/nginx-demo-b8f8b4fc6.1694478eebb65a70
2021-07-23T01:40:15.7950171Z 6m11s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-d2rms 6m11s 1 event/nginx-demo-b8f8b4fc6.1694478eeee4497f
2021-07-23T01:40:15.7953851Z 3m25s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-6pk9n 3m25s 1 event/nginx-demo-b8f8b4fc6.169447b575d21629
2021-07-23T01:40:15.7957393Z 3m25s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-kxvdm 3m25s 1 event/nginx-demo-b8f8b4fc6.169447b576da6a34
2021-07-23T01:40:15.7962278Z 6m11s Warning OwnerRefInvalidNamespace endpointslice/nginx-demo-cluster1 garbage-collector-controller ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 719888ef-3013-40d8-8a00-26455c361970] does not exist in namespace "default" 6m11s 1 event/nginx-demo-cluster1.1694478efa5ffe71
2021-07-23T01:40:15.7966750Z 6m11s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 6m11s 1 event/nginx-demo.1694478ee92475bf
2021-07-23T01:40:15.7969719Z 3m25s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 3m25s 1 event/nginx-demo.169447b57412e933
2021-07-23T01:40:15.7974093Z 3m55s Warning FailedToCreateEndpoint endpoints/submariner-lighthouse-coredns endpoint-controller Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints "submariner-lighthouse-coredns" already exists 3m55s 1 event/submariner-lighthouse-coredns.169447ae7690ad4e
2021-07-23T01:40:16.4102841Z NAME STATUS AGE
2021-07-23T01:40:16.4103456Z namespace/default Active 12m
2021-07-23T01:40:16.4104742Z namespace/kube-node-lease Active 12m
2021-07-23T01:40:16.4106208Z namespace/kube-public Active 12m
2021-07-23T01:40:16.4107125Z namespace/kube-system Active 12m
2021-07-23T01:40:16.4107983Z namespace/local-path-storage Active 12m
2021-07-23T01:40:16.4108966Z namespace/submariner-k8s-broker Active 7m35s
2021-07-23T01:40:16.4110228Z namespace/submariner-operator Active 7m34s
2021-07-23T01:40:16.7035215Z NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
2021-07-23T01:40:16.7050158Z node/cluster1-control-plane Ready control-plane,master 12m v1.20.7 172.18.0.9 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-23T01:40:16.7069311Z node/cluster1-worker Ready <none> 11m v1.20.7 172.18.0.7 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-23T01:40:16.7071836Z node/cluster1-worker2 Ready <none> 11m v1.20.7 172.18.0.4 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-23T01:40:17.6449151Z NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
2021-07-23T01:40:17.6451122Z pod/nginx-demo-b8f8b4fc6-6pk9n 1/1 Running 0 3m27s 10.1.128.4 cluster1-worker2 <none> <none>
2021-07-23T01:40:17.6452824Z pod/nginx-demo-b8f8b4fc6-kxvdm 1/1 Running 0 3m27s 10.1.0.5 cluster1-worker <none> <none>
2021-07-23T01:40:18.8517700Z NAME TYPE DATA AGE
2021-07-23T01:40:18.8519201Z secret/default-token-bncmd kubernetes.io/service-account-token 3 12m
2021-07-23T01:40:19.1496521Z NAME SECRETS AGE
2021-07-23T01:40:19.1497140Z serviceaccount/default 1 12m
2021-07-23T01:40:19.4419629Z NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
2021-07-23T01:40:19.4423258Z service/kubernetes ClusterIP 100.1.0.1 <none> 443/TCP 12m <none>
2021-07-23T01:40:19.4424606Z service/nginx-demo ClusterIP 100.1.223.109 <none> 80/TCP 3m29s app=nginx-demo
2021-07-23T01:40:20.6666535Z NAME CREATED AT
2021-07-23T01:40:20.6675370Z customresourcedefinition.apiextensions.k8s.io/brokers.submariner.io 2021-07-23T01:32:42Z
2021-07-23T01:40:20.6680875Z customresourcedefinition.apiextensions.k8s.io/clusterglobalegressips.submariner.io 2021-07-23T01:36:10Z
2021-07-23T01:40:20.6687774Z customresourcedefinition.apiextensions.k8s.io/clusters.submariner.io 2021-07-23T01:32:52Z
2021-07-23T01:40:20.6692849Z customresourcedefinition.apiextensions.k8s.io/endpoints.submariner.io 2021-07-23T01:32:52Z
2021-07-23T01:40:20.6697523Z customresourcedefinition.apiextensions.k8s.io/gateways.submariner.io 2021-07-23T01:32:52Z
2021-07-23T01:40:20.6701901Z customresourcedefinition.apiextensions.k8s.io/globalegressips.submariner.io 2021-07-23T01:36:10Z
2021-07-23T01:40:20.6706559Z customresourcedefinition.apiextensions.k8s.io/globalingressips.submariner.io 2021-07-23T01:36:10Z
2021-07-23T01:40:20.6709368Z customresourcedefinition.apiextensions.k8s.io/servicediscoveries.submariner.io 2021-07-23T01:32:42Z
2021-07-23T01:40:20.6712070Z customresourcedefinition.apiextensions.k8s.io/serviceexports.multicluster.x-k8s.io 2021-07-23T01:32:50Z
2021-07-23T01:40:20.6714799Z customresourcedefinition.apiextensions.k8s.io/serviceimports.multicluster.x-k8s.io 2021-07-23T01:32:50Z
2021-07-23T01:40:20.6717382Z customresourcedefinition.apiextensions.k8s.io/submariners.submariner.io 2021-07-23T01:32:41Z
2021-07-23T01:40:21.0852314Z NAME SERVICE AVAILABLE AGE
2021-07-23T01:40:21.0874414Z apiservice.apiregistration.k8s.io/v1. Local True 12m
2021-07-23T01:40:21.0876090Z apiservice.apiregistration.k8s.io/v1.admissionregistration.k8s.io Local True 12m
2021-07-23T01:40:21.0877765Z apiservice.apiregistration.k8s.io/v1.apiextensions.k8s.io Local True 12m
2021-07-23T01:40:21.0879419Z apiservice.apiregistration.k8s.io/v1.apps Local True 12m
2021-07-23T01:40:21.0889300Z apiservice.apiregistration.k8s.io/v1.authentication.k8s.io Local True 12m
2021-07-23T01:40:21.0891012Z apiservice.apiregistration.k8s.io/v1.authorization.k8s.io Local True 12m
2021-07-23T01:40:21.0901643Z apiservice.apiregistration.k8s.io/v1.autoscaling Local True 12m
2021-07-23T01:40:21.0966922Z apiservice.apiregistration.k8s.io/v1.batch Local True 12m
2021-07-23T01:40:21.0968247Z apiservice.apiregistration.k8s.io/v1.certificates.k8s.io Local True 12m
2021-07-23T01:40:21.0969661Z apiservice.apiregistration.k8s.io/v1.coordination.k8s.io Local True 12m
2021-07-23T01:40:21.0971016Z apiservice.apiregistration.k8s.io/v1.events.k8s.io Local True 12m
2021-07-23T01:40:21.0972346Z apiservice.apiregistration.k8s.io/v1.networking.k8s.io Local True 12m
2021-07-23T01:40:21.0973648Z apiservice.apiregistration.k8s.io/v1.node.k8s.io Local True 12m
2021-07-23T01:40:21.0975019Z apiservice.apiregistration.k8s.io/v1.rbac.authorization.k8s.io Local True 12m
2021-07-23T01:40:21.0976461Z apiservice.apiregistration.k8s.io/v1.scheduling.k8s.io Local True 12m
2021-07-23T01:40:21.0977792Z apiservice.apiregistration.k8s.io/v1.storage.k8s.io Local True 12m
2021-07-23T01:40:21.0979199Z apiservice.apiregistration.k8s.io/v1.submariner.io Local True 7m29s
2021-07-23T01:40:21.0981383Z apiservice.apiregistration.k8s.io/v1alpha1.multicluster.x-k8s.io Local True 7m31s
2021-07-23T01:40:21.0982892Z apiservice.apiregistration.k8s.io/v1alpha1.submariner.io Local True 7m39s
2021-07-23T01:40:21.0985539Z apiservice.apiregistration.k8s.io/v1beta1.admissionregistration.k8s.io Local True 12m
2021-07-23T01:40:21.0987433Z apiservice.apiregistration.k8s.io/v1beta1.apiextensions.k8s.io Local True 12m
2021-07-23T01:40:21.0989105Z apiservice.apiregistration.k8s.io/v1beta1.authentication.k8s.io Local True 12m
2021-07-23T01:40:21.0990770Z apiservice.apiregistration.k8s.io/v1beta1.authorization.k8s.io Local True 12m
2021-07-23T01:40:21.0992252Z apiservice.apiregistration.k8s.io/v1beta1.batch Local True 12m
2021-07-23T01:40:21.0993732Z apiservice.apiregistration.k8s.io/v1beta1.certificates.k8s.io Local True 12m
2021-07-23T01:40:21.0995336Z apiservice.apiregistration.k8s.io/v1beta1.coordination.k8s.io Local True 12m
2021-07-23T01:40:21.0996923Z apiservice.apiregistration.k8s.io/v1beta1.discovery.k8s.io Local True 12m
2021-07-23T01:40:21.0998449Z apiservice.apiregistration.k8s.io/v1beta1.events.k8s.io Local True 12m
2021-07-23T01:40:21.0999895Z apiservice.apiregistration.k8s.io/v1beta1.extensions Local True 12m
2021-07-23T01:40:21.1004677Z apiservice.apiregistration.k8s.io/v1beta1.flowcontrol.apiserver.k8s.io Local True 12m
2021-07-23T01:40:21.1007415Z apiservice.apiregistration.k8s.io/v1beta1.networking.k8s.io Local True 12m
2021-07-23T01:40:21.1008829Z apiservice.apiregistration.k8s.io/v1beta1.node.k8s.io Local True 12m
2021-07-23T01:40:21.1010130Z apiservice.apiregistration.k8s.io/v1beta1.policy Local True 12m
2021-07-23T01:40:21.1011582Z apiservice.apiregistration.k8s.io/v1beta1.rbac.authorization.k8s.io Local True 12m
2021-07-23T01:40:21.1013145Z apiservice.apiregistration.k8s.io/v1beta1.scheduling.k8s.io Local True 12m
2021-07-23T01:40:21.1015005Z apiservice.apiregistration.k8s.io/v1beta1.storage.k8s.io Local True 12m
2021-07-23T01:40:21.1016389Z apiservice.apiregistration.k8s.io/v2beta1.autoscaling Local True 12m
2021-07-23T01:40:21.1017714Z apiservice.apiregistration.k8s.io/v2beta2.autoscaling Local True 12m
2021-07-23T01:40:22.0106915Z NAME READY UP-TO-DATE AVAILABLE AGE CONTAINERS IMAGES SELECTOR
2021-07-23T01:40:22.0108148Z deployment.apps/nginx-demo 2/2 2 2 3m32s nginx-demo quay.io/bitnami/nginx:latest app=nginx-demo
2021-07-23T01:40:22.3138665Z NAME DESIRED CURRENT READY AGE CONTAINERS IMAGES SELECTOR
2021-07-23T01:40:22.3141128Z replicaset.apps/nginx-demo-b8f8b4fc6 2 2 2 3m32s nginx-demo quay.io/bitnami/nginx:latest app=nginx-demo,pod-template-hash=b8f8b4fc6
2021-07-23T01:40:23.9156889Z NAME AGE SIGNERNAME REQUESTOR CONDITION
2021-07-23T01:40:23.9159585Z certificatesigningrequest.certificates.k8s.io/csr-2zsqp 12m kubernetes.io/kube-apiserver-client-kubelet system:bootstrap:abcdef Approved,Issued
2021-07-23T01:40:23.9162782Z certificatesigningrequest.certificates.k8s.io/csr-q7bqc 12m kubernetes.io/kube-apiserver-client-kubelet system:bootstrap:abcdef Approved,Issued
2021-07-23T01:40:24.7341668Z NAME ADDRESSTYPE PORTS ENDPOINTS AGE
2021-07-23T01:40:24.7342810Z endpointslice.discovery.k8s.io/kubernetes IPv4 6443 172.18.0.9 12m
2021-07-23T01:40:24.7344910Z endpointslice.discovery.k8s.io/nginx-demo-cluster1 IPv4 8080 10.1.0.5,10.1.128.4 3m34s
2021-07-23T01:40:24.7346896Z endpointslice.discovery.k8s.io/nginx-demo-h76l4 IPv4 8080 10.1.0.5,10.1.128.4 3m34s
2021-07-23T01:40:25.1686690Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-23T01:40:25.1719162Z 12m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 12m 1 event.events.k8s.io/cluster1-control-plane.1694473abfe5142b
2021-07-23T01:40:25.1750170Z 12m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 12m 1 event.events.k8s.io/cluster1-control-plane.1694473ac7102218
2021-07-23T01:40:25.1754606Z 12m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 12m 1 event.events.k8s.io/cluster1-control-plane.1694473ac7103b18
2021-07-23T01:40:25.1759153Z 12m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 12m 1 event.events.k8s.io/cluster1-control-plane.1694473ac7104ab8
2021-07-23T01:40:25.1773139Z 12m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 12m 1 event.events.k8s.io/cluster1-control-plane.1694473adcc30cad
2021-07-23T01:40:25.1777191Z 12m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 12m 1 event.events.k8s.io/cluster1-control-plane.1694473cc27ed69b
2021-07-23T01:40:25.1781004Z 12m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 12m 1 event.events.k8s.io/cluster1-control-plane.1694473d58e869dc
2021-07-23T01:40:25.1784618Z 11m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-control-plane.16944746732fe574
2021-07-23T01:40:25.1788085Z 12m Normal Starting node/cluster1-worker kubelet, cluster1-worker Starting kubelet. 12m 1 event.events.k8s.io/cluster1-worker.1694473f317843a9
2021-07-23T01:40:25.1791075Z 12m Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 12m 1 event.events.k8s.io/cluster1-worker.1694473f3a05b885
2021-07-23T01:40:25.1794420Z 12m Normal NodeHasNoDiskPressure node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasNoDiskPressure 12m 1 event.events.k8s.io/cluster1-worker.1694473f3a05d0bd
2021-07-23T01:40:25.1797680Z 12m Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 12m 1 event.events.k8s.io/cluster1-worker.1694473f3a05e571
2021-07-23T01:40:25.1830485Z 12m Normal NodeAllocatableEnforced node/cluster1-worker kubelet, cluster1-worker Updated Node Allocatable limit across pods 12m 1 event.events.k8s.io/cluster1-worker.1694473f43a21ae7
2021-07-23T01:40:25.1833885Z 11m Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 11m 1 event.events.k8s.io/cluster1-worker.1694474030e72a3a
2021-07-23T01:40:25.1836993Z 11m Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 11m 1 event.events.k8s.io/cluster1-worker.1694474040a6e1d6
2021-07-23T01:40:25.1840336Z 11m Normal NodeReady node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-worker.16944744037da17e
2021-07-23T01:40:25.1843225Z 12m Normal Starting node/cluster1-worker2 kubelet, cluster1-worker2 Starting kubelet. 12m 1 event.events.k8s.io/cluster1-worker2.1694473f00de0d6e
2021-07-23T01:40:25.1846372Z 12m Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 12m 1 event.events.k8s.io/cluster1-worker2.1694473f138a1314
2021-07-23T01:40:25.1908835Z 12m Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 12m 1 event.events.k8s.io/cluster1-worker2.1694473f138a2cdd
2021-07-23T01:40:25.1912224Z 12m Normal NodeHasSufficientPID node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientPID 12m 1 event.events.k8s.io/cluster1-worker2.1694473f138a3f9d
2021-07-23T01:40:25.1915489Z 12m Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 12m 1 event.events.k8s.io/cluster1-worker2.1694473f169cdceb
2021-07-23T01:40:25.1918782Z 12m Normal NodeAllocatableEnforced node/cluster1-worker2 kubelet, cluster1-worker2 Updated Node Allocatable limit across pods 12m 1 event.events.k8s.io/cluster1-worker2.1694473f1ef880f4
2021-07-23T01:40:25.1922115Z 12m Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 12m 1 event.events.k8s.io/cluster1-worker2.1694473ffacf5e52
2021-07-23T01:40:25.1925551Z 11m Normal NodeReady node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-worker2.1694474623c46fba
2021-07-23T01:40:25.1929177Z 3m35s Normal Scheduled pod/nginx-demo-b8f8b4fc6-6pk9n default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-6pk9n to cluster1-worker2 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5772f1816
2021-07-23T01:40:25.1933118Z 3m35s Normal Pulling pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b59e316f98
2021-07-23T01:40:25.1937327Z 3m35s Normal Pulled pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 99.109281ms 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5a41a143e
2021-07-23T01:40:25.1941273Z 3m35s Normal Created pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5a5e93662
2021-07-23T01:40:25.1945042Z 3m35s Normal Started pod/nginx-demo-b8f8b4fc6-6pk9n spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6pk9n.169447b5aaddc1ee
2021-07-23T01:40:25.1955517Z 6m21s Normal Scheduled pod/nginx-demo-b8f8b4fc6-ct55c default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-ct55c to cluster1-worker2 6m21s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.1694478eefed7f53
2021-07-23T01:40:25.1959639Z 6m20s Normal Pulling pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 6m20s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.1694478f1133f9f4
2021-07-23T01:40:25.1963634Z 6m16s Normal Pulled pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.147359692s 6m16s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.16944790086807e4
2021-07-23T01:40:25.1967414Z 6m15s Normal Created pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 6m15s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.1694479043aa906a
2021-07-23T01:40:25.1971129Z 6m15s Normal Started pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 6m15s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.169447904bf4a4ff
2021-07-23T01:40:25.1974845Z 6m12s Normal Killing pod/nginx-demo-b8f8b4fc6-ct55c spec.containers{nginx-demo} kubelet, cluster1-worker2 Stopping container nginx-demo 6m12s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-ct55c.16944790fb1986d1
2021-07-23T01:40:25.1978857Z 6m21s Normal Scheduled pod/nginx-demo-b8f8b4fc6-d2rms default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-d2rms to cluster1-worker 6m21s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.1694478eefeb682a
2021-07-23T01:40:25.1982845Z 6m20s Normal Pulling pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 6m20s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.1694478f10a1883e
2021-07-23T01:40:25.2067099Z 6m15s Normal Pulled pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 4.960547211s 6m15s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.16944790384db0dd
2021-07-23T01:40:25.2071181Z 6m15s Normal Created pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 6m15s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.1694479043a6d48d
2021-07-23T01:40:25.2075099Z 6m15s Normal Started pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 6m15s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.16944790494bb123
2021-07-23T01:40:25.2078857Z 6m12s Normal Killing pod/nginx-demo-b8f8b4fc6-d2rms spec.containers{nginx-demo} kubelet, cluster1-worker Stopping container nginx-demo 6m12s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-d2rms.16944790fae609dd
2021-07-23T01:40:25.2082815Z 3m35s Normal Scheduled pod/nginx-demo-b8f8b4fc6-kxvdm default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-kxvdm to cluster1-worker 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b57941e30d
2021-07-23T01:40:25.2086752Z 3m35s Normal Pulling pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b59c987a4c
2021-07-23T01:40:25.2090601Z 3m35s Normal Pulled pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 188.803198ms 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b5a7d99592
2021-07-23T01:40:25.2094531Z 3m35s Normal Created pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b5a948bbab
2021-07-23T01:40:25.2098295Z 3m34s Normal Started pod/nginx-demo-b8f8b4fc6-kxvdm spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 3m34s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-kxvdm.169447b5ae418dc0
2021-07-23T01:40:25.2102008Z 6m21s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-ct55c 6m21s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1694478eebb65a70
2021-07-23T01:40:25.2105894Z 6m21s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-d2rms 6m21s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1694478eeee4497f
2021-07-23T01:40:25.2109583Z 3m35s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-6pk9n 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.169447b575d21629
2021-07-23T01:40:25.2113236Z 3m35s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-kxvdm 3m35s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.169447b576da6a34
2021-07-23T01:40:25.2117939Z 6m21s Warning OwnerRefInvalidNamespace endpointslice/nginx-demo-cluster1 garbage-collector-controller ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 719888ef-3013-40d8-8a00-26455c361970] does not exist in namespace "default" 6m21s 1 event.events.k8s.io/nginx-demo-cluster1.1694478efa5ffe71
2021-07-23T01:40:25.2122374Z 6m21s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 6m21s 1 event.events.k8s.io/nginx-demo.1694478ee92475bf
2021-07-23T01:40:25.2125545Z 3m35s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 3m35s 1 event.events.k8s.io/nginx-demo.169447b57412e933
2021-07-23T01:40:25.2130210Z 4m5s Warning FailedToCreateEndpoint endpoints/submariner-lighthouse-coredns endpoint-controller Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints "submariner-lighthouse-coredns" already exists 4m5s 1 event.events.k8s.io/submariner-lighthouse-coredns.169447ae7690ad4e
2021-07-23T01:40:25.5478926Z Warning: extensions/v1beta1 Ingress is deprecated in v1.14+, unavailable in v1.22+; use networking.k8s.io/v1 Ingress
2021-07-23T01:40:25.9624308Z NAME PRIORITYLEVEL MATCHINGPRECEDENCE DISTINGUISHERMETHOD AGE MISSINGPL
2021-07-23T01:40:25.9626290Z flowschema.flowcontrol.apiserver.k8s.io/exempt exempt 1 <none> 12m False
2021-07-23T01:40:25.9627929Z flowschema.flowcontrol.apiserver.k8s.io/probes exempt 2 <none> 12m False
2021-07-23T01:40:25.9630570Z flowschema.flowcontrol.apiserver.k8s.io/system-leader-election leader-election 100 ByUser 12m False
2021-07-23T01:40:25.9633063Z flowschema.flowcontrol.apiserver.k8s.io/workload-leader-election leader-election 200 ByUser 12m False
2021-07-23T01:40:25.9635218Z flowschema.flowcontrol.apiserver.k8s.io/system-nodes system 500 ByUser 12m False
2021-07-23T01:40:25.9637596Z flowschema.flowcontrol.apiserver.k8s.io/kube-controller-manager workload-high 800 ByNamespace 12m False
2021-07-23T01:40:25.9639903Z flowschema.flowcontrol.apiserver.k8s.io/kube-scheduler workload-high 800 ByNamespace 12m False
2021-07-23T01:40:25.9642335Z flowschema.flowcontrol.apiserver.k8s.io/kube-system-service-accounts workload-high 900 ByNamespace 12m False
2021-07-23T01:40:25.9644682Z flowschema.flowcontrol.apiserver.k8s.io/service-accounts workload-low 9000 ByUser 12m False
2021-07-23T01:40:25.9646800Z flowschema.flowcontrol.apiserver.k8s.io/global-default global-default 9900 ByUser 12m False
2021-07-23T01:40:25.9648810Z flowschema.flowcontrol.apiserver.k8s.io/catch-all catch-all 10000 ByUser 12m False
2021-07-23T01:40:26.3630228Z NAME TYPE ASSUREDCONCURRENCYSHARES QUEUES HANDSIZE QUEUELENGTHLIMIT AGE
2021-07-23T01:40:26.3633701Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/catch-all Limited 5 <none> <none> <none> 12m
2021-07-23T01:40:26.3637159Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/exempt Exempt <none> <none> <none> <none> 12m
2021-07-23T01:40:26.3641335Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/global-default Limited 20 128 6 50 12m
2021-07-23T01:40:26.3645665Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/leader-election Limited 10 16 4 50 12m
2021-07-23T01:40:26.3655020Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/system Limited 30 64 6 50 12m
2021-07-23T01:40:26.3658349Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/workload-high Limited 40 128 6 50 12m
2021-07-23T01:40:26.3661460Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/workload-low Limited 100 128 6 50 12m
2021-07-23T01:40:26.7531372Z NAME AGE
2021-07-23T01:40:26.7534080Z serviceexport.multicluster.x-k8s.io/nginx-demo 3m36s
2021-07-23T01:40:29.8665948Z NAME ROLE AGE USERS GROUPS SERVICEACCOUNTS
2021-07-23T01:40:29.8670869Z clusterrolebinding.rbac.authorization.k8s.io/cluster-admin ClusterRole/cluster-admin 12m system:masters
2021-07-23T01:40:29.8675436Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:get-nodes ClusterRole/kubeadm:get-nodes 12m system:bootstrappers:kubeadm:default-node-token
2021-07-23T01:40:29.8680328Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:kubelet-bootstrap ClusterRole/system:node-bootstrapper 12m system:bootstrappers:kubeadm:default-node-token
2021-07-23T01:40:29.8686744Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-bootstrap ClusterRole/system:certificates.k8s.io:certificatesigningrequests:nodeclient 12m system:bootstrappers:kubeadm:default-node-token
2021-07-23T01:40:29.8694478Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-certificate-rotation ClusterRole/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 12m system:nodes
2021-07-23T01:40:29.8707995Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-proxier ClusterRole/system:node-proxier 12m kube-system/kube-proxy
2021-07-23T01:40:29.8717091Z clusterrolebinding.rbac.authorization.k8s.io/local-path-provisioner-bind ClusterRole/local-path-provisioner-role 12m local-path-storage/local-path-provisioner-service-account
2021-07-23T01:40:29.8722304Z clusterrolebinding.rbac.authorization.k8s.io/submariner-gateway ClusterRole/submariner-gateway 7m43s submariner-operator/submariner-gateway
2021-07-23T01:40:29.8726450Z clusterrolebinding.rbac.authorization.k8s.io/submariner-globalnet ClusterRole/submariner-globalnet 7m43s submariner-operator/submariner-globalnet
2021-07-23T01:40:29.8740066Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-agent ClusterRole/submariner-lighthouse-agent 7m42s submariner-operator/submariner-lighthouse-agent
2021-07-23T01:40:29.8746327Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-coredns ClusterRole/submariner-lighthouse-coredns 7m42s submariner-operator/submariner-lighthouse-coredns
2021-07-23T01:40:29.8754919Z clusterrolebinding.rbac.authorization.k8s.io/submariner-networkplugin-syncer ClusterRole/submariner-networkplugin-syncer 7m42s submariner-operator/submariner-networkplugin-syncer
2021-07-23T01:40:29.8760590Z clusterrolebinding.rbac.authorization.k8s.io/submariner-operator ClusterRole/submariner-operator 7m44s submariner-operator/submariner-operator
2021-07-23T01:40:29.8767260Z clusterrolebinding.rbac.authorization.k8s.io/submariner-routeagent ClusterRole/submariner-routeagent 7m43s submariner-operator/submariner-routeagent
2021-07-23T01:40:29.8771965Z clusterrolebinding.rbac.authorization.k8s.io/system:basic-user ClusterRole/system:basic-user 12m system:authenticated
2021-07-23T01:40:29.8777617Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:attachdetach-controller ClusterRole/system:controller:attachdetach-controller 12m kube-system/attachdetach-controller
2021-07-23T01:40:29.8782637Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:certificate-controller ClusterRole/system:controller:certificate-controller 12m kube-system/certificate-controller
2021-07-23T01:40:29.8789295Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller ClusterRole/system:controller:clusterrole-aggregation-controller 12m kube-system/clusterrole-aggregation-controller
2021-07-23T01:40:29.8794988Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:cronjob-controller ClusterRole/system:controller:cronjob-controller 12m kube-system/cronjob-controller
2021-07-23T01:40:29.8799424Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:daemon-set-controller ClusterRole/system:controller:daemon-set-controller 12m kube-system/daemon-set-controller
2021-07-23T01:40:29.8803436Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:deployment-controller ClusterRole/system:controller:deployment-controller 12m kube-system/deployment-controller
2021-07-23T01:40:29.8807356Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:disruption-controller ClusterRole/system:controller:disruption-controller 12m kube-system/disruption-controller
2021-07-23T01:40:29.8811380Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpoint-controller ClusterRole/system:controller:endpoint-controller 12m kube-system/endpoint-controller
2021-07-23T01:40:29.8815599Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpointslice-controller ClusterRole/system:controller:endpointslice-controller 12m kube-system/endpointslice-controller
2021-07-23T01:40:29.8820507Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpointslicemirroring-controller ClusterRole/system:controller:endpointslicemirroring-controller 12m kube-system/endpointslicemirroring-controller
2021-07-23T01:40:29.8825525Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:expand-controller ClusterRole/system:controller:expand-controller 12m kube-system/expand-controller
2021-07-23T01:40:29.8868706Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:generic-garbage-collector ClusterRole/system:controller:generic-garbage-collector 12m kube-system/generic-garbage-collector
2021-07-23T01:40:29.8872755Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler ClusterRole/system:controller:horizontal-pod-autoscaler 12m kube-system/horizontal-pod-autoscaler
2021-07-23T01:40:29.8876618Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:job-controller ClusterRole/system:controller:job-controller 12m kube-system/job-controller
2021-07-23T01:40:29.8880095Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:namespace-controller ClusterRole/system:controller:namespace-controller 12m kube-system/namespace-controller
2021-07-23T01:40:29.8883544Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:node-controller ClusterRole/system:controller:node-controller 12m kube-system/node-controller
2021-07-23T01:40:29.8886929Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:persistent-volume-binder ClusterRole/system:controller:persistent-volume-binder 12m
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment